Repositorio Digital de la UPF
Publicación
Artículo científico (JournalArticle)
ParlaMint II: advancing comparable parliamentary corpora across Europe
The paper presents the results of the ParlaMint II project, which comprise comparable corpora of parliamentary debates of 29 European countries and autonomous regions, covering at least the period from 2015 to 2022, and containing over 1 billion words. The corpora are uniformly encoded, contain rich metadata about their 24 thousand speakers, and are linguistically annotated up to the level of Universal Dependencies syntax and named entities. The paper focuses on the enhancement made since the ParlaMint I project and presents the compilation of the corpora, including the encoding infrastructure, use of GitHub, the production of individual corpora, the common pipeline for producing their distribution, and use of CLARIN services for dissemination. It then gives a quantitative overview of the produced corpora, followed by the qualitative additions made within the ParlaMint II project, namely metadata localisation, the addition of new metadata, such as the political orientation of political parties, the machine translation of the corpora to English and its tagging with semantic classes, and the production of pilot speech corpora. Finally, outreach activities and further work are discussed., This work was funded by: CLARIN ERIC, ParlaMint: Towards Comparable Parliamentary Corpora; MT corpora: Oracle Cloud Infrastructure credits were donated in kind to the UCREL NLP research group for the semantic annotation task, and we acknowledge the support of Richard Pitts at Oracle Research. Speech corpora: ARIS (Slovenian Research and Innovation Agency), J7-4642 “MEZZANINE - Basic Research for the Development of Spoken Language Resources and Speech Technologies for the Slovenian Language”; AT: Austrian Academy of Sciences; BE: Dutch Language Institute; BG: Bulgarian Ministry of Education and Science, DO1-301/17.12.21: “Bulgarian National Interdisciplinary Research e-Infrastructure for Resources and Technologies in favour of the Bulgarian Language and Cultural Heritage, part of the EU infrastructures CLARIN and DARIAH”; CZ: Ministry of Education, Youth and Sports of the Czech Republic, LM2023062: "LINDAT/CLARIAH-CZ: Digital Research Infrastructure for Language Technologies, Arts and Humanities"; DK: Department of Nordic Studies and Linguistics (NorS), University of Copenhagen CLARIN-DK, "CLARIN-DK"; ES: Spanish Ministry of Science and Innovation, project "Original, translated and interpreted representations of the refugee cris(e)s: methodological triangulation within corpus-based discourse studies" (PID2019-108866RB-I00 / AEI / 10.13039/501100011033); ES-GA: Galician Language Institute, University of Santiago de Compostela; ES-GA: Xunta de Galicia – University of Santiago de Compostela, 2021-CP080: "Nós: Galician in the society and economy of artificial intelligence (2021-CP080), an agreement between Xunta de Galicia and the University of Santiago de Compostela"; ES-PV: HiTZ – Ixa Group (UPV/EHU); - ET: The Postimees Foundation grant "Developments and contradictions on the Estonian political landscape 2011–2023 through the analysis of big textual data"; FI: Research Council of Finland: DIGIHUM research programme project "Semantic Parliament: Linked Open Data Service for Studying Political Culture (SEMPARL)" (2020–2022), FIN-CLARIAH, part of the EU infrastructures CLARIN and DARIAH; GR: Institute for Language and Speech Processing / ATHENA Research Centre; HU: Hungarian Research Centre for Linguistics; IS: The Árni Magnsússon Institute for Icelandic Studies; LV: The EU Recovery and Resilience Facility project "Language technology Initiative" (2.3.1.1.i.0/1/22/I/CFLA/002); NL: Nederlandse Organisatie voor Wetenschappelijk Onderwijs, CISC.CC.016: "Access to City Councils using Exploratory Search Systems"; NO: National Library of Norway; PL: European Commission programme, POIR.04.02.00-00C002/19: European Regional Development Fund as a part of the 2014–2020 Smart Growth Operational Programme, CLARIN – Common Language Resources and Technology Infrastructure"; co-financed by the Polish Ministry of Education and Science under the agreement 2022/WK/09; PL: Institute of Computer Science, Polish Academy of Sciences – "statutory research"; PL: Polish Ministry of Education and Science, 2022/WK/09: "National contribution to CLARIN ERIC – European Research Infrastructure Consortium: Common Language Resources and Technology Infrastructure 2022–2023 (CLARIN Q)"; PT: Fundação para a Ciência e a Tecnologia, UIDP/00214/2020; SI, BA, HR, SR, UA: Research infrastructure CLARIN.SI (Jožef Stefan Institute); SI: ARIS (Slovenian Research and Innovation Agency), P2-0103: "Knowledge Technologies"; SI: ARIS (Slovenian Research and Innovation Agency), P6-0411: "Language Resources and Technologies for Slovene"; SI: ARIS (Slovenian Research and Innovation Agency), P6-0436 "Basic national research program "Digital Humanities"; SI, ParlaSent: ARIS (Slovenian Research and Innovation Agency), N6-0099 "Flemish-Slovenian bilateral basic research project ‘Linguistic landscape of hate speech online’ (2019–2023)"; UA: ARIS (Slovenian Research and Innovation Agency), N6-0288 "The MSCA Seal of Excellence postdoctoral project ’The Changing Discursive Semantics of EU Representations’ (2022–2024)".
Proyecto:
ES / 2PE PID2019-108866RB-I00