Skip to main content

DEEPKNOWLEDGE: DEEP LANGUAGE MODELS FOR UNDERSTANDING AND REASONING WITH MULTILINGUAL CONTENT

PID2021-127777OB-C21

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2021
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDAD DEL PAIS VASCO EUSKAL HERRIKO UNIBERTSITATEA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Entailment-based Task Transfer for Catalan Text Classification in Small Data Regimes, Transferencia de Tareas basada en Implicación Textual para la Clasificación de Textos en Catalán en Escenarios de Pocos Datos

  • Baucells de la Peña, Irene
  • Calvo Figueras, Blanca
  • Villegas Montserrat, Marta
  • López de Lacalle Lekuona, Oier
This study investigates the application of a state-of-the-art zero-shot and few-shot natural language processing (NLP) technique for text classification tasks in Catalan, a moderately under-resourced language. The approach involves reformulating the downstream task as textual entailment, which is then solved by an entailment model. However, unlike English, where entailment models can be trained on huge Natural Language Inference (NLI) datasets, the lack of such large resources in Catalan poses a challenge. In this context, we comparatively explore training on monolingual and (larger) multilingual resources, and identify the strengths and weaknesses of monolingual and multilingual individual components of entailment models: pre-trained language model and NLI training dataset. Furthermore, we propose and implement a simple task transfer strategy using open Wikipedia resources that demonstrates significant performance improvements, providing a practical and effective alternative for languages with limited or no NLI datasets.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Discriminative Benchmarking of Spanish Language Models: Findings from the ODESIA Challenge 2024, Evaluación Discriminativa de Modelos de Lenguaje en Español: Resultados del ODESIA Challenge 2024

  • Benito-Santos, Alejandro
  • Morante Vallejo, Roser
  • Ghajari, Adrián
  • García-Ferrero, Iker
  • Sepúlveda-Torres, Robiert
  • Rigau Claramunt, German
  • Agerri Gascón, Rodrigo
  • Consuegra-Ayala, Juan Pablo
  • Estevanell-Valladares, Ernesto L.
  • Yáñez Romero, Fabio
  • Canal-Esteve, Miquel
  • Gutiérrez, Yoan
  • Muñoz, Rafael
  • Palomar, Manuel
  • Sánchez Salido, Eva
  • Marco, Guillermo
  • Fernández García, Andrés
  • Fresno Fernández, Víctor
  • Amigó Cabrera, Enrique
  • Plaza Morales, Laura
  • Carrillo-de-Albornoz, Jorge
  • Lucas, Miguel
  • Gonzalo Arroyo, Julio
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Consuegra-Ayala, Juan Pablo|||/items/5a98e4ca-607f-4aa0-91c2-a5d929bab52c
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
  • Estevanell-Valladares, Ernesto L.|||/items/d8b1af9a-112f-48de-813f-b4d8f1df8bd1
  • Canal-Esteve, Miquel|||/items/f1b086bf-bce4-49ea-b765-73081f7a27f9
  • Yáñez Romero, Fabio|||/items/792a2bc4-9249-45bf-8389-7a63e1b74671
This paper presents the results from the 2024 ODESIA Challenge, a public competition aimed at benchmarking natural language processing (NLP) systems in Spanish across ten discriminative tasks using a standardized methodology based on private, held-out test sets. Results show the winning system (Qwen2.5-14B) prevailed due to structural advantages in extractive Question Answering, whereas encoders outperformed LLMs in other tasks such as sequence labeling and soft classification. We conclude that, while generative models may dominate reasoning-heavy tasks involving long contexts, encoder architectures obtain on-par or even better performance in many other discriminative scenarios, challenging the assumption that massive scale universally supersedes specialized architectural design.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Overview of CLEARS at IberLEF 2025: Challenge for Plain Language and Easy-to-Read Adaptation for Spanish texts, Resumen de CLEARS en IberLEF 2025: Reto para la adaptación de textos en español a lenguaje claro y lectura fácil

  • Botella-Gil, Beatriz
  • Espinosa-Zaragoza, Isabel
  • Bonet-Jover, Alba
  • Madina, Margot
  • Molino Piñar, Lucas
  • Moreda, Paloma
  • González Dios, Itziar
  • Martín Valdivia, María Teresa
  • Ureña López, Luis Alfonso
  • Botella-Gil, Beatriz|||/items/a03c3d62-efa7-4c50-8870-103ca1d81d37
  • Espinosa-Zaragoza, Isabel|||/items/b9b30d7e-4b6b-4a40-b4c6-214bb9ba331f
  • Bonet-Jover, Alba|||/items/6bd6e7a1-46a7-415c-bdde-2a1e56f97a2f
  • Moreda, Paloma|||/items/aeb186ed-9034-4fdf-96fc-88941be830e7
This paper presents CLEARS, a shared task organized within the framework of the evaluation campaign for Natural Language Processing systems in Spanish and other Iberian languages, IberLEF 2025. The main objective of CLEARS is to investigate and develop automatic techniques for adapting Spanish texts to plain language and easy-to-read formats. Two subtasks are proposed: the first focuses on adapting texts to plain language format, while the second aims to produce easy-to-read texts. CLEARS attracted participation from four teams in Subtask 1 and five teams in Subtask 2. Each team submitted their results and approaches, which are presented below.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Lessons learned from the evaluation of Spanish Language Models, Conclusiones de la evaluación de Modelos del Lenguaje en Español

  • Agerri Gascón, Rodrigo
  • Agirre Bengoa, Eneko
Given the impact of language models on the field of Natural Language Processing, a number of Spanish encoder-only masked language models (aka BERTs) have been trained and released. These models were developed either within large projects using very large private corpora or by means of smaller scale academic efforts leveraging freely available data. In this paper we present a comprehensive head-to-head comparison of language models for Spanish with the following results: (i) Previously ignored multilingual models from large companies fare better than monolingual models, substantially changing the evaluation landscape of language models in Spanish; (ii) Results across the monolingual models are not conclusive, with supposedly smaller and inferior models performing competitively. Based on these empirical results, we argue for the need of more research to understand the factors underlying them. In this sense, the effect of corpus size, quality and pre-training techniques need to be further investigated to be able to obtain Spanish monolingual models significantly better than the multilingual ones released by large private companies, specially in the face of rapid ongoing progress in the field. The recent activity in the development of language technology for Spanish is to be welcomed, but our results show that building language models remains an open, resource-heavy problem which requires to marry resources (monetary and/or computational) with the best research expertise and practice.