Skip to main content

MODELOS MULTIMODALES DE LENGUAJE PARA TRADUCIR LENGUAS CON POCOS RECURSOS.

PID2024-158157OB-C32

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para la Investigación y el Desarrollo Experimental
Subprogram Subprograma Estatal de Generación de Conocimiento Científico-Técnico y Desarrollo Experimental
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2024
State Plan 2024-2027 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION

Resultados relacionados

Resultados totales (Incluyendo duplicados): 2
Encontrada(s) 1 página(s)

Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

From SALAMANDRA to SALAMANDRATA: BSC submission for WMT25 general machine translation shared task

  • García Gilabert, Javier
  • Liao, Xixian
  • Da Dalt, Severino
  • Bohman, Ella
  • Mash, Audrey
  • De Luca Fornaciari, Francesca
  • Baucells de la Peña, Irene
  • Llop Palao, Joan
  • Claramunt Argote, Miguel
  • Escolano Peinado, Carlos
  • Melero Nogues, Maite
In this paper, we present the SalamandraTA family of models, an improved iteration of Salamandra LLMs (Gonzalez-Agirre et al., 2025) specifically trained to achieve strong performance in translation-related tasks for 38 European languages. SalamandraTA comes in two scales: 2B and 7B parameters. For both versions, we applied the same training recipe with a first step of continual pre-training on parallel data, and a second step of supervised fine-tuning on high-quality instructions.The BSC submission to the WMT25 General Machine Translation shared task is based on the 7B variant of SalamandraTA. We first extended the model vocabulary to support the additional non-European languages included in the task. This was followed by a second phase of continual pretraining and supervised fine-tuning, carefully designed to optimize performance across all translation directions for this year’s shared task. For decoding, we employed two quality-aware strategies: Minimum Bayes Risk Decoding and Translation Reranking using Comet and Comet-kiwi.We publicly release both the 2B and 7B versions of SalamandraTA, along with the newer SalamandraTA-v2 model, on Hugging Face., This work has been promoted and financed by the Generalitat de Catalunya through the Aina Project. This work has been supported by the Spanish project PID2021-123988OB-C33 funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is partially supported by MLLM4TRA (PID2024-158157OB-C32) funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública- Funded by EU– NextGenerationEU within the framework of ILENIA Project with reference 2022/TL22/00215337. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública and Plan de Recuperación, Transformación y Resiliencia- Funded by EU– NextGenerationEU within the framework of the project Desarrollo Modelos ALIA., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Terminology-constrained translation from monolingual data using GRPO

  • Garcia Gilabert, Javier
  • Escolano Peinado, Carlos
  • Liao, Xixian
  • Melero Nogues, Maite
Terminology consistency is essential for high-quality machine translation, especially in domain-specific and professional contexts, where accurate term translation directly impacts usability. This paper presents the submission from the BSC team to the WMT25 Terminology-Aware Translation Task. We propose the use of GRPO (Group Relative Policy Optimization) to adapt translation models using monolingual data only, without requiring parallel corpora. Our reward function jointly optimizes for terminology adherence and overall translation quality, leveraging quality-estimation metrics. Experimental results demonstrate that our method consistently improves terminology translation across three language directions—English to Spanish, German, and Russian—by up to +0.36 Tₚ points across all evaluated models., This work has been promoted and financed by the Generalitat de Catalunya through the Aina Project. This work has been supported by the Spanish project PID2021-123988OB-C33 funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is partially supported by MLLM4TRA (PID2024-158157OB-C32) funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública- Funded by EU– NextGenerationEU within the framework of the ILENIA Project with reference 2022/TL22/00215337. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública and Plan de Recuperación, Transformación y Resiliencia- Funded by EU– NextGenerationEU within the framework of the project Desarrollo Modelos ALIA., Peer Reviewed, Postprint (published version)