Recercat. Dipósit de la Recerca de Catalunya
Publication
Contribución de congreso (ConferenceOutput)
From SALAMANDRA to SALAMANDRATA: BSC submission for WMT25 general machine translation shared task
In this paper, we present the SalamandraTA family of models, an improved iteration of Salamandra LLMs (Gonzalez-Agirre et al., 2025) specifically trained to achieve strong performance in translation-related tasks for 38 European languages. SalamandraTA comes in two scales: 2B and 7B parameters. For both versions, we applied the same training recipe with a first step of continual pre-training on parallel data, and a second step of supervised fine-tuning on high-quality instructions.The BSC submission to the WMT25 General Machine Translation shared task is based on the 7B variant of SalamandraTA. We first extended the model vocabulary to support the additional non-European languages included in the task. This was followed by a second phase of continual pretraining and supervised fine-tuning, carefully designed to optimize performance across all translation directions for this year’s shared task. For decoding, we employed two quality-aware strategies: Minimum Bayes Risk Decoding and Translation Reranking using Comet and Comet-kiwi.We publicly release both the 2B and 7B versions of SalamandraTA, along with the newer SalamandraTA-v2 model, on Hugging Face., This work has been promoted and financed by the Generalitat de Catalunya through the Aina Project. This work has been supported by the Spanish project PID2021-123988OB-C33 funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is partially supported by MLLM4TRA (PID2024-158157OB-C32) funded by MCIN/AEI/10.13039/501100011033/FEDER, UE. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública- Funded by EU– NextGenerationEU within the framework of ILENIA Project with reference 2022/TL22/00215337. This work is funded by the Ministerio para la Transformación Digital y de la Función Pública and Plan de Recuperación, Transformación y Resiliencia- Funded by EU– NextGenerationEU within the framework of the project Desarrollo Modelos ALIA., Peer Reviewed, Postprint (published version)