RUA. Repositorio Institucional de la Universidad de Alicante
Publication
Otros (Other)
Data-centric strategies for machine translation: efficient acquisition, cleaning, and exploitation of parallel resources
High-quality parallel corpora are an essential resource for crosslingual natural language processing. Particularly in machine translation (MT), dedicated systems heavily rely on massive amounts of this data for training, while large language models (LLMs) require less parallel data to be adapted for translation through fine-tuning and in-context learning, where quality is prioritized over quantity. However, acquiring high-quality parallel corpora from the web presents significant efficiency and quality challenges. This thesis proposes a comprehensive framework for the acquisition, cleaning, and exploitation of parallel data. First, we tackle the inefficiency of traditional web crawling with a novel smart bilingual focused crawler. By utilizing URL-based models to infer language and document parallelness, our approach reduces wasted bandwidth and accelerates the discovery of parallel content. Second, to ensure data quality, we address the growing proliferation of synthetic, machine-translated text on the web, which can cause model degradation. We introduce an automatic machine translation detection method that leverages the internal representations of a surrogate multilingual MT model to accurately filter out synthetic data, outperforming state-of-the-art techniques, with particularly strong results for non-English language pairs. Finally, we explore the optimal exploitation of high-quality parallel data for MT using LLMs. We propose an in-context learning approach driven by reinforcement learning to dynamically select the most effective parallel examples, maximizing the final translation quality.