Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 2
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

End-to-End speech translation with pre-trained models and adapters: UPC at IWSLT 2021

  • Gallego Olsina, Gerard Ion|||0000-0001-7466-3606
  • Tsiamas, Ioannis|||0000-0003-1049-2515
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Fonollosa, José A. R.
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
Paper accepted to IWSLT 2021, This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of translating English audio recordings extracted from TED talks into German text. Submitted systems can be either cascade or end-to-end and use a custom or given segmentation. Our submission is an end-to-end speech translation system, which combines pre-trained models (Wav2Vec 2.0 and mBART) with coupling modules between the encoder and decoder, and uses an efficient fine-tuning technique, which trains only 20% of its total parameters. We show that adding an Adapter to the system and pre-training it, can increase the convergence speed and the final result, with which we achieve a BLEU score of 27.3 on the MuST-C test set. Our final model is an ensemble that obtains 28.22 BLEU score on the same set. Our submission also uses a custom segmentation algorithm that employs pre-trained Wav2Vec 2.0 for identifying periods of untranscribable text and can bring improvements of 2.5 to 3 BLEU score on the IWSLT 2019 test set, as compared to the result with the given segmentation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

Gender bias in multilingual neural machine translation: The architecture matters

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Basta, Christine Raouf Saad
  • Ferrando Monsonís, Javier|||0000-0002-2637-0961
  • Batlle, Roser
  • Kharitonova, Ksenia
Multilingual Neural Machine Translation architectures mainly differ in the amount of sharing modules and parameters among languages. In this paper, and from an algorithmic perspective, we explore if the chosen architecture, when trained with the same data, influences the gender bias accuracy. Experiments in four language pairs show that Language-Specific encoders-decoders exhibit less bias than the Shared encoder-decoder architecture. Further interpretability analysis of source embeddings and the attention shows that, in the LanguageSpecific case, the embeddings encode more gender information, and its attention is more diverted. Both behaviors help in mitigating gender bias., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657).