Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 24
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Fine-tuning neural machine translation on gender-balanced datasets

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • de Jorge Sánchez, Adrián
Misrepresentation of certain communities in datasets is causing big disruptions in artificial intelligence applications. In this paper, we propose using an automatically extracted gender-balanced dataset parallel corpus from Wikipedia. This balanced set is used to perform fine-tuning techniques from a bigger model trained on unbalanced datasets to mitigate gender biases in neural machine translation., This work is supported in part by the Catalan Agency for Management of University and Research Grants (AGAUR) through an Industrial Ph.D. Grant, the Spanish Ministerio de Ciencia e Innovacion and by the Agencia Estatal de Investigacion, through the postdoctoral senior grant Ramón y Cajal and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Enriching the transformer with linguistic factors for low-resource machine translation

  • Armengol Estapé, Jordi
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
Introducing factors, that is to say, word features such as linguistic information referring to the source tokens, is known to improve the results of neural machine translation systems in certain settings, typically in recurrent architectures. This study proposes enhancing the current state-of-the-art neural machine translation architecture, the Transformer, so that it allows to introduce external knowledge. In particular, our proposed modification, the Factored Transformer, uses linguistic factors that insert additional knowledge into the machine translation system. Apart from using different kinds of features, we study the effect of different architectural configurations. Specifically, we analyze the performance of combining words and features at the embedding level or at the encoder level, and we experiment with two different combination strategies. With the best-found configuration, we show improvements of 0.8 BLEU over the baseline Transformer in the IWSLT German-to-English task. Moreover, we experiment with the more challenging FLoRes English-to-Nepali benchmark, which includes both extremely low-resourced and very distant languages, and obtain an improvement of 1.2 BLEU, This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

End-to-End speech translation with pre-trained models and adapters: UPC at IWSLT 2021

  • Gallego Olsina, Gerard Ion|||0000-0001-7466-3606
  • Tsiamas, Ioannis|||0000-0003-1049-2515
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Fonollosa, José A. R.
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
Paper accepted to IWSLT 2021, This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of translating English audio recordings extracted from TED talks into German text. Submitted systems can be either cascade or end-to-end and use a custom or given segmentation. Our submission is an end-to-end speech translation system, which combines pre-trained models (Wav2Vec 2.0 and mBART) with coupling modules between the encoder and decoder, and uses an efficient fine-tuning technique, which trains only 20% of its total parameters. We show that adding an Adapter to the system and pre-training it, can increase the convergence speed and the final result, with which we achieve a BLEU score of 27.3 on the MuST-C test set. Our final model is an ensemble that obtains 28.22 BLEU score on the same set. Our submission also uses a custom segmentation algorithm that employs pre-trained Wav2Vec 2.0 for identifying periods of untranscribable text and can bring improvements of 2.5 to 3 BLEU score on the IWSLT 2019 test set, as compared to the result with the given segmentation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

Gender bias in multilingual neural machine translation: The architecture matters

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Basta, Christine Raouf Saad
  • Ferrando Monsonís, Javier|||0000-0002-2637-0961
  • Batlle, Roser
  • Kharitonova, Ksenia
Multilingual Neural Machine Translation architectures mainly differ in the amount of sharing modules and parameters among languages. In this paper, and from an algorithmic perspective, we explore if the chosen architecture, when trained with the same data, influences the gender bias accuracy. Experiments in four language pairs show that Language-Specific encoders-decoders exhibit less bias than the Shared encoder-decoder architecture. Further interpretability analysis of source embeddings and the attention shows that, in the LanguageSpecific case, the embeddings encode more gender information, and its attention is more diverted. Both behaviors help in mitigating gender bias., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657).
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Attention weights in transformer NMT fail aligning words between sequences but largely explain model predictions

  • Ferrando Monsonís, Javier|||0000-0002-2637-0961
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we prove that attention weights systematically make alignment errors by relying mainly on uninformative tokens from the source sequence. However, we observe that NMT models assign attention to these tokens to regulate the contribution in the prediction of the two contexts, the source and the prefix of the target sequence. We provide evidence about the influence of wrong alignments on the model behavior, demonstrating that the encoder-decoder attention mechanism is well suited as an interpretability method for NMT. Finally, based on our analysis, we propose methods that largely reduce the word alignment error rate compared to standard induced alignments from attention weights., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Evaluating gender bias in speech translation

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Basta, Christine Raouf Saad
  • Gallego Olsina, Gerard Ion|||0000-0001-7466-3606
The scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups. Currently, there are no standard evaluation techniques for different types of biases. Accordingly, there is an urgent need to provide evaluation sets and protocols to measure existing biases in our automatic systems. Evaluating the biases should be an essential step towards mitigating them in the systems. This paper introduces WinoST, a new freely available challenge set for evaluating gender bias in speech translation. WinoST is the speech version of WinoMT which is a MT challenge set and both follow an evaluation protocol to measure gender accuracy. Using a state-of-the-art end-to-end speech translation system, we report the gender bias evaluation on four language pairs and we show that gender accuracy in speech translation is more than 23% lower than in MT., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657), the Catalan Agency for Management of University and Research Grants (AGAUR) through the FI PhD Scholarship, Universitat Politècnica de Catalunya with the collaboration of Banco de Santander and the Spanish Ministerio de Ciencia e Innovación through the project PID2019- 107579RB-I00 / AEI / 10.13039/501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Semantic and syntactic information for neural machine translation: Injecting features to the transformer

  • Armengol Estapé, Jordi
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
Introducing factors such as linguistic features has long been proposed in machine translation to improve the quality of translations. More recently, factored machine translation has proven to still be useful in the case of sequence-to-sequence systems. In this work, we investigate whether this gains hold in the case of the state-of-the-art architecture in neural machine translation, the Transformer, instead of recurrent architectures. We propose a new model, the Factored Transformer, to introduce an arbitrary number of word features in the source sequence in an attentional system. Specifically, we suggest two variants depending on the level at which the features are injected. Moreover, we suggest two combination mechanisms for the word features and words themselves. We experiment both with classical linguistic features and semantic features extracted from a linked data database, and with two low-resource datasets. With the best-found configuration, we show improvements of 0.8 BLEU over the baseline Transformer in the IWSLT German-to-English task. Moreover, we experiment with the more challenging FLoRes English-to-Nepali benchmark, which includes both low-resource and very distant languages, and obtain an improvement of 1.2 BLEU. These improvements are achieved with linguistic and not with semantic information., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant Agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Multilingual machine translation: Deep analysis of language-specific encoder-decoders

  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Rodríguez Fonollosa, José Adrián|||0000-0001-9513-7939
State-of-the-art multilingual machine translation relies on a shared encoder-decoder. In this paper, we propose an alternative approach based on language-specific encoder-decoders, which can be easily extended to new languages by learning their corresponding modules. To establish a common interlingua representation, we simultaneously train N initial languages. Our experiments show that the proposed approach improves over the shared encoder-decoder for the initial languages and when adding new languages, without the need to retrain the remaining modules. All in all, our work closes the gap between shared and language-specific encoder-decoders, advancing toward modular multilingual machine translation systems that can be flexibly extended in lifelong learning settings., This work is supported by the European Research Council (ERC) under the European Union’sHorizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Continual lifelong learning in natural language processing: a survey

  • Biesialska, Magdalena Marta|||0000-0001-7890-3523
  • Biesialska, Katarzyna|||0000-0002-2865-7990
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously acquired knowledge. Furthermore, CL is particularly challenging for language learning, as natural language is ambiguous: it is discrete, compositional, and its meaning is context-dependent. In this work, we look at the problem of CL through the lens of various NLP tasks. Our survey discusses major challenges in CL and current methods applied in neural network models. We also provide a critical review of the existing CL evaluation methods and datasets in NLP. Finally, we present our outlook on future research directions., This work is supported in part by the Catalan Agencia de Gestión de Ayudas Universitarias y de Investigación (AGAUR) through the FI PhD grant; the Spanish Ministerio de Ciencia e Innovación and by the Agencia Estatal de Investigación through the Ramón y Cajal grant and the project PCIN-2017-079; and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Converses al voltant de la intel·ligència artificial en clau catalana, Conversations around artificial intelligence from the catalan perspective

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Melero Nogues, Maite
La intel·ligència artificial mou milions d’euros i ocupa una part important de les agendes polítiques i estratègiques dels governs. En aquest article reflexionem sobre aquest concepte difús i ho fem a través de tres entrevistes a tres persones que ocupen llocs rellevants en aquest àmbit, i que a més tenen en comú que són nascudes i formades a Catalunya. Amb elles hem parlat distesament dels orígens d’aquesta revolució tecnològica, del seu impacte sobre l’organització social i el mercat laboral, de les seves implicacions ètiques, de les tendències futures que es dibuixen i també sobre quin paper juguem els catalans en aquesta revolució. En la qüestió catalana hem volgut saber si les nostres universitats són capaces de generar el talent necessari, com impulsar estratègicament el teixit empresarial en aquesta àrea, quin paper ha de tenir l’administració i què hauria de passar perquè la intel·ligència artificial també parli en català. En aquestes converses, els nostres interlocutors ens han transmès la urgència i la necessitat de treballar en la definició d’estratègies concretes de país per tal de no quedar socialment i estructuralment enrere en el que sembla una revolució sense límits, Artificial intelligence moves millions of euros and occupies an important part of governments’ political and strategic agendas. In this article we reflect on this varied concept through interviews with three people who hold important positions in the field of artificial intelligence and who also have in common the fact that they were born and trained in Catalonia. We talked with them about the origins of this technological revolution, its impact on social organization and the labour market, its ethical implications, the future trends which are emerging and also on what role we Catalans play in this. With regards to the Catalan question we wanted to know if our universities are capable of generating the necessary talent, how to strategically boost the fabric of business in this area, what role the Administration should play and what should happen for artificial intelligence to communicate in Catalan. Throughout these conversations, the interviewees have conveyed to us the urgency and need to work on the definition of country-specific strategies in order not to be left behind socially and structurally in what seems to be a revolution without limits., Aquest treball ha estat finançat en part pel Ministerio de Ciencia e Innovación mitjançant el programa Ramón i Cajal i per l’European Research Council (ERC) sota European Union’s Horizon 2020 research and innovation programme (grant agreement No 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

End-to-end speech translation with pre-trained models and adapters: UPC at IWSLT 2021

  • Gallego Olsina, Gerard Ion|||0000-0001-7466-3606
  • Tsiamas, Ioannis|||0000-0003-1049-2515
  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Rodríguez Fonollosa, José Adrián|||0000-0001-9513-7939
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of translating English audio recordings extracted from TED talks into German text. Submitted systems can be either cascade or end-to-end and use a custom or given segmentation. Our submission is an end-to-end speech translation system, which combines pre-trained models (Wav2Vec 2.0 and mBART) with coupling modules between the encoder and decoder, and uses an efficient fine-tuning technique, which trains only 20% of its total parameters. We show that adding an Adapter to the system and pre-training it, can increase the convergence speed and the final result, with which we achieve a BLEU score of 27.3 on the MuSTC test set. Our final model is an ensemble that obtains 28.22 BLEU score on the same set. Our submission also uses a custom segmentation algorithm that employs pre-trained Wav2Vec 2.0 for identifying periods of untranscribable text and can bring improvements of 2.5 to 3 BLEU score on the IWSLT 2019 test set, as compared to the result with the given segmentation., This work was supported by the project ADAVOICE, PID2019-107579RB-I00 / AEI / 10.13039/501100011033 and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Multilingual machine translation: Closing the gap between shared and language-specific encoder-decoders

  • Escolano Peinado, Carlos|||0000-0001-6657-673X
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Rodríguez Fonollosa, José Adrián|||0000-0001-9513-7939
  • Artetxe Zurutuza, Mikel
State-of-the-art multilingual machine translation relies on a universal encoder-decoder, which requires retraining the entire system to add new languages. In this paper, we propose an alternative approach that is based on language-specific encoder-decoders, and can thus be more easily extended to new languages by learning their corresponding modules. So as to encourage a common interlingua representation, we simultaneously train the N initial languages. Our experiments show that the proposed approach outperforms the universal encoder-decoder by 3.28 BLEU points on average, while allowing to add new languages without the need to retrain the rest of the modules. All in all, our work closes the gap between shared and language-specific encoderdecoders, advancing toward modular multilingual machine translation systems that can be flexibly extended in lifelong learning settings., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación

End-to-End speech translation with pre-trained models and adapters: UPC at IWSLT 2021

  • Gallego Olsina, Gerard Ion
  • Tsiamas, Ioannis
  • Escolano Peinado, Carlos
  • Fonollosa, José A. R.
  • Ruiz Costa-Jussà, Marta
Paper accepted to IWSLT 2021, This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of translating English audio recordings extracted from TED talks into German text. Submitted systems can be either cascade or end-to-end and use a custom or given segmentation. Our submission is an end-to-end speech translation system, which combines pre-trained models (Wav2Vec 2.0 and mBART) with coupling modules between the encoder and decoder, and uses an efficient fine-tuning technique, which trains only 20% of its total parameters. We show that adding an Adapter to the system and pre-training it, can increase the convergence speed and the final result, with which we achieve a BLEU score of 27.3 on the MuST-C test set. Our final model is an ensemble that obtains 28.22 BLEU score on the same set. Our submission also uses a custom segmentation algorithm that employs pre-trained Wav2Vec 2.0 for identifying periods of untranscribable text and can bring improvements of 2.5 to 3 BLEU score on the IWSLT 2019 test set, as compared to the result with the given segmentation., Peer Reviewed, Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Gender bias in multilingual neural machine translation: The architecture matters

  • Ruiz Costa-Jussà, Marta
  • Escolano Peinado, Carlos
  • Basta, Christine Raouf Saad
  • Ferrando Monsonís, Javier
  • Batlle, Roser
  • Kharitonova, Ksenia
Multilingual Neural Machine Translation architectures mainly differ in the amount of sharing modules and parameters among languages. In this paper, and from an algorithmic perspective, we explore if the chosen architecture, when trained with the same data, influences the gender bias accuracy. Experiments in four language pairs show that Language-Specific encoders-decoders exhibit less bias than the Shared encoder-decoder architecture. Further interpretability analysis of source embeddings and the attention shows that, in the LanguageSpecific case, the embeddings encode more gender information, and its attention is more diverted. Both behaviors help in mitigating gender bias., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multilingual machine translation: Deep analysis of language-specific encoder-decoders

  • Escolano Peinado, Carlos
  • Ruiz Costa-Jussà, Marta
  • Rodríguez Fonollosa, José Adrián
State-of-the-art multilingual machine translation relies on a shared encoder-decoder. In this paper, we propose an alternative approach based on language-specific encoder-decoders, which can be easily extended to new languages by learning their corresponding modules. To establish a common interlingua representation, we simultaneously train N initial languages. Our experiments show that the proposed approach improves over the shared encoder-decoder for the initial languages and when adding new languages, without the need to retrain the remaining modules. All in all, our work closes the gap between shared and language-specific encoder-decoders, advancing toward modular multilingual machine translation systems that can be flexibly extended in lifelong learning settings., This work is supported by the European Research Council (ERC) under the European Union’sHorizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multilingual machine translation: Closing the gap between shared and language-specific encoder-decoders

  • Escolano Peinado, Carlos
  • Ruiz Costa-Jussà, Marta
  • Rodríguez Fonollosa, José Adrián
  • Artetxe Zurutuza, Mikel
State-of-the-art multilingual machine translation relies on a universal encoder-decoder, which requires retraining the entire system to add new languages. In this paper, we propose an alternative approach that is based on language-specific encoder-decoders, and can thus be more easily extended to new languages by learning their corresponding modules. So as to encourage a common interlingua representation, we simultaneously train the N initial languages. Our experiments show that the proposed approach outperforms the universal encoder-decoder by 3.28 BLEU points on average, while allowing to add new languages without the need to retrain the rest of the modules. All in all, our work closes the gap between shared and language-specific encoderdecoders, advancing toward modular multilingual machine translation systems that can be flexibly extended in lifelong learning settings., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fine-tuning neural machine translation on gender-balanced datasets

  • Ruiz Costa-Jussà, Marta
  • de Jorge Sánchez, Adrián
Misrepresentation of certain communities in datasets is causing big disruptions in artificial intelligence applications. In this paper, we propose using an automatically extracted gender-balanced dataset parallel corpus from Wikipedia. This balanced set is used to perform fine-tuning techniques from a bigger model trained on unbalanced datasets to mitigate gender biases in neural machine translation., This work is supported in part by the Catalan Agency for Management of University and Research Grants (AGAUR) through an Industrial Ph.D. Grant, the Spanish Ministerio de Ciencia e Innovacion and by the Agencia Estatal de Investigacion, through the postdoctoral senior grant Ramón y Cajal and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Evaluating gender bias in speech translation

  • Ruiz Costa-Jussà, Marta
  • Basta, Christine Raouf Saad
  • Gallego Olsina, Gerard Ion
The scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups. Currently, there are no standard evaluation techniques for different types of biases. Accordingly, there is an urgent need to provide evaluation sets and protocols to measure existing biases in our automatic systems. Evaluating the biases should be an essential step towards mitigating them in the systems. This paper introduces WinoST, a new freely available challenge set for evaluating gender bias in speech translation. WinoST is the speech version of WinoMT which is a MT challenge set and both follow an evaluation protocol to measure gender accuracy. Using a state-of-the-art end-to-end speech translation system, we report the gender bias evaluation on four language pairs and we show that gender accuracy in speech translation is more than 23% lower than in MT., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657), the Catalan Agency for Management of University and Research Grants (AGAUR) through the FI PhD Scholarship, Universitat Politècnica de Catalunya with the collaboration of Banco de Santander and the Spanish Ministerio de Ciencia e Innovación through the project PID2019- 107579RB-I00 / AEI / 10.13039/501100011033., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Attention weights in transformer NMT fail aligning words between sequences but largely explain model predictions

  • Ferrando Monsonís, Javier
  • Ruiz Costa-Jussà, Marta
This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we prove that attention weights systematically make alignment errors by relying mainly on uninformative tokens from the source sequence. However, we observe that NMT models assign attention to these tokens to regulate the contribution in the prediction of the two contexts, the source and the prefix of the target sequence. We provide evidence about the influence of wrong alignments on the model behavior, demonstrating that the encoder-decoder attention mechanism is well suited as an interpretability method for NMT. Finally, based on our analysis, we propose methods that largely reduce the word alignment error rate compared to standard induced alignments from attention weights., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Converses al voltant de la intel·ligència artificial en clau catalana, Conversations around artificial intelligence from the catalan perspective

  • Ruiz Costa-Jussà, Marta
  • Melero Nogues, Maite
La intel·ligència artificial mou milions d’euros i ocupa una part important de les agendes polítiques i estratègiques dels governs. En aquest article reflexionem sobre aquest concepte difús i ho fem a través de tres entrevistes a tres persones que ocupen llocs rellevants en aquest àmbit, i que a més tenen en comú que són nascudes i formades a Catalunya. Amb elles hem parlat distesament dels orígens d’aquesta revolució tecnològica, del seu impacte sobre l’organització social i el mercat laboral, de les seves implicacions ètiques, de les tendències futures que es dibuixen i també sobre quin paper juguem els catalans en aquesta revolució. En la qüestió catalana hem volgut saber si les nostres universitats són capaces de generar el talent necessari, com impulsar estratègicament el teixit empresarial en aquesta àrea, quin paper ha de tenir l’administració i què hauria de passar perquè la intel·ligència artificial també parli en català. En aquestes converses, els nostres interlocutors ens han transmès la urgència i la necessitat de treballar en la definició d’estratègies concretes de país per tal de no quedar socialment i estructuralment enrere en el que sembla una revolució sense límits, Artificial intelligence moves millions of euros and occupies an important part of governments’ political and strategic agendas. In this article we reflect on this varied concept through interviews with three people who hold important positions in the field of artificial intelligence and who also have in common the fact that they were born and trained in Catalonia. We talked with them about the origins of this technological revolution, its impact on social organization and the labour market, its ethical implications, the future trends which are emerging and also on what role we Catalans play in this. With regards to the Catalan question we wanted to know if our universities are capable of generating the necessary talent, how to strategically boost the fabric of business in this area, what role the Administration should play and what should happen for artificial intelligence to communicate in Catalan. Throughout these conversations, the interviewees have conveyed to us the urgency and need to work on the definition of country-specific strategies in order not to be left behind socially and structurally in what seems to be a revolution without limits., Aquest treball ha estat finançat en part pel Ministerio de Ciencia e Innovación mitjançant el programa Ramón i Cajal i per l’European Research Council (ERC) sota European Union’s Horizon 2020 research and innovation programme (grant agreement No 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Enriching the transformer with linguistic factors for low-resource machine translation

  • Armengol Estapé, Jordi
  • Ruiz Costa-Jussà, Marta
  • Escolano Peinado, Carlos
Introducing factors, that is to say, word features such as linguistic information referring to the source tokens, is known to improve the results of neural machine translation systems in certain settings, typically in recurrent architectures. This study proposes enhancing the current state-of-the-art neural machine translation architecture, the Transformer, so that it allows to introduce external knowledge. In particular, our proposed modification, the Factored Transformer, uses linguistic factors that insert additional knowledge into the machine translation system. Apart from using different kinds of features, we study the effect of different architectural configurations. Specifically, we analyze the performance of combining words and features at the embedding level or at the encoder level, and we experiment with two different combination strategies. With the best-found configuration, we show improvements of 0.8 BLEU over the baseline Transformer in the IWSLT German-to-English task. Moreover, we experiment with the more challenging FLoRes English-to-Nepali benchmark, which includes both extremely low-resourced and very distant languages, and obtain an improvement of 1.2 BLEU, This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

End-to-end speech translation with pre-trained models and adapters: UPC at IWSLT 2021

  • Gallego Olsina, Gerard Ion
  • Tsiamas, Ioannis
  • Escolano Peinado, Carlos
  • Rodríguez Fonollosa, José Adrián
  • Ruiz Costa-Jussà, Marta
This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of translating English audio recordings extracted from TED talks into German text. Submitted systems can be either cascade or end-to-end and use a custom or given segmentation. Our submission is an end-to-end speech translation system, which combines pre-trained models (Wav2Vec 2.0 and mBART) with coupling modules between the encoder and decoder, and uses an efficient fine-tuning technique, which trains only 20% of its total parameters. We show that adding an Adapter to the system and pre-training it, can increase the convergence speed and the final result, with which we achieve a BLEU score of 27.3 on the MuSTC test set. Our final model is an ensemble that obtains 28.22 BLEU score on the same set. Our submission also uses a custom segmentation algorithm that employs pre-trained Wav2Vec 2.0 for identifying periods of untranscribable text and can bring improvements of 2.5 to 3 BLEU score on the IWSLT 2019 test set, as compared to the result with the given segmentation., This work was supported by the project ADAVOICE, PID2019-107579RB-I00 / AEI / 10.13039/501100011033 and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Semantic and syntactic information for neural machine translation: Injecting features to the transformer

  • Armengol Estapé, Jordi
  • Ruiz Costa-Jussà, Marta
Introducing factors such as linguistic features has long been proposed in machine translation to improve the quality of translations. More recently, factored machine translation has proven to still be useful in the case of sequence-to-sequence systems. In this work, we investigate whether this gains hold in the case of the state-of-the-art architecture in neural machine translation, the Transformer, instead of recurrent architectures. We propose a new model, the Factored Transformer, to introduce an arbitrary number of word features in the source sequence in an attentional system. Specifically, we suggest two variants depending on the level at which the features are injected. Moreover, we suggest two combination mechanisms for the word features and words themselves. We experiment both with classical linguistic features and semantic features extracted from a linked data database, and with two low-resource datasets. With the best-found configuration, we show improvements of 0.8 BLEU over the baseline Transformer in the IWSLT German-to-English task. Moreover, we experiment with the more challenging FLoRes English-to-Nepali benchmark, which includes both low-resource and very distant languages, and obtain an improvement of 1.2 BLEU. These improvements are achieved with linguistic and not with semantic information., This work is supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant Agreement No. 947657)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Continual lifelong learning in natural language processing: a survey

  • Biesialska, Magdalena Marta
  • Biesialska, Katarzyna
  • Ruiz Costa-Jussà, Marta
Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously acquired knowledge. Furthermore, CL is particularly challenging for language learning, as natural language is ambiguous: it is discrete, compositional, and its meaning is context-dependent. In this work, we look at the problem of CL through the lens of various NLP tasks. Our survey discusses major challenges in CL and current methods applied in neural network models. We also provide a critical review of the existing CL evaluation methods and datasets in NLP. Finally, we present our outlook on future research directions., This work is supported in part by the Catalan Agencia de Gestión de Ayudas Universitarias y de Investigación (AGAUR) through the FI PhD grant; the Spanish Ministerio de Ciencia e Innovación and by the Agencia Estatal de Investigación through the Ramón y Cajal grant and the project PCIN-2017-079; and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 947657)., Peer Reviewed, Postprint (published version)