Skip to main content

TECNOLOGIAS DE APRENDIZAJE PROFUNDO APLICADAS AL PROCESADO DE VOZ Y AUDIO

TEC2015-69266-P

•
Funding agency name Ministerio de Economía y Competitividad
Funding agency acronym MINECO
Program Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D (Excelencia / Generación de Conocimiento)
Call year 2015
State Plan 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Management unit Secretaría de Estado de Educación, Formación Profesional y Universidades
Beneficiary centre UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 27
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A Deep Source-Context Feature for Lexical Selection in Statistical Machine Translation

  • Gupta, Parth Alokkumar
  • Costa-Jussa, Marta R
  • Banchs, Rafael
  • Rosso, Paolo|||0000-0002-8922-1242
This paper presents a methodology to address lexical disambiguation in a standard phrase-based statistical machine translation system. Similarity among source contexts is used to select appropriate translation units. The information is introduced as a novel feature of the phrase-based model and it is used to select the translation units extracted from the training sentence more similar to the sentence to translate. The similarity is computed through a deep autoencoder representation, which allows to obtain effective lowdimensional embedding of data and statistically significant BLEU score improvements on two different tasks (English-to-Spanish and English-to-Hindi). © 2016 Elsevier B.V. All rights reserved., The work of the first author has been supported by FPI UPV pre-doctoral grant (num. registro - 3505). The work of the second author has been supported by Spanish Ministerio de Economia y Competitividad, contract TEC2015-69266-P and the Seventh Framework Program of the European Commission through the International Outgoing Fellowship Marie Curie Action (IMTraP-2011-29951). The work of the third author has been supported by the Spanish Ministerio de Economia y Competitividad, SomEMBED TIN2015-71147-C2-1-P research project and by the Generalitat Valenciana under the grant ALMAPATER (PrometeoII/2014/030).
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Exploring efficient neural architectures for linguistic-acoustic mapping in text-to-speech

  • Pascual de la Puente, Santiago|||0000-0002-8365-7387
  • Serra, Joan
  • Bonafonte Cávez, Antonio|||0000-0002-6240-9915
Conversion from text to speech relies on the accurate mapping from linguistic to acoustic symbol sequences, for which current practice employs recurrent statistical models such as recurrent neural networks. Despite the good performance of such models (in terms of low distortion in the generated speech), their recursive structure with intermediate affine transformations tends to make them slow to train and to sample from. In this work, we explore two different mechanisms that enhance the operational efficiency of recurrent neural networks, and study their performance–speed trade-off. The first mechanism is based on the quasi-recurrent neural network, where expensive affine transformations are removed from temporal connections and placed only on feed-forward computational directions. The second mechanism includes a module based on the transformer decoder network, designed without recurrent connections but emulating them with attention and positioning codes. Our results show that the proposed decoder networks are competitive in terms of distortion when compared to a recurrent baseline, whilst being significantly faster in terms of CPU and GPU inference time. The best performing model is the one based on the quasi-recurrent mechanism, reaching the same level of naturalness as the recurrent neural network based model with a speedup of 11.2 on CPU and 3.3 on GPU., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Language modelling for speaker diarization in telephonic interviews

  • India Massana, Miquel Àngel|||0000-0002-3107-3662
  • Hernando Pericás, Francisco Javier|||0000-0002-1730-8154
  • Rodríguez Fonollosa, José Adrián|||0000-0001-9513-7939
The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high discriminative speaker information, even more reliable than the acoustic ones. In this study we analyze how an appropriate fusion of both kind of features is able to obtain good results in these cases. The proposed system is based on an iterative algorithm where a LSTM network is used as a speaker classifier. The network is fed with character-level word embeddings and a GMM based acoustic score created with the output labels from previous iterations. The presented algorithm has been evaluated in a Call-Center database, which is composed of telephone interview audios. The combination of acoustic features and linguistic content shows a 84.29% improvement in terms of a word-level DER as compared to a HMM/VB baseline system. The results of this study confirms that linguistic content can be efficiently used for some speaker recognition tasks., This work was partially supported by the Spanish Project DeepVoice (TEC2015-69266-P) and by the project PID2019-107579RBI00/ AEI /10.13039/501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

TEC forecasting based on manifold trajectories

  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • García Rigo, Alberto|||0000-0001-6226-4851
  • Hernández Pajares, Manuel|||0000-0002-9687-5850
  • Yang, Heng
In this paper, we present a method for forecasting the ionospheric Total Electron Content (TEC) distribution from the International GNSS Service’s Global Ionospheric Maps. The forecasting system gives an estimation of the value of the TEC distribution based on linear combination of previous TEC maps (i.e., a set of 2D arrays indexed by time), and the computation of a tangent subspace in a manifold associated to each map. The use of the tangent space to each map is justified because it allows modeling the possible distortions from one observation to the next as a trajectory on the tangent manifold of the map. The coefficients of the linear combination of the last observations along with the tangent space are estimated at each time stamp to minimize the mean square forecasting error with a regularization term. The estimation is made at each time stamp to adapt the forecast to short-term variations in solar activity., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Detection and description of the different ionospheric disturbances that appeared during the solar eclipse of 21 August 2017

  • Yang, Heng
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Hernández Pajares, Manuel|||0000-0002-9687-5850
This work will provide a detailed characterization of the travelling ionospheric disturbances (TIDs) created by the solar eclipse of 21 August 2017, the shadow of which crossed the United States from the Pacific to the Atlantic ocean. The analysis is done by means of the Atomic Decomposition Detector of Traveling Ionospheric Disturbances (ADDTID) algorithm. This method automatically detects and characterizes multiple TIDs from the global navigation satellite system (GNSS) observation. The set of disturbances generated by the eclipse has a richer and more varied behavior than that associated with the shock wave directly produced by cooling effects of the moon shadow. This can be modeled in part as if the umbra and penumbra of the eclipse were moving cylinders that intersects with variable elevation angle a curved surface. This projection gives rise to regions of equal penumbra with shapes similar to ellipses, with different centers and foci. The result of this is reflected in the time evolution of the TID wavelengths produced by the eclipse, which depend on the vertical angle of the sun with the surface of the earth, and also a double bow wave phenomenon, where the bow waves are generated in advance to the umbra. We show that the delay in the appearance of the disturbances with the transit of the eclipse are compatible with the physical explanations, linked to the different origins of the disturbances and the wavelengths. Finally, we detected a consistent pattern, in location and time of disturbances in advance to the penumbra as a set of medium scale TIDs, which could be hypothesized as soliton waves of the bow wave. In all cases, the detected disturbances were checked visually on the detrended vertical total electron content (TEC) maps., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Empirical modelling of survey-based expectations for the design of economic indicators in five European regions

  • Claveria, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
This is a post-peer-review, pre-copyedit version of an article published in Empirica. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10663-017-9395-1”., In this study we use agents’ expectations about the state of the economy to generate indicators of economic activity in twenty-six European countries grouped in five regions (Western, Eastern, and Southern Europe, and Baltic and Scandinavian countries). We apply a data-driven procedure based on evolutionary computation to transform survey variables in economic growth rates. In a first step, we design five independent experiments to derive a formula using survey variables that best replicates the evolution of economic growth in each region by means of genetic programming, limiting the integration schemes to the main mathematical operations. We then rank survey variables according to their performance in tracking economic activity, finding that agents’ ‘‘perception about the overall economy compared to last year’’ is the survey variable with the highest predictive power. In a second step, we assess the out-of-sample forecast accuracy of the evolved indicators. Although we obtain different results across regions, Austria, Slovakia, Portugal, Lithuania and Sweden are the economies of each region that show the best forecast results. We also find evidence that the forecasting performance of the survey-based indicators improves during periods of higher growth., This is a post-peer-review, pre-copyedit version of an article published in Empirica. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10663-017-9395-1”., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Multilingual and interlingual semantic representations for natural language processing: a brief introduction

  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • España-Bonet, Cristina
  • Fung, Pascale
  • Smith, Noah
We introduce the Computational Linguistics special issue on Multilingual and Interlingual Semantic Representations for Natural Language Processing. We situate the special issue’s five articles in the context of our fast-changing field, explaining our motivation for this project. We offer a brief summary of the work in the issue, which includes developments on lexical and sentential semantic representations, from symbolic and neural perspectives., MRC is supported in part by a Google Faculty Research Award 2018, Spanish Ministerio de Economía y Competitividad, the European Regional Development Fund and the Agencia Estatal de Investigacion, through the postdoctoral senior grant Ramon y Cajal, the contract TEC2015-69266-P (MINECO/FEDER,EU) and the contract PCIN-2017-079 (AEI/MINECO). N. A. S. is supported by National Science Foundation grant IIS-1562364. C. E. B. is funded by the German Federal Ministry of Education and Research under the funding code 01IW17001 (Deeplee)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Evolutionary computation for macroeconomic forecasting

  • Claveria, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
The final publication is available at Springer via http://dx.doi.org/10.1007/s10614-017-9767-4, The main objective of this study is twofold. First, we propose an empirical modelling approach based on genetic programming to forecast economic growth by means of survey data on expectations. We use evolutionary algorithms to estimate a symbolic regression that links survey-based expectations to a quantitative variable used as a yardstick, deriving mathematical functional forms that approximate the target variable. The set of empirically-generated proxies of economic growth are used as building blocks to forecast the evolution of GDP. Second, we use these estimates of GDP to assess the impact of the 2008 financial crisis on the accuracy of agents’ expectations about the evolution of the economic activity in four Scandinavian economies. While we find an improvement in the capacity of agents’ to anticipate economic growth after the crisis, predictive accuracy worsens in relation to the period prior to the crisis. The most accurate GDP forecasts are obtained for Sweden., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Economic uncertainty: a geometric indicator of discrepancy among experts’ expectations

  • Claveria González, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
The final publication is available at Springer via http://dx.doi.org/10.1007/s11205-018-1984-2, In this study we present a geometric approach to proxy economic uncertainty. We design a positional indicator of disagreement among survey-based agents’ expectations about the state of the economy. Previous dispersion-based uncertainty indicators derived from business and consumer surveys exclusively make use of the two extreme pieces of information: the percentage of respondents expecting a variable to rise and to fall. With the aim of also incorporating the information coming from the share of respondents expecting a variable to remain constant, we propose a geometrical framework and use a barycentric coordinate system to generate a measure of disagreement, referred to as a discrepancy indicator. We assess its performance both empirically and experimentally by comparing it to the standard deviation of the share of positive and negative responses. When applied in sixteen European countries, we find that both time-varying metrics co-evolve in most countries for expectations about the country’s overall economic situation in the present, but not in the future. Additionally, we obtain their simulated sampling distributions and we find that the proposed indicator gravitates uniformly towards the three vertices of the simplex representing the three answering categories, as opposed to the standard deviation, which tends to overestimate the level of uncertainty as a result of ignoring the no-change responses. Consequently, we find evidence that the information coming from agents expecting a variable to remain constant has an effect on the measurement of disagreement., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Unemployment expectations: A socio-demographic analysis of the effect of news

  • Soric, Petar
  • Lolic, Ivana
  • Claveria González, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
© <2019>. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/, In this study, we evaluate the effect of news on consumer unemployment expectations for sixteen socio-demographic groups. To this end, we construct an unemployment sentiment indicator and extract news about several economic variables. By means of genetic programming we estimate symbolic regressions that link unemployment rates in the Euro Area to qualitative expectations about a wide range of economic variables. We then use the evolved expressions to compute unemployment expectations for each consumer group. We first assess the out-of-sample forecast accuracy of the evolved indicators, obtaining better forecasts for the leading unemployment sentiment indicator than for the coincident one. Results are similar across the different socio-demographic groups. The best forecast results are obtained for respondents between 30 and 49 years. The group where we observe the bigger differences among categories is the occupation, where the lowest forecast errors are obtained for the unemployed respondents. Next, we link news about inflation, industrial production, and stock markets to unemployment expectations. With this aim we match positive and negative news with consumers’ unemployment sentiment using a distributed lag regression model for each news item. We find asymmetries in the responses of consumers’ unemployment expectations to economic news: they tend to be stronger in the case of negative news, especially in the case of inflation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Using survey data to forecast real activity with evolutionary algorithms. A cross-country analysis

  • Claveria, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
In this study we use survey expectations about a wide range of economic variables to forecast real activity. We propose an empirical approach to derive mathematical functional forms that link survey expectations to economic growth. Combining symbolic regression with genetic programming we generate two survey-based indicators: a perceptions index, using agents’assessments about the present, and an expectations index with their expectations about the future. In order to find the optimal combination of both indexes that best replicates the evolution of economic activity in each country we use a portfolio management procedure known as index tracking. By means of a generalized reduced gradient algorithm we derive the relative weights of both indexes. In most economies, the survey-based predictions generated with the composite indicator outperform the benchmark model for one-quarter ahead forecasts, although these improvements are only significant in Austria, Belgium and Portugal., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Time-domain speech enhancement using generative adversarial networks

  • Pascual de la Puente, Santiago|||0000-0002-8365-7387
  • Serra, Joan
  • Bonafonte Cávez, Antonio|||0000-0002-6240-9915
Speech enhancement improves recorded voice utterances to eliminate noise that might be impeding their intelligibility or compromising their quality. Typical speech enhancement systems are based on regression approaches that subtract noise or predict clean signals. Most of them do not operate directly on waveforms. In this work, we propose a generative approach to regenerate corrupted signals into a clean version by using generative adversarial networks on the raw signal. We also explore several variations of the proposed system, obtaining insights into proper architectural choices for an adversarially trained, convolutional autoencoder applied to speech. We conduct both objective and subjective evaluations to assess the performance of the proposed method. The former helps us choose among variations and better tune hyperparameters, while the latter is used in a listening experiment with 42 subjects, confirming the effectiveness of the approach in the real world. We also demonstrate the applicability of the approach for more generalized speech enhancement, where we have to regenerate voices from whispered signals., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Time series features and machine learning forecasts

  • Claveria González, Oscar
  • Monte Moreno, Enrique|||0000-0002-4907-0494
  • Torra Porras, Salvador
In this study we combine the results of two independent analyses to position Spanish regions according to both the characteristics of the time series of international tourist arrivals and the accuracy of predictions of arrivals at the regional level. We apply a seasonal-trend decomposition procedure based on non-parametric regression to isolate the different components of the series and calculate the main time series features. Predictions are generated with several machine learning models in a recursive multi-step-ahead forecasting experiment. Finally, we summarize all the information from the two previous experiments using categorical principal component analysis. By overlapping the distribution of the regions and the component loadings of each variable along both dimensions, we observe that entropy and dispersion show an inverse relation with forecast accuracy, but the interactions between the rest of the features and accuracy are heavily dependent on the forecast horizon. On this evidence, we conclude that in order to increase forecast accuracy of tourist arrivals at the regional level, model selection should be region-specific and based on the forecast horizon., This research was supported by by the projects ECO2016-75805-R and TEC2015-69266-P from the Spanish Ministry of Economy and Competitiveness. We would like to thank the Editor and two anonymous referees for their useful comments and suggestions., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Linguistic knowledge-based vocabularies for Neural Machine Translation

  • Casas Manzanares, Noé
  • Ruiz Costa-Jussà, Marta|||0000-0002-5703-520X
  • Rodríguez Fonollosa, José Adrián|||0000-0001-9513-7939
  • Alonso, Juan
  • Fanlo, Ramon
This article has been published in a revised form in Natural Language Engineering https://doi.org/10.1017/S1351324920000364. This version is free to view and download for private research and study only. Not for re-distribution, re-sale or use in derivative works. © Cambridge University Press, Neural Networks applied to Machine Translation need a finite vocabulary to express textual information as a sequence of discrete tokens. The currently dominant subword vocabularies exploit statistically-discovered common parts of words to achieve the flexibility of character-based vocabularies without delegating the whole learning of word formation to the neural network. However, they trade this for the inability to apply word-level token associations, which limits their use in semantically-rich areas and prevents some transfer learning approaches e.g. cross-lingual pretrained embeddings, and reduces their interpretability. In this work, we propose new hybrid linguistically-grounded vocabulary definition strategies that keep both the advantages of subword vocabularies and the word-level associations, enabling neural networks to profit from the derived benefits. We test the proposed approaches in both morphologically rich and poor languages, showing that, for the former, the quality in the translation of out-of-domain texts is improved with respect to a strong subword baseline., This work is partially supported by Lucy Software / United Language Group (ULG) and the Catalan Agency for Management of University and Research Grants (AGAUR) through an Industrial PhD Grant. This work is also supported in part by the Spanish Ministerio de Economa y Competitividad, the European Regional Development Fund and the Agencia Estatal de Investigacin, through the postdoctoral senior grant Ramn y Cajal, contract TEC2015-69266-P (MINECO/FEDER,EU) and contract PCIN-2017-079 (AEI/MINECO)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Unemployment expectations: A socio-demographic analysis of the effect of news

  • Soric, Petar
  • Lolic, Ivana
  • Claveria González, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
© <2019>. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/, In this study, we evaluate the effect of news on consumer unemployment expectations for sixteen socio-demographic groups. To this end, we construct an unemployment sentiment indicator and extract news about several economic variables. By means of genetic programming we estimate symbolic regressions that link unemployment rates in the Euro Area to qualitative expectations about a wide range of economic variables. We then use the evolved expressions to compute unemployment expectations for each consumer group. We first assess the out-of-sample forecast accuracy of the evolved indicators, obtaining better forecasts for the leading unemployment sentiment indicator than for the coincident one. Results are similar across the different socio-demographic groups. The best forecast results are obtained for respondents between 30 and 49 years. The group where we observe the bigger differences among categories is the occupation, where the lowest forecast errors are obtained for the unemployed respondents. Next, we link news about inflation, industrial production, and stock markets to unemployment expectations. With this aim we match positive and negative news with consumers’ unemployment sentiment using a distributed lag regression model for each news item. We find asymmetries in the responses of consumers’ unemployment expectations to economic news: they tend to be stronger in the case of negative news, especially in the case of inflation., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Detection and description of the different ionospheric disturbances that appeared during the solar eclipse of 21 August 2017

  • Yang, Heng
  • Monte Moreno, Enrique
  • Hernández Pajares, Manuel
This work will provide a detailed characterization of the travelling ionospheric disturbances (TIDs) created by the solar eclipse of 21 August 2017, the shadow of which crossed the United States from the Pacific to the Atlantic ocean. The analysis is done by means of the Atomic Decomposition Detector of Traveling Ionospheric Disturbances (ADDTID) algorithm. This method automatically detects and characterizes multiple TIDs from the global navigation satellite system (GNSS) observation. The set of disturbances generated by the eclipse has a richer and more varied behavior than that associated with the shock wave directly produced by cooling effects of the moon shadow. This can be modeled in part as if the umbra and penumbra of the eclipse were moving cylinders that intersects with variable elevation angle a curved surface. This projection gives rise to regions of equal penumbra with shapes similar to ellipses, with different centers and foci. The result of this is reflected in the time evolution of the TID wavelengths produced by the eclipse, which depend on the vertical angle of the sun with the surface of the earth, and also a double bow wave phenomenon, where the bow waves are generated in advance to the umbra. We show that the delay in the appearance of the disturbances with the transit of the eclipse are compatible with the physical explanations, linked to the different origins of the disturbances and the wavelengths. Finally, we detected a consistent pattern, in location and time of disturbances in advance to the penumbra as a set of medium scale TIDs, which could be hypothesized as soliton waves of the bow wave. In all cases, the detected disturbances were checked visually on the detrended vertical total electron content (TEC) maps., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Using survey data to forecast real activity with evolutionary algorithms. A cross-country analysis

  • Claveria, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
In this study we use survey expectations about a wide range of economic variables to forecast real activity. We propose an empirical approach to derive mathematical functional forms that link survey expectations to economic growth. Combining symbolic regression with genetic programming we generate two survey-based indicators: a perceptions index, using agents’assessments about the present, and an expectations index with their expectations about the future. In order to find the optimal combination of both indexes that best replicates the evolution of economic activity in each country we use a portfolio management procedure known as index tracking. By means of a generalized reduced gradient algorithm we derive the relative weights of both indexes. In most economies, the survey-based predictions generated with the composite indicator outperform the benchmark model for one-quarter ahead forecasts, although these improvements are only significant in Austria, Belgium and Portugal., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Empirical modelling of survey-based expectations for the design of economic indicators in five European regions

  • Claveria, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
This is a post-peer-review, pre-copyedit version of an article published in Empirica. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10663-017-9395-1”., In this study we use agents’ expectations about the state of the economy to generate indicators of economic activity in twenty-six European countries grouped in five regions (Western, Eastern, and Southern Europe, and Baltic and Scandinavian countries). We apply a data-driven procedure based on evolutionary computation to transform survey variables in economic growth rates. In a first step, we design five independent experiments to derive a formula using survey variables that best replicates the evolution of economic growth in each region by means of genetic programming, limiting the integration schemes to the main mathematical operations. We then rank survey variables according to their performance in tracking economic activity, finding that agents’ ‘‘perception about the overall economy compared to last year’’ is the survey variable with the highest predictive power. In a second step, we assess the out-of-sample forecast accuracy of the evolved indicators. Although we obtain different results across regions, Austria, Slovakia, Portugal, Lithuania and Sweden are the economies of each region that show the best forecast results. We also find evidence that the forecasting performance of the survey-based indicators improves during periods of higher growth., This is a post-peer-review, pre-copyedit version of an article published in Empirica. The final authenticated version is available online at: http://dx.doi.org/10.1007/s10663-017-9395-1”., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Linguistic knowledge-based vocabularies for Neural Machine Translation

  • Casas Manzanares, Noé
  • Ruiz Costa-Jussà, Marta
  • Rodríguez Fonollosa, José Adrián
  • Alonso, Juan
  • Fanlo, Ramon
This article has been published in a revised form in Natural Language Engineering https://doi.org/10.1017/S1351324920000364. This version is free to view and download for private research and study only. Not for re-distribution, re-sale or use in derivative works. © Cambridge University Press, Neural Networks applied to Machine Translation need a finite vocabulary to express textual information as a sequence of discrete tokens. The currently dominant subword vocabularies exploit statistically-discovered common parts of words to achieve the flexibility of character-based vocabularies without delegating the whole learning of word formation to the neural network. However, they trade this for the inability to apply word-level token associations, which limits their use in semantically-rich areas and prevents some transfer learning approaches e.g. cross-lingual pretrained embeddings, and reduces their interpretability. In this work, we propose new hybrid linguistically-grounded vocabulary definition strategies that keep both the advantages of subword vocabularies and the word-level associations, enabling neural networks to profit from the derived benefits. We test the proposed approaches in both morphologically rich and poor languages, showing that, for the former, the quality in the translation of out-of-domain texts is improved with respect to a strong subword baseline., This work is partially supported by Lucy Software / United Language Group (ULG) and the Catalan Agency for Management of University and Research Grants (AGAUR) through an Industrial PhD Grant. This work is also supported in part by the Spanish Ministerio de Economa y Competitividad, the European Regional Development Fund and the Agencia Estatal de Investigacin, through the postdoctoral senior grant Ramn y Cajal, contract TEC2015-69266-P (MINECO/FEDER,EU) and contract PCIN-2017-079 (AEI/MINECO)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Time-domain speech enhancement using generative adversarial networks

  • Pascual de la Puente, Santiago
  • Serra, Joan
  • Bonafonte Cávez, Antonio
Speech enhancement improves recorded voice utterances to eliminate noise that might be impeding their intelligibility or compromising their quality. Typical speech enhancement systems are based on regression approaches that subtract noise or predict clean signals. Most of them do not operate directly on waveforms. In this work, we propose a generative approach to regenerate corrupted signals into a clean version by using generative adversarial networks on the raw signal. We also explore several variations of the proposed system, obtaining insights into proper architectural choices for an adversarially trained, convolutional autoencoder applied to speech. We conduct both objective and subjective evaluations to assess the performance of the proposed method. The former helps us choose among variations and better tune hyperparameters, while the latter is used in a listening experiment with 42 subjects, confirming the effectiveness of the approach in the real world. We also demonstrate the applicability of the approach for more generalized speech enhancement, where we have to regenerate voices from whispered signals., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

TEC forecasting based on manifold trajectories

  • Monte Moreno, Enrique
  • García Rigo, Alberto
  • Hernández Pajares, Manuel
  • Yang, Heng
In this paper, we present a method for forecasting the ionospheric Total Electron Content (TEC) distribution from the International GNSS Service’s Global Ionospheric Maps. The forecasting system gives an estimation of the value of the TEC distribution based on linear combination of previous TEC maps (i.e., a set of 2D arrays indexed by time), and the computation of a tangent subspace in a manifold associated to each map. The use of the tangent space to each map is justified because it allows modeling the possible distortions from one observation to the next as a trajectory on the tangent manifold of the map. The coefficients of the linear combination of the last observations along with the tangent space are estimated at each time stamp to minimize the mean square forecasting error with a regularization term. The estimation is made at each time stamp to adapt the forecast to short-term variations in solar activity., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Evolutionary computation for macroeconomic forecasting

  • Claveria, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
The final publication is available at Springer via http://dx.doi.org/10.1007/s10614-017-9767-4, The main objective of this study is twofold. First, we propose an empirical modelling approach based on genetic programming to forecast economic growth by means of survey data on expectations. We use evolutionary algorithms to estimate a symbolic regression that links survey-based expectations to a quantitative variable used as a yardstick, deriving mathematical functional forms that approximate the target variable. The set of empirically-generated proxies of economic growth are used as building blocks to forecast the evolution of GDP. Second, we use these estimates of GDP to assess the impact of the 2008 financial crisis on the accuracy of agents’ expectations about the evolution of the economic activity in four Scandinavian economies. While we find an improvement in the capacity of agents’ to anticipate economic growth after the crisis, predictive accuracy worsens in relation to the period prior to the crisis. The most accurate GDP forecasts are obtained for Sweden., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Multilingual and interlingual semantic representations for natural language processing: a brief introduction

  • Ruiz Costa-Jussà, Marta
  • España-Bonet, Cristina
  • Fung, Pascale
  • Smith, Noah
We introduce the Computational Linguistics special issue on Multilingual and Interlingual Semantic Representations for Natural Language Processing. We situate the special issue’s five articles in the context of our fast-changing field, explaining our motivation for this project. We offer a brief summary of the work in the issue, which includes developments on lexical and sentential semantic representations, from symbolic and neural perspectives., MRC is supported in part by a Google Faculty Research Award 2018, Spanish Ministerio de Economía y Competitividad, the European Regional Development Fund and the Agencia Estatal de Investigacion, through the postdoctoral senior grant Ramon y Cajal, the contract TEC2015-69266-P (MINECO/FEDER,EU) and the contract PCIN-2017-079 (AEI/MINECO). N. A. S. is supported by National Science Foundation grant IIS-1562364. C. E. B. is funded by the German Federal Ministry of Education and Research under the funding code 01IW17001 (Deeplee)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Language modelling for speaker diarization in telephonic interviews

  • India Massana, Miquel Àngel
  • Hernando Pericás, Francisco Javier
  • Rodríguez Fonollosa, José Adrián
The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high discriminative speaker information, even more reliable than the acoustic ones. In this study we analyze how an appropriate fusion of both kind of features is able to obtain good results in these cases. The proposed system is based on an iterative algorithm where a LSTM network is used as a speaker classifier. The network is fed with character-level word embeddings and a GMM based acoustic score created with the output labels from previous iterations. The presented algorithm has been evaluated in a Call-Center database, which is composed of telephone interview audios. The combination of acoustic features and linguistic content shows a 84.29% improvement in terms of a word-level DER as compared to a HMM/VB baseline system. The results of this study confirms that linguistic content can be efficiently used for some speaker recognition tasks., This work was partially supported by the Spanish Project DeepVoice (TEC2015-69266-P) and by the project PID2019-107579RBI00/ AEI /10.13039/501100011033., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Time series features and machine learning forecasts

  • Claveria González, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
In this study we combine the results of two independent analyses to position Spanish regions according to both the characteristics of the time series of international tourist arrivals and the accuracy of predictions of arrivals at the regional level. We apply a seasonal-trend decomposition procedure based on non-parametric regression to isolate the different components of the series and calculate the main time series features. Predictions are generated with several machine learning models in a recursive multi-step-ahead forecasting experiment. Finally, we summarize all the information from the two previous experiments using categorical principal component analysis. By overlapping the distribution of the regions and the component loadings of each variable along both dimensions, we observe that entropy and dispersion show an inverse relation with forecast accuracy, but the interactions between the rest of the features and accuracy are heavily dependent on the forecast horizon. On this evidence, we conclude that in order to increase forecast accuracy of tourist arrivals at the regional level, model selection should be region-specific and based on the forecast horizon., This research was supported by by the projects ECO2016-75805-R and TEC2015-69266-P from the Spanish Ministry of Economy and Competitiveness. We would like to thank the Editor and two anonymous referees for their useful comments and suggestions., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Economic uncertainty: a geometric indicator of discrepancy among experts’ expectations

  • Claveria González, Oscar
  • Monte Moreno, Enrique
  • Torra Porras, Salvador
The final publication is available at Springer via http://dx.doi.org/10.1007/s11205-018-1984-2, In this study we present a geometric approach to proxy economic uncertainty. We design a positional indicator of disagreement among survey-based agents’ expectations about the state of the economy. Previous dispersion-based uncertainty indicators derived from business and consumer surveys exclusively make use of the two extreme pieces of information: the percentage of respondents expecting a variable to rise and to fall. With the aim of also incorporating the information coming from the share of respondents expecting a variable to remain constant, we propose a geometrical framework and use a barycentric coordinate system to generate a measure of disagreement, referred to as a discrepancy indicator. We assess its performance both empirically and experimentally by comparing it to the standard deviation of the share of positive and negative responses. When applied in sixteen European countries, we find that both time-varying metrics co-evolve in most countries for expectations about the country’s overall economic situation in the present, but not in the future. Additionally, we obtain their simulated sampling distributions and we find that the proposed indicator gravitates uniformly towards the three vertices of the simplex representing the three answering categories, as opposed to the standard deviation, which tends to overestimate the level of uncertainty as a result of ignoring the no-change responses. Consequently, we find evidence that the information coming from agents expecting a variable to remain constant has an effect on the measurement of disagreement., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Exploring efficient neural architectures for linguistic-acoustic mapping in text-to-speech

  • Pascual de la Puente, Santiago
  • Serra, Joan
  • Bonafonte Cávez, Antonio
Conversion from text to speech relies on the accurate mapping from linguistic to acoustic symbol sequences, for which current practice employs recurrent statistical models such as recurrent neural networks. Despite the good performance of such models (in terms of low distortion in the generated speech), their recursive structure with intermediate affine transformations tends to make them slow to train and to sample from. In this work, we explore two different mechanisms that enhance the operational efficiency of recurrent neural networks, and study their performance–speed trade-off. The first mechanism is based on the quasi-recurrent neural network, where expensive affine transformations are removed from temporal connections and placed only on feed-forward computational directions. The second mechanism includes a module based on the transformer decoder network, designed without recurrent connections but emulating them with attention and positioning codes. Our results show that the proposed decoder networks are competitive in terms of distortion when compared to a recurrent baseline, whilst being significantly faster in terms of CPU and GPU inference time. The best performing model is the one based on the quasi-recurrent mechanism, reaching the same level of naturalness as the recurrent neural network based model with a speedup of 11.2 on CPU and 3.3 on GPU., Peer Reviewed, Postprint (published version)