Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 6
Encontrada(s) 1 página(s)

DAU Arxiu Digital de la Universitat Ramon Llull
Publicación Artículo científico (JournalArticle)

A unit selection text-to-speech-and-singing synthesis framework from neutral speech: proof of concept

  • Freixes, Marc
  • Alías-Pujol, Francesc
  • Socoró, Joan Claudi
Text-to-speech (TTS) synthesis systems have been widely used in general-purpose applications based on the generation of speech. Nonetheless, there are some domains, such as storytelling or voice output aid devices, which may also require singing. To enable a corpus-based TTS system to sing, a supplementary singing database should be recorded. This solution, however, might be too costly for eventual singing needs, or even unfeasible if the original speaker is unavailable or unable to sing properly. This work introduces a unit selection-based text-to-speech-and-singing (US-TTS&S) synthesis framework, which integrates speech-to-singing (STS) conversion to enable the generation of both speech and singing from an input text and a score, respectively, using the same neutral speech corpus. The viability of the proposal is evaluated considering three vocal ranges and two tempos on a proof-of-concept implementation using a 2.6-h Spanish neutral speech corpus. The experiments show that challenging STS transformation factors are required to sing beyond the corpus vocal range and/or with notes longer than 150 ms. While score-driven US configurations allow the reduction of pitch-scale factors, time-scale factors are not reduced due to the short length of the spoken vowels. Moreover, in the MUSHRA test, text-driven and score-driven US configurations obtain similar naturalness rates of around 40 for all the analysed scenarios. Although these naturalness scores are far from those of vocaloid, the singing scores of around 60 which were obtained validate that the framework could reasonably address eventual singing needs.
DAU Arxiu Digital de la Universitat Ramon Llull
Publicación Artículo científico (JournalArticle)

Review of Wireless Acoustic Sensor Networks for Environmental Noise Monitoring in Smart Cities

  • Alías-Pujol, Francesc
  • Alsina-Pagès, Rosa Ma
Nowadays, more than half of the world’s population lives in urban areas. Since this proportion is expected to keep rising, the sustainable development of cities is of paramount importance to guarantee the quality of life of their inhabitants. Environmental noise is one of the main concerns that has to be addressed, due to its negative impact on the health of people. Different national and international noise directives and legislations have been defined during the past decades, which local authorities must comply with involving noise mapping, action plans, policing, and public awareness, among others. To this aim, a recent change in the paradigm for environmental noise monitoring has been driven by the rise of Internet of Things technology within smart cities through the design and development of wireless acoustic sensor networks (WASNs). This work reviews the most relevant WASN-based approaches developed to date focused on environmental noise monitoring. The proposals have moved from networks composed of high-accuracy commercial devices to the those integrated by ad hoc low-cost acoustic sensors, sometimes designed as hybrid networks with low and high computational capacity nodes. After describing the main characteristics of recent WASN-based projects, the paper also discusses several open challenges, such as the development of acoustic signal processing techniques to identify noise events, to allow the reliable and pervasive deployment of WASNs in urban areas together with some potential future applications.
DAU Arxiu Digital de la Universitat Ramon Llull
Publicación Artículo científico (JournalArticle)

Leveraging Urban Sounds: A Commodity Multi-Microphone Hardware Approach for Sound Recognition

  • Tappero, Fabrizio
  • Alsina-Pagès, Rosa Ma
  • Duboc, Leticia
  • Alías-Pujol, Francesc
City noise and sound are measured and processed with the purpose of drawing appropriate government legislation and regulations, ultimately aimed at contributing to a healthier environment for humans. The primary use of urban noise analysis is carried out with the main purpose of reporting or denouncing, to the appropriate authorities, a misconduct or correct a misuse of council resources. We believe that urban sounds carry more information than what it is extracted to date. In this paper we present a cloud-based urban sound analysis system for the capturing, processing and trading of urban sound-based information. By leveraging modern artificial intelligence algorithms running on a FOG computing city infrastructure, we will show how the presented solution can offer a valuable solution for exploiting urban sound information. A specific focus is given to the hardware implementation of the sound sensor and its multimicrophone architecture. We discuss how the presented architecture is designed to allow the trading of sound information between independent parties, transparently, using cloud-based sound processing APIs running on an inexpensive consumer-grade microphone.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A unit selection text-to-speech-and-singing synthesis framework from neutral speech: proof of concept

  • Freixes, Marc
  • Alías-Pujol, Francesc
  • Socoró, Joan Claudi
Text-to-speech (TTS) synthesis systems have been widely used in general-purpose applications based on the generation of speech. Nonetheless, there are some domains, such as storytelling or voice output aid devices, which may also require singing. To enable a corpus-based TTS system to sing, a supplementary singing database should be recorded. This solution, however, might be too costly for eventual singing needs, or even unfeasible if the original speaker is unavailable or unable to sing properly. This work introduces a unit selection-based text-to-speech-and-singing (US-TTS&S) synthesis framework, which integrates speech-to-singing (STS) conversion to enable the generation of both speech and singing from an input text and a score, respectively, using the same neutral speech corpus. The viability of the proposal is evaluated considering three vocal ranges and two tempos on a proof-of-concept implementation using a 2.6-h Spanish neutral speech corpus. The experiments show that challenging STS transformation factors are required to sing beyond the corpus vocal range and/or with notes longer than 150 ms. While score-driven US configurations allow the reduction of pitch-scale factors, time-scale factors are not reduced due to the short length of the spoken vowels. Moreover, in the MUSHRA test, text-driven and score-driven US configurations obtain similar naturalness rates of around 40 for all the analysed scenarios. Although these naturalness scores are far from those of vocaloid, the singing scores of around 60 which were obtained validate that the framework could reasonably address eventual singing needs.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Leveraging Urban Sounds: A Commodity Multi-Microphone Hardware Approach for Sound Recognition

  • Tappero, Fabrizio
  • Alsina-Pagès, Rosa Ma
  • Duboc, Leticia
  • Alías-Pujol, Francesc
City noise and sound are measured and processed with the purpose of drawing appropriate government legislation and regulations, ultimately aimed at contributing to a healthier environment for humans. The primary use of urban noise analysis is carried out with the main purpose of reporting or denouncing, to the appropriate authorities, a misconduct or correct a misuse of council resources. We believe that urban sounds carry more information than what it is extracted to date. In this paper we present a cloud-based urban sound analysis system for the capturing, processing and trading of urban sound-based information. By leveraging modern artificial intelligence algorithms running on a FOG computing city infrastructure, we will show how the presented solution can offer a valuable solution for exploiting urban sound information. A specific focus is given to the hardware implementation of the sound sensor and its multimicrophone architecture. We discuss how the presented architecture is designed to allow the trading of sound information between independent parties, transparently, using cloud-based sound processing APIs running on an inexpensive consumer-grade microphone.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Review of Wireless Acoustic Sensor Networks for Environmental Noise Monitoring in Smart Cities

  • Alías-Pujol, Francesc
  • Alsina-Pagès, Rosa Ma
Nowadays, more than half of the world’s population lives in urban areas. Since this proportion is expected to keep rising, the sustainable development of cities is of paramount importance to guarantee the quality of life of their inhabitants. Environmental noise is one of the main concerns that has to be addressed, due to its negative impact on the health of people. Different national and international noise directives and legislations have been defined during the past decades, which local authorities must comply with involving noise mapping, action plans, policing, and public awareness, among others. To this aim, a recent change in the paradigm for environmental noise monitoring has been driven by the rise of Internet of Things technology within smart cities through the design and development of wireless acoustic sensor networks (WASNs). This work reviews the most relevant WASN-based approaches developed to date focused on environmental noise monitoring. The proposals have moved from networks composed of high-accuracy commercial devices to the those integrated by ad hoc low-cost acoustic sensors, sometimes designed as hybrid networks with low and high computational capacity nodes. After describing the main characteristics of recent WASN-based projects, the paper also discusses several open challenges, such as the development of acoustic signal processing techniques to identify noise events, to allow the reliable and pervasive deployment of WASNs in urban areas together with some potential future applications.