Pasar al contenido principal

AUDIO ESPACIAL INTELIGENTE: SINTESIS Y PERSONALIZACION

RTI2018-097045-B-C22

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2018
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITÈCNICA DE VALÈNCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Effects and applications of spatial acuity in advanced spatial audioreproduction systems with loudspeakers

  • López Monfort, José Javier|||0000-0001-6884-5577
  • Gutiérrez-Parera, Pablo|||0000-0002-5349-5698
  • Savioja, Lauri
[EN] Spatial audio reproduction systems using loudspeakers produce coloration effects at high frequencies due to spatial interference between loudspeakers, in both those based on panning and those based on field synthesis. As a response to this problem and in order to reduce coloration, this paper studies the feasibility of an alternative approach where high-frequencies are reproduced from a single loudspeaker, with a different direction from that of its panned low-frequency counterpart. Listening tests are conducted to investigate the localization and quality of the source in the case that frequencies higher than 1.5 kHz are reproduced from a different direction than the low frequencies. In this context, the human ability to discriminate the spatial direction of low/high frequency bands and the error in the perceived direction of arrival for different separation angles is evaluated and quantified. The resulting data has been analyzed with ANOVA, providing significant results that allow us to establish a threshold in the angular separation of the high and low frequency parts where subjects do not perceive source location artifacts. The term just noticeable band splitting angle (JNBSA) is defined and introduced. It represents the minimum angle of separation between high and low frequencies from which the listener starts to perceive artifacts in the reproduction of a sound source using loudspeakers., The Spanish Ministry of Economy, Industry and Competitiveness supported this work within the framework of the TEC2015-68076-R and RTI2018-097045-B-C22 projects, as well as the Aalto Science Institute with a visiting professor grant. The authors also thank Sakari Tervo for the support in the experimental procedure, and Philip W. Robinson for the suggestion of bibliographic references.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

An Open-Set Recognition and Few-Shot Learning Dataset for Audio Event Classification in Domestic Environments

  • Naranjo-Alcaraz, Javier
  • Perez-Castanos, Sergi
  • Zuccarello, Pedro
  • Torres, Ana M.
  • Ferri, Francesc J.
  • Cobos, Maximo
  • López Monfort, José Javier|||0000-0001-6884-5577
[EN] The problem of training with a small set of positive samples is known as few-shot learning (FSL). It is widely known that traditional deep learning algorithms usually show very good performance when trained with large datasets. However, in many applications, it is not possible to obtain such a high num- ber of samples. This paper deals with the application of FSL to the detection of specific and intentional acoustic events given by different types of sound alarms, such as door bells or fire alarms, using a limited number of samples. These sounds typically occur in domestic environments where many events corre- sponding to a wide variety of sound classes take place. Therefore, the detection of such alarms in a practi- cal scenario can be considered an open-set recognition (OSR) problem. To address the lack of a dedicated public dataset for audio FSL, researchers usually make modifications on other available datasets. This pa- per is aimed at providing the audio recognition community with a carefully annotated dataset1 for FSL in an OSR context comprised of 1360 clips from 34 classes divided into pattern sounds and unwanted sounds. To facilitate and promote research on this area, results with state-of-the-art baseline systems based on transfer learning are also presented., This work was supported by the EU Horizon 2020 programme [grant No 779158] . Grants DIN2018-009982, PTQ-17-09106, RTI2018-097045-B-C21/C22 funded by MCIN/AEI/10.13039/50110 0 011033, the latter also by "ERDF A way of making Europe ". Grants TED2021-131003B-C21/C22 funded by MCIN/AEI/10.13039/50110 0 011033 and by the "EU Union NextGenerationEU/PRTR ". Grants AICO/2020/154 and AEST/2020/012, funded by GVA. The authors acknowledge also the Artemisa computer resources funded by the EU ERDF and Comunitat Valenciana, and the technical support of IFIC (CSIC-UV) . Authors J. Naranjo, S. Perez and P. Zuccarello were working at Visualfy when this work was done, but they are now with the Instituto Tecnologico de Informatica (ITI) , Tyris AI and ITI, respectively.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Interaural time difference individualization in HRTF by scaling through anthropometric parameters

  • Gutiérrez-Parera, Pablo|||0000-0002-5349-5698
  • López Monfort, José Javier|||0000-0001-6884-5577
  • Mora-Merchan, Javier M.
  • Larios, Diego F.
[EN] Head-related transfer function (HRTF) individualization can improve the perception of binaural sound. The interaural time difference (ITD) of the HRTF is a relevant cue for sound localization, especially in azimuth. Therefore, individualization of the ITD is likely to result in better sound spatial localization. A study of ITD has been conducted from a perceptual point of view using data from individual HRTF measurements and subjective perceptual tests. Two anthropometric dimensions have been demonstrated in relation to the ITD, predicting the subjective behavior of various subjects in a perceptual test. With this information, a method is proposed to individualize the ITD of a generic HRTF set by adapting it with a scale factor, which is obtained by a linear regression formula dependent on the two previous anthropometric dimensions. The method has been validated with both objective measures and another perceptual test. In addition, practical regression formula coefficients are provided for fitting the ITD of the generic HRTFs of the widely used Brüel & Kjær 4100 and Neumann KU100 binaural dummy heads., This work has received funding from the Spanish Ministry of Science and Innovation through the project RTI2018-097045-B-C22, and from the Spanish Ministry of Universities under the "Margarita Salas" program supported by the NextGenerationEU funds of the European Union.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

An Efficient Implementation of Parallel Parametric HRTF Models for Binaural Sound Synthesis in Mobile Multimedia

  • Belloch, José A.
  • Badia, Jose M.
  • Cobos, Máximo
  • Ramos Peinado, Germán|||0000-0001-7152-0044
[EN] The extended use of mobile multimedia devices in applications like gaming, 3D video and audio reproduction, immersive teleconferencing, or virtual and augmented reality, is demanding efficient algorithms and methodologies. All these applications require real-time spatial audio engines with the capability of dealing with intensive signal processing operations while facing a number of constraints related to computational cost, latency and energy consumption. Most mobile multimedia devices include a Graphics Processing Unit (GPU) that is primarily used to accelerate video processing tasks, providing high computational capabilities due to its inherent parallel architecture. This paper describes a scalable parallel implementation of a real-time binaural audio engine for GPU-equipped mobile devices. The engine is based on a set of head-related transfer functions (HRTFs) modelled with a parametric parallel structure, allowing efficient synthesis and interpolation while reducing the size required for HRTF data storage. Several strategies to optimize the GPU implementation are evaluated over a well-known kind of processor present in a wide range of mobile devices. In this context, we analyze both the energy consumption and real-time capabilities of the system by exploring different GPU and CPU configuration alternatives. Moreover, the implementation has been conducted using the OpenCL framework, guarantying the portability of the code., This work was supported in part by the Spanish Ministry of Economy and Competitiveness under Grant RTI2018-097045-B-C21, Grant RTI2018-097045-B-C22, Grant TIN2017-82972-R, and Grant ESP2015-68245-C4-1-P, and in part by the Universitat Jaume I Project UJI-B2019-36.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Compensating first reflections in non-anechoic head-related transfer function measurements

  • López Monfort, José Javier|||0000-0001-6884-5577
  • Gutiérrez-Parera, Pablo|||0000-0002-5349-5698
  • Cobos, Maximo
[EN] Personalized Head-Related Transfer Functions (HRTFs) are needed as part of the binaural sound individ- ualization process in order to provide a high-quality immersive experience for a specific user. Signal processing methods for performing HRTF measurements in non-anechoic conditions are of high interest to avoid the complex and inconvenient access to anechoic facilities. Non-anechoic HRTF measurements capture the effect of room reflections, which should be correctly identified and eliminated to obtain HRTFs estimates comparable to ones acquired in an anechoic setup. This paper proposes a sub-band frequency-dependent processing method for reflection suppression in non-anechoic HRTF signals. Array processing techniques based on Plane Wave Decomposition (PWD) are adopted as an essential part of the solution for low frequency ranges, whereas the higher frequencies are easily handled by means of time-crop windowing methods. The formulation of the model, extraction of parameters and evaluation of the method are described in detail. In addition, a validation case study is presented showing the suppression of reflections from an HRTF measured in a real system. The results confirm that the method allows to obtain processed HRTFs comparable to those acquired in anechoic conditions., This work has received funding from the Spanish Ministry of Science, Innovation and Universities, through projects RTI2018097045-B-C21 and RTI2018-097045-B-C22, and Generalitat Valenciana under the AICO/2020/154 project grant.