Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Indexing music by mood: design and integration of an automatic content-based annotator

  • Laurier, Cyril François
  • Meyers, Owen
  • Serrà Julià, Joan
  • Blech, Martin
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
In the context of content analysis for indexing and retrieval, a method for creating automatic music mood annotation is presented. The method is based on results from psychological studies and framed into a supervised learning approach using musical features automatically extracted from the raw audio signal. We present here some of the most relevant audio features to solve this problem. A ground truth, used for training, is created using both social network information systems (wisdom of crowds) and individual experts (wisdom of the few). At the experimental level, we evaluate our approach on a database of 1,000 songs. Tests of different classification methods, configurations and optimizations have been conducted, showing that Support Vector Machines perform best for the task at hand. Moreover, we evaluate the algorithm robustness against different audio compression schemes. This fact, often neglected, is fundamental to build a system that is usable in real conditions. In addition, the integration of a fast and scalable version of this technique with the European Project PHAROS is discussed. This real world application demonstrates the usability of this tool to annotate large-scale databases. We also report on a user evaluation in the context of the PHAROS search engine, asking people about the utility, interest and innovation of this technology in real world use cases., This research has been partially funded by the EU Project PHAROS IST-2006-045035.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Cross recurrence quantification for cover song identification

  • Serrà Julià, Joan
  • Serra, Xavier
  • Andrzejak, Ralph Gregor
There is growing evidence that nonlinear time series analysis techniques can be used to successfully characterize, classify, or process signals derived from realworld dynamics even though these are not necessarily deterministic and stationary. In the present study we proceed in this direction by addressing an important problem our modern society is facing, the automatic classification of digital information. In particular, we address the automatic identification of cover songs, i.e. alternative renditions of a previously recorded musical piece. For this purpose we here propose a recurrence quantification analysis measure that allows tracking potentially curved and disrupted traces in cross recurrence plots. We apply this measure to cross recurrence /nplots constructed from the state space representation of musical descriptor time series extracted from the raw audio signal. We show that our method identifies cover songs with a higher accuracy as compared to previously published techniques. Beyond the particular application proposed here, we discuss how our approach can be useful for the characterization of a variety of signals from different scientific disciplines. We study coupled Rössler dynamics with stochastically modulated mean frequencies as one concrete example to illustrate this point., This research has been partially funded by the EU-IP project PHAROS IST-2006-045035 and by the BFU2007-61710 Spanish Ministry of Education and Science grant.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Statistical analysis of chroma features in western music predicts human judgments of tonality

  • Serrà Julià, Joan
  • Gómez Gutiérrez, Emilia, 1975-
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Motivated by evidence that image source statistics predict the response properties of several visual perception aspects, we provide an empirical analysis of the relation between chroma statistics and human judgments of tonality. To accomplish this, a statistical analysis method based on chroma feature covariance is proposed. It makes use of a large collection of western music to build a tonal profile. The obtained profile is compared to alternative tonal profiles proposed in the literature, either cognitively, perceptually, or theoretically inspired. The high degree of correlation we find between the covariance-based tonal profile proposed here and several ones proposed in the literature (reaching values higher than 0.9) is interpreted as evidence that human-derived profiles faithfully reflect the statistics of the musical input listeners have been exposed to. Furthermore, we show that very short time scales allow us to correctly predict these profiles, which brings us to discuss the role that local-scale implicit learning plays in building mental representations of tonality., This research has been partially funded by the EU-IP project PHAROS6 (IST-2006-045035), the e-Content Plus project VARIAZIONI 7 (ECP-2005-CULT-038264) and the European FET project EmCAP 8 (FP6-IST-013123).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Essentia: an audio analysis library for music information retrieval

  • Bogdanov, Dmitry
  • Wack, Nicolas
  • Gómez Gutiérrez, Emilia, 1975-
  • Gulati, Sankalp
  • Herrera Boyer, Perfecto, 1964-
  • Mayor, Oscar
  • Roma Trepat, Gerard
  • Salamon, Justin
  • Zapata González, José Ricardo
  • Serra, Xavier
Comunicació presentada a la 14th International Society for Music Information Retrieval Conference, celebrada a Curitiba (Brasil) els dies 4 a 8 de novembre de 2013., We present Essentia 2.0, an open-source C++ library for audio analysis and audio-based music information retrieval released under the Affero GPL license. It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors. The library is also wrapped in Python and includes a number of predefined executable extractors for the available music descriptors, which facilitates its use for fast prototyping and allows setting up research experiments very rapidly. Furthermore, it includes a Vamp plugin to be used with Sonic Visualiser for visualization purposes. The library is cross-platform and currently supports Linux, Mac OS X, and Windows systems. Essentia is designed with a focus on the robustness of the provided music descriptors and is optimized in terms of the computational cost of the algorithms. The provided functionality, specifically the music descriptors included in-the-box and signal processing algorithms, is easily expandable and allows for both research experiments and development of large-scale industrial applications., The work on Essentia has been partially funded by the PHAROS (EUIP, IST-2006-045035), Buscamedia (CEN-20091026), CANTATA (ITEA 05010, FIT-350300-2006-33), SIGMUS (TIN2012-36650), CompMusic (ERC 267583), and TECNIO (TECCIT12-1-0003) projects.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

ESSENTIA: an open-source library for sound and music analysis

  • Bogdanov, Dmitry
  • Wack, Nicolas
  • Gómez Gutiérrez, Emilia, 1975-
  • Gulati, Sankalp
  • Herrera Boyer, Perfecto, 1964-
  • Mayor, Oscar
  • Roma Trepat, Gerard
  • Salamon, Justin
  • Zapata González, José Ricardo
  • Serra, Xavier
Comunicació presentada a la 21st ACM international conference on Multimedia, celebrada els dies 21 a 25 d'octubre de 2013 a Barcelona, Espanya., We present Essentia 2.0, an open-source C++ library for audio analysis and audio-based music information retrieval released under the Affero GPL license. It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors. The library is also wrapped in Python and includes a number of predefined executable extractors for the available music descriptors, which facilitates its use for fast prototyping and allows setting up research experiments very rapidly. Furthermore, it includes a Vamp plugin to be used with Sonic Visualiser for visualization purposes. The library is cross-platform and currently supports Linux, Mac OS X, and Windows systems. Essentia is designed with a focus on the robustness of the provided music descriptors and is optimized in terms of the computational cost of the algorithms. The provided functionality, specifically the music descriptors included in-the-box and signal processing algorithms, is easily expandable and allows for both research experiments and development of large-scale industrial applications., The work on Essentia has been partially funded by the PHAROS (EU-IP, IST-2006-045035), CANTATA (ITEA 05010, FIT-350300-2006-33), Buscamedia (CEN-20091026), SIGMUS (TIN2012-36650), CompMusic (ERC 267583), and TECNIO (TECCIT12-1-0003) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Statistical analysis of chroma features in western music predicts human judgments of tonality

  • Serrà Julià, Joan
  • Gómez Gutiérrez, Emilia, 1975-
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Motivated by evidence that image source statistics predict the response properties of several visual perception aspects, we provide an empirical analysis of the relation between chroma statistics and human judgments of tonality. To accomplish this, a statistical analysis method based on chroma feature covariance is proposed. It makes use of a large collection of western music to build a tonal profile. The obtained profile is compared to alternative tonal profiles proposed in the literature, either cognitively, perceptually, or theoretically inspired. The high degree of correlation we find between the covariance-based tonal profile proposed here and several ones proposed in the literature (reaching values higher than 0.9) is interpreted as evidence that human-derived profiles faithfully reflect the statistics of the musical input listeners have been exposed to. Furthermore, we show that very short time scales allow us to correctly predict these profiles, which brings us to discuss the role that local-scale implicit learning plays in building mental representations of tonality., This research has been partially funded by the EU-IP project PHAROS6 (IST-2006-045035), the e-Content Plus project VARIAZIONI 7 (ECP-2005-CULT-038264) and the European FET project EmCAP 8 (FP6-IST-013123).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Cross recurrence quantification for cover song identification

  • Serrà Julià, Joan
  • Serra, Xavier
  • Andrzejak, Ralph Gregor
There is growing evidence that nonlinear time series analysis techniques can be used to successfully characterize, classify, or process signals derived from realworld dynamics even though these are not necessarily deterministic and stationary. In the present study we proceed in this direction by addressing an important problem our modern society is facing, the automatic classification of digital information. In particular, we address the automatic identification of cover songs, i.e. alternative renditions of a previously recorded musical piece. For this purpose we here propose a recurrence quantification analysis measure that allows tracking potentially curved and disrupted traces in cross recurrence plots. We apply this measure to cross recurrence /nplots constructed from the state space representation of musical descriptor time series extracted from the raw audio signal. We show that our method identifies cover songs with a higher accuracy as compared to previously published techniques. Beyond the particular application proposed here, we discuss how our approach can be useful for the characterization of a variety of signals from different scientific disciplines. We study coupled Rössler dynamics with stochastically modulated mean frequencies as one concrete example to illustrate this point., This research has been partially funded by the EU-IP project PHAROS IST-2006-045035 and by the BFU2007-61710 Spanish Ministry of Education and Science grant.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Indexing music by mood: design and integration of an automatic content-based annotator

  • Laurier, Cyril François
  • Meyers, Owen
  • Serrà Julià, Joan
  • Blech, Martin
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
In the context of content analysis for indexing and retrieval, a method for creating automatic music mood annotation is presented. The method is based on results from psychological studies and framed into a supervised learning approach using musical features automatically extracted from the raw audio signal. We present here some of the most relevant audio features to solve this problem. A ground truth, used for training, is created using both social network information systems (wisdom of crowds) and individual experts (wisdom of the few). At the experimental level, we evaluate our approach on a database of 1,000 songs. Tests of different classification methods, configurations and optimizations have been conducted, showing that Support Vector Machines perform best for the task at hand. Moreover, we evaluate the algorithm robustness against different audio compression schemes. This fact, often neglected, is fundamental to build a system that is usable in real conditions. In addition, the integration of a fast and scalable version of this technique with the European Project PHAROS is discussed. This real world application demonstrates the usability of this tool to annotate large-scale databases. We also report on a user evaluation in the context of the PHAROS search engine, asking people about the utility, interest and innovation of this technology in real world use cases., This research has been partially funded by the EU Project PHAROS IST-2006-045035.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

ESSENTIA: an open-source library for sound and music analysis

  • Bogdanov, Dmitry
  • Wack, Nicolas
  • Gómez Gutiérrez, Emilia, 1975-
  • Gulati, Sankalp
  • Herrera Boyer, Perfecto, 1964-
  • Mayor, Oscar
  • Roma Trepat, Gerard
  • Salamon, Justin
  • Zapata González, José Ricardo
  • Serra, Xavier
Comunicació presentada a la 21st ACM international conference on Multimedia, celebrada els dies 21 a 25 d'octubre de 2013 a Barcelona, Espanya., We present Essentia 2.0, an open-source C++ library for audio analysis and audio-based music information retrieval released under the Affero GPL license. It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors. The library is also wrapped in Python and includes a number of predefined executable extractors for the available music descriptors, which facilitates its use for fast prototyping and allows setting up research experiments very rapidly. Furthermore, it includes a Vamp plugin to be used with Sonic Visualiser for visualization purposes. The library is cross-platform and currently supports Linux, Mac OS X, and Windows systems. Essentia is designed with a focus on the robustness of the provided music descriptors and is optimized in terms of the computational cost of the algorithms. The provided functionality, specifically the music descriptors included in-the-box and signal processing algorithms, is easily expandable and allows for both research experiments and development of large-scale industrial applications., The work on Essentia has been partially funded by the PHAROS (EU-IP, IST-2006-045035), CANTATA (ITEA 05010, FIT-350300-2006-33), Buscamedia (CEN-20091026), SIGMUS (TIN2012-36650), CompMusic (ERC 267583), and TECNIO (TECCIT12-1-0003) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Essentia: an audio analysis library for music information retrieval

  • Bogdanov, Dmitry
  • Wack, Nicolas
  • Gómez Gutiérrez, Emilia, 1975-
  • Gulati, Sankalp
  • Herrera Boyer, Perfecto, 1964-
  • Mayor, Oscar
  • Roma Trepat, Gerard
  • Salamon, Justin
  • Zapata González, José Ricardo
  • Serra, Xavier
Comunicació presentada a la 14th International Society for Music Information Retrieval Conference, celebrada a Curitiba (Brasil) els dies 4 a 8 de novembre de 2013., We present Essentia 2.0, an open-source C++ library for audio analysis and audio-based music information retrieval released under the Affero GPL license. It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors. The library is also wrapped in Python and includes a number of predefined executable extractors for the available music descriptors, which facilitates its use for fast prototyping and allows setting up research experiments very rapidly. Furthermore, it includes a Vamp plugin to be used with Sonic Visualiser for visualization purposes. The library is cross-platform and currently supports Linux, Mac OS X, and Windows systems. Essentia is designed with a focus on the robustness of the provided music descriptors and is optimized in terms of the computational cost of the algorithms. The provided functionality, specifically the music descriptors included in-the-box and signal processing algorithms, is easily expandable and allows for both research experiments and development of large-scale industrial applications., The work on Essentia has been partially funded by the PHAROS (EUIP, IST-2006-045035), Buscamedia (CEN-20091026), CANTATA (ITEA 05010, FIT-350300-2006-33), SIGMUS (TIN2012-36650), CompMusic (ERC 267583), and TECNIO (TECCIT12-1-0003) projects.