Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 14
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A personality-based adaptive system for visualizing classical music performances

  • Schedl, Markus
  • Melenhorst, Mark
  • Liem, Cynthia C. S.
  • Martorell Domínguez, Agustín
  • Mayor, Oscar
  • Tkalčič, Marko
To enhance the experience of listening to classical orchestra music, either in the concert hall or at home, we present a personalized system that integrates three visualization/interaction concepts: Score Follower (points to the current position in the score), Orchestra Layout (illustrates instruments that are currently playing and their dynamics), and Structure Visualization (visualizes structural elements such as themes or motifs). Motivated by previous literature that found evidence for connections between personality and music consumption and preference, we first assessed in a user study to which extent personality traits and music visualization preferences correlate. Measuring preference via pragmatic quality and personality traits according to the Big Five Inventory (BFI) questionnaire, we found substantial interconnections between them. These translate into rules relating certain personality traits (e.g., extraversion or agreeableness) to preference rankings of the visualizations. In the proposed personality-based system, users are grouped into four clusters according to their answers to the most significant personality questions determined in the study. The order of the visualizations for a given user is adapted with respect to the ranking preferred by other users in the same cluster. Evaluation of the system was carried out by a second user study that showed a significantly higher normalized discounted cumulative gain (NDCG) for the personalized system in comparison to a system with randomized order of the visualizations., This work is supported by the EU FP7-ICT-2011-9 project 601166 (“PHENICX”) and the Austrian Science Fund (FWF): P25655.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

An analysis of agreement in classical music perception and its relationship to listener characteristics

  • Schedl, Markus
  • Eghbal-Zadeh, Hamid
  • Gómez Gutiérrez, Emilia, 1975-
  • Tkalčič, Marko
Comunicació presentada a la ISMR 2016, 17th International Society for Music Information Retrieval Conference, celebrada els dies 7 a 11 d'agost de 2016 a New York City., We present a study, carried out on 241 participants, which investigates on classical music material the agreement of listeners on perceptual music aspects (related to emotion, tempo, complexity, and instrumentation) and the relationship between listener characteristics and these aspects. For the currently popular task of music emotion recognition, the former question is particularly important when defining a ground truth of emotions perceived in a given music collection. We characterize listeners via a range of factors, including demographics, musical inclination, experience, and education, and personality traits. Participants rate the music material under investigation, i.e., 15 expert-defined segments of Beethoven’s 3rd symphony, “Eroica”, in terms of 10 emotions, perceived tempo, complexity, and number of instrument groups. Our study indicates only slight agreement on most perceptual aspects, but significant correlations between several listener characteristics and perceptual qualities., This research is supported by the Austrian Science Fund (FWF): P25655 and was made possible by the EU FP7 project no. 601166 (“PHENICX”).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A comparison of melody extraction methods based on source-filter modelling

  • Bosch, Juan J.
  • Bittner, Rachel M.
  • Salamon, Justin
  • Gómez Gutiérrez, Emilia, 1975-
This work explores the use of source-filter models for pitch/nsalience estimation and their combination with different/npitch tracking and voicing estimation methods for automatic/nmelody extraction. Source-filter models are used/nto create a mid-level representation of pitch that implicitly/nincorporates timbre information. The spectrogram of/na musical audio signal is modelled as the sum of the leading/nvoice (produced by human voice or pitched musical instruments)/nand accompaniment. The leading voice is then/nmodelled with a Smoothed Instantaneous Mixture Model/n(SIMM) based on a source-filter model. The main advantage/nof such a pitch salience function is that it enhances/nthe leading voice even without explicitly separating it from/nthe rest of the signal. We show that this is beneficial/nfor melody extraction, increasing pitch estimation accuracy/nand reducing octave errors in comparison with simpler/npitch salience functions. The adequate combination with/nvoicing detection techniques based on pitch contour characterisation/nleads to significant improvements over stateof-the-art/nmethods, for both vocal and instrumental music., This work is partially supported by the European Union/nunder the PHENICX project (FP7-ICT-601166) and the/nSpanish Ministry of Economy and Competitiveness under/nCASAS project (TIN2015-70816-R) and Maria de Maeztu/nUnits of Excellence Programme (MDM-2015-0502)
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

What is the effect of audio quality on the robustness of MFCCs and chroma features?

  • Urbano, Julián
  • Bogdanov, Dmitry
  • Herrera Boyer, Perfecto, 1964-
  • Gómez Gutiérrez, Emilia, 1975-
  • Serra, Xavier
Music Information Retrieval is largely based on descriptors computed from audio signals, and in many practical applications they are to be computed on music corpora containing audio files encoded in a variety of lossy formats. Such encodings distort the original signal and therefore may affect the computation of descriptors. This raises the question of the robustness of these descriptors across various audio encodings. We examine this assumption for the case of MFCCs and chroma features. In particular, we analyze their robustness to sampling rate, codec, bitrate, frame size and music genre. Using two different audio analysis tools over a diverse collection of music tracks, we compute several statistics to quantify the robustness of the resulting descriptors, and then estimate the practical effects for a sample task like genre classification., This work is partially supported by an A4U postdoctoral grant and projects SIGMUS (TIN2012-36650), Comp- Music (ERC 267583), PHENICX (ICT-2011.8.2) and GiantSteps (ICT-2013-10).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Melody extraction based on a source-filter model using pitch contour selection

  • Bosch, Juan J.
  • Gómez Gutiérrez, Emilia, 1975-
This work proposes a melody extraction method which combines a pitch salience function based on source-filter modelling with melody tracking based on pitch contour selection. We model the spectrogram of a musical audio signal as the sum of the leading voice and accompaniment. The leading voice is modelled with a Smoothed Instantaneous Mixture Model (SIMM), and the accompaniment is modelled with a Non-negative Matrix Factorization (NMF). The main benefit of this representation is that it incorporates timbre information, and that the leading voice is enhanced, even without an explicit separation from the rest of the signal. Two different salience functions based on SIMM are proposed, in order to adapt the output of such model to the pitch contour based tracking. Candidate melody pitch contours are then created by grouping pitch sequences, using auditory streaming cues. Finally, melody pitch contours are selected using a set of heuristic rules based on contour characteristics and smoothness constraints. The evaluation on a large set of challenging polyphonic music material, shows that the proposed salience functions help increasing the salience of melody pitches in comparison to similar methods. The complete melody extraction methods also achieve a higher overall accuracy than state-of-the-art approaches when evaluated on both vocal and instrumental music., This work is partially supported by the European Union under the PHENICX project (FP7-ICT-601166) and the Spanish Ministry of Economy and Competitiveness under CASAS project (TIN2015-70816-R) and Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Becoming the maestro - A game to enhance curiosity for classical music

  • Sarasúa Berodia, Álvaro
  • Melenhorst, Mark
  • Fernandez Julià, Carles, 1984-
  • Gómez Gutiérrez, Emilia, 1975-
Comunicació presentada a la 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), celebrada els dies 7 a 9 de setembre de 2016 a Barcelona, Espanya., Classical music is associated with a set of social and cognitive barriers that prevent potentially interested novice classical music listeners from attending concerts. The possible strategies to overcome these barriers and make the genre appealing to new audiences are diverse. In this paper, we present Becoming the Maestro, a game where users impersonate the conductor of an orchestra during a concert in a way that allows them to better understand musical concepts of symphonic music. A user study of the game prototype with 20 subjects proved that the game succeeded in increasing curiosity for classical music., This research received funding from the European Union Seventh Framework Programme FP7 / 2007-2013 PHENICX project (grant agreement no. 601166).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Improving score-informed source separation for classical music through note refinement

  • Miron, Marius
  • Carabias Orti, Julio J.
  • Janer Mestres, Jordi
Comunicació presentada a la 16th International Society for Music Information Retrieval Conference (ISMIR 2015), celebrada els dies 26 a 30 d'octubre de 2015 a Màlaga, Espanya., Signal decomposition methods such as Non-negative Matrix Factorization (NMF) demonstrated to be a suitable approach for music signal processing applications, including sound source separation. To better control this decomposition, NMF has been extended using prior knowledge and parametric models. In fact, using score information considerably improved separation results. Nevertheless, one of the main problems of using score information is the misalignment between the score and the actual performance. A potential solution to this problem is the use of audio to score alignment systems. However, most of them rely on a tolerance window that clearly affects the separation results. To overcome this problem, we propose a novel method to refine the aligned score at note level by detecting both, onset and offset for each note present in the score. Note refinement is achieved by detecting shapes and contours in the estimated instrument-wise time activation (gains) matrix. Decomposition is performed in a supervised way, using training instrument models and coarsely-aligned score information. The detected contours define time-frequency note boundaries, and they increase the sparsity. Finally, we have evaluated our method for informed source separation using a dataset of Bach chorales obtaining satisfactory results, especially in terms of SIR., This work was supported by the European Commission, FP7 (Seventh Framework Programme), STREP project, ICT- 2011.8.2 ICT for access to cultural resources, grant agreement No 601166. Phenicx Project
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

An analysis of agreement in classical music perception and its relationship to listener characteristics

  • Schedl, Markus
  • Eghbal-Zadeh, Hamid
  • Gómez Gutiérrez, Emilia, 1975-
  • Tkalčič, Marko
Comunicació presentada a la ISMR 2016, 17th International Society for Music Information Retrieval Conference, celebrada els dies 7 a 11 d'agost de 2016 a New York City., We present a study, carried out on 241 participants, which investigates on classical music material the agreement of listeners on perceptual music aspects (related to emotion, tempo, complexity, and instrumentation) and the relationship between listener characteristics and these aspects. For the currently popular task of music emotion recognition, the former question is particularly important when defining a ground truth of emotions perceived in a given music collection. We characterize listeners via a range of factors, including demographics, musical inclination, experience, and education, and personality traits. Participants rate the music material under investigation, i.e., 15 expert-defined segments of Beethoven’s 3rd symphony, “Eroica”, in terms of 10 emotions, perceived tempo, complexity, and number of instrument groups. Our study indicates only slight agreement on most perceptual aspects, but significant correlations between several listener characteristics and perceptual qualities., This research is supported by the Austrian Science Fund (FWF): P25655 and was made possible by the EU FP7 project no. 601166 (“PHENICX”).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A comparison of melody extraction methods based on source-filter modelling

  • Bosch, Juan J.
  • Bittner, Rachel M.
  • Salamon, Justin
  • Gómez Gutiérrez, Emilia, 1975-
This work explores the use of source-filter models for pitch/nsalience estimation and their combination with different/npitch tracking and voicing estimation methods for automatic/nmelody extraction. Source-filter models are used/nto create a mid-level representation of pitch that implicitly/nincorporates timbre information. The spectrogram of/na musical audio signal is modelled as the sum of the leading/nvoice (produced by human voice or pitched musical instruments)/nand accompaniment. The leading voice is then/nmodelled with a Smoothed Instantaneous Mixture Model/n(SIMM) based on a source-filter model. The main advantage/nof such a pitch salience function is that it enhances/nthe leading voice even without explicitly separating it from/nthe rest of the signal. We show that this is beneficial/nfor melody extraction, increasing pitch estimation accuracy/nand reducing octave errors in comparison with simpler/npitch salience functions. The adequate combination with/nvoicing detection techniques based on pitch contour characterisation/nleads to significant improvements over stateof-the-art/nmethods, for both vocal and instrumental music., This work is partially supported by the European Union/nunder the PHENICX project (FP7-ICT-601166) and the/nSpanish Ministry of Economy and Competitiveness under/nCASAS project (TIN2015-70816-R) and Maria de Maeztu/nUnits of Excellence Programme (MDM-2015-0502)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Becoming the maestro - A game to enhance curiosity for classical music

  • Sarasúa Berodia, Álvaro
  • Melenhorst, Mark
  • Fernandez Julià, Carles, 1984-
  • Gómez Gutiérrez, Emilia, 1975-
Comunicació presentada a la 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), celebrada els dies 7 a 9 de setembre de 2016 a Barcelona, Espanya., Classical music is associated with a set of social and cognitive barriers that prevent potentially interested novice classical music listeners from attending concerts. The possible strategies to overcome these barriers and make the genre appealing to new audiences are diverse. In this paper, we present Becoming the Maestro, a game where users impersonate the conductor of an orchestra during a concert in a way that allows them to better understand musical concepts of symphonic music. A user study of the game prototype with 20 subjects proved that the game succeeded in increasing curiosity for classical music., This research received funding from the European Union Seventh Framework Programme FP7 / 2007-2013 PHENICX project (grant agreement no. 601166).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Improving score-informed source separation for classical music through note refinement

  • Miron, Marius
  • Carabias Orti, Julio J.
  • Janer Mestres, Jordi
Comunicació presentada a la 16th International Society for Music Information Retrieval Conference (ISMIR 2015), celebrada els dies 26 a 30 d'octubre de 2015 a Màlaga, Espanya., Signal decomposition methods such as Non-negative Matrix Factorization (NMF) demonstrated to be a suitable approach for music signal processing applications, including sound source separation. To better control this decomposition, NMF has been extended using prior knowledge and parametric models. In fact, using score information considerably improved separation results. Nevertheless, one of the main problems of using score information is the misalignment between the score and the actual performance. A potential solution to this problem is the use of audio to score alignment systems. However, most of them rely on a tolerance window that clearly affects the separation results. To overcome this problem, we propose a novel method to refine the aligned score at note level by detecting both, onset and offset for each note present in the score. Note refinement is achieved by detecting shapes and contours in the estimated instrument-wise time activation (gains) matrix. Decomposition is performed in a supervised way, using training instrument models and coarsely-aligned score information. The detected contours define time-frequency note boundaries, and they increase the sparsity. Finally, we have evaluated our method for informed source separation using a dataset of Bach chorales obtaining satisfactory results, especially in terms of SIR., This work was supported by the European Commission, FP7 (Seventh Framework Programme), STREP project, ICT- 2011.8.2 ICT for access to cultural resources, grant agreement No 601166. Phenicx Project
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Melody extraction based on a source-filter model using pitch contour selection

  • Bosch, Juan J.
  • Gómez Gutiérrez, Emilia, 1975-
This work proposes a melody extraction method which combines a pitch salience function based on source-filter modelling with melody tracking based on pitch contour selection. We model the spectrogram of a musical audio signal as the sum of the leading voice and accompaniment. The leading voice is modelled with a Smoothed Instantaneous Mixture Model (SIMM), and the accompaniment is modelled with a Non-negative Matrix Factorization (NMF). The main benefit of this representation is that it incorporates timbre information, and that the leading voice is enhanced, even without an explicit separation from the rest of the signal. Two different salience functions based on SIMM are proposed, in order to adapt the output of such model to the pitch contour based tracking. Candidate melody pitch contours are then created by grouping pitch sequences, using auditory streaming cues. Finally, melody pitch contours are selected using a set of heuristic rules based on contour characteristics and smoothness constraints. The evaluation on a large set of challenging polyphonic music material, shows that the proposed salience functions help increasing the salience of melody pitches in comparison to similar methods. The complete melody extraction methods also achieve a higher overall accuracy than state-of-the-art approaches when evaluated on both vocal and instrumental music., This work is partially supported by the European Union under the PHENICX project (FP7-ICT-601166) and the Spanish Ministry of Economy and Competitiveness under CASAS project (TIN2015-70816-R) and Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

What is the effect of audio quality on the robustness of MFCCs and chroma features?

  • Urbano, Julián
  • Bogdanov, Dmitry
  • Herrera Boyer, Perfecto, 1964-
  • Gómez Gutiérrez, Emilia, 1975-
  • Serra, Xavier
Music Information Retrieval is largely based on descriptors computed from audio signals, and in many practical applications they are to be computed on music corpora containing audio files encoded in a variety of lossy formats. Such encodings distort the original signal and therefore may affect the computation of descriptors. This raises the question of the robustness of these descriptors across various audio encodings. We examine this assumption for the case of MFCCs and chroma features. In particular, we analyze their robustness to sampling rate, codec, bitrate, frame size and music genre. Using two different audio analysis tools over a diverse collection of music tracks, we compute several statistics to quantify the robustness of the resulting descriptors, and then estimate the practical effects for a sample task like genre classification., This work is partially supported by an A4U postdoctoral grant and projects SIGMUS (TIN2012-36650), Comp- Music (ERC 267583), PHENICX (ICT-2011.8.2) and GiantSteps (ICT-2013-10).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A personality-based adaptive system for visualizing classical music performances

  • Schedl, Markus
  • Melenhorst, Mark
  • Liem, Cynthia C. S.
  • Martorell Domínguez, Agustín
  • Mayor, Oscar
  • Tkalčič, Marko
To enhance the experience of listening to classical orchestra music, either in the concert hall or at home, we present a personalized system that integrates three visualization/interaction concepts: Score Follower (points to the current position in the score), Orchestra Layout (illustrates instruments that are currently playing and their dynamics), and Structure Visualization (visualizes structural elements such as themes or motifs). Motivated by previous literature that found evidence for connections between personality and music consumption and preference, we first assessed in a user study to which extent personality traits and music visualization preferences correlate. Measuring preference via pragmatic quality and personality traits according to the Big Five Inventory (BFI) questionnaire, we found substantial interconnections between them. These translate into rules relating certain personality traits (e.g., extraversion or agreeableness) to preference rankings of the visualizations. In the proposed personality-based system, users are grouped into four clusters according to their answers to the most significant personality questions determined in the study. The order of the visualizations for a given user is adapted with respect to the ranking preferred by other users in the same cluster. Evaluation of the system was carried out by a second user study that showed a significantly higher normalized discounted cumulative gain (NDCG) for the personalized system in comparison to a system with randomized order of the visualizations., This work is supported by the EU FP7-ICT-2011-9 project 601166 (“PHENICX”) and the Austrian Science Fund (FWF): P25655.