Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 16
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the interrelation between listener characteristics and the perception of emotion in classical orchestra music

  • Schedl, Markus
  • Gómez Gutiérrez, Emilia, 1975-
  • Trent, Erika S.
  • Tkalčič, Marko
  • Eghbal-Zadeh, Hamid
  • Martorell Domínguez, Agustín
This study deals with the strong relationship between emotions and music, investigating three main research questions: (RQ1) Are there differences in human music perception (e.g., emotions, tempo, instrumentation, and complexity), according to musical education, experience, demographics, and personality traits?; (RQ2) Do certain perceived music characteristics correlate (e.g., tension and sadness), irrespective of a particular listener's background or personality?; (RQ3) Does human perception of music characteristics, such as emotions and tempo, correlate with descriptors extracted from music audio signals? To investigate our research questions, we conducted two user studies focusing on different groups of subjects. We used web-based surveys to collect information about demographics, listening habits, musical education, personality, and perceptual ratings with respect to perceived emotions, tempo, complexity, and instrumentation for 15 segments of Beethoven's 3rd symphony, “Eroica”. Our experiments showed that all three research questions can be affirmed, at least partly. We found strong support for RQ2 and RQ3, while RQ1 could be confirmed only for some perceptual aspects and user groups., This research is supported by the EU-FP7 project no. 601166 (“PHENICX”), the Austrian Science Fund (FWF): P25655 and the Spanish Government (CASAS project TIN2015-70816-R).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Evaluation and combination of pitch estimation methods for melody extraction in symphonic classical music

  • Bosch, Juan J.
  • Marxer Piñón, Ricard
  • Gómez Gutiérrez, Emilia, 1975-
The extraction of pitch information is arguably one of the most important tasks in automatic music description systems. However, previous research and evaluation datasets dealing with pitch estimation focused on relatively limited kinds of musical data. This work aims to broaden this scope by addressing symphonic western classical music recordings, focusing on pitch estimation for melody extraction. This material is characterized by a high number of overlapping sources, and by the fact that the melody may be played by different instrumental sections, often alternating within an excerpt. We evaluate the performance of eleven state-of-the-art pitch salience functions, multipitch estimation and melody extraction algorithms when determining the sequence of pitches corresponding to the main melody in a varied set of pieces. An important contribution of the present study is the proposed evaluation framework, including the annotation methodology, generated dataset and evaluation metrics. The results show that the assumptions made by certain methods hold better than others when dealing with this type of music signal, leading to a better performance. Additionally, we propose a simple method for combining the output of several algorithms, with promising results., This work is supported by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project (grant agreement no. 601166). This work is also (partly) supported by the Spanish Ministry of Economy and Competitiveness/nunder the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Towards concurrent multi-tasking in shareable interfaces

  • Fernandez Julià, Carles, 1984-
  • Jordà Puig, Sergi
Shareable interfaces, those that can be interacted simultaneously by several users, are a common tool used both in CSCW research and in real world applications. They tend however to lack a capability that has been traditionally relevant to the usefulness of computing systems: multi-tasking. In this paper we explain why a combination of the multi-user features of shareable interfaces and the multi-tasking capabilities of general-purpose computing, could be relevant for building useful systems, and why these features are not present today in most of the current prototypes and systems. We also discuss possible approaches for solving the problems that prevent shareable interfaces to fully support multi-tasking, and we present a novel approach based on a distributed, application-centered, content-based gesture disambiguation. We describe how an already existing framework, GestureAgents, implements this new approach, focusing on expanding the description of the relevant elements related to this problem, and conclude with some example applications and a discussion., The research leading to these results has received funding from the European Union Seventh Framework Programme FP7 / 2007–2013 through PHENICX project under grant agreement n° 601166.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Music information retrieval: recent developments and applications

  • Schedl, Markus
  • Gómez Gutiérrez, Emilia, 1975-
  • Urbano, Julián
We provide a survey of the field of Music Information Retrieval (MIR), in particular paying attention to latest developments, such as semantic auto-tagging and user-centric retrieval and recommendation approaches. We first elaborate on well-established and proven methods for feature extraction and music indexing, from both the audio signal and contextual data sources about music items, such as web pages or collaborative tags. These in turn enable a wide variety of music retrieval tasks, such as semantic music search or music identification (“query by example”). Subsequently, we review current work on user analysis and modeling in the context of music recommendation and retrieval, addressing the recent trend towards user-centric and adaptive approaches and systems. A discussion follows about the important aspect of how various MIR approaches to different problems are evaluated and compared. Eventually, a discussion about the major open challenges concludes the survey., This work is supported by the Austrian Science Fund (FWF): P22856 and P25655, as well as by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project under grant agreement no. 601166, the A4U postdoctoral grants programme, and the Junta of Andalusia through the COFLA2 project (P12-TIC-1362). The authors would further like to thank Masataka Goto, Mohamed Sordo, and Edith Law for granting permission to include their visual material in this survey, and Juan J. Bosch for his comments on the manuscript. Furthermore, the authors would like to express their gratitude to the anonymous reviewers for their highly valuable suggestions for improving the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Enriched multimodal representations of music performances: online access and visualization

  • Maestre Gómez, Esteban
  • Papiotis, Panagiotis, 1985-
  • Marchini, Marco, 1984-
  • Llimona Torras, Quim
  • Mayor, Oscar
  • Pérez Carrillo, Alfonso Antonio, 1977-
  • Wanderley, Marcelo
The authors provide a first-person outlook on the technical challenges involved in the recording, analysis, archiving, and cloud-based interchange of multimodal string quartet performance data as part of a collaborative research project on ensemble music making. To facilitate the sharing of their own collection of multimodal recordings and extracted descriptors and annotations, they developed a hosting platform through which multimodal data (audio, video, motion capture, and derived signals) can be stored, visualized, annotated, and selectively retrieved via a web interface and a dedicated API. This article offers a twofold contribution: the authors open their collection of enriched multimodal recordings, the Quartet dataset, to the community, and they introduce and enable access to their multimodal data exchange platform and web application, the Repovizz system. This article is part of a special issue on multimedia technologies for enriched music., This work was partially funded by the EU FP7 project numbers 250026 (SIEMPRE) and 601166 (PHENICX), the EU Marie Curie Integration Grant PIOF-GA-2012-331270, and the AGAUR Catalan Public Funding Agency. Moreover, the authors thank the BRAMS Laboratory and the contributions by Erika Donald, Marcello Giordano, Carolina B. Medeiros, Marina Azón, Guillermo Navarro, and Jordi Llop.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Mapping by observation: building a user-tailored conducting system from spontaneous movements

  • Sarasúa Berodia, Álvaro
  • Urbano, Julián
  • Gómez Gutiérrez, Emilia, 1975-
Metaphors are commonly used in interface design within Human-Computer Interaction (HCI). Interface metaphors provide users with a way to interact with the computer that resembles a known activity, giving instantaneous knowledge or intuition about how the interaction works. A widely used one in Digital Musical Instruments (DMIs) is the conductor-orchestra metaphor, where the orchestra is considered as an instrument controlled by the movements of the conductor. We propose a DMI based on the conductor metaphor that allows to control tempo and dynamics and adapts its mapping specifically for each user by observing spontaneous conducting movements (i.e., movements performed on top of fixed music without any instructions). We refer to this as mapping by observation given that, even though the system is trained specifically for each user, this training is not done explicitly and consciously by the user. More specifically, the system adapts its mapping based on the tendency of the user to anticipate or fall behind the beat and observing the Motion Capture descriptors that best correlate to loudness during spontaneous conducting. We evaluate the proposed system in an experiment with twenty four (24) participants where we compare it with a baseline that does not perform this user-specific adaptation. The comparison is done in a context where the user does not receive instructions and, instead, is allowed to discover by playing. We evaluate objective and subjective measures from tasks where participants have to make the orchestra play at different loudness levels or in synchrony with a metronome. Results of the experiment prove that the usability of the system that automatically learns its mapping from spontaneous movements is better both in terms of providing a more intuitive control over loudness and a more precise control over beat timing. Interestingly, the results also show a strong correlation between measures taken from the data used for training and the improvement introduced by the adapting system. This indicates that it is possible to estimate in advance how useful the observation of spontaneous movements is to build user-specific adaptations. This opens interesting directions for creating more intuitive and expressive DMIs, particularly in public installations., This work was supported by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project (grant agreement no. 601166) and by the CASAS project (TIN2015-70816-R).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Hierarchical multi-scale set-class analysis

  • Martorell Domínguez, Agustín
  • Gómez Gutiérrez, Emilia, 1975-
This work presents a systematic methodology for set-class surface analysis using temporal multi-scale techniques. The method extracts the set-class content of all the possible temporal segments, addressing the representational problems derived from the massive overlapping of segments. A time versus time-scale representation, named class-scape, provides a global hierarchical overview of the class content in the piece, and it serves as a visual index for interactive inspection. Additional data structures summarize the set-class inclusion relations over time and quantify the class and subclass content in pieces or collections, helping to decide about sets of analytical interest. Case studies include the comparative subclass characterization of diatonicism in Victoria's masses (in Ionian mode) and Bach's preludes and fugues (in major mode), as well as the structural analysis of Webern's Variations for piano op. 27, under different class-equivalences., This work was supported by the EU Seventh Framework Programme FP7/2007-2013 through PHENICX project [grant no. 601166].
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multi-feature beat tracking

  • Zapata González, José Ricardo
  • Davies, Matthew E. P.
  • Gómez Gutiérrez, Emilia, 1975-
A recent trend in the field of beat tracking for musical audio signals has been to explore techniques for measuring the level of agreement and disagreement between a committee of beat tracking algorithms. By using beat tracking evaluation methods to compare all pairwise combinations of beat tracker outputs, it has been shown that selecting the beat tracker which most agrees with the remainder of the committee, on a song-by-song basis, leads to improved performance which surpasses the accuracy of any individual beat tracker used on its own. In this paper we extend this idea towards presenting a single, standalone beat tracking solution which can exploit the benefit of mutual agreement without the need to run multiple separate beat tracking algorithms. In contrast to existing work, we re-cast the problem as one of selecting between the beat outputs resulting from a single beat tracking model with multiple, diverse input features. Through extended evaluation on a large annotated database, we show that our multi-feature beat tracker can outperform the state of the art, and thereby demonstrate that there is sufficient diversity in input features for beat tracking, without the need for multiple tracking models., This work was supported in part by the R+I+D Ph.D. scholarship of Universidad Pontificia Bolivariana and Colciencias (Colombia), the projects of the Spanish Ministry of Science and Innovation DRIMS (MICINN-TIN2009-14247-C02-01), SIGMUS (MINECO-TIN2012-36650) and Mires (EC-7PM-MIReS), and in part by the Media Arts and Technologies project (MAT), NORTE-07-0124-FEDER-000061, financed by the North Portugal Regional Operational Programme (ON.2 O Novo Norte), under the National Strategic Reference Framework (NSRF), through the European Regional Development Fund (ERDF) by national funds, through the Portuguese funding agency, Fundação para a Ciência e a Tecnologia (FCT), the FCT post-doctoral grant (SFRH/BPD/88722/2012), the PHENICX (EU: FP7 2007/2013 grant agreement n 601166) and COFLA (Junta de Andaluca P09-TIC-4840) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Hierarchical multi-scale set-class analysis

  • Martorell Domínguez, Agustín
  • Gómez Gutiérrez, Emilia, 1975-
This work presents a systematic methodology for set-class surface analysis using temporal multi-scale techniques. The method extracts the set-class content of all the possible temporal segments, addressing the representational problems derived from the massive overlapping of segments. A time versus time-scale representation, named class-scape, provides a global hierarchical overview of the class content in the piece, and it serves as a visual index for interactive inspection. Additional data structures summarize the set-class inclusion relations over time and quantify the class and subclass content in pieces or collections, helping to decide about sets of analytical interest. Case studies include the comparative subclass characterization of diatonicism in Victoria's masses (in Ionian mode) and Bach's preludes and fugues (in major mode), as well as the structural analysis of Webern's Variations for piano op. 27, under different class-equivalences., This work was supported by the EU Seventh Framework Programme FP7/2007-2013 through PHENICX project [grant no. 601166].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Enriched multimodal representations of music performances: online access and visualization

  • Maestre Gómez, Esteban
  • Papiotis, Panagiotis, 1985-
  • Marchini, Marco, 1984-
  • Llimona Torras, Quim
  • Mayor, Oscar
  • Pérez Carrillo, Alfonso Antonio, 1977-
  • Wanderley, Marcelo
The authors provide a first-person outlook on the technical challenges involved in the recording, analysis, archiving, and cloud-based interchange of multimodal string quartet performance data as part of a collaborative research project on ensemble music making. To facilitate the sharing of their own collection of multimodal recordings and extracted descriptors and annotations, they developed a hosting platform through which multimodal data (audio, video, motion capture, and derived signals) can be stored, visualized, annotated, and selectively retrieved via a web interface and a dedicated API. This article offers a twofold contribution: the authors open their collection of enriched multimodal recordings, the Quartet dataset, to the community, and they introduce and enable access to their multimodal data exchange platform and web application, the Repovizz system. This article is part of a special issue on multimedia technologies for enriched music., This work was partially funded by the EU FP7 project numbers 250026 (SIEMPRE) and 601166 (PHENICX), the EU Marie Curie Integration Grant PIOF-GA-2012-331270, and the AGAUR Catalan Public Funding Agency. Moreover, the authors thank the BRAMS Laboratory and the contributions by Erika Donald, Marcello Giordano, Carolina B. Medeiros, Marina Azón, Guillermo Navarro, and Jordi Llop.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-feature beat tracking

  • Zapata González, José Ricardo
  • Davies, Matthew E. P.
  • Gómez Gutiérrez, Emilia, 1975-
A recent trend in the field of beat tracking for musical audio signals has been to explore techniques for measuring the level of agreement and disagreement between a committee of beat tracking algorithms. By using beat tracking evaluation methods to compare all pairwise combinations of beat tracker outputs, it has been shown that selecting the beat tracker which most agrees with the remainder of the committee, on a song-by-song basis, leads to improved performance which surpasses the accuracy of any individual beat tracker used on its own. In this paper we extend this idea towards presenting a single, standalone beat tracking solution which can exploit the benefit of mutual agreement without the need to run multiple separate beat tracking algorithms. In contrast to existing work, we re-cast the problem as one of selecting between the beat outputs resulting from a single beat tracking model with multiple, diverse input features. Through extended evaluation on a large annotated database, we show that our multi-feature beat tracker can outperform the state of the art, and thereby demonstrate that there is sufficient diversity in input features for beat tracking, without the need for multiple tracking models., This work was supported in part by the R+I+D Ph.D. scholarship of Universidad Pontificia Bolivariana and Colciencias (Colombia), the projects of the Spanish Ministry of Science and Innovation DRIMS (MICINN-TIN2009-14247-C02-01), SIGMUS (MINECO-TIN2012-36650) and Mires (EC-7PM-MIReS), and in part by the Media Arts and Technologies project (MAT), NORTE-07-0124-FEDER-000061, financed by the North Portugal Regional Operational Programme (ON.2 O Novo Norte), under the National Strategic Reference Framework (NSRF), through the European Regional Development Fund (ERDF) by national funds, through the Portuguese funding agency, Fundação para a Ciência e a Tecnologia (FCT), the FCT post-doctoral grant (SFRH/BPD/88722/2012), the PHENICX (EU: FP7 2007/2013 grant agreement n 601166) and COFLA (Junta de Andaluca P09-TIC-4840) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Mapping by observation: building a user-tailored conducting system from spontaneous movements

  • Sarasúa Berodia, Álvaro
  • Urbano, Julián
  • Gómez Gutiérrez, Emilia, 1975-
Metaphors are commonly used in interface design within Human-Computer Interaction (HCI). Interface metaphors provide users with a way to interact with the computer that resembles a known activity, giving instantaneous knowledge or intuition about how the interaction works. A widely used one in Digital Musical Instruments (DMIs) is the conductor-orchestra metaphor, where the orchestra is considered as an instrument controlled by the movements of the conductor. We propose a DMI based on the conductor metaphor that allows to control tempo and dynamics and adapts its mapping specifically for each user by observing spontaneous conducting movements (i.e., movements performed on top of fixed music without any instructions). We refer to this as mapping by observation given that, even though the system is trained specifically for each user, this training is not done explicitly and consciously by the user. More specifically, the system adapts its mapping based on the tendency of the user to anticipate or fall behind the beat and observing the Motion Capture descriptors that best correlate to loudness during spontaneous conducting. We evaluate the proposed system in an experiment with twenty four (24) participants where we compare it with a baseline that does not perform this user-specific adaptation. The comparison is done in a context where the user does not receive instructions and, instead, is allowed to discover by playing. We evaluate objective and subjective measures from tasks where participants have to make the orchestra play at different loudness levels or in synchrony with a metronome. Results of the experiment prove that the usability of the system that automatically learns its mapping from spontaneous movements is better both in terms of providing a more intuitive control over loudness and a more precise control over beat timing. Interestingly, the results also show a strong correlation between measures taken from the data used for training and the improvement introduced by the adapting system. This indicates that it is possible to estimate in advance how useful the observation of spontaneous movements is to build user-specific adaptations. This opens interesting directions for creating more intuitive and expressive DMIs, particularly in public installations., This work was supported by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project (grant agreement no. 601166) and by the CASAS project (TIN2015-70816-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Towards concurrent multi-tasking in shareable interfaces

  • Fernandez Julià, Carles, 1984-
  • Jordà Puig, Sergi
Shareable interfaces, those that can be interacted simultaneously by several users, are a common tool used both in CSCW research and in real world applications. They tend however to lack a capability that has been traditionally relevant to the usefulness of computing systems: multi-tasking. In this paper we explain why a combination of the multi-user features of shareable interfaces and the multi-tasking capabilities of general-purpose computing, could be relevant for building useful systems, and why these features are not present today in most of the current prototypes and systems. We also discuss possible approaches for solving the problems that prevent shareable interfaces to fully support multi-tasking, and we present a novel approach based on a distributed, application-centered, content-based gesture disambiguation. We describe how an already existing framework, GestureAgents, implements this new approach, focusing on expanding the description of the relevant elements related to this problem, and conclude with some example applications and a discussion., The research leading to these results has received funding from the European Union Seventh Framework Programme FP7 / 2007–2013 through PHENICX project under grant agreement n° 601166.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

On the interrelation between listener characteristics and the perception of emotion in classical orchestra music

  • Schedl, Markus
  • Gómez Gutiérrez, Emilia, 1975-
  • Trent, Erika S.
  • Tkalčič, Marko
  • Eghbal-Zadeh, Hamid
  • Martorell Domínguez, Agustín
This study deals with the strong relationship between emotions and music, investigating three main research questions: (RQ1) Are there differences in human music perception (e.g., emotions, tempo, instrumentation, and complexity), according to musical education, experience, demographics, and personality traits?; (RQ2) Do certain perceived music characteristics correlate (e.g., tension and sadness), irrespective of a particular listener's background or personality?; (RQ3) Does human perception of music characteristics, such as emotions and tempo, correlate with descriptors extracted from music audio signals? To investigate our research questions, we conducted two user studies focusing on different groups of subjects. We used web-based surveys to collect information about demographics, listening habits, musical education, personality, and perceptual ratings with respect to perceived emotions, tempo, complexity, and instrumentation for 15 segments of Beethoven's 3rd symphony, “Eroica”. Our experiments showed that all three research questions can be affirmed, at least partly. We found strong support for RQ2 and RQ3, while RQ1 could be confirmed only for some perceptual aspects and user groups., This research is supported by the EU-FP7 project no. 601166 (“PHENICX”), the Austrian Science Fund (FWF): P25655 and the Spanish Government (CASAS project TIN2015-70816-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Evaluation and combination of pitch estimation methods for melody extraction in symphonic classical music

  • Bosch, Juan J.
  • Marxer Piñón, Ricard
  • Gómez Gutiérrez, Emilia, 1975-
The extraction of pitch information is arguably one of the most important tasks in automatic music description systems. However, previous research and evaluation datasets dealing with pitch estimation focused on relatively limited kinds of musical data. This work aims to broaden this scope by addressing symphonic western classical music recordings, focusing on pitch estimation for melody extraction. This material is characterized by a high number of overlapping sources, and by the fact that the melody may be played by different instrumental sections, often alternating within an excerpt. We evaluate the performance of eleven state-of-the-art pitch salience functions, multipitch estimation and melody extraction algorithms when determining the sequence of pitches corresponding to the main melody in a varied set of pieces. An important contribution of the present study is the proposed evaluation framework, including the annotation methodology, generated dataset and evaluation metrics. The results show that the assumptions made by certain methods hold better than others when dealing with this type of music signal, leading to a better performance. Additionally, we propose a simple method for combining the output of several algorithms, with promising results., This work is supported by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project (grant agreement no. 601166). This work is also (partly) supported by the Spanish Ministry of Economy and Competitiveness/nunder the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Music information retrieval: recent developments and applications

  • Schedl, Markus
  • Gómez Gutiérrez, Emilia, 1975-
  • Urbano, Julián
We provide a survey of the field of Music Information Retrieval (MIR), in particular paying attention to latest developments, such as semantic auto-tagging and user-centric retrieval and recommendation approaches. We first elaborate on well-established and proven methods for feature extraction and music indexing, from both the audio signal and contextual data sources about music items, such as web pages or collaborative tags. These in turn enable a wide variety of music retrieval tasks, such as semantic music search or music identification (“query by example”). Subsequently, we review current work on user analysis and modeling in the context of music recommendation and retrieval, addressing the recent trend towards user-centric and adaptive approaches and systems. A discussion follows about the important aspect of how various MIR approaches to different problems are evaluated and compared. Eventually, a discussion about the major open challenges concludes the survey., This work is supported by the Austrian Science Fund (FWF): P22856 and P25655, as well as by the European Union Seventh Framework Programme FP7 / 2007-2013 through the PHENICX project under grant agreement no. 601166, the A4U postdoctoral grants programme, and the Junta of Andalusia through the COFLA2 project (P12-TIC-1362). The authors would further like to thank Masataka Goto, Mohamed Sordo, and Edith Law for granting permission to include their visual material in this survey, and Juan J. Bosch for his comments on the manuscript. Furthermore, the authors would like to express their gratitude to the anonymous reviewers for their highly valuable suggestions for improving the manuscript.