Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 26
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Rāga Recognition based on Pitch Distribution Methods

  • Koduri, Gopala Krishna
  • Gulati, Sankalp
  • Rao, Preeti
  • Serra, Xavier
  • Serra, Xavier
Rāga forms the melodic framework for most of the music of the Indian subcontinent. Thus automatic rāga recognition is a fundamental step in the computational modeling of the Indian art-music traditions. In this work, we investigate the properties of rāga and the natural processes by which people identify it. We bring together and discuss the previous computational approaches to rāga recognition correlating them with human techniques, in both Karṇāṭak (south Indian) and Hindustānī (north Indian) music traditions. Thee approaches which are based on first-order pitch distributions are further evaluated on a large comprehensive dataset to understand their merits and limitations. We outline the possible short and mid-term future directions in this line of work., This research was partly funded by the European Research Council under the European Union's Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The computational study of a musical culture through its digital traces

  • Serra, Xavier
From most musical cultures there are digital traces, digital artifacts, that can be processed and studied computationally, and this has been the focus of computational musicology already for several decades. This type of research requires clear formalizations and some simplifications, for example, by considering that a musical culture can be conceptualized as a system of interconnected entities. A musician, an instrument, a performance, or a melodic motive, are examples of entities and they are linked by various types of relationships. We then need adequate digital traces of the entities, for example, a textual description can be a useful trace of a musician and a recording one of a performance. The analytical study of these entities and of their interactions is accomplished by processing the digital traces and by generating mathematical representations and models of them. But a more ambitious goal, however, is to go beyond the study of individual artifacts and analyze the overall system of interconnected entities in order to model a musical culture as a whole. The reader might think that this is science fiction, and he or she might be right, but there is research trying to make advances in this direction. In this article I undertake an overview the state-of-the-art related to this type of research, identifying current challenges, describing computational methodologies being developed, and summarizing musicologically relevant results of such research. In particular, I review the work done within CompMusic, a project in which my colleagues and I have developed audio signal processing, machine learning, and semantic web methodologies to study several musical cultures., The CompMusic project has been funded by the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013) / ERC grant agreement 267583.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Automatic tonic identification in Indian art music: approaches and evaluation

  • Gulati, Sankalp
  • Bellur, Ashwin
  • Salamon, Justin
  • Ranjani, H. G.
  • Ishwar, Vignesh
  • Murthy, Hema A.
  • Serra, Xavier
The tonic is a fundamental concept in Indian art music. It is the base pitch, which an artist chooses in order to construct the melodies during a rāg(a) rendition, and all accompanying instruments are tuned using the tonic pitch. Consequently, tonic identification is a fundamental task for most computational analyses of Indian art music, such as intonation analysis, melodic motif analysis and rāg recognition. In this paper we review existing approaches for tonic identification in Indian art music and evaluate them on six diverse datasets for a thorough comparison and analysis. We study the performance of each method in different contexts such as the presence/absence of additional metadata, the quality of audio data, the duration of audio data, music tradition (Hindustani/Carnatic) and the gender of the singer (male/female). We show that the approaches that combine multi-pitch analysis with machine learning provide the best performance in most cases (90% identification accuracy on average), and are robust across the aforementioned contexts compared to the approaches based on expert knowledge. In addition, we also show that the performance of the latter can be improved when additional metadata is available to further constrain the problem. Finally, we present a detailed error analysis of each method, providing further insights into the advantages and limitations of the methods., This work is partly supported by the European Research Council/nunder the European Union’s Seventh Framework Program, as/npart of the CompMusic project (ERC grant agreement 267583).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Intonation analysis of rāgas in Carnatic music

  • Koduri, Gopala Krishna
  • Ishwar, Vignesh
  • Serrà Julià, Joan
  • Serra, Xavier
Intonation is a fundamental music concept that has a special relevance in Indian art music. It is characteristic of a rga and key to the musical expression of the artist. Describing intonation is of importance to several music information retrieval tasks such as developing similarity measures based on rgas and artists. In this paper, we first assess rga intonation qualitatively by analysing varṇaṁs, a particular form of Carnatic music compositions. We then approach the task of automatically obtaining a compact representation of the intonation of a recording from its pitch track. We propose two approaches based on the parametrization of pitch-value distributions: performance pitch histograms, and context-based svara distributions obtained by categorizing pitch contours based on the melodic context. We evaluate both approaches on a large Carnatic music collection and discuss their merits and limitations. We finally go through different kinds of contextual information that can be obtained to further improve the two approaches., This research was partly funded by the European Research Council/nunder the European Union’s Seventh Framework/nProgram, as part of the CompMusic project (ERC grant agreement/n267583). J.S. acknowledges 2009-SGR-1434 fromGeneralitat/nde Catalunya, ICT-2011-8-318770 from the European Commission,/nJAEDOC069/2010 from CSIC, and European Social/nFunds.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Analysis of the impact of a tag recommendation system in a real-world folksonomy

  • Font Corbera, Frederic
  • Serrà Julià, Joan
  • Serra, Xavier
Collaborative tagging systems have emerged as a successful solution for annotating contributed resources to online sharing platforms, facilitating searching, browsing, and organizing their contents. To aid users in the annotation process, several tag recommendation methods have been proposed. It has been repeatedly hypothesized that these methods should contribute to improving annotation quality and reducing the cost of the annotation process. It has been also hypothesized that these methods should contribute to the consolidation of the vocabulary of collaborative tagging systems. However, to date, no empirical and quantitative result supports these hypotheses. In this work, we deeply analyze the impact of a tag recommendation system in the folksonomy of Freesound, a real-world and large-scale online sound sharing platform. Our results suggest that tag recommendation effectively increases vocabulary sharing among users of the platform. In addition, tag recommendation is shown to contribute to the convergence of the vocabulary as well as to a partial increase in the quality of annotations. However, according to our analysis, the cost of the annotation process does not seem to be effectively reduced. Our work is relevant to increase our understanding about the nature of tag recommendation systems and points to future directions for the further development of those systems and their analysis., This work has been supported by BES-2010-037309 FPI from the Spanish Ministry of Science and Innovation, TIN2009-14247-C02-01 from the Spanish government (F.F.), 2009-SGR-1434 from Generalitat de Catalunya (J.S.), JAEDOC069/2010 from CSIC (J.S.), FSE2007-2013 E. U. Social funds (J.S.), and FP7-2007-2013/ERC grant agreement 267583 (CompMusic; F.F. and X.S.).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A microtonal tuning method: test & discussion on the use of microtonal intervals for the performance of traditional Turkish music

  • Tamer, Yahya Burak
  • Bozkurt, Baris
Background in music computing: An automatic method for tuning analysis of recordings was presented in (Bozkurt 2008). Data collected from this method have been used to develop a new microtonal tuner system implemented in Max MSP and Java (Tamer and Bozkurt 2013). The distinctive quality of the tuning method (previously demonstrated in (Bozkurt 2012)) is the use of a recording as reference instead of theoretical presets. During the process, fundamental frequency analysis is performed and pitch distributions are obtained for the selected recordings. This data is visualized via the tuner interface along with the real-time frequency estimate from the input signal to realize the tuning operation. Background in music performance: Electronic tuner devices are widely used by musicians. However these devices offer only a limited number of theoretical presets and equal temperament is the primary one. Lack of consistency between tuning theory and its practice of Turkish makam music has been addressed in a number of studies such as (Ay and Akkal 2008; Bozkurt et al. 2009). In the general traditional Turkish music concept, when microtonal intervals are used, the question of how musicians interpret the theory and apply it into their tuning practices arises. Aims: We investigate the relevance of tuning practices applied by three selected musicians who perform traditional Turkish music with the authentic intervals used by master musicians in selected recordings. We present the microtonal tuner application in order to provide a basic research tool for musicians and ethnomusicologists. Main contribution: The manuscript presents the user tests carried out with three professional musicians who perform traditional Turkish music and discusses the outcomes. A semistructured interview method is applied in order to test the process with the musicians. The tests contain comparisons of performances with and without the aid of the microtonal tuner application, providing insight to the musicians’ regular tuning practices and discussing further possibilities on the use of the application. The tests include recordings by well-known Turkish master musicians who perform microtonal music as Turkish makam music (one example) and Turkish folk music (three examples). Implications: By offering a direct access to any tuning system used by a master musician that has been captured in a recording, the application presented in this paper is suitable to serve as a computational ethnomusicology (CE) tool, thus has the potential to assist in ethnomusicological research. (Tzanetakis et al. 2007)., This work was funded in part by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement 267583 (CompMusic).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Computational analysis of Turkish makam music: review of state-of-the-art and challenges

  • Bozkurt, Baris
  • Ayangil, Ruhi
  • Holzapfel, Andre
This text targets a review of the computational analysis literature for Turkish makam music, discussing in detail the challenges involved and presenting a perspective for further studies. For that purpose, the basic concepts of Turkish makam music and the description of melodic, rhythmic and timbral aspects are considered in detail. Studies on tuning analysis, automatic transcription, automatic melodic analysis, automatic makam and usul detection are reviewed. Technological and data resource needs for further advancement are discussed and available sources are presented., This work was funded by the European Research Council under the European Union’s Seventh Framework Pro-gramme (FP7/2007–2013)/ERC grant agreement 267583 (CompMusic).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Class-based tag recommendation and user-based evaluation in online audio clip sharing

  • Font Corbera, Frederic
  • Serrà Julià, Joan
  • Serra, Xavier
Online sharing platforms often rely on collaborative tagging systems for annotating content. In this way, users themselves annotate and describe the shared contents using textual labels, commonly called tags. These annotations typically suffer from a number of issues such as tag scarcity or ambiguous labelling. Hence, to minimise some of these issues, tag recommendation systems can be employed to suggest potentially relevant tags during the annotation process. In this work, we present a tag recommendation system and evaluate it in the context of an online platform for audio clip sharing. By exploiting domain-specific knowledge, the system we present is able to classify an audio clip among a number of predefined audio classes and to produce specific tag recommendations for the different classes. We perform an in-depth user-based evaluation of the recommendation method along with two baselines and a former version that we described in previous work. This user-based evaluation is further complemented with a prediction-based evaluation following standard information retrieval methodologies. Results show that the proposed tag recommendation method brings a statistically significant improvement over the previous method and the baselines. In addition, we report a number of findings based on the detailed analysis of user feedback provided during the evaluation process. The considered methods, when applied to real-world collaborative tagging systems, should serve the purpose of consolidating the tagging vocabulary and improving the quality of content annotations., This work has been supported by BES-2010-037309 FPI from the Spanish Ministry of Science and Innovation (TIN2009-14247-C02-01; F.F.), 2009-SGR-1434 from Generalitat de Catalunya (J.S.), JAEDOC069/2010 from CSIC (J.S.), ICT-2011-8-318770 from the European Commission (J.S.), and FP7-2007-2013/ERC Grant Agreement 267583 (CompMusic; F.F., X.S.).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Saraga: Open Datasets for Research on Indian Art Music

  • Srinivasamurthy, Ajay
  • Gulati, Sankalp
  • Caro Repetto, Rafael
  • Serra, Xavier
We introduce two large open data collections of Indian Art Music, both its Carnatic and Hindustani traditions, comprising audio from vocal concerts, editorial metadata, and time-aligned melody, rhythm, and structure annotations. Shared under Creative Commons licenses, they currently form the largest annotated data collections available for computational analysis of Indian Art Music. The collections are intended to provide audio and ground truth for several music information research tasks and large-scale data-driven analysis in musicological studies. A part of the Saraga Carnatic collection also has multitrack recordings, making it a valuable collection for research on melody extraction, source separation, automatic mixing, and performance analysis. We describe the tenets and the process of collection, annotation, and organization of the data. We provide easy access to the audio, metadata, and the annotations in the collections through an API, along with a companion website that has example scripts to facilitate access and use of the data. To sustain and grow the collections, we provide a mechanism for both the research and music community to contribute additional data and annotations to the collections. We also present applications with the collections for music education, understanding, exploration, and discovery., This work has been funded by the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013)/ERC grant agreement 267583, The CompMusic Project (http://compmusic.upf.edu).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Linking scores and audio recordings in makam music of Turkey

  • Sentürk, Sertan
  • Holzapfel, Andre
  • Serra, Xavier
The most relevant representations of music are notations and audio recordings, each of which emphasizes a particular perspective and promotes different approximations in the analysis and understanding of music. Linking these two representations and analysing them jointly should help to better study many musical facets by being able to combine complementary analysis methodologies. In order to develop accurate linking methods, we have to take into account the specificities of a given type of music. In this paper, we present a method for linking musically relevant sections in a score of a piece from makam music of Turkey (MMT) to the corresponding time intervals of an audio recording of the same piece. The method starts by extracting relevant features from the score and from the audio recording. The features of a given score section are compared with the features of the audio recording to find the candidate links in the audio for that score section. Next, using the sequential section information stored in the score, it selects the most likely links. The method is tested on a dataset consisting of instrumental and vocal compositions of MMT, achieving 92.1% and 96.9% -scores on the instrumental and vocal pieces, respectively. Our results show the importance of culture-specific and knowledge-based approaches in music information processing., This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

In search of automatic rhythm analysis methods for Turkish and Indian art music

  • Srinivasamurthy, Ajay
  • Holzapfel, Andre
  • Serra, Xavier
The aim of this paper is to identify and discuss various methods in computational rhythm description of Carnatic and Hindustani music of India, and Makam music of Turkey. We define and describe three relevant rhythm annotation tasks for these cultures—beat tracking, meter estimation, and downbeat detection. We then evaluate several methodologies from the state of the art in Music Information Retrieval (MIR) for these tasks, using manually annotated datasets of Turkish and Indian music. This evaluation provides insights into the nature of rhythm in these cultures and the challenges to automatic rhythm analysis. Our results indicate that the performance of evaluated approaches is not adequate for the presented tasks, and that methods that are suitable to tackle the culture specific challenges in computational analysis of rhythm need to be developed. The results from the different analysis methods enable us to identify promising directions for an appropriate exploration of rhythm analysis in Turkish, Carnatic and Hindustani music., This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Aspects of tempo and rhythmic elaboration in hindustani music: A corpus study

  • Srinivasamurthy, Ajay
  • Holzapfel, Andre
  • Ganguli, Kaustuv Kanti
  • Serra, Xavier
This article provides insights into aspects of tempo and rhythmic elaboration in Hindustani music, based on a study of a large corpus of recorded performances. Typical tempo developments and stress patterns within a metrical cycle are computed, which we refer to as tempo and rhythm patterns, respectively. Rhythm patterns are obtained by aggregating spectral features over metrical cycles. They reflect percussion patterns that are frequent in the corpus and enable a discussion of the relation between such patterns and the underlying metrical framework, the tal. Tempo patterns, on the other hand, are computed using reference beat annotations. They document the dynamic development of tempo throughout a metrical cycle and reveal insights into the flexibility of time in Hindustani music for the first time using quantitative methods on a large set of performances. Focusing on aspects of tempo and rhythm, we demonstrate the value of a computational methodology for the analysis of large music corpora by revealing the range of tempi used in performances, intra-cycle tempo dynamics and percussion accents at different positions of the tal cycle., This work is partly funded by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Class-based tag recommendation and user-based evaluation in online audio clip sharing

  • Font, Frederic
  • Serrà, Joan
  • Serra, Xavier
Online sharing platforms often rely on collaborative tagging systems for annotating content. In this way, users themselves annotate and describe the shared contents using textual labels, commonly called tags. These annotations typically suffer from a number of issues such as tag scarcity or ambiguous labelling. Hence, to minimise some of these issues, tag recommendation systems can be employed to suggest potentially relevant tags during the annotation process. In this work, we present a tag recommendation system and evaluate it in the context of an online platform for audio clip sharing. By exploiting domain-specific knowledge, the system we present is able to classify an audio clip among a number of predefined audio classes and to produce specific tag recommendations for the different classes. We perform an in-depth user-based evaluation of the recommendation method along with two baselines and a former version that we described in previous work. This user-based evaluation is further complemented with a prediction-based evaluation following standard information retrieval methodologies. Results show that the proposed tag recommendation method brings a statistically significant improvement over the previous method and the baselines. In addition, we report a number of findings based on the detailed analysis of user feedback provided during the evaluation process. The considered methods, when applied to real-world collaborative tagging systems, should serve the purpose of consolidating the tagging vocabulary and improving the quality of content annotations. © 2014 Elsevier B.V. All rights reserved., This work has been supported by BES-2010-037309 FPI from the Spanish Ministry of Science and Innovation (TIN2009-14247-C02-01; F.F.), 2009-SGR-1434 from Generalitat de Catalunya (J.S.), JAEDOC069/2010 from CSIC (J.S.), ICT-2011-8-318770 from the European Commission (J.S.), and FP7-2007-2013/ERC Grant Agreement 267583 (CompMusic; F.F., X.S.), Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Intonation Analysis of Rāgas in Carnatic Music

  • Koduri, Gopala K.
  • Ishwar, Vignesh
  • Serrà, Joan
  • Serra, Xavier
  • Murthy, Hema
Intonation is a fundamental music concept that has a special relevance in Indian art music. It is characteristic of a rga and key to the musical expression of the artist. Describing intonation is of importance to several music information retrieval tasks such as developing similarity measures based on rgas and artists. In this paper, we first assess rga intonation qualitatively by analysing varN{dot below}aṁs, a particular form of Carnatic music compositions. We then approach the task of automatically obtaining a compact representation of the intonation of a recording from its pitch track. We propose two approaches based on the parametrization of pitch-value distributions: performance pitch histograms, and context-based svara distributions obtained by categorizing pitch contours based on the melodic context. We evaluate both approaches on a large Carnatic music collection and discuss their merits and limitations. We finally go through different kinds of contextual information that can be obtained to further improve the two approaches. © 2014 Taylor & Francis., This research was partly funded by the European Research Council under the European Union's Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583). J.S. acknowledges 2009-SGR-1434 from Generalitat de Catalunya, ICT-2011-8-318770 from the European Commission, JAEDOC069/2010 from CSIC, and European Social Funds., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Analysis of the impact of a tag recommendation system in a real-world folksonomy

  • Font Corbera, Frederic
  • Serrà Julià, Joan
  • Serra, Xavier
Collaborative tagging systems have emerged as a successful solution for annotating contributed resources to online sharing platforms, facilitating searching, browsing, and organizing their contents. To aid users in the annotation process, several tag recommendation methods have been proposed. It has been repeatedly hypothesized that these methods should contribute to improving annotation quality and reducing the cost of the annotation process. It has been also hypothesized that these methods should contribute to the consolidation of the vocabulary of collaborative tagging systems. However, to date, no empirical and quantitative result supports these hypotheses. In this work, we deeply analyze the impact of a tag recommendation system in the folksonomy of Freesound, a real-world and large-scale online sound sharing platform. Our results suggest that tag recommendation effectively increases vocabulary sharing among users of the platform. In addition, tag recommendation is shown to contribute to the convergence of the vocabulary as well as to a partial increase in the quality of annotations. However, according to our analysis, the cost of the annotation process does not seem to be effectively reduced. Our work is relevant to increase our understanding about the nature of tag recommendation systems and points to future directions for the further development of those systems and their analysis., This work has been supported by BES-2010-037309 FPI from the Spanish Ministry of Science and Innovation, TIN2009-14247-C02-01 from the Spanish government (F.F.), 2009-SGR-1434 from Generalitat de Catalunya (J.S.), JAEDOC069/2010 from CSIC (J.S.), FSE2007-2013 E. U. Social funds (J.S.), and FP7-2007-2013/ERC grant agreement 267583 (CompMusic; F.F. and X.S.).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The computational study of a musical culture through its digital traces

  • Serra, Xavier
From most musical cultures there are digital traces, digital artifacts, that can be processed and studied computationally, and this has been the focus of computational musicology already for several decades. This type of research requires clear formalizations and some simplifications, for example, by considering that a musical culture can be conceptualized as a system of interconnected entities. A musician, an instrument, a performance, or a melodic motive, are examples of entities and they are linked by various types of relationships. We then need adequate digital traces of the entities, for example, a textual description can be a useful trace of a musician and a recording one of a performance. The analytical study of these entities and of their interactions is accomplished by processing the digital traces and by generating mathematical representations and models of them. But a more ambitious goal, however, is to go beyond the study of individual artifacts and analyze the overall system of interconnected entities in order to model a musical culture as a whole. The reader might think that this is science fiction, and he or she might be right, but there is research trying to make advances in this direction. In this article I undertake an overview the state-of-the-art related to this type of research, identifying current challenges, describing computational methodologies being developed, and summarizing musicologically relevant results of such research. In particular, I review the work done within CompMusic, a project in which my colleagues and I have developed audio signal processing, machine learning, and semantic web methodologies to study several musical cultures., The CompMusic project has been funded by the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013) / ERC grant agreement 267583.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Rāga Recognition based on Pitch Distribution Methods

  • Koduri, Gopala Krishna
  • Gulati, Sankalp
  • Rao, Preeti
  • Serra, Xavier
  • Serra, Xavier
Rāga forms the melodic framework for most of the music of the Indian subcontinent. Thus automatic rāga recognition is a fundamental step in the computational modeling of the Indian art-music traditions. In this work, we investigate the properties of rāga and the natural processes by which people identify it. We bring together and discuss the previous computational approaches to rāga recognition correlating them with human techniques, in both Karṇāṭak (south Indian) and Hindustānī (north Indian) music traditions. Thee approaches which are based on first-order pitch distributions are further evaluated on a large comprehensive dataset to understand their merits and limitations. We outline the possible short and mid-term future directions in this line of work., This research was partly funded by the European Research Council under the European Union's Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Automatic tonic identification in Indian art music: approaches and evaluation

  • Gulati, Sankalp
  • Bellur, Ashwin
  • Salamon, Justin
  • Ranjani, H. G.
  • Ishwar, Vignesh
  • Murthy, Hema A.
  • Serra, Xavier
The tonic is a fundamental concept in Indian art music. It is the base pitch, which an artist chooses in order to construct the melodies during a rāg(a) rendition, and all accompanying instruments are tuned using the tonic pitch. Consequently, tonic identification is a fundamental task for most computational analyses of Indian art music, such as intonation analysis, melodic motif analysis and rāg recognition. In this paper we review existing approaches for tonic identification in Indian art music and evaluate them on six diverse datasets for a thorough comparison and analysis. We study the performance of each method in different contexts such as the presence/absence of additional metadata, the quality of audio data, the duration of audio data, music tradition (Hindustani/Carnatic) and the gender of the singer (male/female). We show that the approaches that combine multi-pitch analysis with machine learning provide the best performance in most cases (90% identification accuracy on average), and are robust across the aforementioned contexts compared to the approaches based on expert knowledge. In addition, we also show that the performance of the latter can be improved when additional metadata is available to further constrain the problem. Finally, we present a detailed error analysis of each method, providing further insights into the advantages and limitations of the methods., This work is partly supported by the European Research Council/nunder the European Union’s Seventh Framework Program, as/npart of the CompMusic project (ERC grant agreement 267583).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Computational analysis of Turkish makam music: review of state-of-the-art and challenges

  • Bozkurt, Baris
  • Ayangil, Ruhi
  • Holzapfel, Andre
This text targets a review of the computational analysis literature for Turkish makam music, discussing in detail the challenges involved and presenting a perspective for further studies. For that purpose, the basic concepts of Turkish makam music and the description of melodic, rhythmic and timbral aspects are considered in detail. Studies on tuning analysis, automatic transcription, automatic melodic analysis, automatic makam and usul detection are reviewed. Technological and data resource needs for further advancement are discussed and available sources are presented., This work was funded by the European Research Council under the European Union’s Seventh Framework Pro-gramme (FP7/2007–2013)/ERC grant agreement 267583 (CompMusic).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Linking scores and audio recordings in makam music of Turkey

  • Sentürk, Sertan
  • Holzapfel, Andre
  • Serra, Xavier
The most relevant representations of music are notations and audio recordings, each of which emphasizes a particular perspective and promotes different approximations in the analysis and understanding of music. Linking these two representations and analysing them jointly should help to better study many musical facets by being able to combine complementary analysis methodologies. In order to develop accurate linking methods, we have to take into account the specificities of a given type of music. In this paper, we present a method for linking musically relevant sections in a score of a piece from makam music of Turkey (MMT) to the corresponding time intervals of an audio recording of the same piece. The method starts by extracting relevant features from the score and from the audio recording. The features of a given score section are compared with the features of the audio recording to find the candidate links in the audio for that score section. Next, using the sequential section information stored in the score, it selects the most likely links. The method is tested on a dataset consisting of instrumental and vocal compositions of MMT, achieving 92.1% and 96.9% -scores on the instrumental and vocal pieces, respectively. Our results show the importance of culture-specific and knowledge-based approaches in music information processing., This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

In search of automatic rhythm analysis methods for Turkish and Indian art music

  • Srinivasamurthy, Ajay
  • Holzapfel, Andre
  • Serra, Xavier
The aim of this paper is to identify and discuss various methods in computational rhythm description of Carnatic and Hindustani music of India, and Makam music of Turkey. We define and describe three relevant rhythm annotation tasks for these cultures—beat tracking, meter estimation, and downbeat detection. We then evaluate several methodologies from the state of the art in Music Information Retrieval (MIR) for these tasks, using manually annotated datasets of Turkish and Indian music. This evaluation provides insights into the nature of rhythm in these cultures and the challenges to automatic rhythm analysis. Our results indicate that the performance of evaluated approaches is not adequate for the presented tasks, and that methods that are suitable to tackle the culture specific challenges in computational analysis of rhythm need to be developed. The results from the different analysis methods enable us to identify promising directions for an appropriate exploration of rhythm analysis in Turkish, Carnatic and Hindustani music., This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Saraga: Open Datasets for Research on Indian Art Music

  • Srinivasamurthy, Ajay
  • Gulati, Sankalp
  • Caro Repetto, Rafael
  • Serra, Xavier
We introduce two large open data collections of Indian Art Music, both its Carnatic and Hindustani traditions, comprising audio from vocal concerts, editorial metadata, and time-aligned melody, rhythm, and structure annotations. Shared under Creative Commons licenses, they currently form the largest annotated data collections available for computational analysis of Indian Art Music. The collections are intended to provide audio and ground truth for several music information research tasks and large-scale data-driven analysis in musicological studies. A part of the Saraga Carnatic collection also has multitrack recordings, making it a valuable collection for research on melody extraction, source separation, automatic mixing, and performance analysis. We describe the tenets and the process of collection, annotation, and organization of the data. We provide easy access to the audio, metadata, and the annotations in the collections through an API, along with a companion website that has example scripts to facilitate access and use of the data. To sustain and grow the collections, we provide a mechanism for both the research and music community to contribute additional data and annotations to the collections. We also present applications with the collections for music education, understanding, exploration, and discovery., This work has been funded by the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013)/ERC grant agreement 267583, The CompMusic Project (http://compmusic.upf.edu).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A microtonal tuning method: test & discussion on the use of microtonal intervals for the performance of traditional Turkish music

  • Tamer, Yahya Burak
  • Bozkurt, Baris
Background in music computing: An automatic method for tuning analysis of recordings was presented in (Bozkurt 2008). Data collected from this method have been used to develop a new microtonal tuner system implemented in Max MSP and Java (Tamer and Bozkurt 2013). The distinctive quality of the tuning method (previously demonstrated in (Bozkurt 2012)) is the use of a recording as reference instead of theoretical presets. During the process, fundamental frequency analysis is performed and pitch distributions are obtained for the selected recordings. This data is visualized via the tuner interface along with the real-time frequency estimate from the input signal to realize the tuning operation. Background in music performance: Electronic tuner devices are widely used by musicians. However these devices offer only a limited number of theoretical presets and equal temperament is the primary one. Lack of consistency between tuning theory and its practice of Turkish makam music has been addressed in a number of studies such as (Ay and Akkal 2008; Bozkurt et al. 2009). In the general traditional Turkish music concept, when microtonal intervals are used, the question of how musicians interpret the theory and apply it into their tuning practices arises. Aims: We investigate the relevance of tuning practices applied by three selected musicians who perform traditional Turkish music with the authentic intervals used by master musicians in selected recordings. We present the microtonal tuner application in order to provide a basic research tool for musicians and ethnomusicologists. Main contribution: The manuscript presents the user tests carried out with three professional musicians who perform traditional Turkish music and discusses the outcomes. A semistructured interview method is applied in order to test the process with the musicians. The tests contain comparisons of performances with and without the aid of the microtonal tuner application, providing insight to the musicians’ regular tuning practices and discussing further possibilities on the use of the application. The tests include recordings by well-known Turkish master musicians who perform microtonal music as Turkish makam music (one example) and Turkish folk music (three examples). Implications: By offering a direct access to any tuning system used by a master musician that has been captured in a recording, the application presented in this paper is suitable to serve as a computational ethnomusicology (CE) tool, thus has the potential to assist in ethnomusicological research. (Tzanetakis et al. 2007)., This work was funded in part by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement 267583 (CompMusic).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Class-based tag recommendation and user-based evaluation in online audio clip sharing

  • Font Corbera, Frederic
  • Serrà Julià, Joan
  • Serra, Xavier
Online sharing platforms often rely on collaborative tagging systems for annotating content. In this way, users themselves annotate and describe the shared contents using textual labels, commonly called tags. These annotations typically suffer from a number of issues such as tag scarcity or ambiguous labelling. Hence, to minimise some of these issues, tag recommendation systems can be employed to suggest potentially relevant tags during the annotation process. In this work, we present a tag recommendation system and evaluate it in the context of an online platform for audio clip sharing. By exploiting domain-specific knowledge, the system we present is able to classify an audio clip among a number of predefined audio classes and to produce specific tag recommendations for the different classes. We perform an in-depth user-based evaluation of the recommendation method along with two baselines and a former version that we described in previous work. This user-based evaluation is further complemented with a prediction-based evaluation following standard information retrieval methodologies. Results show that the proposed tag recommendation method brings a statistically significant improvement over the previous method and the baselines. In addition, we report a number of findings based on the detailed analysis of user feedback provided during the evaluation process. The considered methods, when applied to real-world collaborative tagging systems, should serve the purpose of consolidating the tagging vocabulary and improving the quality of content annotations., This work has been supported by BES-2010-037309 FPI from the Spanish Ministry of Science and Innovation (TIN2009-14247-C02-01; F.F.), 2009-SGR-1434 from Generalitat de Catalunya (J.S.), JAEDOC069/2010 from CSIC (J.S.), ICT-2011-8-318770 from the European Commission (J.S.), and FP7-2007-2013/ERC Grant Agreement 267583 (CompMusic; F.F., X.S.).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Intonation analysis of rāgas in Carnatic music

  • Koduri, Gopala Krishna
  • Ishwar, Vignesh
  • Serrà Julià, Joan
  • Serra, Xavier
Intonation is a fundamental music concept that has a special relevance in Indian art music. It is characteristic of a rga and key to the musical expression of the artist. Describing intonation is of importance to several music information retrieval tasks such as developing similarity measures based on rgas and artists. In this paper, we first assess rga intonation qualitatively by analysing varṇaṁs, a particular form of Carnatic music compositions. We then approach the task of automatically obtaining a compact representation of the intonation of a recording from its pitch track. We propose two approaches based on the parametrization of pitch-value distributions: performance pitch histograms, and context-based svara distributions obtained by categorizing pitch contours based on the melodic context. We evaluate both approaches on a large Carnatic music collection and discuss their merits and limitations. We finally go through different kinds of contextual information that can be obtained to further improve the two approaches., This research was partly funded by the European Research Council/nunder the European Union’s Seventh Framework/nProgram, as part of the CompMusic project (ERC grant agreement/n267583). J.S. acknowledges 2009-SGR-1434 fromGeneralitat/nde Catalunya, ICT-2011-8-318770 from the European Commission,/nJAEDOC069/2010 from CSIC, and European Social/nFunds.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Aspects of tempo and rhythmic elaboration in hindustani music: A corpus study

  • Srinivasamurthy, Ajay
  • Holzapfel, Andre
  • Ganguli, Kaustuv Kanti
  • Serra, Xavier
This article provides insights into aspects of tempo and rhythmic elaboration in Hindustani music, based on a study of a large corpus of recorded performances. Typical tempo developments and stress patterns within a metrical cycle are computed, which we refer to as tempo and rhythm patterns, respectively. Rhythm patterns are obtained by aggregating spectral features over metrical cycles. They reflect percussion patterns that are frequent in the corpus and enable a discussion of the relation between such patterns and the underlying metrical framework, the tal. Tempo patterns, on the other hand, are computed using reference beat annotations. They document the dynamic development of tempo throughout a metrical cycle and reveal insights into the flexibility of time in Hindustani music for the first time using quantitative methods on a large set of performances. Focusing on aspects of tempo and rhythm, we demonstrate the value of a computational methodology for the analysis of large music corpora by revealing the range of tempi used in performances, intra-cycle tempo dynamics and percussion accents at different positions of the tal cycle., This work is partly funded by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583).