Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Computational models of music perception and cognition II: domain-specific music processing

  • Purwins, Hendrik
  • Grachten, Maarten
  • Herrera Boyer, Perfecto, 1964-
  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Serra, Xavier
In Part I [Purwins H, Herrera P, Grachten M, Hazan A, Marxer R, Serra X. Computational models of music perception and cognition I: The perceptual and cognitive processing chain. Physics of Life Reviews 2008, in press, doi:10.1016/j.plrev.2008.03.004], we addressed the study of cognitive processes that underlie auditory perception of music, and their neural correlates. The aim of the present paper is to summarize empirical findings from music cognition research that are relevant to three prominent music theoretic domains: rhythm, melody, and tonality. Attention is paid to how cognitive processes like category formation, stimulus grouping, and expectation can account for the music theoretic key concepts in these domains, such as beat, meter, voice, consonance. We give an overview of computational models that have been proposed in the literature for a variety of music processing tasks related to rhythm, melody, and tonality. Although the present state-of-the-art in computational modeling of music cognition definitely provides valuable resources for testing specific hypotheses and theories, we observe the need for models that integrate the various aspects of music perception and cognition into a single framework. Such models should be able to account for aspects that until now have only rarely been addressed in computational models of music cognition, like the active nature of perception and the development of cognitive capacities from infancy to adulthood., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and the Spanish TIC project ProSeMus (TIN2006-14932-C02- 01). The first author also received support from a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science. The second author is funded by the Austrian National Science Fund, FWF (project: P19349-N15).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Computational models of music perception and cognition I: the perceptual and cognitive processing chain

  • Purwins, Hendrik
  • Herrera Boyer, Perfecto, 1964-
  • Grachten, Maarten
  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Serra, Xavier
We present a review on perception and cognition models designed for or applicable to music. An emphasis is put on computational implementations. We include findings from different disciplines: neuroscience, psychology, cognitive science, artificial intelligence, and musicology. The article summarizes the methodology that these disciplines use to approach the phenomena of music understanding, the localization of musical processes in the brain, and the flow of cognitive operations involved in turning physical signals into musical symbols, going from the transducers to the memory systems of the brain. We discuss formal models developed to emulate, explain and predict phenomena involved in early auditory processing, pitch processing, grouping, source separation, and music structure computation. We cover generic computational architectures of attention, memory, and expectation that can be instantiated and tuned to deal with specific musical phenomena. Criteria for the evaluation of such models are presented and discussed. Thereby, we lay out the general framework that provides the basis for the discussion of domain-specific music models in Part II., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and the Spanish TIC project ProSeMus (TIN2006-14932-C02-01). The first author also received support from a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science. The third author is funded by the Austrian National Science Fund, FWF (project: P19349-N15).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Model cortical responses for the detection of perceptual onsets and beat tracking in singing

  • Coath, Martin
  • Denham, Susan L.
  • Smith, Leigh M.
  • Honing, Henkjan
  • Hazan, Amaury
  • Holonowicz, Piotr
  • Purwins, Hendrik
We describe a biophysically motivated model of auditory salience based on a model of cortical responses and present results that show that the derived measure of salience can be used to identify the position of perceptual onsets in a musical stimulus successfully. The salience measure is also shown to be useful to track beats and predict rhythmic structure in the stimulus on the basis of its periodicity patterns. We evaluate the method using a corpus of unaccompanied freely sung stimuli and show that the method performs well, in some cases better than state-of-the-art algorithms. These results deserve attention because they are derived from a general model of auditory processing and not an arbitrary model achieving best performance in onset detection or beat-tracking tasks., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and EPSRC EP/C010841/1 (COLAMN).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Statistical analysis of chroma features in western music predicts human judgments of tonality

  • Serrà Julià, Joan
  • Gómez Gutiérrez, Emilia, 1975-
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Motivated by evidence that image source statistics predict the response properties of several visual perception aspects, we provide an empirical analysis of the relation between chroma statistics and human judgments of tonality. To accomplish this, a statistical analysis method based on chroma feature covariance is proposed. It makes use of a large collection of western music to build a tonal profile. The obtained profile is compared to alternative tonal profiles proposed in the literature, either cognitively, perceptually, or theoretically inspired. The high degree of correlation we find between the covariance-based tonal profile proposed here and several ones proposed in the literature (reaching values higher than 0.9) is interpreted as evidence that human-derived profiles faithfully reflect the statistics of the musical input listeners have been exposed to. Furthermore, we show that very short time scales allow us to correctly predict these profiles, which brings us to discuss the role that local-scale implicit learning plays in building mental representations of tonality., This research has been partially funded by the EU-IP project PHAROS6 (IST-2006-045035), the e-Content Plus project VARIAZIONI 7 (ECP-2005-CULT-038264) and the European FET project EmCAP 8 (FP6-IST-013123).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Trends and perspectives in music cognition research and technology

  • Purwins, Hendrik
  • Hardoon, David R.
The emergence of this special issue has been supported by EPSRCproject Le Strum (EP-D063612-1), the European projects CLOSED (FP6-NEST-PATH, contract 29085), and EmCAP (FP6-IST, contract 013123). One editor (H.P.) received a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

What/when causal expectation modelling applied to audio signals

  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Brossier, Paul
  • Purwins, Hendrik
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
A causal system to represent a stream of music into musical events, and to generate further expected events, is presented. Starting from an auditory front-end that extracts low-level (i.e. MFCC) and mid-level features such as onsets and beats, an unsupervised clustering process builds and maintains a set of symbols aimed at representing musical stream events using both timbre and time descriptions. The time events are represented using inter-onset intervals relative to the beats. These symbols are then processed by an expectation module using Predictive Partial Match, a multiscale technique based on N-grams. To characterise the ability of the system to generate an expectation that matches both ground truth and system transcription, we introduce several measures that take into account the uncertainty associated with the unsupervised encoding of the musical sequence. The system is evaluated using a subset of the ENST-drums database of annotated drum recordings. We compare three approaches to combine timing (when) and timbre (what) expectation. In our experiments, we show that the induced representation is useful for generating expectation patterns in a causal way., This work is partially funded by the EmCAP project (European Commission FP6-IST, contract 013123).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Computational models of music perception and cognition II: domain-specific music processing

  • Purwins, Hendrik
  • Grachten, Maarten
  • Herrera Boyer, Perfecto, 1964-
  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Serra, Xavier
In Part I [Purwins H, Herrera P, Grachten M, Hazan A, Marxer R, Serra X. Computational models of music perception and cognition I: The perceptual and cognitive processing chain. Physics of Life Reviews 2008, in press, doi:10.1016/j.plrev.2008.03.004], we addressed the study of cognitive processes that underlie auditory perception of music, and their neural correlates. The aim of the present paper is to summarize empirical findings from music cognition research that are relevant to three prominent music theoretic domains: rhythm, melody, and tonality. Attention is paid to how cognitive processes like category formation, stimulus grouping, and expectation can account for the music theoretic key concepts in these domains, such as beat, meter, voice, consonance. We give an overview of computational models that have been proposed in the literature for a variety of music processing tasks related to rhythm, melody, and tonality. Although the present state-of-the-art in computational modeling of music cognition definitely provides valuable resources for testing specific hypotheses and theories, we observe the need for models that integrate the various aspects of music perception and cognition into a single framework. Such models should be able to account for aspects that until now have only rarely been addressed in computational models of music cognition, like the active nature of perception and the development of cognitive capacities from infancy to adulthood., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and the Spanish TIC project ProSeMus (TIN2006-14932-C02- 01). The first author also received support from a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science. The second author is funded by the Austrian National Science Fund, FWF (project: P19349-N15).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Model cortical responses for the detection of perceptual onsets and beat tracking in singing

  • Coath, Martin
  • Denham, Susan L.
  • Smith, Leigh M.
  • Honing, Henkjan
  • Hazan, Amaury
  • Holonowicz, Piotr
  • Purwins, Hendrik
We describe a biophysically motivated model of auditory salience based on a model of cortical responses and present results that show that the derived measure of salience can be used to identify the position of perceptual onsets in a musical stimulus successfully. The salience measure is also shown to be useful to track beats and predict rhythmic structure in the stimulus on the basis of its periodicity patterns. We evaluate the method using a corpus of unaccompanied freely sung stimuli and show that the method performs well, in some cases better than state-of-the-art algorithms. These results deserve attention because they are derived from a general model of auditory processing and not an arbitrary model achieving best performance in onset detection or beat-tracking tasks., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and EPSRC EP/C010841/1 (COLAMN).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Statistical analysis of chroma features in western music predicts human judgments of tonality

  • Serrà Julià, Joan
  • Gómez Gutiérrez, Emilia, 1975-
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Motivated by evidence that image source statistics predict the response properties of several visual perception aspects, we provide an empirical analysis of the relation between chroma statistics and human judgments of tonality. To accomplish this, a statistical analysis method based on chroma feature covariance is proposed. It makes use of a large collection of western music to build a tonal profile. The obtained profile is compared to alternative tonal profiles proposed in the literature, either cognitively, perceptually, or theoretically inspired. The high degree of correlation we find between the covariance-based tonal profile proposed here and several ones proposed in the literature (reaching values higher than 0.9) is interpreted as evidence that human-derived profiles faithfully reflect the statistics of the musical input listeners have been exposed to. Furthermore, we show that very short time scales allow us to correctly predict these profiles, which brings us to discuss the role that local-scale implicit learning plays in building mental representations of tonality., This research has been partially funded by the EU-IP project PHAROS6 (IST-2006-045035), the e-Content Plus project VARIAZIONI 7 (ECP-2005-CULT-038264) and the European FET project EmCAP 8 (FP6-IST-013123).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

What/when causal expectation modelling applied to audio signals

  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Brossier, Paul
  • Purwins, Hendrik
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
A causal system to represent a stream of music into musical events, and to generate further expected events, is presented. Starting from an auditory front-end that extracts low-level (i.e. MFCC) and mid-level features such as onsets and beats, an unsupervised clustering process builds and maintains a set of symbols aimed at representing musical stream events using both timbre and time descriptions. The time events are represented using inter-onset intervals relative to the beats. These symbols are then processed by an expectation module using Predictive Partial Match, a multiscale technique based on N-grams. To characterise the ability of the system to generate an expectation that matches both ground truth and system transcription, we introduce several measures that take into account the uncertainty associated with the unsupervised encoding of the musical sequence. The system is evaluated using a subset of the ENST-drums database of annotated drum recordings. We compare three approaches to combine timing (when) and timbre (what) expectation. In our experiments, we show that the induced representation is useful for generating expectation patterns in a causal way., This work is partially funded by the EmCAP project (European Commission FP6-IST, contract 013123).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Computational models of music perception and cognition I: the perceptual and cognitive processing chain

  • Purwins, Hendrik
  • Herrera Boyer, Perfecto, 1964-
  • Grachten, Maarten
  • Hazan, Amaury
  • Marxer Piñón, Ricard
  • Serra, Xavier
We present a review on perception and cognition models designed for or applicable to music. An emphasis is put on computational implementations. We include findings from different disciplines: neuroscience, psychology, cognitive science, artificial intelligence, and musicology. The article summarizes the methodology that these disciplines use to approach the phenomena of music understanding, the localization of musical processes in the brain, and the flow of cognitive operations involved in turning physical signals into musical symbols, going from the transducers to the memory systems of the brain. We discuss formal models developed to emulate, explain and predict phenomena involved in early auditory processing, pitch processing, grouping, source separation, and music structure computation. We cover generic computational architectures of attention, memory, and expectation that can be instantiated and tuned to deal with specific musical phenomena. Criteria for the evaluation of such models are presented and discussed. Thereby, we lay out the general framework that provides the basis for the discussion of domain-specific music models in Part II., This work is funded by EU Open FET IST-FP6-013123 (EmCAP) and the Spanish TIC project ProSeMus (TIN2006-14932-C02-01). The first author also received support from a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science. The third author is funded by the Austrian National Science Fund, FWF (project: P19349-N15).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Trends and perspectives in music cognition research and technology

  • Purwins, Hendrik
  • Hardoon, David R.
The emergence of this special issue has been supported by EPSRCproject Le Strum (EP-D063612-1), the European projects CLOSED (FP6-NEST-PATH, contract 29085), and EmCAP (FP6-IST, contract 013123). One editor (H.P.) received a Juan de la Cierva scholarship from the Spanish Ministry of Education and Science.