Skip to main content

RECOLECCION, ESTRUCTURACION Y PROCESADO DE INFORMACION MUSICAL PARA APLICACIONES DE AUDIO SEMANTICO

TIN2015-69935-P

•
Funding agency name Ministerio de Economía y Competitividad
Funding agency acronym MINECO
Program Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D (Excelencia / Generación de Conocimiento)
Call year 2015
State Plan 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Management unit Secretaría de Estado de Educación, Formación Profesional y Universidades
Beneficiary centre UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

MediaEval 2018 AcousticBrainz genre task: A baseline combining deep feature embeddings across datasets

  • Oramas, Sergio
  • Bogdanov, Dmitry
  • Porter, Alastair
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., In this paper we present a baseline approach for the MediaEval 2018 AcousticBrainz Genre Task that takes advantage of stacking multiple feature embeddings learned on individual genre datasets by simple deep learning architectures. Although we employ basic neural networks, the combination of their deep feature embeddings provides a significant gain in performance compared to each individual network., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

The MediaEval 2018 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., We thank all contributors to AcousticBrainz. This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P). We also thank tagtraum industries for providing the Tagtraum genre annotations.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Using offline metrics and user behavior analysis to combine multiple systems for music recommendation

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Choi, Kyumin
  • Serra, Xavier
Comunicació presentada a: RecSys 2018 Workshop on Offline Evaluation of Recommender Systems, celebrada el 7 d'octubre del 2018 a Vancouver, Canadà., There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining different systems. In this work we focus on music recommendation and propose a new way to improve recommendations, with respect to a desired metric of choice, by combining multiple systems for each user individually based on their expected performance. Essentially, our approach consists in predicting an expected error that each system will produce for each user based on their previous activity. To this end, we propose to train regression models for different metrics predicting the performance of each system based on a number of features characterizing previous user behavior in the system. We then use different fusion strategies to combine recommendations generated by each system. Following this approach one can optimize the final hybrid system with respect to the desired metric of choice. As a proof of concept, we conduct experiments combining two recommendation systems, a Matrix Factorization model and a popularity-based recommender. We use the data provided by Melon, a Korean music streaming service, to train and evaluate the performance of the systems., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Automatic playlist continuation using a hybrid recommender system combining features from text and audio

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Yoon, Jisang
  • Kim, KwangSeob
  • Serra, Xavier
Comunicació presentada a: RecSys Challenge 2018, celebrat el 7 d'octubre de 2018, a Vancouver, Canadà., The ACM RecSys Challenge 2018 focuses on music recommendation in the context of automatic playlist continuation. In this paper, we describe our approach to the problem and the final hybrid system that was submitted to the challenge by our team Cocoplaya. This system consists in combining the recommendations produced by two different models using ranking fusion. The first model is based on Matrix Factorization and it incorporates information from tracks’ audio and playlist titles. The second model generates recommendations based on typical track co-occurrences considering their proximity in the playlists. The proposed approach is efficient and achieves a good overall performance, with our model ranked 4th on the creative track of the challenge leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Skip prediction using boosting trees based on acoustic features of tracks in sessions

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 12th ACM International Conference on Web Search and Data Mining celebrat del11 al 15 de febrer de 2019 a Melbourne, Austràlia., The Spotify Sequential Skip Prediction Challenge focuses on predicting if a track in a session will be skipped by the user or not. In this paper, we describe our approach to this problem and the final system that was submitted to the challenge by our team from the Music Technology Group (MTG) under the name “aferraro”. This system consists in combining the predictions of multiple boosting trees models trained with features extracted from the sessions and the tracks. The proposed approach achieves good overall performance (MAA of 0.554), with our model ranked 14th out of more than 600 submissions in the final leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

The AcousticBrainz genre dataset: Multi-source, multi-level, multi-label, and large-scale

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Schreiber, Hendrik
  • Urbano, Julián
  • Oramas, Sergio
Comunicació presentada a: 20th International Society for Music Information Retrieval Conference celebrat del 4 al 8 de novembre de 2019 a Delft, Països Baixos., This paper introduces the AcousticBrainz Genre Dataset, a large-scale collection of hierarchical multi-label genre annotations from different metadata sources. It allows researchers to explore how the same music pieces are annotated differently by different communities following their own genre taxonomies, and how this could be addressed by genre recognition systems. Genre labels for the dataset are sourced from both expert annotations and crowds, permitting comparisons between strict hierarchies and folksonomies. Music features are available via the Acoustic- Brainz database. To guide research, we suggest a concrete research task and provide a baseline as well as an evaluation method. This task may serve as an example of the development and validation of automatic annotation algorithms on complementary datasets with different taxonomies and coverage. With this dataset, we hope to contribute to developments in content-based music genre recognition as well as cross-disciplinary studies on genre metadata analysis., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376- 2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Automatic playlist continuation using a hybrid recommender system combining features from text and audio

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Yoon, Jisang
  • Kim, KwangSeob
  • Serra, Xavier
Comunicació presentada a: RecSys Challenge 2018, celebrat el 7 d'octubre de 2018, a Vancouver, Canadà., The ACM RecSys Challenge 2018 focuses on music recommendation in the context of automatic playlist continuation. In this paper, we describe our approach to the problem and the final hybrid system that was submitted to the challenge by our team Cocoplaya. This system consists in combining the recommendations produced by two different models using ranking fusion. The first model is based on Matrix Factorization and it incorporates information from tracks’ audio and playlist titles. The second model generates recommendations based on typical track co-occurrences considering their proximity in the playlists. The proposed approach is efficient and achieves a good overall performance, with our model ranked 4th on the creative track of the challenge leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The AcousticBrainz genre dataset: Multi-source, multi-level, multi-label, and large-scale

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Schreiber, Hendrik
  • Urbano, Julián
  • Oramas, Sergio
Comunicació presentada a: 20th International Society for Music Information Retrieval Conference celebrat del 4 al 8 de novembre de 2019 a Delft, Països Baixos., This paper introduces the AcousticBrainz Genre Dataset, a large-scale collection of hierarchical multi-label genre annotations from different metadata sources. It allows researchers to explore how the same music pieces are annotated differently by different communities following their own genre taxonomies, and how this could be addressed by genre recognition systems. Genre labels for the dataset are sourced from both expert annotations and crowds, permitting comparisons between strict hierarchies and folksonomies. Music features are available via the Acoustic- Brainz database. To guide research, we suggest a concrete research task and provide a baseline as well as an evaluation method. This task may serve as an example of the development and validation of automatic annotation algorithms on complementary datasets with different taxonomies and coverage. With this dataset, we hope to contribute to developments in content-based music genre recognition as well as cross-disciplinary studies on genre metadata analysis., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376- 2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The MediaEval 2018 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., We thank all contributors to AcousticBrainz. This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P). We also thank tagtraum industries for providing the Tagtraum genre annotations.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Skip prediction using boosting trees based on acoustic features of tracks in sessions

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 12th ACM International Conference on Web Search and Data Mining celebrat del11 al 15 de febrer de 2019 a Melbourne, Austràlia., The Spotify Sequential Skip Prediction Challenge focuses on predicting if a track in a session will be skipped by the user or not. In this paper, we describe our approach to this problem and the final system that was submitted to the challenge by our team from the Music Technology Group (MTG) under the name “aferraro”. This system consists in combining the predictions of multiple boosting trees models trained with features extracted from the sessions and the tracks. The proposed approach achieves good overall performance (MAA of 0.554), with our model ranked 14th out of more than 600 submissions in the final leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Using offline metrics and user behavior analysis to combine multiple systems for music recommendation

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Choi, Kyumin
  • Serra, Xavier
Comunicació presentada a: RecSys 2018 Workshop on Offline Evaluation of Recommender Systems, celebrada el 7 d'octubre del 2018 a Vancouver, Canadà., There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining different systems. In this work we focus on music recommendation and propose a new way to improve recommendations, with respect to a desired metric of choice, by combining multiple systems for each user individually based on their expected performance. Essentially, our approach consists in predicting an expected error that each system will produce for each user based on their previous activity. To this end, we propose to train regression models for different metrics predicting the performance of each system based on a number of features characterizing previous user behavior in the system. We then use different fusion strategies to combine recommendations generated by each system. Following this approach one can optimize the final hybrid system with respect to the desired metric of choice. As a proof of concept, we conduct experiments combining two recommendation systems, a Matrix Factorization model and a popularity-based recommender. We use the data provided by Melon, a Korean music streaming service, to train and evaluate the performance of the systems., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

MediaEval 2018 AcousticBrainz genre task: A baseline combining deep feature embeddings across datasets

  • Oramas, Sergio
  • Bogdanov, Dmitry
  • Porter, Alastair
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., In this paper we present a baseline approach for the MediaEval 2018 AcousticBrainz Genre Task that takes advantage of stacking multiple feature embeddings learned on individual genre datasets by simple deep learning architectures. Although we employ basic neural networks, the combination of their deep feature embeddings provides a significant gain in performance compared to each individual network., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).