Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 40
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

MediaEval 2018 AcousticBrainz genre task: A baseline combining deep feature embeddings across datasets

  • Oramas, Sergio
  • Bogdanov, Dmitry
  • Porter, Alastair
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., In this paper we present a baseline approach for the MediaEval 2018 AcousticBrainz Genre Task that takes advantage of stacking multiple feature embeddings learned on individual genre datasets by simple deep learning architectures. Although we employ basic neural networks, the combination of their deep feature embeddings provides a significant gain in performance compared to each individual network., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The MediaEval 2017 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada a: MediaEval2017 Workshop, celebrat del 13 al 15 de setembre de 2017 a Dublin, Irlanda., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2017 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The MediaEval 2018 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., We thank all contributors to AcousticBrainz. This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P). We also thank tagtraum industries for providing the Tagtraum genre annotations.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Cross-collection evaluation for music classification tasks

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., Many studies in music classification are concerned with obtaining the highest possible cross-validation result. However, some studies have noted that cross-validation may be prone to biases and that additional evaluations based on independent out-of-sample data are desirable. In this paper we present a methodology and software tools for cross-collection evaluation for music classification tasks. The tools allow users to conduct large-scale evaluations of classifier models trained within the AcousticBrainz platform, given an independent source of ground-truth annotations, and its mapping with the classes used for model training. To demonstrate the application of this methodology we evaluate five models trained on genre datasets commonly used by researchers for genre classification, and use collaborative tags from Last.fm as an independent source of ground truth. We study a number of evaluation strategies using our tools on validation sets from 240,000 to 1,740,000 music recordings and discuss the results., This research has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Freesound datasets: a platform for the creation of open audio datasets

  • Fonseca, Eduardo
  • Pons Puig, Jordi
  • Favory, Xavier
  • Font Corbera, Frederic
  • Bogdanov, Dmitry
  • Ferraro, Andrés
  • Oramas, Sergio
  • Porter, Alastair
  • Serra, Xavier
Comunicació presentada al 18th International Society for Music Information Retrieval Conference celebrada a Suzhou, Xina, del 23 al 27 d'cotubre de 2017., Openly available datasets are a key factor in the advancement of data-driven research approaches, including many of the ones used in sound and music computing. In the last few years, quite a number of new audio datasets have been made available but there are still major shortcomings in many of them to have a significant research impact. Among the common shortcomings are the lack of transparency in their creation and the difficulty of making them completely open and sharable. They often do not include clear mechanisms to amend errors and many times they are not large enough for current machine learning needs. This paper introduces Freesound Datasets, an online platform for the collaborative creation of open audio datasets based on principles of transparency, openness, dynamic character, and sustainability. As a proof-of-concept, we present an early snapshot of a large-scale audio dataset built using this platform. It consists of audio samples from Freesound organised in a hierarchy based on the AudioSet Ontology. We believe that building and maintaining datasets following the outlined principles and using open tools and collaborative approaches like the ones presented here will have a significant impact in our research community., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”, and from the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

FSD50K: an open dataset of human-labeled sound events

  • Fonseca, Eduardo
  • Favory, Xavier
  • Pons, Jordi
  • Font, Frederic
  • Serra, Xavier
Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2 M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K , an open dataset containing over 51 k audio clips totalling over 100 h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research., This work was supported in part by European Union’s Horizon 2020 research and innovation programme under Grant Agreement 688382 AudioCommons, in part by two Google Faculty Research Awards 2017 and 2018, and in part by the Maria de Maeztu Units of Excellence Programme under Grant MDM-2015-0502.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Audio Commons: Bringing Creative Commons audio content to the creative industries

  • Font Corbera, Frederic
  • Brookes, Tim
  • Fazekas, George
  • Guerber, Martin
  • La Burthe, Amaury
  • Plans, David
  • Plumbley, Mark D.
  • Shaashua, Meir
  • Wang, Wenwu
  • Serra, Xavier
Comunicació presentada a la 61st International Conference: Audio for Games, celebrada els dies 10 a 12 de febrer de 2016 a Londres, Regne Unit., Significant amounts of user-generated audio content, such as sound effects, musical samples and music pieces, are uploaded to online repositories and made available under open licenses. Moreover, a constantly increasing amount of multimedia content, originally released with traditional licenses, is becoming public domain as its copyright expires. Nevertheless, the creative industries are not yet using much of all this content in their media productions. There is still a lack of familiarity and understanding of the legal context of all this open content, but there are also problems related with its accessibility. A big percentage of this content remains unreachable either because it is not published online or because it is not well organised and annotated. In this paper we present the Audio Commons Initiative, which is aimed at promoting the use of open audio content and at developing technologies with which to support the ecosystem composed by content repositories, production tools and users. These technologies should enable the reuse of this audio material, facilitating its integration in the production workflows used by the creative industries. This is a position paper in which we describe the core ideas behind this initiative and outline the ways in which we plan to address the challenges it poses., This work has been funded by the European Commission H2020 “AudioCommons” research and innovation grant 688382.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multi web audio sequencer: collaborative music making

  • Favory, Xavier
  • Serra, Xavier
Comunicació presentada a: Web Audio Conference WAC-2018, celebrat del 19 al 21 de setembre de 2018 a Berlin, Alemanya., Recent advancements in web-based audio systems have enabled sufficiently accurate timing control and real-time sound processing capabilities. Numerous specialized music tools, as well as digital audio workstations, are now accessible from browsers. Features such as the large accessibility of data and real-time communication between clients make the web attractive for collaborative data manipulation. However, this innovative field has yet to produce effective tools for multiple-user coordination on specialized music creation tasks. The Multi Web Audio Sequencer is a prototype of an application for segment-based sequencing of Freesound sound clips, with an emphasis on seamless remote collaboration. In this work we consider a fixed-grid step sequencer as a probe for understanding the necessary features of crowd-shared music creation sessions. This manuscript describes the sequencer and the functionalities and types of interactions required for effective and attractive collaboration of remote people during creative music creation activities., This work has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 688382 \AudioCommons".
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Using offline metrics and user behavior analysis to combine multiple systems for music recommendation

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Choi, Kyumin
  • Serra, Xavier
Comunicació presentada a: RecSys 2018 Workshop on Offline Evaluation of Recommender Systems, celebrada el 7 d'octubre del 2018 a Vancouver, Canadà., There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining different systems. In this work we focus on music recommendation and propose a new way to improve recommendations, with respect to a desired metric of choice, by combining multiple systems for each user individually based on their expected performance. Essentially, our approach consists in predicting an expected error that each system will produce for each user based on their previous activity. To this end, we propose to train regression models for different metrics predicting the performance of each system based on a number of features characterizing previous user behavior in the system. We then use different fusion strategies to combine recommendations generated by each system. Following this approach one can optimize the final hybrid system with respect to the desired metric of choice. As a proof of concept, we conduct experiments combining two recommendation systems, a Matrix Factorization model and a popularity-based recommender. We use the data provided by Melon, a Korean music streaming service, to train and evaluate the performance of the systems., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Mining metadata from the web for AcousticBrainz

  • Porter, Alastair
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 3rd International Workshop on Digital Libraries for Musicology, celebrat el dia 12 d'agost de 2016 a Nova York., Semantic annotations of music collections in digital libraries are important for organization and navigation of the collection. These annotations and their associated metadata are useful in many Music Information Retrieval tasks, and related fields in musicology. Music collections used in research are growing in size, and therefore it is useful to use semi-automatic means to obtain such annotations. We present software tools for mining metadata from the web for the purpose of annotating music collections. These tools expand on data present in the AcousticBrainz database, which contains software-generated analysis of music audio files. Using this tool we gather metadata and semantic information from a variety of sources including both community-based services such as MusicBrainz, Last.fm, and Discogs, and commercial databases including Itunes and AllMusic. The tool can be easily expanded to collect data from a new source, and is automatically updated when new items are added to AcousticBrainz. We extract genre annotations for recordings in AcousticBrainz using our tool and study the agreement between folksonomies and expert sources. We discuss the results and explore possibilities for future work., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Acoustic scene classification by ensembling gradient boosting machine and convolutional neural networks

  • Fonseca, Eduardo
  • Gong, Rong
  • Bogdanov, Dmitry
  • Slizovskaia, Olga
  • Gómez Gutiérrez, Emilia, 1975-
  • Serra, Xavier
Comunicació presentada al Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017), celebrat el dia 16 de novembre de 2017 a Munic, Alemanya., This work describes our contribution to the acoustic scene classifi- cation task of the DCASE 2017 challenge. We propose a system that consists of the ensemble of two methods of different nature: a feature engineering approach, where a collection of hand-crafted features is input to a Gradient Boosting Machine, and another approach based on learning representations from data, where log-scaled melspectrograms are input to a Convolutional Neural Network. This CNN is designed with multiple filter shapes in the first layer. We use a simple late fusion strategy to combine both methods. We report classification accuracy of each method alone and the ensemble system on the provided cross-validation setup of TUT Acoustic Scenes 2017 dataset. The proposed system outperforms each of its component methods and improves the provided baseline system by 8.2%., This work is partially supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”, and the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Automatic playlist continuation using a hybrid recommender system combining features from text and audio

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Yoon, Jisang
  • Kim, KwangSeob
  • Serra, Xavier
Comunicació presentada a: RecSys Challenge 2018, celebrat el 7 d'octubre de 2018, a Vancouver, Canadà., The ACM RecSys Challenge 2018 focuses on music recommendation in the context of automatic playlist continuation. In this paper, we describe our approach to the problem and the final hybrid system that was submitted to the challenge by our team Cocoplaya. This system consists in combining the recommendations produced by two different models using ranking fusion. The first model is based on Matrix Factorization and it incorporates information from tracks’ audio and playlist titles. The second model generates recommendations based on typical track co-occurrences considering their proximity in the playlists. The proposed approach is efficient and achieves a good overall performance, with our model ranked 4th on the creative track of the challenge leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Quantifying music trends and facts using editorial metadata from the Discogs database

  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada a: ISMIR 2017, celebrat a Suzhou, Xina, del 23 al 27 d'octubre de 2017, While a vast amount of editorial metadata is being actively gathered and used by music collectors and enthusiasts, it is often neglected by music information retrieval and musicology researchers. In this paper we propose to explore Discogs, one of the largest databases of such data available in the public domain. Our main goal is to show how largescale analysis of its editorial metadata can raise questions and serve as a tool for musicological research on a number of example studies. The metadata that we use describes music releases, such as albums or EPs. It includes information about artists, tracks and their durations, genre and style, format (such as vinyl, CD, or digital files), year and country of each release. Using this data we study correlations between different genre and style labels, assess their specificity and analyze typical track durations. We estimate trends in prevalence of different genres, styles, and formats across different time periods. In our analysis of styles we use electronic music as an example. Our contribution also includes the tools we developed for our analysis and the generated datasets that can be re-used by MIR researchers and musicologists., This research has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons). We also thank Alastair Porter for proofreading.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Facilitating the manual annotation of sounds when using large taxonomies

  • Favory, Xavier
  • Fonseca, Eduardo
  • Font Corbera, Frederic
  • Serra, Xavier
Comunicació presentada a: 23rd Conference of Open Innovations Association FRUCT, celebrat a Bologna, Italy, del 13 al 16 de novembre de 2018., Properly annotated multimedia content is crucial for supporting advances in many Information Retrieval applications. It enables, for instance, the development of automatic tools for the annotation of large and diverse multimedia collections. In the context of everyday sounds and online collections, the content to describe is very diverse and involves many different types of concepts, often organised in large hierarchical structures called taxonomies. This makes the task of manually annotating content arduous. In this paper, we present our user-centered development of two tools for the manual annotation of audio content from a wide range of types. We conducted a preliminary evaluation of functional prototypes involving real users. The goal is to evaluate them in a real context, engage in discussions with users, and inspire new ideas. A qualitative analysis was carried out including usability questionnaires and semi-structured interviews. This revealed interesting aspects to consider when developing tools for the manual annotation of audio content with labels drawn from large hierarchical taxonomies., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons” and from a Google Faculty Research Award 2017. The authors thank Lorenzo Romanelli for his help with the development of the annotation tools, and the participants of the evaluation for the valuable feedback gathered.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

General-purpose tagging of Freesound audio with audioSet labels: task description, dataset, and baseline

  • Fonseca, Eduardo
  • Plakal, Manoj
  • Font Corbera, Frederic
  • Ellis, Daniel P. W.
  • Favory, Xavier
  • Pons Puig, Jordi
  • Serra, Xavier
Comunicació presentada a: Detection and Classification of Acoustic Scenes and Events 2018, celebrat a Surrey, Regne Unit, del 19 al 20 de novembre de 2018., This paper describes Task 2 of the DCASE 2018 Challenge, titled “General-purpose audio tagging of Freesound content with AudioSet labels”. This task was hosted on the Kaggle platform as “Freesound General-Purpose Audio Tagging Challenge”. The goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology. We present the task, the dataset prepared for the competition, and a baseline system., This work is partially supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 AudioCommons and a Google Faculty Research Award 2017.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Tempo estimation for music loops and a simple confidence measure

  • Font Corbera, Frederic
  • Serra, Xavier
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., Tempo estimation is a common task within the music information retrieval community, but existing works are rarely evaluated with datasets of music loops and the algorithms are not tailored to this particular type of content. In addition to this, existing works on tempo estimation do not put an emphasis on providing a confidence value that indicates how reliable their tempo estimations are. In current music creation contexts, it is common for users to search for and use loops shared in online repositories. These loops are typically not produced by professionals and lack annotations. Hence, the existence of reliable tempo estimation algorithms becomes necessary to enhance the reusability of loops shared in such repositories. In this paper, we test six existing tempo estimation algorithms against four music loop datasets containing more than 35k loops. We also propose a simple and computationally cheap confidence measure that can be applied to any existing algorithm to estimate the reliability of their tempo predictions when applied to music loops. We analyse the accuracy of the algorithms in combination with our proposed confidence measure, and see that we can significantly improve the algorithms' performance when only considering music loops with high estimated confidence., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A Simple fusion of deep and shallow learning for acoustic scene classification

  • Fonseca, Eduardo
  • Gong, Rong
  • Serra, Xavier
Comunicació presentada a: 15th Sound and Music Computing Conference (SMC2018). Sonic crossing, celebrat a Limassol, Xipre, del 4 al 7 de juliol de 2018., In the past, Acoustic Scene Classification systems havebeen based on hand crafting audio features that are input toa classifier. Nowadays, the common trend is to adopt datadriven techniques, e.g., deep learning, where audio repre-sentations are learned from data. In this paper, we proposea system that consists of a simple fusion of two methods ofthe aforementioned types: a deep learning approach wherelog-scaled mel-spectrograms are input to a convolutionalneural network, and a feature engineering approach, wherea collection of hand-crafted features is input to a gradientboosting machine. We first show that both methods pro-vide complementary information to some extent. Then, weuse a simple late fusion strategy to combine both meth-ods. We report classification accuracy of each method in-dividually and the combined system on the TUT AcousticScenes 2017 dataset. The proposed fused system outper-forms each of the individual methods and attains a classifi-cation accuracy of 72.8% on the evaluation set, improvingthe baseline system by 11.8%., This work is partially supported by the European Union’sHorizon 2020 research and innovation programme undergrant agreement No 688382 “AudioCommons”, and theEuropean Research Council under the European Union’sSeventh Framework Program, as part of the CompMusicproject (ERC grant agreement 267583), and a Google Fac-ulty Research Award 2017. We are grateful for the GPUsdonated by NVidia.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The MTG-Jamendo dataset for automatic music tagging

  • Bogdanov, Dmitry
  • Won, Minz
  • Tovstogan, Philip
  • Porter, Alastair
  • Serra, Xavier
Comunicació presentada a: ML4MD Machine Learning for Music Discovery Workshop del congrés ICML2019 celebrat el 15 de juny de 2019 a Long Beach, California., We present the MTG-Jamendo Dataset, a new open dataset for music auto-tagging. It is built using music available at Jamendo under Creative Commons licenses and tags provided by content uploaders. The dataset contains over 55,000 full audio tracks with 195 tags from genre, instrument, and mood/theme categories. We provide elaborated data splits for researchers and report the performance of a simple baseline approach on five different sets of tags: genre, instrument, mood/theme, top-50, and overall., This work was funded by the predoctoral grant MDM-2015- 0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502). This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 765068. This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Skip prediction using boosting trees based on acoustic features of tracks in sessions

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 12th ACM International Conference on Web Search and Data Mining celebrat del11 al 15 de febrer de 2019 a Melbourne, Austràlia., The Spotify Sequential Skip Prediction Challenge focuses on predicting if a track in a session will be skipped by the user or not. In this paper, we describe our approach to this problem and the final system that was submitted to the challenge by our team from the Music Technology Group (MTG) under the name “aferraro”. This system consists in combining the predictions of multiple boosting trees models trained with features extracted from the sessions and the tracks. The proposed approach achieves good overall performance (MAA of 0.554), with our model ranked 14th out of more than 600 submissions in the final leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The AcousticBrainz genre dataset: Multi-source, multi-level, multi-label, and large-scale

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Schreiber, Hendrik
  • Urbano, Julián
  • Oramas, Sergio
Comunicació presentada a: 20th International Society for Music Information Retrieval Conference celebrat del 4 al 8 de novembre de 2019 a Delft, Països Baixos., This paper introduces the AcousticBrainz Genre Dataset, a large-scale collection of hierarchical multi-label genre annotations from different metadata sources. It allows researchers to explore how the same music pieces are annotated differently by different communities following their own genre taxonomies, and how this could be addressed by genre recognition systems. Genre labels for the dataset are sourced from both expert annotations and crowds, permitting comparisons between strict hierarchies and folksonomies. Music features are available via the Acoustic- Brainz database. To guide research, we suggest a concrete research task and provide a baseline as well as an evaluation method. This task may serve as an example of the development and validation of automatic annotation algorithms on complementary datasets with different taxonomies and coverage. With this dataset, we hope to contribute to developments in content-based music genre recognition as well as cross-disciplinary studies on genre metadata analysis., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376- 2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

General-purpose tagging of Freesound audio with audioSet labels: task description, dataset, and baseline

  • Fonseca, Eduardo
  • Plakal, Manoj
  • Font Corbera, Frederic
  • Ellis, Daniel P. W.
  • Favory, Xavier
  • Pons Puig, Jordi
  • Serra, Xavier
Comunicació presentada a: Detection and Classification of Acoustic Scenes and Events 2018, celebrat a Surrey, Regne Unit, del 19 al 20 de novembre de 2018., This paper describes Task 2 of the DCASE 2018 Challenge, titled “General-purpose audio tagging of Freesound content with AudioSet labels”. This task was hosted on the Kaggle platform as “Freesound General-Purpose Audio Tagging Challenge”. The goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology. We present the task, the dataset prepared for the competition, and a baseline system., This work is partially supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 AudioCommons and a Google Faculty Research Award 2017.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Tempo estimation for music loops and a simple confidence measure

  • Font Corbera, Frederic
  • Serra, Xavier
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., Tempo estimation is a common task within the music information retrieval community, but existing works are rarely evaluated with datasets of music loops and the algorithms are not tailored to this particular type of content. In addition to this, existing works on tempo estimation do not put an emphasis on providing a confidence value that indicates how reliable their tempo estimations are. In current music creation contexts, it is common for users to search for and use loops shared in online repositories. These loops are typically not produced by professionals and lack annotations. Hence, the existence of reliable tempo estimation algorithms becomes necessary to enhance the reusability of loops shared in such repositories. In this paper, we test six existing tempo estimation algorithms against four music loop datasets containing more than 35k loops. We also propose a simple and computationally cheap confidence measure that can be applied to any existing algorithm to estimate the reliability of their tempo predictions when applied to music loops. We analyse the accuracy of the algorithms in combination with our proposed confidence measure, and see that we can significantly improve the algorithms' performance when only considering music loops with high estimated confidence., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Automatic playlist continuation using a hybrid recommender system combining features from text and audio

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Yoon, Jisang
  • Kim, KwangSeob
  • Serra, Xavier
Comunicació presentada a: RecSys Challenge 2018, celebrat el 7 d'octubre de 2018, a Vancouver, Canadà., The ACM RecSys Challenge 2018 focuses on music recommendation in the context of automatic playlist continuation. In this paper, we describe our approach to the problem and the final hybrid system that was submitted to the challenge by our team Cocoplaya. This system consists in combining the recommendations produced by two different models using ranking fusion. The first model is based on Matrix Factorization and it incorporates information from tracks’ audio and playlist titles. The second model generates recommendations based on typical track co-occurrences considering their proximity in the playlists. The proposed approach is efficient and achieves a good overall performance, with our model ranked 4th on the creative track of the challenge leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Quantifying music trends and facts using editorial metadata from the Discogs database

  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada a: ISMIR 2017, celebrat a Suzhou, Xina, del 23 al 27 d'octubre de 2017, While a vast amount of editorial metadata is being actively gathered and used by music collectors and enthusiasts, it is often neglected by music information retrieval and musicology researchers. In this paper we propose to explore Discogs, one of the largest databases of such data available in the public domain. Our main goal is to show how largescale analysis of its editorial metadata can raise questions and serve as a tool for musicological research on a number of example studies. The metadata that we use describes music releases, such as albums or EPs. It includes information about artists, tracks and their durations, genre and style, format (such as vinyl, CD, or digital files), year and country of each release. Using this data we study correlations between different genre and style labels, assess their specificity and analyze typical track durations. We estimate trends in prevalence of different genres, styles, and formats across different time periods. In our analysis of styles we use electronic music as an example. Our contribution also includes the tools we developed for our analysis and the generated datasets that can be re-used by MIR researchers and musicologists., This research has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons). We also thank Alastair Porter for proofreading.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The MTG-Jamendo dataset for automatic music tagging

  • Bogdanov, Dmitry
  • Won, Minz
  • Tovstogan, Philip
  • Porter, Alastair
  • Serra, Xavier
Comunicació presentada a: ML4MD Machine Learning for Music Discovery Workshop del congrés ICML2019 celebrat el 15 de juny de 2019 a Long Beach, California., We present the MTG-Jamendo Dataset, a new open dataset for music auto-tagging. It is built using music available at Jamendo under Creative Commons licenses and tags provided by content uploaders. The dataset contains over 55,000 full audio tracks with 195 tags from genre, instrument, and mood/theme categories. We provide elaborated data splits for researchers and report the performance of a simple baseline approach on five different sets of tags: genre, instrument, mood/theme, top-50, and overall., This work was funded by the predoctoral grant MDM-2015- 0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502). This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 765068. This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Mining metadata from the web for AcousticBrainz

  • Porter, Alastair
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 3rd International Workshop on Digital Libraries for Musicology, celebrat el dia 12 d'agost de 2016 a Nova York., Semantic annotations of music collections in digital libraries are important for organization and navigation of the collection. These annotations and their associated metadata are useful in many Music Information Retrieval tasks, and related fields in musicology. Music collections used in research are growing in size, and therefore it is useful to use semi-automatic means to obtain such annotations. We present software tools for mining metadata from the web for the purpose of annotating music collections. These tools expand on data present in the AcousticBrainz database, which contains software-generated analysis of music audio files. Using this tool we gather metadata and semantic information from a variety of sources including both community-based services such as MusicBrainz, Last.fm, and Discogs, and commercial databases including Itunes and AllMusic. The tool can be easily expanded to collect data from a new source, and is automatically updated when new items are added to AcousticBrainz. We extract genre annotations for recordings in AcousticBrainz using our tool and study the agreement between folksonomies and expert sources. We discuss the results and explore possibilities for future work., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The MediaEval 2017 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada a: MediaEval2017 Workshop, celebrat del 13 al 15 de setembre de 2017 a Dublin, Irlanda., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2017 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The AcousticBrainz genre dataset: Multi-source, multi-level, multi-label, and large-scale

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Schreiber, Hendrik
  • Urbano, Julián
  • Oramas, Sergio
Comunicació presentada a: 20th International Society for Music Information Retrieval Conference celebrat del 4 al 8 de novembre de 2019 a Delft, Països Baixos., This paper introduces the AcousticBrainz Genre Dataset, a large-scale collection of hierarchical multi-label genre annotations from different metadata sources. It allows researchers to explore how the same music pieces are annotated differently by different communities following their own genre taxonomies, and how this could be addressed by genre recognition systems. Genre labels for the dataset are sourced from both expert annotations and crowds, permitting comparisons between strict hierarchies and folksonomies. Music features are available via the Acoustic- Brainz database. To guide research, we suggest a concrete research task and provide a baseline as well as an evaluation method. This task may serve as an example of the development and validation of automatic annotation algorithms on complementary datasets with different taxonomies and coverage. With this dataset, we hope to contribute to developments in content-based music genre recognition as well as cross-disciplinary studies on genre metadata analysis., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376- 2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The MediaEval 2018 AcousticBrainz genre task: content-based music genre recognition from multiple sources

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Urbano, Julián
  • Schreiber, Hendrik
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., This paper provides an overview of the AcousticBrainz Genre Task organized as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. The task is focused on content-based music genre recognition using genre annotations from multiple sources and large-scale music features data available in the AcousticBrainz database. The goal of our task is to explore how the same music pieces can be annotated differently by different communities following different genre taxonomies, and how this should be addressed by content-based genre recognition systems. We present the task challenges, the employed ground-truth information and datasets, and the evaluation methodology., We thank all contributors to AcousticBrainz. This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P). We also thank tagtraum industries for providing the Tagtraum genre annotations.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Audio Commons: Bringing Creative Commons audio content to the creative industries

  • Font Corbera, Frederic
  • Brookes, Tim
  • Fazekas, George
  • Guerber, Martin
  • La Burthe, Amaury
  • Plans, David
  • Plumbley, Mark D.
  • Shaashua, Meir
  • Wang, Wenwu
  • Serra, Xavier
Comunicació presentada a la 61st International Conference: Audio for Games, celebrada els dies 10 a 12 de febrer de 2016 a Londres, Regne Unit., Significant amounts of user-generated audio content, such as sound effects, musical samples and music pieces, are uploaded to online repositories and made available under open licenses. Moreover, a constantly increasing amount of multimedia content, originally released with traditional licenses, is becoming public domain as its copyright expires. Nevertheless, the creative industries are not yet using much of all this content in their media productions. There is still a lack of familiarity and understanding of the legal context of all this open content, but there are also problems related with its accessibility. A big percentage of this content remains unreachable either because it is not published online or because it is not well organised and annotated. In this paper we present the Audio Commons Initiative, which is aimed at promoting the use of open audio content and at developing technologies with which to support the ecosystem composed by content repositories, production tools and users. These technologies should enable the reuse of this audio material, facilitating its integration in the production workflows used by the creative industries. This is a position paper in which we describe the core ideas behind this initiative and outline the ways in which we plan to address the challenges it poses., This work has been funded by the European Commission H2020 “AudioCommons” research and innovation grant 688382.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Freesound datasets: a platform for the creation of open audio datasets

  • Fonseca, Eduardo
  • Pons Puig, Jordi
  • Favory, Xavier
  • Font Corbera, Frederic
  • Bogdanov, Dmitry
  • Ferraro, Andrés
  • Oramas, Sergio
  • Porter, Alastair
  • Serra, Xavier
Comunicació presentada al 18th International Society for Music Information Retrieval Conference celebrada a Suzhou, Xina, del 23 al 27 d'cotubre de 2017., Openly available datasets are a key factor in the advancement of data-driven research approaches, including many of the ones used in sound and music computing. In the last few years, quite a number of new audio datasets have been made available but there are still major shortcomings in many of them to have a significant research impact. Among the common shortcomings are the lack of transparency in their creation and the difficulty of making them completely open and sharable. They often do not include clear mechanisms to amend errors and many times they are not large enough for current machine learning needs. This paper introduces Freesound Datasets, an online platform for the collaborative creation of open audio datasets based on principles of transparency, openness, dynamic character, and sustainability. As a proof-of-concept, we present an early snapshot of a large-scale audio dataset built using this platform. It consists of audio samples from Freesound organised in a hierarchy based on the AudioSet Ontology. We believe that building and maintaining datasets following the outlined principles and using open tools and collaborative approaches like the ones presented here will have a significant impact in our research community., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”, and from the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A Simple fusion of deep and shallow learning for acoustic scene classification

  • Fonseca, Eduardo
  • Gong, Rong
  • Serra, Xavier
Comunicació presentada a: 15th Sound and Music Computing Conference (SMC2018). Sonic crossing, celebrat a Limassol, Xipre, del 4 al 7 de juliol de 2018., In the past, Acoustic Scene Classification systems havebeen based on hand crafting audio features that are input toa classifier. Nowadays, the common trend is to adopt datadriven techniques, e.g., deep learning, where audio repre-sentations are learned from data. In this paper, we proposea system that consists of a simple fusion of two methods ofthe aforementioned types: a deep learning approach wherelog-scaled mel-spectrograms are input to a convolutionalneural network, and a feature engineering approach, wherea collection of hand-crafted features is input to a gradientboosting machine. We first show that both methods pro-vide complementary information to some extent. Then, weuse a simple late fusion strategy to combine both meth-ods. We report classification accuracy of each method in-dividually and the combined system on the TUT AcousticScenes 2017 dataset. The proposed fused system outper-forms each of the individual methods and attains a classifi-cation accuracy of 72.8% on the evaluation set, improvingthe baseline system by 11.8%., This work is partially supported by the European Union’sHorizon 2020 research and innovation programme undergrant agreement No 688382 “AudioCommons”, and theEuropean Research Council under the European Union’sSeventh Framework Program, as part of the CompMusicproject (ERC grant agreement 267583), and a Google Fac-ulty Research Award 2017. We are grateful for the GPUsdonated by NVidia.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Skip prediction using boosting trees based on acoustic features of tracks in sessions

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Serra, Xavier
Comunicació presentada al 12th ACM International Conference on Web Search and Data Mining celebrat del11 al 15 de febrer de 2019 a Melbourne, Austràlia., The Spotify Sequential Skip Prediction Challenge focuses on predicting if a track in a session will be skipped by the user or not. In this paper, we describe our approach to this problem and the final system that was submitted to the challenge by our team from the Music Technology Group (MTG) under the name “aferraro”. This system consists in combining the predictions of multiple boosting trees models trained with features extracted from the sessions and the tracks. The proposed approach achieves good overall performance (MAA of 0.554), with our model ranked 14th out of more than 600 submissions in the final leaderboard., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Using offline metrics and user behavior analysis to combine multiple systems for music recommendation

  • Ferraro, Andrés
  • Bogdanov, Dmitry
  • Choi, Kyumin
  • Serra, Xavier
Comunicació presentada a: RecSys 2018 Workshop on Offline Evaluation of Recommender Systems, celebrada el 7 d'octubre del 2018 a Vancouver, Canadà., There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining different systems. In this work we focus on music recommendation and propose a new way to improve recommendations, with respect to a desired metric of choice, by combining multiple systems for each user individually based on their expected performance. Essentially, our approach consists in predicting an expected error that each system will produce for each user based on their previous activity. To this end, we propose to train regression models for different metrics predicting the performance of each system based on a number of features characterizing previous user behavior in the system. We then use different fusion strategies to combine recommendations generated by each system. Following this approach one can optimize the final hybrid system with respect to the desired metric of choice. As a proof of concept, we conduct experiments combining two recommendation systems, a Matrix Factorization model and a popularity-based recommender. We use the data provided by Melon, a Korean music streaming service, to train and evaluate the performance of the systems., This research has been supported by Kakao Corp., and partially funded by the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382 (AudioCommons) and the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Cross-collection evaluation for music classification tasks

  • Bogdanov, Dmitry
  • Porter, Alastair
  • Herrera Boyer, Perfecto, 1964-
  • Serra, Xavier
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., Many studies in music classification are concerned with obtaining the highest possible cross-validation result. However, some studies have noted that cross-validation may be prone to biases and that additional evaluations based on independent out-of-sample data are desirable. In this paper we present a methodology and software tools for cross-collection evaluation for music classification tasks. The tools allow users to conduct large-scale evaluations of classifier models trained within the AcousticBrainz platform, given an independent source of ground-truth annotations, and its mapping with the classes used for model training. To demonstrate the application of this methodology we evaluate five models trained on genre datasets commonly used by researchers for genre classification, and use collaborative tags from Last.fm as an independent source of ground truth. We study a number of evaluation strategies using our tools on validation sets from 240,000 to 1,740,000 music recordings and discuss the results., This research has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 688382.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

FSD50K: an open dataset of human-labeled sound events

  • Fonseca, Eduardo
  • Favory, Xavier
  • Pons, Jordi
  • Font, Frederic
  • Serra, Xavier
Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2 M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K , an open dataset containing over 51 k audio clips totalling over 100 h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research., This work was supported in part by European Union’s Horizon 2020 research and innovation programme under Grant Agreement 688382 AudioCommons, in part by two Google Faculty Research Awards 2017 and 2018, and in part by the Maria de Maeztu Units of Excellence Programme under Grant MDM-2015-0502.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Facilitating the manual annotation of sounds when using large taxonomies

  • Favory, Xavier
  • Fonseca, Eduardo
  • Font Corbera, Frederic
  • Serra, Xavier
Comunicació presentada a: 23rd Conference of Open Innovations Association FRUCT, celebrat a Bologna, Italy, del 13 al 16 de novembre de 2018., Properly annotated multimedia content is crucial for supporting advances in many Information Retrieval applications. It enables, for instance, the development of automatic tools for the annotation of large and diverse multimedia collections. In the context of everyday sounds and online collections, the content to describe is very diverse and involves many different types of concepts, often organised in large hierarchical structures called taxonomies. This makes the task of manually annotating content arduous. In this paper, we present our user-centered development of two tools for the manual annotation of audio content from a wide range of types. We conducted a preliminary evaluation of functional prototypes involving real users. The goal is to evaluate them in a real context, engage in discussions with users, and inspire new ideas. A qualitative analysis was carried out including usability questionnaires and semi-structured interviews. This revealed interesting aspects to consider when developing tools for the manual annotation of audio content with labels drawn from large hierarchical taxonomies., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons” and from a Google Faculty Research Award 2017. The authors thank Lorenzo Romanelli for his help with the development of the annotation tools, and the participants of the evaluation for the valuable feedback gathered.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Acoustic scene classification by ensembling gradient boosting machine and convolutional neural networks

  • Fonseca, Eduardo
  • Gong, Rong
  • Bogdanov, Dmitry
  • Slizovskaia, Olga
  • Gómez Gutiérrez, Emilia, 1975-
  • Serra, Xavier
Comunicació presentada al Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017), celebrat el dia 16 de novembre de 2017 a Munic, Alemanya., This work describes our contribution to the acoustic scene classifi- cation task of the DCASE 2017 challenge. We propose a system that consists of the ensemble of two methods of different nature: a feature engineering approach, where a collection of hand-crafted features is input to a Gradient Boosting Machine, and another approach based on learning representations from data, where log-scaled melspectrograms are input to a Convolutional Neural Network. This CNN is designed with multiple filter shapes in the first layer. We use a simple late fusion strategy to combine both methods. We report classification accuracy of each method alone and the ensemble system on the provided cross-validation setup of TUT Acoustic Scenes 2017 dataset. The proposed system outperforms each of its component methods and improves the provided baseline system by 8.2%., This work is partially supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688382 “AudioCommons”, and the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multi web audio sequencer: collaborative music making

  • Favory, Xavier
  • Serra, Xavier
Comunicació presentada a: Web Audio Conference WAC-2018, celebrat del 19 al 21 de setembre de 2018 a Berlin, Alemanya., Recent advancements in web-based audio systems have enabled sufficiently accurate timing control and real-time sound processing capabilities. Numerous specialized music tools, as well as digital audio workstations, are now accessible from browsers. Features such as the large accessibility of data and real-time communication between clients make the web attractive for collaborative data manipulation. However, this innovative field has yet to produce effective tools for multiple-user coordination on specialized music creation tasks. The Multi Web Audio Sequencer is a prototype of an application for segment-based sequencing of Freesound sound clips, with an emphasis on seamless remote collaboration. In this work we consider a fixed-grid step sequencer as a probe for understanding the necessary features of crowd-shared music creation sessions. This manuscript describes the sequencer and the functionalities and types of interactions required for effective and attractive collaboration of remote people during creative music creation activities., This work has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 688382 \AudioCommons".
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

MediaEval 2018 AcousticBrainz genre task: A baseline combining deep feature embeddings across datasets

  • Oramas, Sergio
  • Bogdanov, Dmitry
  • Porter, Alastair
Comunicació presentada al MediaEval 2018 Workshop celebrat a Sophia Antipolis (França) del 29 al 31 d'octubre de 2018., In this paper we present a baseline approach for the MediaEval 2018 AcousticBrainz Genre Task that takes advantage of stacking multiple feature embeddings learned on individual genre datasets by simple deep learning architectures. Although we employ basic neural networks, the combination of their deep feature embeddings provides a significant gain in performance compared to each individual network., This research has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreements No 688382 (AudioCommons) and 770376-2 (TROMPA), as well as the Ministry of Economy and Competitiveness of the Spanish Government (Reference: TIN2015-69935-P).