Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 34
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Empirically investigating virtual learning companions to enhance social media literacy

  • Theophilou, Emily
  • Schwarze, Veronica
  • Börsting, Johanna
  • Sánchez Reina, Jesús Roberto
  • Scifo, Lidia
  • Lomonaco, Francesco
  • Aprin, Farbod
  • Ognibene, Dimitri
  • Taibi, Davide
  • Hernández Leo, Davinia
  • Eimler, Sabrina
Comunicació presentada a 4th International Conference on Higher Education Learning Methodologies and Technologies Online, celebrat del 21 al 23 de setembre de 2022 a Palerm, Itàlia., Social media platforms provide opportunities for users across the world to connect and communicate between them and engage into acts of social support and entertainment. Yet it can also bring negative consequences as it has been associated with poor mental health and life dissatisfaction. This underlines the importance of delivering social media literacy (SML) interventions that raise awareness of the dangers and threats that are hidden within. To this date, SML initiatives have shown their benefits towards the acquisition of SML skills through the forms of school interventions and mini-games. However, studies on promoting SML through social media platforms need to be also encouraged and innovative approaches to provide interactive scenarios with hands-on experiences need to be formulated. Hence, the project COURAGE introduces a new approach towards SML by proposing the integration of educational opportunities within a controlled social media platform. To provide students the opportunity to learn whilst they naturally explore social media we propose the integration of virtual learning companions. In this paper we report seven empirical approaches towards SML skills acquisition powered by virtual learning companions. The paper concludes with a discussion towards the benefits and limitations of using this type of SML interventions., This work has been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502) and the Volkswagen Stiftung (Courage, ref. 95 566). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Robust facial alignment with internal denoising auto-encoder

  • Aspandi, Decky
  • Martínez, Oriol
  • Sukno, Federico Mateo
  • Binefa i Valls, Xavier
Comunicació presentada a: 16th Conference on Computer and Robot Vision (CRV) celebrat del 29 al 31 de maig de 2019 a Kingston, Canadà., The development of facial alignment models is growing rapidly thanks to the availability of large facial landmarked datasets and powerful deep learning models. However, important challenges still remain for facial alignment models to work on images under extreme conditions, such as severe occlusions or large variations in pose and illumination. Current attempts to overcome this limitation have mainly focused on building robust feature extractors with the assumption that the model will be able to discard the noise and select only the meaningful features. However, such an assumption ignores the importance of understanding the noise that characterizes unconstrained images, which has been shown to benefit computer vision models if used appropriately on the learning strategy. Thus, in this paper we investigate the introduction of specialized modules for noise detection and removal, in combination with our state-of-the-art facial alignment module and show that this leads to improved robustness both to synthesized noise and in-the-wild conditions. The proposed model is built by combining two major subnetworks: internal image denoiser (based on the Auto-Encoder architecture) and facial landmark localiser (based on the inception-resnet architecture). Our results on the 300-W and Menpo datasets show that our model can effectively handle different types of synthetic noise, which also leads to enhanced robustness in real-world unconstrained settings, reaching top state-of-the-art accuracy., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502) and the donation bahi2018-19 to the CMTech at the UPF.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Heatmap-guided balanced deep convolution networks for family classification in the wild

  • Aspandi, Decky
  • Martínez, Oriol
  • Binefa i Valls, Xavier
Comunicació presentada a: Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019) celebrat del 14 al 18 de maig a Lille, France., Automatic kinship recognition using Computer Vision, which aims to infer the blood relationship between individuals by only comparing their facial features, has started to gain attention recently. The introduction of large kinship datasets, such as Family In The Wild (FIW), has allowed large scale dataset modeling using state of the art deep learning models. Among other kinship recognition tasks, family classification task is lacking any significant progress due to its increasing difficulty in relation to the family member size. Furthermore, most current state of-the-art approaches do not perform any data pre-processing (which try to improve models accuracy) and are trained without a regularizer (which results in models susceptible to overfitting). In this paper, we present the Deep Family Classifier (DFC), a deep learning model for family classification in the wild. We build our model by combining two sub-networks: internal Image Feature Enhancer which operates by removing the image noise and provides an additional facial heatmap layer and Family Class Estimator trained with strong regularizers and a compound loss. We observe progressive improvement in accuracy during the validation phase, with a state of the art results of 16.89% is obtained for the track 2 in the RFIW2019 challenge and 17.08% of familly classification task on FIW dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the donation bahi2018-19 to the CMTech at the UPF.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Emotion embedding spaces for matching music to stories

  • Won, Minz
  • Salamon, Justin
  • Bryan, Nicholas J
  • Mysore, Gautham J
  • Serra, Xavier
Content creators often use music to enhance their stories, as it can be a powerful tool to convey emotion. In this paper, our goal is to help creators find music to match the emotion of their story. We focus on text-based stories that can be auralized (e.g., books), use multiple sentences as input queries, and automatically retrieve matching music. We formalize this task as a cross-modal text-to-music retrieval problem. Both the music and text domains have existing datasets with emotion labels, but mismatched emotion vocabularies prevent us from using mood or emotion annotations directly for matching. To address this challenge, we propose and investigate several emotion embedding spaces, both manually defined (e.g., valence/arousal) and data-driven (e.g., Word2Vec and metric learning) to bridge this gap. Our experiments show that by leveraging these embedding spaces, we are able to successfully bridge the gap between modalities to facilitate cross modal retrieval. We show that our method can leverage the well established valence-arousal space, but that it can also achieve our goal via data-driven embedding spaces. By leveraging data-driven embeddings, our approach has the potential of being generalized to other retrieval tasks that require broader or completely different vocabularies., This work was funded by the predoctoral grant MDM2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Latent-based adversarial neural networks for facial affect estimations

  • Aspandi, Decky
  • Mallol Ragolta, Adrià
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), celebrat del 16 al 20 de novembre de 2020 a Buenos Aires, Argentina., There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has recently been accelerated due to the emergence of bigger dataset. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Redundancy as a measure of fault-tolerance for the Internet of Things: A review

  • Lobo, Jorge
  • Rullo, Antonino
  • Serra, Edoardo
In this paper we review and analyze redundancy-based fault-tolerant techniques for the IoT as a paradigm to support two of the main goals of computer security: availability and integrity. We organized the presentation in terms of the three main tasks performed by the nodes of an IoT network: sensing, routing, and control. We first discuss how the implementation of fault-tolerance in the three areas is primary for the correct operation of an entire system. We provide an overview of the different approaches that have been used to address failures in sensing and routing. Control devices typically implement state machines that take decisions based on the measurement of sensors and may also ask actuators to execute actions. Traditionally state-machine replication for fault-tolerance is realized through consensus protocols. Most protocols were developed in the 80’s and 90’s. We will review the properties of such protocols in detail and discuss their limitations for the IoT. Since 2008, consensus algorithms took a new direction with the introduction of the concept of blockchain. Standard blockchain based protocols cannot be applied without modifications to support fault-tolerance in the IoT. We will review some recent results in this new class of algorithms, and show how they can provide the flexibility required to support fault-tolerance in control devices, and thus overcome some of the limitations of the traditional consensus protocols., Jorge Lobo was partially supported by the Spanish Ministry of Economy and Competitiveness. Grant Numbers: TIN201681032P, MDM20150502.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multimodal metric learning for tag-based music retrieval

  • Won, Minz
  • Oramas, Sergio
  • Nieto Caballero, Oriol
  • Gouyon, Fabien
  • Serra, Xavier
Comunicació presentada a 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), celebrat del 6 a l'11 de juny de 2021 de manera virtual., Tag-based music retrieval is crucial to browse large-scale mu-sic libraries efficiently. Hence, automatic music tagging has been actively explored, mostly as a classification task, which has an inherent limitation: a fixed vocabulary. On the other hand, metric learning enables flexible vocabularies by using pretrained word embeddings as side information. Also, met-ric learning has proven its suitability for cross-modal retrieval tasks in other domains (e.g., text-to-image) by jointly learning a multimodal embedding space. In this paper, we investigate three ideas to successfully introduce multimodal metric learning for tag-based music retrieval: elaborate triplet sampling, acoustic and cultural music information, and domain-specific word embeddings. Our experimental results show that the proposed ideas enhance the retrieval system quantitatively and qualitatively. Furthermore, we release the MSD500: a subset of the Million Song Dataset (MSD) containing 500 cleaned tags, 7 manually annotated tag categories, and user taste profiles., This work was funded by the predoctoral grant MDM-2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

TALN at SemEval-2016 Task 14: semantic taxonomy enrichment via sense-based embeddings

  • Espinosa-Anke, Luis
  • Ronzano, Francesco
  • Saggion, Horacio
This paper describes the participation of the TALN team in SemEval-2016 Task 14: Semantic Taxonomy Enrichment. The purpose of the task is to find the best point of attachment in WordNet for a set of Out of Vocabulary (OOV) terms. These may come, to name a few, from domain specific glossaries, slang or typical jargon from Internet forums and chatrooms. Our contribution takes as input an OOV term, its part of speech and its associated definition, and generates a set of WordNet synset candidates derived from modelling the term’s definition as a sense embedding representation. We leverage a BabelNet-based vector space representation, which allows us to map the algorithm’s prediction to WordNet. Our approach is designed to be generic and fitting to any domain, without exploiting, for instance, HTML markup in source web pages. Our system performs above the median of all submitted systems, and rivals in performance a powerful baseline based on extracting the first word of the definition with the same partof-speech as the OOV term., This work was partially funded by Dr. Inventor (FP7-ICT-2013.8.1611383), and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

FastLAS: scalable inductive logic programming incorporating domain-specific optimisation criteria

  • Law, Mark
  • Russo, Alessandra
  • Bertino, Elisa
  • Broda, Krysia
  • Lobo, Jorge
Comunicació presentada a The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), celebrat del 7 al 12 de febrer de 2020 a Nova York, Estats Units., Inductive Logic Programming (ILP) systems aim to find a set of logical rules, called a hypothesis, that explain a set of examples. In cases where many such hypotheses exist, ILP systems often bias towards shorter solutions, leading to highly general rules being learned. In some application domains like security and access control policies, this bias may not be desirable, as when data is sparse more specific rules that guarantee tighter security should be preferred. This paper presents a new general notion of a scoring function over hypotheses that allows a user to express domain-specific optimisation criteria. This is incorporated into a new ILP system, called FastLAS, that takes as input a learning task and a customised scoring function, and computes an optimal solution with respect to the given scoring function. We evaluate the accuracy of FastLAS over real-world datasets for access control policies and show that varying the scoring function allows a user to target domain-specific performance metrics. We also compare FastLAS to state-of-the-art ILP systems, using the standard ILP bias for shorter solutions, and demonstrate that FastLAS is significantly faster and more scalable., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

An enhanced adversarial network with combined latent features for spatio-temporal facial affect estimation in the wild

  • Aspandi, Decky
  • Sukno, Federico Mateo
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, celebrat del 8 al 10 de febrer de 2021 a Setúbal, Portugal., Affective Computing has recently attracted the attention of the research community, due to its numerous applications in diverse areas. In this context, the emergence of video-based data allows to enrich the widely used spatial features with the inclusion of temporal information. However, such spatio-temporal modelling often results in very high-dimensional feature spaces and large volumes of data, making training difficult and time consuming. This paper addresses these shortcomings by proposing a novel model that efficiently extracts both spatial and temporal features of the data by means of its enhanced temporal modelling based on latent features. Our proposed model consists of three major networks, coined Generator, Discriminator, and Combiner, which are trained in an adversarial setting combined with curriculum learning to enable our adaptive attention modules. In our experiments, we show the effectiveness of our approach by reporting our competitive results on both the AFEW-VA and SEWA datasets, suggesting that temporal modelling improves the affect estimates both in qualitative and quantitative terms. Furthermore, we find that the inclusion of attention mechanisms leads to the highest accuracy improvements, as its weights seem to correlate well with the appearance of facial movements, both in terms of temporal localisation and intensity. Finally, we observe the sequence length of around 160 ms to be the optimum one for temporal modelling, which is consistent with other relevant findings utilising similar lengths., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

On security policy migrations

  • Lobo, Jorge
  • Bertino, Elisa
  • Russo, Alessandra
Comunicació presentada al SACMAT '20: The 25th ACM Symposium on Access Control Models and Technologies, celebrat del 10 al 12 de juny de 2020 a Barcelona, Espanya., There has been over the past decade a rapid change towards computational environments that are comprised of large and diverse sets of devices, many of them mobile, which can connect in flexible and context-dependent ways. Examples range from networks where we can have communications between powerful cloud centers, to the myriad of simple sensor devices on the IoT. As the management of these dynamic environments becomes ever more complex, we want to propose policy migrations as a methodology to simplify the management of security policies by re-utilizing and re-deploying existing policies as the systems change. We are interested in understanding the challenges raised answering the following question: given a security policy that is being enforced in a particular source computational device, what does it entail to migrate this policy to be enforced in a different target device? Because of the differences between devices and because these devices cannot be seen in isolation but in the context where they are deployed, the meaning of the policy enforced in the source device needs to be re-interpreted and implemented in the context of the target device. The aim of the paper is to present a formal framework to evaluate the appropriateness of the migration., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was also supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Effectiveness of a mixed reality system in terms of social interaction behaviors in children with and without autism spectrum condition

  • Galí Pérez, Olga
  • Sayis, Batuhan
  • Parés, Narcís, 1966-
Comunicació presentada a XXI International Conference on Human Computer Interaction (INTERACCIÓN 20/21), celebrada del 22 al 24 de setembre de 2021 a Màlaga, Espanya., The present study analyses the effectiveness of a mixed reality (MR) face-to-face full-body system to foster social interaction behaviors (SIBs) in a child with ASC and a play partner, a child without ASC (non-ASC). An MR system allows the development of an active and dynamic environment in which the therapist does not need to have a direct influence on individuals during the therapy. In this study, as part of a larger project, the main goals are to show (1) whether an MR system is as effective in fostering SIBs and non-stressful contexts of play in children with ASC as well as in non-ASC, and (2) whether an MR system has the potential to foster a higher number of SIBs and lower state anxiety levels compared to a traditional therapy setting (LEGO). Our results show that no significant differences were found in starting a new social sequence ("social initiation"), in externalizing "thoughts aloud" ("externalization"), and in SIBs as a whole ("social interaction") between ASC/non-ASC children both in LEGO and in the MR system. In addition, we found similar results when we compared both systems. There were also no significant differences related to state anxiety levels. These positive results show that an MR system is, at least, as good as a typical social intervention in promoting SIBs, as well as, in creating a non-stressful context of play; while an MR system has greater flexibility and a broad range of potential experiences., This work has been funded by Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Program (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

  • Blanco, Angel David
  • Ramírez, Rafael, 1966-
Comunicació presentada a: 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education (MIE'17), celebrat en Glasgow (Regne Unit) el 13 de novembre de 2017., We present a study of the effects of feedback technologies on the learning process of novice violin students. Twenty-one subjects participated in our experiment, divided into two groups: Beginners (participants with no prior violin playing experience, N=14), and experts (participants with more than 6 years of violin playing experience, N=7). The beginners group was further divided into two: a group of beginners learning with Youtube videos (N=7), and a group of beginners with additional feedback related to the quality of their performance (N=7). Participants were asked to perform a violin exercise during 21 trials while their audio was recorded and analyzed. Three different audio descriptors were extracted from each audio in order to evaluate the quality of the performance: Dynamic stability, pitch stability and aperiodicity. Beginners showed a significant improvement during the session(i.e. by comparing the beginning and the end of the session)in the quality of the sound recorded, while experts maintained their results. However, only the beginner group with feedback showed significant improvement between the middle and late part of the session, while the group without feedback remained stable., This work has been partly sponsored by the Spanish TIN project TIMUL (TIN 2013-48152-C2-2-R), the European Union Horizon 2020 research and innovation programme under grant agreement No. 688269 (TELMI project), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Increasing LPWAN scalability by means of concurrent multiband IoT technologies: an industry 4.0 use case

  • Adame, Toni
  • Bel, Albert
  • Bellalta, Boris
One of the most important challenges of the Internet of Things (IoT) in the next years will be the smooth incorporation of millions of smart devices into its communications paradigm. The greater coverage area of sub-1-GHz low-power wide area networks (LPWANs) makes them a suitable technology to easily encompass hundreds of end devices under a single base station. However, LPWAN inherent simplicity affects negatively on scalability, as these networks are not flexible enough to deal with a high number of nodes unless their traffic load is really low, which limits many potential use-cases. This paper analyzes the scalability issue in LPWAN and proposes the INTER-HARE protocol: a solution based on the use of concurrent multiband IoT technologies, where an 868-MHz LPWAN acts as transparent backhaul for a set of subnetworks working at 2.4 GHz. The implementation of the INTER-HARE protocol on a real IoT platform was assessed both in several laboratory testbeds and in a pilot developed in the premises of an industrial company, proving its suitability in non-delay sensitive monitoring applications with end devices scattered throughout the targeted area., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Open Call of INTER-IoT, Research and Innovation action - Horizon 2020 European Project, Grant Agreement #687283, financed by the European Union. It also received funding from the Catalan government through projects SGR-2017-1188 and SGR-2017-1739, and from the Spanish government under the project TEC2016-79510-P.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Contribución de congreso (ConferenceOutput)

Generalized Planning with Positive and Negative Examples

  • Segovia-Aguas, Javier
  • Jonsson, Anders
  • Jiménez-Celorrio, Sergio|||0000-0003-0561-4880
[EN] Generalized planning aims at computing an algorithm-like structure (generalized plan) that solves a set of multiple planning instances. In this paper we define negative examples for generalized planning as planning instances that must not be solved by a generalized plan. With this regard the paper extends the notion of validation of a generalized plan as the problem of verifying that a given generalized plan solves the set of input positives instances while it fails to solve a given input set of negative examples. This notion of plan validation allows us to define quantitative metrics to asses the generalization capacity of generalized plans. The paper also shows how to incorporate this new notion of plan validation into a compilation for plan synthesis that takes both positive and negative instances as input. Experiments show that incorporating negative examples can accelerate plan synthesis in several domains and leverage quantitative metrics to evaluate the generalization capacity of the synthesized plans., The research leading to these results has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no. 731761, IMAGINE; and it is partially supported by grant TIN-2015- 67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jimenez is supported by the Ramon y Cajal program, RYC-2015- 18009, the Spanish MINECO project TIN2017-88476-C2- 1-R, and the generalitat valenciana project GV/2019/082. Anders Jonsson is partially supported by the Spanish grants TIN2015-67959 and PCIN-2017-082.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Generalized planning with positive and negative examples

  • Segovia-Aguas, Javier
  • Jiménez, Sergio
  • Jonsson, Anders
Trabajo presentado en la 34th AAAI Conference on Artificial Intelligence (AAAI), celebrada en New York (Estados Unidos), del 7 al 12 de febrero de 2020, Generalized planning aims at computing an algorithm-like structure (generalized plan) that solves a set of multiple planning instances. In this paper we define negative examples for generalized planning as planning instances that must not be solved by a generalized plan. With this regard the paper extends the notion of validation of a generalized plan as the problem of verifying that a given generalized plan solves the set of input positives instances while it fails to solve a given input set of negative examples. This notion of plan validation allows us to define quantitative metrics to asses the generalization capacity of generalized plans. The paper also shows how to incorporate this new notion of plan validation into a compilation for plan synthesis that takes both positive and negative instances as input. Experiments show that incorporating negative examples can accelerate plan synthesis in several domains and leverage quantitative metrics to evaluate the generalization capacity of the synthesized plans., The research leading to these results has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement no. 731761, IMAGINE; and it is partially supported by grant TIN-2015- 67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jimenez ´ is supported by the Ramon y Cajal program, RYC-2015- 18009, the Spanish MINECO project TIN2017-88476-C2- 1-R, and the generalitat valenciana project GV/2019/082. Anders Jonsson is partially supported by the Spanish grants TIN2015-67959 and PCIN-2017-082.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Redundancy as a measure of fault-tolerance for the Internet of Things: A review

  • Lobo, Jorge
  • Rullo, Antonino
  • Serra, Edoardo
In this paper we review and analyze redundancy-based fault-tolerant techniques for the IoT as a paradigm to support two of the main goals of computer security: availability and integrity. We organized the presentation in terms of the three main tasks performed by the nodes of an IoT network: sensing, routing, and control. We first discuss how the implementation of fault-tolerance in the three areas is primary for the correct operation of an entire system. We provide an overview of the different approaches that have been used to address failures in sensing and routing. Control devices typically implement state machines that take decisions based on the measurement of sensors and may also ask actuators to execute actions. Traditionally state-machine replication for fault-tolerance is realized through consensus protocols. Most protocols were developed in the 80’s and 90’s. We will review the properties of such protocols in detail and discuss their limitations for the IoT. Since 2008, consensus algorithms took a new direction with the introduction of the concept of blockchain. Standard blockchain based protocols cannot be applied without modifications to support fault-tolerance in the IoT. We will review some recent results in this new class of algorithms, and show how they can provide the flexibility required to support fault-tolerance in control devices, and thus overcome some of the limitations of the traditional consensus protocols., Jorge Lobo was partially supported by the Spanish Ministry of Economy and Competitiveness. Grant Numbers: TIN201681032P, MDM20150502.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Robust facial alignment with internal denoising auto-encoder

  • Aspandi, Decky
  • Martínez, Oriol
  • Sukno, Federico Mateo
  • Binefa i Valls, Xavier
Comunicació presentada a: 16th Conference on Computer and Robot Vision (CRV) celebrat del 29 al 31 de maig de 2019 a Kingston, Canadà., The development of facial alignment models is growing rapidly thanks to the availability of large facial landmarked datasets and powerful deep learning models. However, important challenges still remain for facial alignment models to work on images under extreme conditions, such as severe occlusions or large variations in pose and illumination. Current attempts to overcome this limitation have mainly focused on building robust feature extractors with the assumption that the model will be able to discard the noise and select only the meaningful features. However, such an assumption ignores the importance of understanding the noise that characterizes unconstrained images, which has been shown to benefit computer vision models if used appropriately on the learning strategy. Thus, in this paper we investigate the introduction of specialized modules for noise detection and removal, in combination with our state-of-the-art facial alignment module and show that this leads to improved robustness both to synthesized noise and in-the-wild conditions. The proposed model is built by combining two major subnetworks: internal image denoiser (based on the Auto-Encoder architecture) and facial landmark localiser (based on the inception-resnet architecture). Our results on the 300-W and Menpo datasets show that our model can effectively handle different types of synthetic noise, which also leads to enhanced robustness in real-world unconstrained settings, reaching top state-of-the-art accuracy., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502) and the donation bahi2018-19 to the CMTech at the UPF.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

On security policy migrations

  • Lobo, Jorge
  • Bertino, Elisa
  • Russo, Alessandra
Comunicació presentada al SACMAT '20: The 25th ACM Symposium on Access Control Models and Technologies, celebrat del 10 al 12 de juny de 2020 a Barcelona, Espanya., There has been over the past decade a rapid change towards computational environments that are comprised of large and diverse sets of devices, many of them mobile, which can connect in flexible and context-dependent ways. Examples range from networks where we can have communications between powerful cloud centers, to the myriad of simple sensor devices on the IoT. As the management of these dynamic environments becomes ever more complex, we want to propose policy migrations as a methodology to simplify the management of security policies by re-utilizing and re-deploying existing policies as the systems change. We are interested in understanding the challenges raised answering the following question: given a security policy that is being enforced in a particular source computational device, what does it entail to migrate this policy to be enforced in a different target device? Because of the differences between devices and because these devices cannot be seen in isolation but in the context where they are deployed, the meaning of the policy enforced in the source device needs to be re-interpreted and implemented in the context of the target device. The aim of the paper is to present a formal framework to evaluate the appropriateness of the migration., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was also supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multimodal metric learning for tag-based music retrieval

  • Won, Minz
  • Oramas, Sergio
  • Nieto Caballero, Oriol
  • Gouyon, Fabien
  • Serra, Xavier
Comunicació presentada a 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), celebrat del 6 a l'11 de juny de 2021 de manera virtual., Tag-based music retrieval is crucial to browse large-scale mu-sic libraries efficiently. Hence, automatic music tagging has been actively explored, mostly as a classification task, which has an inherent limitation: a fixed vocabulary. On the other hand, metric learning enables flexible vocabularies by using pretrained word embeddings as side information. Also, met-ric learning has proven its suitability for cross-modal retrieval tasks in other domains (e.g., text-to-image) by jointly learning a multimodal embedding space. In this paper, we investigate three ideas to successfully introduce multimodal metric learning for tag-based music retrieval: elaborate triplet sampling, acoustic and cultural music information, and domain-specific word embeddings. Our experimental results show that the proposed ideas enhance the retrieval system quantitatively and qualitatively. Furthermore, we release the MSD500: a subset of the Million Song Dataset (MSD) containing 500 cleaned tags, 7 manually annotated tag categories, and user taste profiles., This work was funded by the predoctoral grant MDM-2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

  • Blanco, Angel David
  • Ramírez, Rafael, 1966-
Comunicació presentada a: 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education (MIE'17), celebrat en Glasgow (Regne Unit) el 13 de novembre de 2017., We present a study of the effects of feedback technologies on the learning process of novice violin students. Twenty-one subjects participated in our experiment, divided into two groups: Beginners (participants with no prior violin playing experience, N=14), and experts (participants with more than 6 years of violin playing experience, N=7). The beginners group was further divided into two: a group of beginners learning with Youtube videos (N=7), and a group of beginners with additional feedback related to the quality of their performance (N=7). Participants were asked to perform a violin exercise during 21 trials while their audio was recorded and analyzed. Three different audio descriptors were extracted from each audio in order to evaluate the quality of the performance: Dynamic stability, pitch stability and aperiodicity. Beginners showed a significant improvement during the session(i.e. by comparing the beginning and the end of the session)in the quality of the sound recorded, while experts maintained their results. However, only the beginner group with feedback showed significant improvement between the middle and late part of the session, while the group without feedback remained stable., This work has been partly sponsored by the Spanish TIN project TIMUL (TIN 2013-48152-C2-2-R), the European Union Horizon 2020 research and innovation programme under grant agreement No. 688269 (TELMI project), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Empirically investigating virtual learning companions to enhance social media literacy

  • Theophilou, Emily
  • Schwarze, Veronica
  • Börsting, Johanna
  • Sánchez Reina, Jesús Roberto
  • Scifo, Lidia
  • Lomonaco, Francesco
  • Aprin, Farbod
  • Ognibene, Dimitri
  • Taibi, Davide
  • Hernández Leo, Davinia
  • Eimler, Sabrina
Comunicació presentada a 4th International Conference on Higher Education Learning Methodologies and Technologies Online, celebrat del 21 al 23 de setembre de 2022 a Palerm, Itàlia., Social media platforms provide opportunities for users across the world to connect and communicate between them and engage into acts of social support and entertainment. Yet it can also bring negative consequences as it has been associated with poor mental health and life dissatisfaction. This underlines the importance of delivering social media literacy (SML) interventions that raise awareness of the dangers and threats that are hidden within. To this date, SML initiatives have shown their benefits towards the acquisition of SML skills through the forms of school interventions and mini-games. However, studies on promoting SML through social media platforms need to be also encouraged and innovative approaches to provide interactive scenarios with hands-on experiences need to be formulated. Hence, the project COURAGE introduces a new approach towards SML by proposing the integration of educational opportunities within a controlled social media platform. To provide students the opportunity to learn whilst they naturally explore social media we propose the integration of virtual learning companions. In this paper we report seven empirical approaches towards SML skills acquisition powered by virtual learning companions. The paper concludes with a discussion towards the benefits and limitations of using this type of SML interventions., This work has been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502) and the Volkswagen Stiftung (Courage, ref. 95 566). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Heatmap-guided balanced deep convolution networks for family classification in the wild

  • Aspandi, Decky
  • Martínez, Oriol
  • Binefa i Valls, Xavier
Comunicació presentada a: Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019) celebrat del 14 al 18 de maig a Lille, France., Automatic kinship recognition using Computer Vision, which aims to infer the blood relationship between individuals by only comparing their facial features, has started to gain attention recently. The introduction of large kinship datasets, such as Family In The Wild (FIW), has allowed large scale dataset modeling using state of the art deep learning models. Among other kinship recognition tasks, family classification task is lacking any significant progress due to its increasing difficulty in relation to the family member size. Furthermore, most current state of-the-art approaches do not perform any data pre-processing (which try to improve models accuracy) and are trained without a regularizer (which results in models susceptible to overfitting). In this paper, we present the Deep Family Classifier (DFC), a deep learning model for family classification in the wild. We build our model by combining two sub-networks: internal Image Feature Enhancer which operates by removing the image noise and provides an additional facial heatmap layer and Family Class Estimator trained with strong regularizers and a compound loss. We observe progressive improvement in accuracy during the validation phase, with a state of the art results of 16.89% is obtained for the track 2 in the RFIW2019 challenge and 17.08% of familly classification task on FIW dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the donation bahi2018-19 to the CMTech at the UPF.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Increasing LPWAN scalability by means of concurrent multiband IoT technologies: an industry 4.0 use case

  • Adame, Toni
  • Bel, Albert
  • Bellalta, Boris
One of the most important challenges of the Internet of Things (IoT) in the next years will be the smooth incorporation of millions of smart devices into its communications paradigm. The greater coverage area of sub-1-GHz low-power wide area networks (LPWANs) makes them a suitable technology to easily encompass hundreds of end devices under a single base station. However, LPWAN inherent simplicity affects negatively on scalability, as these networks are not flexible enough to deal with a high number of nodes unless their traffic load is really low, which limits many potential use-cases. This paper analyzes the scalability issue in LPWAN and proposes the INTER-HARE protocol: a solution based on the use of concurrent multiband IoT technologies, where an 868-MHz LPWAN acts as transparent backhaul for a set of subnetworks working at 2.4 GHz. The implementation of the INTER-HARE protocol on a real IoT platform was assessed both in several laboratory testbeds and in a pilot developed in the premises of an industrial company, proving its suitability in non-delay sensitive monitoring applications with end devices scattered throughout the targeted area., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Open Call of INTER-IoT, Research and Innovation action - Horizon 2020 European Project, Grant Agreement #687283, financed by the European Union. It also received funding from the Catalan government through projects SGR-2017-1188 and SGR-2017-1739, and from the Spanish government under the project TEC2016-79510-P.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

TALN at SemEval-2016 Task 14: semantic taxonomy enrichment via sense-based embeddings

  • Espinosa-Anke, Luis
  • Ronzano, Francesco
  • Saggion, Horacio
This paper describes the participation of the TALN team in SemEval-2016 Task 14: Semantic Taxonomy Enrichment. The purpose of the task is to find the best point of attachment in WordNet for a set of Out of Vocabulary (OOV) terms. These may come, to name a few, from domain specific glossaries, slang or typical jargon from Internet forums and chatrooms. Our contribution takes as input an OOV term, its part of speech and its associated definition, and generates a set of WordNet synset candidates derived from modelling the term’s definition as a sense embedding representation. We leverage a BabelNet-based vector space representation, which allows us to map the algorithm’s prediction to WordNet. Our approach is designed to be generic and fitting to any domain, without exploiting, for instance, HTML markup in source web pages. Our system performs above the median of all submitted systems, and rivals in performance a powerful baseline based on extracting the first word of the definition with the same partof-speech as the OOV term., This work was partially funded by Dr. Inventor (FP7-ICT-2013.8.1611383), and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Latent-based adversarial neural networks for facial affect estimations

  • Aspandi, Decky
  • Mallol Ragolta, Adrià
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), celebrat del 16 al 20 de novembre de 2020 a Buenos Aires, Argentina., There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has recently been accelerated due to the emergence of bigger dataset. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

An enhanced adversarial network with combined latent features for spatio-temporal facial affect estimation in the wild

  • Aspandi, Decky
  • Sukno, Federico Mateo
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, celebrat del 8 al 10 de febrer de 2021 a Setúbal, Portugal., Affective Computing has recently attracted the attention of the research community, due to its numerous applications in diverse areas. In this context, the emergence of video-based data allows to enrich the widely used spatial features with the inclusion of temporal information. However, such spatio-temporal modelling often results in very high-dimensional feature spaces and large volumes of data, making training difficult and time consuming. This paper addresses these shortcomings by proposing a novel model that efficiently extracts both spatial and temporal features of the data by means of its enhanced temporal modelling based on latent features. Our proposed model consists of three major networks, coined Generator, Discriminator, and Combiner, which are trained in an adversarial setting combined with curriculum learning to enable our adaptive attention modules. In our experiments, we show the effectiveness of our approach by reporting our competitive results on both the AFEW-VA and SEWA datasets, suggesting that temporal modelling improves the affect estimates both in qualitative and quantitative terms. Furthermore, we find that the inclusion of attention mechanisms leads to the highest accuracy improvements, as its weights seem to correlate well with the appearance of facial movements, both in terms of temporal localisation and intensity. Finally, we observe the sequence length of around 160 ms to be the optimum one for temporal modelling, which is consistent with other relevant findings utilising similar lengths., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Effectiveness of a mixed reality system in terms of social interaction behaviors in children with and without autism spectrum condition

  • Galí Pérez, Olga
  • Sayis, Batuhan
  • Parés, Narcís, 1966-
Comunicació presentada a XXI International Conference on Human Computer Interaction (INTERACCIÓN 20/21), celebrada del 22 al 24 de setembre de 2021 a Màlaga, Espanya., The present study analyses the effectiveness of a mixed reality (MR) face-to-face full-body system to foster social interaction behaviors (SIBs) in a child with ASC and a play partner, a child without ASC (non-ASC). An MR system allows the development of an active and dynamic environment in which the therapist does not need to have a direct influence on individuals during the therapy. In this study, as part of a larger project, the main goals are to show (1) whether an MR system is as effective in fostering SIBs and non-stressful contexts of play in children with ASC as well as in non-ASC, and (2) whether an MR system has the potential to foster a higher number of SIBs and lower state anxiety levels compared to a traditional therapy setting (LEGO). Our results show that no significant differences were found in starting a new social sequence ("social initiation"), in externalizing "thoughts aloud" ("externalization"), and in SIBs as a whole ("social interaction") between ASC/non-ASC children both in LEGO and in the MR system. In addition, we found similar results when we compared both systems. There were also no significant differences related to state anxiety levels. These positive results show that an MR system is, at least, as good as a typical social intervention in promoting SIBs, as well as, in creating a non-stressful context of play; while an MR system has greater flexibility and a broad range of potential experiences., This work has been funded by Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Program (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Emotion embedding spaces for matching music to stories

  • Won, Minz
  • Salamon, Justin
  • Bryan, Nicholas J
  • Mysore, Gautham J
  • Serra, Xavier
Content creators often use music to enhance their stories, as it can be a powerful tool to convey emotion. In this paper, our goal is to help creators find music to match the emotion of their story. We focus on text-based stories that can be auralized (e.g., books), use multiple sentences as input queries, and automatically retrieve matching music. We formalize this task as a cross-modal text-to-music retrieval problem. Both the music and text domains have existing datasets with emotion labels, but mismatched emotion vocabularies prevent us from using mood or emotion annotations directly for matching. To address this challenge, we propose and investigate several emotion embedding spaces, both manually defined (e.g., valence/arousal) and data-driven (e.g., Word2Vec and metric learning) to bridge this gap. Our experiments show that by leveraging these embedding spaces, we are able to successfully bridge the gap between modalities to facilitate cross modal retrieval. We show that our method can leverage the well established valence-arousal space, but that it can also achieve our goal via data-driven embedding spaces. By leveraging data-driven embeddings, our approach has the potential of being generalized to other retrieval tasks that require broader or completely different vocabularies., This work was funded by the predoctoral grant MDM2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

FastLAS: scalable inductive logic programming incorporating domain-specific optimisation criteria

  • Law, Mark
  • Russo, Alessandra
  • Bertino, Elisa
  • Broda, Krysia
  • Lobo, Jorge
Comunicació presentada a The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), celebrat del 7 al 12 de febrer de 2020 a Nova York, Estats Units., Inductive Logic Programming (ILP) systems aim to find a set of logical rules, called a hypothesis, that explain a set of examples. In cases where many such hypotheses exist, ILP systems often bias towards shorter solutions, leading to highly general rules being learned. In some application domains like security and access control policies, this bias may not be desirable, as when data is sparse more specific rules that guarantee tighter security should be preferred. This paper presents a new general notion of a scoring function over hypotheses that allows a user to express domain-specific optimisation criteria. This is incorporated into a new ILP system, called FastLAS, that takes as input a learning task and a customised scoring function, and computes an optimal solution with respect to the given scoring function. We evaluate the accuracy of FastLAS over real-world datasets for access control policies and show that varying the scoring function allows a user to target domain-specific performance metrics. We also compare FastLAS to state-of-the-art ILP systems, using the standard ILP bias for shorter solutions, and demonstrate that FastLAS is significantly faster and more scalable., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.