Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 82
Encontrada(s) 1 página(s)

Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

Breathing, postural stability, and psychological health, a study to explore triangular links

  • Tassani, Simone|||0000-0002-8652-2314
  • Chaves, Paula
  • Beardsley, Marc|||0000-0002-3874-0739
  • Vujovic, Milica|||0000-0003-0963-7182
  • Ramírez, Juan
  • Mendoza, Jimena
  • Portero Tresserra, Marta|||0000-0003-4149-1339
  • González Ballester, Miguel Ángel|||0000-0002-9227-6826
  • Hernández-Leo, Davinia|||0000-0003-0548-7455
This study aims to test the hypothesis that breathing can be directly linked to postural stability and psychological health. A protocol enabling the simultaneous analysis of breathing, posture, and emotional levels in university students is presented. This aims to verify the possibility of defining a triangular link and to test the adequacy of various measurement techniques. Twenty-three subjects (9 females and 14 males), aged between 18 and 23 years, were recruited. The experiment consisted of four conditions, each lasting 3 minutes: Standard quiet standing with open eyes 1), with closed eyes 2), and relaxed quiet standing while attempting deep abdominal breathing with open eyes 3) and with closed eyes 4). These latter two acquisitions were performed after subjects were instructed to maintain a relaxed state. All subjects underwent postural and stability analysis in a motion capture laboratory. The presented protocol enabled the extraction of 4 sets of variables: Stabilometric data, based on the displacement of the center of pressure and acceleration, derived respectively from force plate and wearable sensors. Postural variables: angles of each joint of the body were measured using a stereophotogrammetric system, implementing the Helen Hayes protocol. Breathing compartment: optoelectronic plethysmography allowed the measurement of the percentage of use of each chest compartment. Emotional state was evaluated using both psychometric data and physiological signals. A multivariate analysis was proposed. A holistic protocol was presented and tested. Emotional levels were found to be related to posture and the varied use of breathing compartments. Abdominal breathing proved to be a challenging task for most subjects, especially females, who were unable to control their breathing patterns. In males, the abdominal breathing pattern was associated with increased stability and reduced anxiety. In conclusion, difficulties in performing deep abdominal breathing were associated with elevated anxiety scores and decreased stability. This depicts a circular self-sustaining relationship that may reduce the quality of life, undermine learning, and contribute to muscular co-contraction and the development of musculoskeletal disorders. The presented protocol can be utilized to quantitatively and holistically assess the healthy and/or pathological condition of subjects.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The effect of a group awareness tool in synchronous online discussions: studying participation, quality and balance

  • Theophilou, Emily
  • Sánchez Reina, Jesús Roberto
  • Hernández Leo, Davinia
  • Odakura, Valguima
  • Amarasinghe, Ishari
  • Lobo Quintero, René Alejandro
Computer-supported collaborative learning (CSCL) seeks to improve students’ learning with the support of technology. Although CSCL facilitates an enriching environment for cooperation, CSCL activities might be affected by asymmetrical participation. Group awareness tools have proven to enhance learners’ interactions, balancing the levels of participation and increasing the learning outcomes. This study investigates the effect of a group awareness tool (GAT) on participation within synchronous CSCL activities in the context of extracurricular activities. We designed a quasi-experimental within-subject study (GAT exposure and control condition) and tested an ad hoc GAT in a web-based CSCL platform with high school students (N = 140). The measured variables included the effect of the GAT on students’ participation and the quality of discussion. A complementary analysis evaluated students’ perceptions of the tool. Results revealed that the implementation of a GAT encourages students to take part in CSCL discussions without explicitly hindering its quality. Even so, the balance of participation was not significantly affected. Students further reported that they found the GAT useful to regulate collaboration. The results from the study provide further knowledge of the functioning of group awareness tools in secondary education and share an insight into how students perceive them., This work has been partially funded by the Volkswagen Foundation (COURAGE project, no. 95567). TIDE-UPF also acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502 and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Robust algorithms with polynomial loss for near-unanimity CSPs

  • Dalmau, Víctor
  • Kozik, Marcin
  • Krokhin, Andrei
  • Makarychev, Konstantin
  • Makarychev, Yury
  • Opršal, Jakub
An instance of the constraint satisfaction problem (CSP) is given by a family of constraints on overlapping sets of variables, and the goal is to assign values from a fixed domain to the variables so that all constraints are satisfied. In the optimization version, the goal is to maximize the number of satisfied constraints. An approximation algorithm for a CSP is called robust if it outputs an assignment satisfying an (1 - g(ϵ))-fraction of constraints on any (1 ϵ)- satisfiable instance, where the loss function g is such that g(ϵ) → 0 as ϵ → 0. We study how the robust approximability of CSPs depends on the set of constraint relations allowed in instances, the so-called constraint language. All constraint languages admitting a robust polynomial-time algorithm (with some g) have been characterized by Barto and Kozik, with the general bound on the loss g being doubly exponential, specifically g(ϵ) = O((log log(1/ϵ))/ log(1/ϵ)). It is natural to ask when a better loss can be achieved, in particular polynomial loss g(ϵ) = O(ϵ1/k) for some constant k. In this paper, we consider CSPs with a constraint language having a near-unanimity polymorphism. This general condition almost matches a known necessary condition for having a robust algorithm with polynomial loss. We give two randomized robust algorithms with polynomial loss for such CSPs: one works for any near-unanimity polymorphism and the parameter k in the loss depends on the size of the domain and the arity of the relations in Γ, while the other works for a special ternary near-unanimity operation called the dual discriminator with k = 2 for any domain size. In the latter case, the CSP is a common generalization of Unique Games with a fixed domain and 2-Sat. In the former case, we use the algebraic approach to the CSP. Both cases use the standard semidefinite programming relaxation for the CSP., The first author's research was partially supported by MINECO under grant TIN2016-76573-C2-1-P and Maria de Maeztu Units of Excellence programme MDM-2015-0502. The fifth author's research was partially supported by NSF awards CAREER CCF-1150062 and IIS-1302662. The sixth author's research was supported by the European Research Council (grant agreement 681988, CSP-Infinity). The research of the second and sixth authors was partially supported by the National Science Centre Poland under grant UMO-2014/13/B/ST6/01812.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Empirically investigating virtual learning companions to enhance social media literacy

  • Theophilou, Emily
  • Schwarze, Veronica
  • Börsting, Johanna
  • Sánchez Reina, Jesús Roberto
  • Scifo, Lidia
  • Lomonaco, Francesco
  • Aprin, Farbod
  • Ognibene, Dimitri
  • Taibi, Davide
  • Hernández Leo, Davinia
  • Eimler, Sabrina
Comunicació presentada a 4th International Conference on Higher Education Learning Methodologies and Technologies Online, celebrat del 21 al 23 de setembre de 2022 a Palerm, Itàlia., Social media platforms provide opportunities for users across the world to connect and communicate between them and engage into acts of social support and entertainment. Yet it can also bring negative consequences as it has been associated with poor mental health and life dissatisfaction. This underlines the importance of delivering social media literacy (SML) interventions that raise awareness of the dangers and threats that are hidden within. To this date, SML initiatives have shown their benefits towards the acquisition of SML skills through the forms of school interventions and mini-games. However, studies on promoting SML through social media platforms need to be also encouraged and innovative approaches to provide interactive scenarios with hands-on experiences need to be formulated. Hence, the project COURAGE introduces a new approach towards SML by proposing the integration of educational opportunities within a controlled social media platform. To provide students the opportunity to learn whilst they naturally explore social media we propose the integration of virtual learning companions. In this paper we report seven empirical approaches towards SML skills acquisition powered by virtual learning companions. The paper concludes with a discussion towards the benefits and limitations of using this type of SML interventions., This work has been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502) and the Volkswagen Stiftung (Courage, ref. 95 566). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Moving beyond benchmarks and competitions: towards addressing social media challenges in an educational context

  • Ognibene, Dimitri
  • Donabauer, Gregor
  • Theophilou, Emily
  • Buršić, Sathya
  • Lomonaco, Francesco
  • Wilkens, Rodrigo
  • Hernández Leo, Davinia
  • Kruschwitz, Udo
Natural language processing and other areas of artificial intelligence have seen staggering progress in recent years, yet much of this is reported with reference to somewhat limited benchmark datasets. We see the deployment of these techniques in realistic use cases as the next step in this development. In particular, much progress is still needed in educational settings, which can strongly improve users’ safety on social media. We present our efforts to develop multi-modal machine learning algorithms to be integrated into a social media companion aimed at supporting and educating users in dealing with fake news and other social media threats. Inside the companion environment, such algorithms can automatically assess and enable users to contextualize different aspects of their social media experience. They can estimate and display different characteristics of content in supported users’ feeds, such as ‘fakeness’ and ‘sentiment’, and suggest related alternatives to enrich users’ perspectives. In addition, they can evaluate the opinions, attitudes, and neighbourhoods of the users and of those appearing in their feeds. The aim of the latter process is to raise users’ awareness and resilience to filter bubbles and echo chambers, which are almost unnoticeable and rarely understood phenomena that may affect users’ information intake unconsciously and are unexpectedly widespread. The social media environment is rapidly changing and complex. While our algorithms show state-of-the-art performance, they rely on task-specific datasets, and their reliability may decrease over time and be limited against novel threats. The negative impact of these limits may be exasperated by users’ over-reliance on algorithmic tools. Therefore, companion algorithms and educational activities are meant to increase users’ awareness of social media threats while exposing the limits of such algorithms. This will also provide an educational example of the limits affecting the machine-learning components of social media platforms. We aim to devise, implement and test the impact of the companion and connected educational activities in acquiring and supporting conscientious and autonomous social media usage., This work was mainly supported by the project COURAGE: A Social Media Companion Safeguarding and Educating Students funded by the Volkswagen Foundation, grant number 95563, 95564, 95566, 9B145. This work has also been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Robust facial alignment with internal denoising auto-encoder

  • Aspandi, Decky
  • Martínez, Oriol
  • Sukno, Federico Mateo
  • Binefa i Valls, Xavier
Comunicació presentada a: 16th Conference on Computer and Robot Vision (CRV) celebrat del 29 al 31 de maig de 2019 a Kingston, Canadà., The development of facial alignment models is growing rapidly thanks to the availability of large facial landmarked datasets and powerful deep learning models. However, important challenges still remain for facial alignment models to work on images under extreme conditions, such as severe occlusions or large variations in pose and illumination. Current attempts to overcome this limitation have mainly focused on building robust feature extractors with the assumption that the model will be able to discard the noise and select only the meaningful features. However, such an assumption ignores the importance of understanding the noise that characterizes unconstrained images, which has been shown to benefit computer vision models if used appropriately on the learning strategy. Thus, in this paper we investigate the introduction of specialized modules for noise detection and removal, in combination with our state-of-the-art facial alignment module and show that this leads to improved robustness both to synthesized noise and in-the-wild conditions. The proposed model is built by combining two major subnetworks: internal image denoiser (based on the Auto-Encoder architecture) and facial landmark localiser (based on the inception-resnet architecture). Our results on the 300-W and Menpo datasets show that our model can effectively handle different types of synthetic noise, which also leads to enhanced robustness in real-world unconstrained settings, reaching top state-of-the-art accuracy., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502) and the donation bahi2018-19 to the CMTech at the UPF.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

FSD50K: an open dataset of human-labeled sound events

  • Fonseca, Eduardo
  • Favory, Xavier
  • Pons, Jordi
  • Font, Frederic
  • Serra, Xavier
Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2 M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K , an open dataset containing over 51 k audio clips totalling over 100 h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research., This work was supported in part by European Union’s Horizon 2020 research and innovation programme under Grant Agreement 688382 AudioCommons, in part by two Google Faculty Research Awards 2017 and 2018, and in part by the Maria de Maeztu Units of Excellence Programme under Grant MDM-2015-0502.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Heatmap-guided balanced deep convolution networks for family classification in the wild

  • Aspandi, Decky
  • Martínez, Oriol
  • Binefa i Valls, Xavier
Comunicació presentada a: Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019) celebrat del 14 al 18 de maig a Lille, France., Automatic kinship recognition using Computer Vision, which aims to infer the blood relationship between individuals by only comparing their facial features, has started to gain attention recently. The introduction of large kinship datasets, such as Family In The Wild (FIW), has allowed large scale dataset modeling using state of the art deep learning models. Among other kinship recognition tasks, family classification task is lacking any significant progress due to its increasing difficulty in relation to the family member size. Furthermore, most current state of-the-art approaches do not perform any data pre-processing (which try to improve models accuracy) and are trained without a regularizer (which results in models susceptible to overfitting). In this paper, we present the Deep Family Classifier (DFC), a deep learning model for family classification in the wild. We build our model by combining two sub-networks: internal Image Feature Enhancer which operates by removing the image noise and provides an additional facial heatmap layer and Family Class Estimator trained with strong regularizers and a compound loss. We observe progressive improvement in accuracy during the validation phase, with a state of the art results of 16.89% is obtained for the track 2 in the RFIW2019 challenge and 17.08% of familly classification task on FIW dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the donation bahi2018-19 to the CMTech at the UPF.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Emotion embedding spaces for matching music to stories

  • Won, Minz
  • Salamon, Justin
  • Bryan, Nicholas J
  • Mysore, Gautham J
  • Serra, Xavier
Content creators often use music to enhance their stories, as it can be a powerful tool to convey emotion. In this paper, our goal is to help creators find music to match the emotion of their story. We focus on text-based stories that can be auralized (e.g., books), use multiple sentences as input queries, and automatically retrieve matching music. We formalize this task as a cross-modal text-to-music retrieval problem. Both the music and text domains have existing datasets with emotion labels, but mismatched emotion vocabularies prevent us from using mood or emotion annotations directly for matching. To address this challenge, we propose and investigate several emotion embedding spaces, both manually defined (e.g., valence/arousal) and data-driven (e.g., Word2Vec and metric learning) to bridge this gap. Our experiments show that by leveraging these embedding spaces, we are able to successfully bridge the gap between modalities to facilitate cross modal retrieval. We show that our method can leverage the well established valence-arousal space, but that it can also achieve our goal via data-driven embedding spaces. By leveraging data-driven embeddings, our approach has the potential of being generalized to other retrieval tasks that require broader or completely different vocabularies., This work was funded by the predoctoral grant MDM2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Latent-based adversarial neural networks for facial affect estimations

  • Aspandi, Decky
  • Mallol Ragolta, Adrià
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), celebrat del 16 al 20 de novembre de 2020 a Buenos Aires, Argentina., There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has recently been accelerated due to the emergence of bigger dataset. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Seizure onset zone lateralization using a non-linear analysis of micro vs. macro electroencephalographic recordings during seizure-free stages of the sleep-wake cycle from epilepsy patients

  • Martínez, Cristina G. B.
  • Niediek, Johannes
  • Mormann, Florian
  • Andrzejak, Ralph Gregor
The application of non-linear signal analysis techniques to biomedical data is key to improve our knowledge about complex physiological and pathological processes. In particular, the use of non-linear techniques to study electroencephalographic (EEG) recordings can provide an advanced characterization of brain dynamics. In epilepsy these dynamics are altered at different spatial scales of neuronal organization. We therefore apply non-linear signal analysis to EEG recordings from epilepsy patients derived with intracranial hybrid electrodes, which are composed of classical macro contacts and micro wires. Thereby, these electrodes record EEG at two different spatial scales. Our aim is to test the degree to which the analysis of the EEG recorded at these different scales allows us to characterize the neuronal dynamics affected by epilepsy. For this purpose, we retrospectively analyzed long-term recordings performed during five nights in three patients during which no seizures took place. As a benchmark we used the accuracy with which this analysis allows determining the hemisphere that contains the seizure onset zone, which is the brain area where clinical seizures originate. We applied the surrogate-corrected non-linear predictability score (ψ), a non-linear signal analysis technique which was shown previously to be useful for the lateralization of the seizure onset zone from classical intracranial EEG macro contact recordings. Higher values of ψ were found predominantly for signals recorded from the hemisphere containing the seizure onset zone as compared to signals recorded from the opposite hemisphere. These differences were found not only for the EEG signals recorded with macro contacts, but also for those recorded with micro wires. In conclusion, the information obtained from the analysis of classical macro EEG contacts can be complemented by the one of micro wire EEG recordings. This combined approach may therefore help to further improve the degree to which quantitative EEG analysis can contribute to the diagnostics in epilepsy patients., The authors acknowledge funding from the Spanish Ministry of Economy and Competitiveness, Grant No. FIS2014-54177-R (CM and RA) and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme, MDM-2015-0502 (CM), from the Volkswagen foundation (FM), from the German Research Council (DFG MO 930/8-1, DFG SFB 1089 to FM).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Towards assisted electrocardiogram interpretation using an AI-enabled Augmented Reality headset

  • Lampreave, Paula
  • Jimenez-Perez, Guillermo
  • Sanz-Pérez, Isidro
  • Gomez, Alberto
  • Camara, Oscar
The interpretation of electrocardiograms (ECGs) is key for the diagnosis and monitoring of cardiovascular health. Despite the progressive digital transformation in healthcare, it is still common for clinicians to analyse ECG printed on paper. Although some systems provide signal processing-based ECG classification, clinicians often find it unreliable. Artificial Intelligence (AI) techniques are becoming state-of-the-art for ECG processing but the lack of digitised ECG has hampered the clinical translation of these techniques. Concurrently, we are living a rise in augmented reality (AR) technologies, with an increasing availability of devices. In this work, we present an automatic digitisation and assisted interpretation of ECG based on an AI-enabled Augmented Reality headset. The AR headset is used to acquire an image of the printed ECG, from which the digitised ECG signal is extracted. Afterwards, the digitised ECG is introduced into a Deep Learning (DL) algorithm pre-trained on a public database of 12-lead ECG recordings. The output of the DL algorithm classifies the ECG signal onto different cardiomyopathy categories, which is then visualized back in the AR headset. Preliminary classification results on simulated ECG images (96.5% of accuracy) confirm the potential of the developed approach to contribute on the digital transformation of ECG processing., This work was supported by the Ministerio de Ciencia, Innovación y Universidades under the Retos I+D Programme (RTI2018-101193-B-I00), the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Ministerio de Economíay Competitividad under the Programme for the Formation of Doctors (PRE2018-084062). Alberto Gomez acknowl-edges financial support from the Department of Health via the National Institute for Health Research (NIHR) comprehensive Biomedical Research Centre award to Guy’s and St Thomas’ NHS Foundation Trust in partnership with King's College London and King’s College Hospital NHS Foundation Trust.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Redundancy as a measure of fault-tolerance for the Internet of Things: A review

  • Lobo, Jorge
  • Rullo, Antonino
  • Serra, Edoardo
In this paper we review and analyze redundancy-based fault-tolerant techniques for the IoT as a paradigm to support two of the main goals of computer security: availability and integrity. We organized the presentation in terms of the three main tasks performed by the nodes of an IoT network: sensing, routing, and control. We first discuss how the implementation of fault-tolerance in the three areas is primary for the correct operation of an entire system. We provide an overview of the different approaches that have been used to address failures in sensing and routing. Control devices typically implement state machines that take decisions based on the measurement of sensors and may also ask actuators to execute actions. Traditionally state-machine replication for fault-tolerance is realized through consensus protocols. Most protocols were developed in the 80’s and 90’s. We will review the properties of such protocols in detail and discuss their limitations for the IoT. Since 2008, consensus algorithms took a new direction with the introduction of the concept of blockchain. Standard blockchain based protocols cannot be applied without modifications to support fault-tolerance in the IoT. We will review some recent results in this new class of algorithms, and show how they can provide the flexibility required to support fault-tolerance in control devices, and thus overcome some of the limitations of the traditional consensus protocols., Jorge Lobo was partially supported by the Spanish Ministry of Economy and Competitiveness. Grant Numbers: TIN201681032P, MDM20150502.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Multimodal metric learning for tag-based music retrieval

  • Won, Minz
  • Oramas, Sergio
  • Nieto Caballero, Oriol
  • Gouyon, Fabien
  • Serra, Xavier
Comunicació presentada a 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), celebrat del 6 a l'11 de juny de 2021 de manera virtual., Tag-based music retrieval is crucial to browse large-scale mu-sic libraries efficiently. Hence, automatic music tagging has been actively explored, mostly as a classification task, which has an inherent limitation: a fixed vocabulary. On the other hand, metric learning enables flexible vocabularies by using pretrained word embeddings as side information. Also, met-ric learning has proven its suitability for cross-modal retrieval tasks in other domains (e.g., text-to-image) by jointly learning a multimodal embedding space. In this paper, we investigate three ideas to successfully introduce multimodal metric learning for tag-based music retrieval: elaborate triplet sampling, acoustic and cultural music information, and domain-specific word embeddings. Our experimental results show that the proposed ideas enhance the retrieval system quantitatively and qualitatively. Furthermore, we release the MSD500: a subset of the Million Song Dataset (MSD) containing 500 cleaned tags, 7 manually annotated tag categories, and user taste profiles., This work was funded by the predoctoral grant MDM-2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Usage of network simulators in machine-learning-assisted 5G/6G networks

  • Wilhelmi Roca, Francesc
  • Carrascosa Zamacois, Marc
  • Cano, Cristina
  • Jonsson, Anders, 1973-
  • Ram, Vishnu
  • Bellalta, Boris
Without any doubt, Machine Learning (ML) will be an important driver of future communications due to its foreseen performance when applied to complex problems. However, the application of ML to networking systems raises concerns among network operators and other stakeholders, especially regarding trustworthiness and reliability. In this article, we devise the role of network simulators for bridging the gap between ML and communications systems. In particular, we present an architectural integration of simulators in ML-aware networks for training, testing, and validating ML models before being applied to the operative network. Moreover, we provide insights into the main challenges resulting from this integration, and then give hints discussing how they can be overcome. Finally, we illustrate the integration of network simulators into ML-assisted communications through a proof-of-concept testbed implementation of a residential WiFi network., This work has been partially supported by grants MDM-2015-0502, WINDMAL PGC2018-099959- B-I00 (MCIU/AEI/FEDER,UE), 2017-SGR-11888, and by SPOTS project (RTI2018-095438-A-I00) funded by the Spanish Ministry of Science, Innovation and Universities.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Prediction of lung nodule progression with an uncertainty-aware hierarchical probabilistic network

  • Rafael-Palou, Xavier
  • Aubanell, Anton
  • Ceresa, Mario
  • Ribas, Vicent
  • Piella Fenoy, Gemma
  • González Ballester, Miguel Ángel, 1973-
Predicting whether a lung nodule will grow, remain stable or regress over time, especially early in its follow-up, would help doctors prescribe personalized treatments and better surgical planning. However, the multifactorial nature of lung tumour progression hampers the identification of growth patterns. In this work, we propose a deep hierarchical generative and probabilistic network that, given an initial image of the nodule, predicts whether it will grow, quantifies its future size and provides its expected semantic appearance at a future time. Unlike previous solutions, our approach also estimates the uncertainty in the predictions from the intrinsic noise in medical images and the inter-observer variability in the annotations. The evaluation of this method on an independent test set reported a future tumour growth size mean absolute error of 1.74 mm, a nodule segmentation Dice's coefficient of 78% and a tumour growth accuracy of 84% on predictions made up to 24 months ahead. Due to the lack of similar methods for providing future lung tumour growth predictions, along with their associated uncertainty, we adapted equivalent deterministic and alternative generative networks (i.e., probabilistic U-Net, Bayesian test dropout and Pix2Pix). Our method outperformed all these methods, corroborating the adequacy of our approach., This work was partially funded by the Industrial Doctorates Program (AGAUR) grant number DI087, the Spanish Ministry of Economy and Competitiveness (Project INSPIRE FIS2017-89535-C2-2-R, Maria de Maeztu Units of Excellence Program MDM-2015-0502, and CoVEST project PID2019-110185RB-C21). G. Piella is supported by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

TALN at SemEval-2016 Task 14: semantic taxonomy enrichment via sense-based embeddings

  • Espinosa-Anke, Luis
  • Ronzano, Francesco
  • Saggion, Horacio
This paper describes the participation of the TALN team in SemEval-2016 Task 14: Semantic Taxonomy Enrichment. The purpose of the task is to find the best point of attachment in WordNet for a set of Out of Vocabulary (OOV) terms. These may come, to name a few, from domain specific glossaries, slang or typical jargon from Internet forums and chatrooms. Our contribution takes as input an OOV term, its part of speech and its associated definition, and generates a set of WordNet synset candidates derived from modelling the term’s definition as a sense embedding representation. We leverage a BabelNet-based vector space representation, which allows us to map the algorithm’s prediction to WordNet. Our approach is designed to be generic and fitting to any domain, without exploiting, for instance, HTML markup in source web pages. Our system performs above the median of all submitted systems, and rivals in performance a powerful baseline based on extracting the first word of the definition with the same partof-speech as the OOV term., This work was partially funded by Dr. Inventor (FP7-ICT-2013.8.1611383), and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

FastLAS: scalable inductive logic programming incorporating domain-specific optimisation criteria

  • Law, Mark
  • Russo, Alessandra
  • Bertino, Elisa
  • Broda, Krysia
  • Lobo, Jorge
Comunicació presentada a The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), celebrat del 7 al 12 de febrer de 2020 a Nova York, Estats Units., Inductive Logic Programming (ILP) systems aim to find a set of logical rules, called a hypothesis, that explain a set of examples. In cases where many such hypotheses exist, ILP systems often bias towards shorter solutions, leading to highly general rules being learned. In some application domains like security and access control policies, this bias may not be desirable, as when data is sparse more specific rules that guarantee tighter security should be preferred. This paper presents a new general notion of a scoring function over hypotheses that allows a user to express domain-specific optimisation criteria. This is incorporated into a new ILP system, called FastLAS, that takes as input a learning task and a customised scoring function, and computes an optimal solution with respect to the given scoring function. We evaluate the accuracy of FastLAS over real-world datasets for access control policies and show that varying the scoring function allows a user to target domain-specific performance metrics. We also compare FastLAS to state-of-the-art ILP systems, using the standard ILP bias for shorter solutions, and demonstrate that FastLAS is significantly faster and more scalable., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

A multiple constraints framework for collaborative learning flow orchestration

  • Manathunga, Kalpani
  • Hernández Leo, Davinia
Paper presented at ICWL 2016, 15th International Conference, Rome, Italy, October 26–29, 2016., Collaborative Learning Flow Patterns (e.g., Jigsaw) offer sound pedagogical strategies to foster fruitful social interactions among learners. The pedagogy behind the patterns involves a set of intrinsic constraints that need to/nbe considered when orchestrating the learning flow. These constraints relate to the organization of the flow (e.g., Jigsaw pattern - a global problem is divided into sub-problems and a constraint is that there need to be at least one expert group working on each sub-problem) and group formation policies (e.g., groups solving the global problem need to have at least one member coming from a different previous expert group). Besides, characteristics of specific learning situations such as learners’ profile and technological tools used provide additional parameters that can be considered as context-related extrinsic constraints relevant to the orchestration (e.g., heterogeneous groups depending on experience or interests). This paper proposes a constraint framework that considers different constraints for orchestration services enabling adaptive computation of orchestration aspects. Substantiation of the framework with a case study demonstrated the feasibility, usefulness and the expressiveness of the framework., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness/n(TIN2014-53199-C3-3-R; MDM-2015-0502).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Curriculum learning for improved femur fracture classification: scheduling data with prior knowledge and uncertainty

  • Jiménez Sánchez, Amelia
  • Mateus, Diana
  • Kirchhoff, Sonja
  • Kirchhoff, Chlodwig
  • Biberthaler, Peter
  • Navab, Nassir
  • González Ballester, Miguel Ángel, 1973-
  • Piella Fenoy, Gemma
An adequate classification of proximal femur fractures from X-ray images is crucial for the treatment choice and the patients’ clinical outcome. We rely on the commonly used AO system, which describes a hierarchical knowledge tree classifying the images into types and subtypes according to the fracture’s location and complexity. In this paper, we propose a method for the automatic classification of proximal femur fractures into 3 and 7 AO classes based on a Convolutional Neural Network (CNN). As it is known, CNNs need large and representative datasets with reliable labels, which are hard to collect for the application at hand. In this paper, we design a curriculum learning (CL) approach that improves over the basic CNNs performance under such conditions. Our novel formulation reunites three curriculum strategies: individually weighting training samples, reordering the training set, and sampling subsets of data. The core of these strategies is a scoring function ranking the training samples. We define two novel scoring functions: one from domain-specific prior knowledge and an original self-paced uncertainty score. We perform experiments on a clinical dataset of proximal femur radiographs. The curriculum improves proximal femur fracture classification up to the performance of experienced trauma surgeons. The best curriculum method reorders the training set based on prior knowledge resulting into a classification improvement of 15%. Using the publicly available MNIST dataset, we further discuss and demonstrate the benefits of our unified CL formulation for three controlled and challenging digit recognition scenarios: with limited amounts of data, under class-imbalance, and in the presence of label noise. The code of our work is available at: https://github.com/ameliajimenez/curriculum-learning-prior-uncertainty., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673 and by the Spanish Ministry of Economy [MDM-2015-0502]. A. Jiménez-Sánchez has received financial support through the “la Caixa” Foundation (ID Q5850017D), fellowship code: LCF/BQ/IN17/11620013. D. Mateus has received funding from Nantes Métropole and the European Regional Development, Pays de la Loire, under the Connect Talent scheme.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Computing hierarchical finite state controllers with classical planning

  • Segovia-Aguas, Javier
  • Jiménez, Sergio
  • Jonsson, Anders, 1973-
Finite State Controllers (FSCs) are an effective way to compactly represent sequential plans. By imposing appropriate conditions on transitions, FSCs can also represent generalized plans (plans that solve a range of planning problems from a given domain). In this paper we introduce the concept of hierarchical FSCs for planning by allowing controllers to call other controllers. This call mechanism allows hierarchical FSCs to represent generalized plans more compactly than individual FSCs, to compute controllers in a modular fashion or even more, to compute recursive controllers. The paper introduces a classical planning compilation for computing hierarchical FSCs that solve challenging generalized planning tasks. The compilation takes as input a finite set of classical planning problems from a given domain. The output of the compilation is a single classical planning problem whose solution induces: (1) a hierarchical FSC and (2), the corresponding validation of that controller on the input classical planning problems., This work is partially supported by grant TIN2015-67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jiménez is supported by the RYC15/18009, program funded by the Spanish government.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

An enhanced adversarial network with combined latent features for spatio-temporal facial affect estimation in the wild

  • Aspandi, Decky
  • Sukno, Federico Mateo
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, celebrat del 8 al 10 de febrer de 2021 a Setúbal, Portugal., Affective Computing has recently attracted the attention of the research community, due to its numerous applications in diverse areas. In this context, the emergence of video-based data allows to enrich the widely used spatial features with the inclusion of temporal information. However, such spatio-temporal modelling often results in very high-dimensional feature spaces and large volumes of data, making training difficult and time consuming. This paper addresses these shortcomings by proposing a novel model that efficiently extracts both spatial and temporal features of the data by means of its enhanced temporal modelling based on latent features. Our proposed model consists of three major networks, coined Generator, Discriminator, and Combiner, which are trained in an adversarial setting combined with curriculum learning to enable our adaptive attention modules. In our experiments, we show the effectiveness of our approach by reporting our competitive results on both the AFEW-VA and SEWA datasets, suggesting that temporal modelling improves the affect estimates both in qualitative and quantitative terms. Furthermore, we find that the inclusion of attention mechanisms leads to the highest accuracy improvements, as its weights seem to correlate well with the appearance of facial movements, both in terms of temporal localisation and intensity. Finally, we observe the sequence length of around 160 ms to be the optimum one for temporal modelling, which is consistent with other relevant findings utilising similar lengths., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

On security policy migrations

  • Lobo, Jorge
  • Bertino, Elisa
  • Russo, Alessandra
Comunicació presentada al SACMAT '20: The 25th ACM Symposium on Access Control Models and Technologies, celebrat del 10 al 12 de juny de 2020 a Barcelona, Espanya., There has been over the past decade a rapid change towards computational environments that are comprised of large and diverse sets of devices, many of them mobile, which can connect in flexible and context-dependent ways. Examples range from networks where we can have communications between powerful cloud centers, to the myriad of simple sensor devices on the IoT. As the management of these dynamic environments becomes ever more complex, we want to propose policy migrations as a methodology to simplify the management of security policies by re-utilizing and re-deploying existing policies as the systems change. We are interested in understanding the challenges raised answering the following question: given a security policy that is being enforced in a particular source computational device, what does it entail to migrate this policy to be enforced in a different target device? Because of the differences between devices and because these devices cannot be seen in isolation but in the context where they are deployed, the meaning of the policy enforced in the source device needs to be re-interpreted and implemented in the context of the target device. The aim of the paper is to present a formal framework to evaluate the appropriateness of the migration., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was also supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Meshless electrophysiological modeling of cardiac resynchronization therapy: benchmark analysis with finite-element methods in experimental data

  • Albors Lucas, Carlos
  • Lluch Álvarez, Èric
  • Gomez, Juan Francisco
  • Cedilnik, Nicolas
  • Mountris, Konstantinos A.
  • Mansi, Tommaso
  • Khamzin, Svyatoslav
  • Dokuchaev, Arsenii
  • Solovyova, Olga
  • Pueyo, Esther
  • Sermesant, Maxime
  • Sebastian, Rafael
  • Morales, Hernán G.
  • Camara, Oscar
Computational models of cardiac electrophysiology are promising tools for reducing the rates of non-response patients suitable for cardiac resynchronization therapy (CRT) by optimizing electrode placement. The majority of computational models in the literature are mesh-based, primarily using the finite element method (FEM). The generation of patient-specific cardiac meshes has traditionally been a tedious task requiring manual intervention and hindering the modeling of a large number of cases. Meshless models can be a valid alternative due to their mesh quality independence. The organization of challenges such as the CRT-EPiggy19, providing unique experimental data as open access, enables benchmarking analysis of different cardiac computational modeling solutions with quantitative metrics. We present a benchmark analysis of a meshless-based method with finite-element methods for the prediction of cardiac electrical patterns in CRT, based on a subset of the CRT-EPiggy19 dataset. A data assimilation strategy was designed to personalize the most relevant parameters of the electrophysiological simulations and identify the optimal CRT lead configuration. The simulation results obtained with the meshless model were equivalent to FEM, with the most relevant aspect for accurate CRT predictions being the parameter personalization strategy (e.g., regional conduction velocity distribution, including the Purkinje system and CRT lead distribution)., This work was supported in part by the Spanish Ministry of Science and Innovation (TIN2011-28067, REDINSCOR RD06/003/008, PID2019-105674RB-I00), the Spanish Industrial and Technological Development Center (cvREMOD-CEN-20091044), the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), the Government of Aragón (Spain) (LMP94_21), the Directorate General of Science Policy of the Generalitat Valenciana (Spain) (PROMETEU 2016/088), the Seventh Framework Programme (FP7/2007-2013) for research, technological and demonstration under grant agreement VP2HF (no. 611823), by the RSF grant no. 19-14-00134, and by European Regional Development Fund (ERDF) DPI2016-75799-R (AEI/ERDF, EU).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Effectiveness of a mixed reality system in terms of social interaction behaviors in children with and without autism spectrum condition

  • Galí Pérez, Olga
  • Sayis, Batuhan
  • Parés, Narcís, 1966-
Comunicació presentada a XXI International Conference on Human Computer Interaction (INTERACCIÓN 20/21), celebrada del 22 al 24 de setembre de 2021 a Màlaga, Espanya., The present study analyses the effectiveness of a mixed reality (MR) face-to-face full-body system to foster social interaction behaviors (SIBs) in a child with ASC and a play partner, a child without ASC (non-ASC). An MR system allows the development of an active and dynamic environment in which the therapist does not need to have a direct influence on individuals during the therapy. In this study, as part of a larger project, the main goals are to show (1) whether an MR system is as effective in fostering SIBs and non-stressful contexts of play in children with ASC as well as in non-ASC, and (2) whether an MR system has the potential to foster a higher number of SIBs and lower state anxiety levels compared to a traditional therapy setting (LEGO). Our results show that no significant differences were found in starting a new social sequence ("social initiation"), in externalizing "thoughts aloud" ("externalization"), and in SIBs as a whole ("social interaction") between ASC/non-ASC children both in LEGO and in the MR system. In addition, we found similar results when we compared both systems. There were also no significant differences related to state anxiety levels. These positive results show that an MR system is, at least, as good as a typical social intervention in promoting SIBs, as well as, in creating a non-stressful context of play; while an MR system has greater flexibility and a broad range of potential experiences., This work has been funded by Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Program (MDM-2015-0502).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

  • Blanco, Angel David
  • Ramírez, Rafael, 1966-
Comunicació presentada a: 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education (MIE'17), celebrat en Glasgow (Regne Unit) el 13 de novembre de 2017., We present a study of the effects of feedback technologies on the learning process of novice violin students. Twenty-one subjects participated in our experiment, divided into two groups: Beginners (participants with no prior violin playing experience, N=14), and experts (participants with more than 6 years of violin playing experience, N=7). The beginners group was further divided into two: a group of beginners learning with Youtube videos (N=7), and a group of beginners with additional feedback related to the quality of their performance (N=7). Participants were asked to perform a violin exercise during 21 trials while their audio was recorded and analyzed. Three different audio descriptors were extracted from each audio in order to evaluate the quality of the performance: Dynamic stability, pitch stability and aperiodicity. Beginners showed a significant improvement during the session(i.e. by comparing the beginning and the end of the session)in the quality of the sound recorded, while experts maintained their results. However, only the beginner group with feedback showed significant improvement between the middle and late part of the session, while the group without feedback remained stable., This work has been partly sponsored by the Spanish TIN project TIMUL (TIN 2013-48152-C2-2-R), the European Union Horizon 2020 research and innovation programme under grant agreement No. 688269 (TELMI project), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

Responsible educational technology research: from open science and open data to ethics and trustworthy learning analytics

  • Hernández Leo, Davinia
  • Amarasinghe, Ishari
  • Beardsley, Marc Yoshimi
  • Hakami, Eyad
  • Ruiz Garcia, Aurelio
  • Santos Rodríguez, Patrícia
This chapter unfolds some elements of responsible research in the educational technology field and provides examples about how these elements have been considered in initiatives by the Interactive and Distributed Technologies for Education (TIDE) research group at Universitat Pompeu Fabra in Barcelona. First, it focuses on open science, an ongoing movement that promotes, on the one hand, transparent and frequent open-access updates of the research progress and the collected data and, on the other hand, reproducible, accurate, and verifiable research, bringing benefits for the individual researchers, the research community, and the society. Second, the chapter discusses ethics perspectives in educational technology research, relevant when collecting and sharing data and also in the design and development of technologies, especially when they are based on data analytics or artificial intelligence techniques. The latter aspects relate to the capacity of educational software systems to support human agency and preserve human well-being., TIDE-UPF acknowledges the support from the National Research Agency of the Spanish Ministry of Science and Innovation (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033), and previously from TIN2017-85179-C3-3-R, MDM-2015-0502, AGAUR (2017 SGR 1698. DHL (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme, PS by the Ramon y Cajal programme and EH by Jazan University, Saudi Arabia.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Increasing LPWAN scalability by means of concurrent multiband IoT technologies: an industry 4.0 use case

  • Adame, Toni
  • Bel, Albert
  • Bellalta, Boris
One of the most important challenges of the Internet of Things (IoT) in the next years will be the smooth incorporation of millions of smart devices into its communications paradigm. The greater coverage area of sub-1-GHz low-power wide area networks (LPWANs) makes them a suitable technology to easily encompass hundreds of end devices under a single base station. However, LPWAN inherent simplicity affects negatively on scalability, as these networks are not flexible enough to deal with a high number of nodes unless their traffic load is really low, which limits many potential use-cases. This paper analyzes the scalability issue in LPWAN and proposes the INTER-HARE protocol: a solution based on the use of concurrent multiband IoT technologies, where an 868-MHz LPWAN acts as transparent backhaul for a set of subnetworks working at 2.4 GHz. The implementation of the INTER-HARE protocol on a real IoT platform was assessed both in several laboratory testbeds and in a pilot developed in the premises of an industrial company, proving its suitability in non-delay sensitive monitoring applications with end devices scattered throughout the targeted area., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Open Call of INTER-IoT, Research and Innovation action - Horizon 2020 European Project, Grant Agreement #687283, financed by the European Union. It also received funding from the Catalan government through projects SGR-2017-1188 and SGR-2017-1739, and from the Spanish government under the project TEC2016-79510-P.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Cardiac computational modelling, Modelización computacional cardiaca

  • Bragard, Jean R.
  • Cámara, Óscar
  • Echebarria, Blas
  • Giorda, Luca Gerardo
  • Pueyo, Esther
  • Sebastián, Rafael
  • Soudah, Eduardo
  • Vázquez, Mariano
  • Saiz Rodríguez, Francisco Javier|||0000-0002-9850-0825
[EN] Cardiovascular diseases currently have a major social and economic impact, constituting one of the leading causes of mortality and morbidity. Personalized computational models of the heart are demonstrating their usefulness both to help understand the mechanisms underlying cardiac disease, and to optimize their treatment and predict the patient's response. Within this framework, the Spanish Research Network for Cardiac Computational Modelling (VHeart-SN) has been launched. The general objective of the VHeart-SN network is the development of an integrated, modular and multiscale multiphysical computational model of the heart. This general objective is addressed through the following specific objectives: a) to integrate the different numerical methods and models taking into account the specificity of patients; b) to assist in advancing knowledge of the mechanisms associated with cardiac and vascular diseases; and c) to support the application of different personalized therapies. This article presents the current state of cardiac computational modelling and different scientific works conducted by the members of the network to gain greater understanding of the characteristics and usefulness of these models., [ES] Las enfermedades cardiovasculares tienen en la actualidad un gran impacto social y económico y constituyen una de las principales causas de mortalidad y morbilidad. Los modelos computacionales personalizados del corazón están demostrando ser útiles tanto para ayudar a comprender los mecanismos subyacentes a las patologías cardiacas como para optimizar su tratamiento prediciendo la respuesta del paciente. En este contexto, se ha puesto en marcha la Red Española de Investigación en Modelización Computacional Cardiaca (V-Heart SN). El objetivo general de V-Heart SN es el desarrollo de un modelo computacional multifísico y multiescala integrado del corazón. Este objetivo general se aborda a través de los siguientes objetivos específicos: a) integrar los diferentes modelos numéricos teniendo en cuenta la especificidad de los pacientes; b) ayudar a avanzar en el conocimiento de los mecanismos asociados a las diferentes patologías cardiacas y vasculares; y c) apoyar la aplicación de terapias personalizadas. Este artículo presenta el estado actual de la modelización computacional cardiaca y los diferentes trabajos científicos desarrollados por los miembros de la red para favorecer una mayor comprensión de las características y utilidad de los modelos., This work was partially supported by: Acciones de Dinamización Redes de Excelencia 2016, Plan Estatal de Investigación Científica y Técnica y de Innovación, Ministerio de Economía y Competitividad (DPI2016-81873-REDT) and CompBioMed2, Grant agreement ID: 823712. The authors also thank the support of the European Research Council (ERC-StG 638284) and the Spanish Goverment through the following programmes: Retos I+D (TIN2014-59932-JIN, RTI2018-093416-B-I00, SAF2017-88019-C3-3R, RTI2018- 101193-B-I00, DPI2016-75799-R and PID2019-105674RB-I00); María de Maeztu (MDM-2015-0502); and Severo Ochoa (SEV2017-0718 and CEX2018-000797-S)
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

Generalized Planning with Positive and Negative Examples

  • Segovia-Aguas, Javier
  • Jonsson, Anders
  • Jiménez-Celorrio, Sergio|||0000-0003-0561-4880
[EN] Generalized planning aims at computing an algorithm-like structure (generalized plan) that solves a set of multiple planning instances. In this paper we define negative examples for generalized planning as planning instances that must not be solved by a generalized plan. With this regard the paper extends the notion of validation of a generalized plan as the problem of verifying that a given generalized plan solves the set of input positives instances while it fails to solve a given input set of negative examples. This notion of plan validation allows us to define quantitative metrics to asses the generalization capacity of generalized plans. The paper also shows how to incorporate this new notion of plan validation into a compilation for plan synthesis that takes both positive and negative instances as input. Experiments show that incorporating negative examples can accelerate plan synthesis in several domains and leverage quantitative metrics to evaluate the generalization capacity of the synthesized plans., The research leading to these results has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no. 731761, IMAGINE; and it is partially supported by grant TIN-2015- 67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jimenez is supported by the Ramon y Cajal program, RYC-2015- 18009, the Spanish MINECO project TIN2017-88476-C2- 1-R, and the generalitat valenciana project GV/2019/082. Anders Jonsson is partially supported by the Spanish grants TIN2015-67959 and PCIN-2017-082.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

La interfaz estructura informativa-prosodia: el rol de la tematicidad jerárquica basado en un modelo empírico, The Information Structure-Prosody Interface: On the Role of Hierarchical Thematicity in an Empirically-grounded Model

  • Domínguez Bajo, Mónica
Tesis doctoral en tecnologías de la información y las comunicaciones realizada por Mónica Domínguez Bajo en la Universidad Pompeu Fabra bajo la dirección del Dr. Leo Wanner y la Dra. Mireia Farrús Cabecerán. El acto de defensa tuvo lugar el viernes 17 de noviembre de 2017 ante el tribunal formado por los doctores Bernd Möbius (Universidad de Saarland), Pilar Prieto Vives (Universidad Pompeu Fabra) y Catherine Lai (Universidad de Edimburgo). Obtuvo la calificación de Sobresaliente.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Spanish Morphological Generation with Wide-Coverage Lexicons and Decision Trees, Generación Morfológica del Español con Lexicones de Amplia Cobertura y Árboles de Decisión

  • Ferrés, Daniel
  • AbuRa'ed, Ahmed
  • Saggion, Horacio
Morphological Generation is the task of producing the appropiate inflected form of a lemma in a given textual context and according to some morphological features. This paper describes and evaluates wide-coverage morphological lexicons and a Decision Tree algorithm that perform Morphological Generation in Spanish at state-of-the art level. The Freeling, Leffe and Apertium Spanish lexicons, the J48 Decision Tree algorithm and the combination of J48 with Freeling and Leffe lexicons have been evaluated with the following datasets for Spanish: i) CoNLL2009 Shared Task dataset, ii) Durrett and DeNero dataset of Spanish Verbs (DDN), and iii) SIGMORPHON 2016 Shared Task (task-1) dataset. The results show that: i) the Freeling and Leffe lexicons achieve high coverage and precision over the DDN and SIGMORPHON 2016 datasets, ii) the J48 algorithm achieves state-of-the-art results in all of the three datasets, and iii) the combination of Freeling, Leffe and the J48 algorithm outperformed the results of our other approaches in the three evaluation datasets, improved slightly the results of the CoNLL2009 and SIGMORPHON 2016 reported in the state-of-the-art literature, and achieved results comparable to the ones reported in the state-of-the-art literature on the DDN dataset evaluation.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Savana: A Global Information Extraction and Terminology Expansion Framework in the Medical Domain, Savana: Un Entorno Integral de Extracción de Información y Expansión de Terminologías en el Dominio de la Medicina

  • Espinosa-Anke, Luis
  • Tello, Jorge
  • Pardo, Alberto
  • Medrano, Ignacio
  • Ureña, Alberto
  • Salcedo, Ignacio
  • Saggion, Horacio
Terminological databases constitute a fundamental source of information in the medical domain. They are used daily both by practitioners in the area, as well as in academia. Several resources of this kind are available, e.g. CIE, SnomedCT or UMLS (Unified Medical Language System). These terminological databases are of high quality due to them being the result of collaborative expert knowledge. However, they may show certain drawbacks in terms of faithfully representing the ever-changing medical domain. Therefore, systems aimed at capturing novel terminological knowledge in heterogeneous text sources, and able to include them in standard terminologies have the potential to add great value to such repositories. This paper presents, first, Savana, a Biomedical Information Extraction system which, combined with a validation phase carried out by medical practitioners, is used to populate the Spanish branch of SnomedCT with novel knowledge. Second, we describe and evaluate a system which, given a novel medical term, finds its most likely hypernym, thus becoming an enabler in the task of terminological database enrichment and expansion.
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Improving the accessibility of biomedical texts by semantic enrichment and definition expansion, Mejora de la accesibilidad de textos biomédicos mediante enriquecimiento semántico y expansión de definiciones

  • Accuosto, Pablo
  • Saggion, Horacio
We present work aimed at facilitating the comprehensibility of health-related English-Spanish parallel texts by means of the semantic annotation of biomedical concepts and the automatic expansion of their definitions. In order to overcome the limitations posed by the scarcity of resources available for Spanish, we propose to exploit existing tools targeted at English and then transfer the produced annotations. The evaluations performed show the feasibility of this approach. An enriched set of texts is made available, which can be retrieved, visualized and downloaded through a web interface.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Generalized planning with positive and negative examples

  • Segovia-Aguas, Javier
  • Jiménez, Sergio
  • Jonsson, Anders
Trabajo presentado en la 34th AAAI Conference on Artificial Intelligence (AAAI), celebrada en New York (Estados Unidos), del 7 al 12 de febrero de 2020, Generalized planning aims at computing an algorithm-like structure (generalized plan) that solves a set of multiple planning instances. In this paper we define negative examples for generalized planning as planning instances that must not be solved by a generalized plan. With this regard the paper extends the notion of validation of a generalized plan as the problem of verifying that a given generalized plan solves the set of input positives instances while it fails to solve a given input set of negative examples. This notion of plan validation allows us to define quantitative metrics to asses the generalization capacity of generalized plans. The paper also shows how to incorporate this new notion of plan validation into a compilation for plan synthesis that takes both positive and negative instances as input. Experiments show that incorporating negative examples can accelerate plan synthesis in several domains and leverage quantitative metrics to evaluate the generalization capacity of the synthesized plans., The research leading to these results has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement no. 731761, IMAGINE; and it is partially supported by grant TIN-2015- 67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jimenez ´ is supported by the Ramon y Cajal program, RYC-2015- 18009, the Spanish MINECO project TIN2017-88476-C2- 1-R, and the generalitat valenciana project GV/2019/082. Anders Jonsson is partially supported by the Spanish grants TIN2015-67959 and PCIN-2017-082.
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

TANGO1 builds a machine for collagen export by recruiting and spatially organizing COPII, tethers and membranes

  • Raote, Ishier
  • Ortega-Bellido, María
  • Santos, António J M
  • Foresti, Ombretta
  • Zhang, Chong
  • Garcia-Parajo, Maria F.
  • Campelo, Felix
  • Malhotra, Vivek
Collagen export from the endoplasmic reticulum (ER) requires TANGO1, COPII coats, and retrograde fusion of ERGIC membranes. How do these components come together to produce a transport carrier commensurate with the bulky cargo collagen? TANGO1 is known to form a ring that corrals COPII coats and we show here how this ring or fence is assembled. Our data reveal that a TANGO1 ring is organized by its radial interaction with COPII, and lateral interactions with cTAGE5, TANGO1-short or itself. Of particular interest is the finding that TANGO1 recruits ERGIC membranes for collagen export via the NRZ (NBAS/RINT1/ZW10) tether complex. Therefore, TANGO1 couples retrograde membrane flow to anterograde cargo transport. Without the NRZ complex, the TANGO1 ring does not assemble, suggesting its role in nucleating or stabilising of this process. Thus, coordinated capture of COPII coats, cTAGE5, TANGO1-short, and tethers by TANGO1 assembles a collagen export machine at the ER., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Inferring directed networks using a rank-based connectivity measure

  • Malvestio, Irene
  • Rocamora, Rodrigo
  • Tauste Campo, Adrián Francisco|||0000-0003-0982-4017
  • Grau Leguia, Marc
  • González Martínez, Cristina
  • Andrzejak, Ralph Gregor
  • Levnajica, Zoran
Inferring the topology of a network using the knowledge of the signals of each of the interacting units is key to understanding real-world systems. One way to address this problem is using data-driven methods like cross-correlation or mutual information. However, these measures lack the ability to distinguish the direction of coupling. Here, we use a rank-based nonlinear interdependence measure originally developed for pairs of signals. This measure not only allows one to measure the strength but also the direction of the coupling. Our results for a system of coupled Lorenz dynamics show that we are able to consistently infer the underlying network for a subrange of the coupling strength and link density. Furthermore, we report that the addition of dynamical noise can benefit the reconstruction. Finally, we show an application to multichannel electroencephalographic recordings from an epilepsy patient., Peer Reviewed
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publication Artículo científico (JournalArticle)

Modelización computacional cardiaca

  • Bragard, J.R.
  • Camara, O.
  • Echebarria, B.
  • Gerardo Giorda, L.
  • Pueyo, E.
  • Saiz, J.
  • Sebastián, R.
  • Soudah, E.
  • Vázquez, M.
Cardiovascular diseases currently have a major social and economic impact, constituting one of the leading causes of mortality and morbidity. Personalized computational models of the heart are demonstrating their usefulness both to help understand the mechanisms underlying cardiac disease, and to optimize their treatment and predict the patient''s response. Within this framework, the Spanish Research Network for Cardiac Computational Modelling (VHeart-SN) has been launched. The general objective of the VHeart-SN network is the development of an integrated, modular and multiscale multiphysical computational model of the heart. This general objective is addressed through the following specific objectives: a) to integrate the different numerical methods and models taking into account the specificity of patients; b) to assist in advancing knowledge of the mechanisms associated with cardiac and vascular diseases; and c) to support the application of different personalized therapies. This article presents the current state of cardiac computational modelling and different scientific works conducted by the members of the network to gain greater understanding of the characteristics and usefulness of these models.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publication Artículo científico (JournalArticle)

Delineation of the electrocardiogram with a mixed-quality-annotations dataset using convolutional neural networks

  • Jimenez-Perez, Guillermo
  • Alcaine, Alejandro
  • Camara, Oscar
Detection and delineation are key steps for retrieving and structuring information of the electrocardiogram (ECG), being thus crucial for numerous tasks in clinical practice. Digital signal processing (DSP) algorithms are often considered state-of-the-art for this purpose but require laborious rule readaptation for adapting to unseen morphologies. This work explores the adaptation of the the U-Net, a deep learning (DL) network employed for image segmentation, to electrocardiographic data. The model was trained using PhysioNet’s QT database, a small dataset of 105 2-lead ambulatory recordings, while being independently tested for many architectural variations, comprising changes in the model’s capacity (depth, width) and inference strategy (single- and multi-lead) in a fivefold cross-validation manner. This work features several regularization techniques to alleviate data scarcity, such as semi-supervised pre-training with low-quality data labels, performing ECG-based data augmentation and applying in-built model regularizers. The best performing configuration reached precisions of 90.12%, 99.14% and 98.25% and recalls of 98.73%, 99.94% and 99.88% for the P, QRS and T waves, respectively, on par with DSP-based approaches. Despite being a data-hungry technique trained on a small dataset, a U-Net based approach demonstrates to be a viable alternative for this task.
O2, repositorio institucional de la UOC
Publication Artículo científico (JournalArticle)

A Simple Solution to Locate Groups of Items in Large Retail Stores Using an RFID Robot

  • Casamayor-Pujol, Victor
  • Gastón, Bernat
  • López-Soriano, Sergio
  • Alajami, Abdussalam A.
  • Pous, Rafael
This article presents a simple solution to estimate the location of products in a retail store, using an autonomous ground robot with a radio frequency identification payload. The model used and explained in this article is designed to be as simple and versatile as possible, while achieving accurate location estimations when compared with other proposed models in the state of the art. In addition, the solution developed meets the business requirements of the retail industry, such as locating at stock keeping unit level, as opposed to item level, or expressing the location in terms of store fixtures (e.g., shelf and rack) as opposed to (x,y) coordinates. The research results are obtained from experiments of the model in different environments, achieving accurate location estimations in a controlled laboratory environment. Moreover, for the first time, the model has been tested in a large retail store, where the results obtained met the requirements of the store owners.
O2, repositorio institucional de la UOC
Publication Artículo científico (JournalArticle)

A Metric for Assessing, Comparing, and Predicting the Performance of Autonomous RFID-Based Inventory Robots for Retail

  • Gastón, Bernat
  • Casamayor-Pujol, Victor
  • López-Soriano, Sergio
  • Pous, Rafael
Radio frequency identification (RFID) technology is being widely adopted by retailers due to its accuracy, versatility, and reduction of operational costs. Most commonly, RFID in retail is used for taking frequent and accurate inventories of items in the stores. Usually, RFID inventories use handheld RFID devices, which makes the task tedious, costly, and prone to human errors. More reliable, fully automatic alternatives exist, such as smart shelves, overhead RFID antennas, and RFID-equipped robots. Among them, robots seem to be the preferred choice by retailers with large stores. However, retailers need an objective way to compare the different options for inventory solutions and to calculate the return on investment of each of them before they make an investment decision. In this article, we present a metric for assessing, comparing, and predicting the performance of autonomous RFID-based robots in retail stores. The metric is based on a theoretical model of both the store and the robot, and predicts the performance of a given robot when inventorying a specific store. The metric also allows to compare the performance of different RFID robots in different stores. The metric has been developed using experimental data and has been validated in a real store.
Recercat. Dipósit de la Recerca de Catalunya
Publication

Computational evaluation of Cochlear implant surgery outcomes accounting for uncertainty and parameter variability

  • Mangado, Nerea
  • Pons Prats, Jordi
  • Coma Company, Martí
  • Mistrik, Pavel
  • Piella, Gemma
  • Ceresa, Mario
  • González Ballester, Miguel A.
Cochlear implantation (CI) is a complex surgical procedure that restores hearing in patients with severe deafness. The successful outcome of the implanted device relies on a group of factors, some of them unpredictable or difficult to control. Uncertainties on the electrode array position and the electrical properties of the bone make it difficult to accurately compute the current propagation delivered by the implant and the resulting neural activation. In this context, we use uncertainty quantification methods to explore how these uncertainties propagate through all the stages of CI computational simulations. To this end, we employ an automatic framework, encompassing from the finite element generation of CI models to the assessment of the neural response induced by the implant stimulation. To estimate the confidence intervals of the simulated neural response, we propose two approaches. First, we encode the variability of the cochlear morphology among the population through a statistical shape model. This allows us to generate a population of virtual patients using Monte Carlo sampling and to assign to each of them a set of parameter values according to a statistical distribution. The framework is implemented and parallelized in a High Throughput Computing environment that enables to maximize the available computing resources. Secondly, we perform a patient-specific study to evaluate the computed neural response to seek the optimal post-implantation stimulus levels. Considering a single cochlear morphology, the uncertainty in tissue electrical resistivity and surgical insertion parameters is propagated using the Probabilistic Collocation method, which reduces the number of samples to evaluate. Results show that bone resistivity has the highest influence on CI outcomes. In conjunction with the variability of the cochlear length, worst outcomes are obtained for small cochleae with high resistivity values. However, the effect of the surgical insertion length on the CI outcomes could not be clearly observed, since its impact may be concealed by the other considered parameters. Whereas the Monte Carlo approach implies a high computational cost, Probabilistic Collocation presents a suitable trade-off between precision and computational time. Results suggest that the proposed framework has a great potential to help in both surgical planning decisions and in the audiological setting process., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Redundancy as a measure of fault-tolerance for the Internet of Things: A review

  • Lobo, Jorge
  • Rullo, Antonino
  • Serra, Edoardo
In this paper we review and analyze redundancy-based fault-tolerant techniques for the IoT as a paradigm to support two of the main goals of computer security: availability and integrity. We organized the presentation in terms of the three main tasks performed by the nodes of an IoT network: sensing, routing, and control. We first discuss how the implementation of fault-tolerance in the three areas is primary for the correct operation of an entire system. We provide an overview of the different approaches that have been used to address failures in sensing and routing. Control devices typically implement state machines that take decisions based on the measurement of sensors and may also ask actuators to execute actions. Traditionally state-machine replication for fault-tolerance is realized through consensus protocols. Most protocols were developed in the 80’s and 90’s. We will review the properties of such protocols in detail and discuss their limitations for the IoT. Since 2008, consensus algorithms took a new direction with the introduction of the concept of blockchain. Standard blockchain based protocols cannot be applied without modifications to support fault-tolerance in the IoT. We will review some recent results in this new class of algorithms, and show how they can provide the flexibility required to support fault-tolerance in control devices, and thus overcome some of the limitations of the traditional consensus protocols., Jorge Lobo was partially supported by the Spanish Ministry of Economy and Competitiveness. Grant Numbers: TIN201681032P, MDM20150502.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Robust facial alignment with internal denoising auto-encoder

  • Aspandi, Decky
  • Martínez, Oriol
  • Sukno, Federico Mateo
  • Binefa i Valls, Xavier
Comunicació presentada a: 16th Conference on Computer and Robot Vision (CRV) celebrat del 29 al 31 de maig de 2019 a Kingston, Canadà., The development of facial alignment models is growing rapidly thanks to the availability of large facial landmarked datasets and powerful deep learning models. However, important challenges still remain for facial alignment models to work on images under extreme conditions, such as severe occlusions or large variations in pose and illumination. Current attempts to overcome this limitation have mainly focused on building robust feature extractors with the assumption that the model will be able to discard the noise and select only the meaningful features. However, such an assumption ignores the importance of understanding the noise that characterizes unconstrained images, which has been shown to benefit computer vision models if used appropriately on the learning strategy. Thus, in this paper we investigate the introduction of specialized modules for noise detection and removal, in combination with our state-of-the-art facial alignment module and show that this leads to improved robustness both to synthesized noise and in-the-wild conditions. The proposed model is built by combining two major subnetworks: internal image denoiser (based on the Auto-Encoder architecture) and facial landmark localiser (based on the inception-resnet architecture). Our results on the 300-W and Menpo datasets show that our model can effectively handle different types of synthetic noise, which also leads to enhanced robustness in real-world unconstrained settings, reaching top state-of-the-art accuracy., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502) and the donation bahi2018-19 to the CMTech at the UPF.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

On security policy migrations

  • Lobo, Jorge
  • Bertino, Elisa
  • Russo, Alessandra
Comunicació presentada al SACMAT '20: The 25th ACM Symposium on Access Control Models and Technologies, celebrat del 10 al 12 de juny de 2020 a Barcelona, Espanya., There has been over the past decade a rapid change towards computational environments that are comprised of large and diverse sets of devices, many of them mobile, which can connect in flexible and context-dependent ways. Examples range from networks where we can have communications between powerful cloud centers, to the myriad of simple sensor devices on the IoT. As the management of these dynamic environments becomes ever more complex, we want to propose policy migrations as a methodology to simplify the management of security policies by re-utilizing and re-deploying existing policies as the systems change. We are interested in understanding the challenges raised answering the following question: given a security policy that is being enforced in a particular source computational device, what does it entail to migrate this policy to be enforced in a different target device? Because of the differences between devices and because these devices cannot be seen in isolation but in the context where they are deployed, the meaning of the policy enforced in the source device needs to be re-interpreted and implemented in the context of the target device. The aim of the paper is to present a formal framework to evaluate the appropriateness of the migration., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was also supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The effect of a group awareness tool in synchronous online discussions: studying participation, quality and balance

  • Theophilou, Emily
  • Sánchez Reina, Jesús Roberto
  • Hernández Leo, Davinia
  • Odakura, Valguima
  • Amarasinghe, Ishari
  • Lobo Quintero, René Alejandro
Computer-supported collaborative learning (CSCL) seeks to improve students’ learning with the support of technology. Although CSCL facilitates an enriching environment for cooperation, CSCL activities might be affected by asymmetrical participation. Group awareness tools have proven to enhance learners’ interactions, balancing the levels of participation and increasing the learning outcomes. This study investigates the effect of a group awareness tool (GAT) on participation within synchronous CSCL activities in the context of extracurricular activities. We designed a quasi-experimental within-subject study (GAT exposure and control condition) and tested an ad hoc GAT in a web-based CSCL platform with high school students (N = 140). The measured variables included the effect of the GAT on students’ participation and the quality of discussion. A complementary analysis evaluated students’ perceptions of the tool. Results revealed that the implementation of a GAT encourages students to take part in CSCL discussions without explicitly hindering its quality. Even so, the balance of participation was not significantly affected. Students further reported that they found the GAT useful to regulate collaboration. The results from the study provide further knowledge of the functioning of group awareness tools in secondary education and share an insight into how students perceive them., This work has been partially funded by the Volkswagen Foundation (COURAGE project, no. 95567). TIDE-UPF also acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502 and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Multimodal metric learning for tag-based music retrieval

  • Won, Minz
  • Oramas, Sergio
  • Nieto Caballero, Oriol
  • Gouyon, Fabien
  • Serra, Xavier
Comunicació presentada a 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), celebrat del 6 a l'11 de juny de 2021 de manera virtual., Tag-based music retrieval is crucial to browse large-scale mu-sic libraries efficiently. Hence, automatic music tagging has been actively explored, mostly as a classification task, which has an inherent limitation: a fixed vocabulary. On the other hand, metric learning enables flexible vocabularies by using pretrained word embeddings as side information. Also, met-ric learning has proven its suitability for cross-modal retrieval tasks in other domains (e.g., text-to-image) by jointly learning a multimodal embedding space. In this paper, we investigate three ideas to successfully introduce multimodal metric learning for tag-based music retrieval: elaborate triplet sampling, acoustic and cultural music information, and domain-specific word embeddings. Our experimental results show that the proposed ideas enhance the retrieval system quantitatively and qualitatively. Furthermore, we release the MSD500: a subset of the Million Song Dataset (MSD) containing 500 cleaned tags, 7 manually annotated tag categories, and user taste profiles., This work was funded by the predoctoral grant MDM-2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Evaluation of audio-based feedback technologies for bow learning technique in violin beginners

  • Blanco, Angel David
  • Ramírez, Rafael, 1966-
Comunicació presentada a: 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education (MIE'17), celebrat en Glasgow (Regne Unit) el 13 de novembre de 2017., We present a study of the effects of feedback technologies on the learning process of novice violin students. Twenty-one subjects participated in our experiment, divided into two groups: Beginners (participants with no prior violin playing experience, N=14), and experts (participants with more than 6 years of violin playing experience, N=7). The beginners group was further divided into two: a group of beginners learning with Youtube videos (N=7), and a group of beginners with additional feedback related to the quality of their performance (N=7). Participants were asked to perform a violin exercise during 21 trials while their audio was recorded and analyzed. Three different audio descriptors were extracted from each audio in order to evaluate the quality of the performance: Dynamic stability, pitch stability and aperiodicity. Beginners showed a significant improvement during the session(i.e. by comparing the beginning and the end of the session)in the quality of the sound recorded, while experts maintained their results. However, only the beginner group with feedback showed significant improvement between the middle and late part of the session, while the group without feedback remained stable., This work has been partly sponsored by the Spanish TIN project TIMUL (TIN 2013-48152-C2-2-R), the European Union Horizon 2020 research and innovation programme under grant agreement No. 688269 (TELMI project), and the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Prediction of lung nodule progression with an uncertainty-aware hierarchical probabilistic network

  • Rafael-Palou, Xavier
  • Aubanell, Anton
  • Ceresa, Mario
  • Ribas, Vicent
  • Piella Fenoy, Gemma
  • González Ballester, Miguel Ángel, 1973-
Predicting whether a lung nodule will grow, remain stable or regress over time, especially early in its follow-up, would help doctors prescribe personalized treatments and better surgical planning. However, the multifactorial nature of lung tumour progression hampers the identification of growth patterns. In this work, we propose a deep hierarchical generative and probabilistic network that, given an initial image of the nodule, predicts whether it will grow, quantifies its future size and provides its expected semantic appearance at a future time. Unlike previous solutions, our approach also estimates the uncertainty in the predictions from the intrinsic noise in medical images and the inter-observer variability in the annotations. The evaluation of this method on an independent test set reported a future tumour growth size mean absolute error of 1.74 mm, a nodule segmentation Dice's coefficient of 78% and a tumour growth accuracy of 84% on predictions made up to 24 months ahead. Due to the lack of similar methods for providing future lung tumour growth predictions, along with their associated uncertainty, we adapted equivalent deterministic and alternative generative networks (i.e., probabilistic U-Net, Bayesian test dropout and Pix2Pix). Our method outperformed all these methods, corroborating the adequacy of our approach., This work was partially funded by the Industrial Doctorates Program (AGAUR) grant number DI087, the Spanish Ministry of Economy and Competitiveness (Project INSPIRE FIS2017-89535-C2-2-R, Maria de Maeztu Units of Excellence Program MDM-2015-0502, and CoVEST project PID2019-110185RB-C21). G. Piella is supported by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Curriculum learning for improved femur fracture classification: scheduling data with prior knowledge and uncertainty

  • Jiménez Sánchez, Amelia
  • Mateus, Diana
  • Kirchhoff, Sonja
  • Kirchhoff, Chlodwig
  • Biberthaler, Peter
  • Navab, Nassir
  • González Ballester, Miguel Ángel, 1973-
  • Piella Fenoy, Gemma
An adequate classification of proximal femur fractures from X-ray images is crucial for the treatment choice and the patients’ clinical outcome. We rely on the commonly used AO system, which describes a hierarchical knowledge tree classifying the images into types and subtypes according to the fracture’s location and complexity. In this paper, we propose a method for the automatic classification of proximal femur fractures into 3 and 7 AO classes based on a Convolutional Neural Network (CNN). As it is known, CNNs need large and representative datasets with reliable labels, which are hard to collect for the application at hand. In this paper, we design a curriculum learning (CL) approach that improves over the basic CNNs performance under such conditions. Our novel formulation reunites three curriculum strategies: individually weighting training samples, reordering the training set, and sampling subsets of data. The core of these strategies is a scoring function ranking the training samples. We define two novel scoring functions: one from domain-specific prior knowledge and an original self-paced uncertainty score. We perform experiments on a clinical dataset of proximal femur radiographs. The curriculum improves proximal femur fracture classification up to the performance of experienced trauma surgeons. The best curriculum method reorders the training set based on prior knowledge resulting into a classification improvement of 15%. Using the publicly available MNIST dataset, we further discuss and demonstrate the benefits of our unified CL formulation for three controlled and challenging digit recognition scenarios: with limited amounts of data, under class-imbalance, and in the presence of label noise. The code of our work is available at: https://github.com/ameliajimenez/curriculum-learning-prior-uncertainty., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673 and by the Spanish Ministry of Economy [MDM-2015-0502]. A. Jiménez-Sánchez has received financial support through the “la Caixa” Foundation (ID Q5850017D), fellowship code: LCF/BQ/IN17/11620013. D. Mateus has received funding from Nantes Métropole and the European Regional Development, Pays de la Loire, under the Connect Talent scheme.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Usage of network simulators in machine-learning-assisted 5G/6G networks

  • Wilhelmi Roca, Francesc
  • Carrascosa Zamacois, Marc
  • Cano, Cristina
  • Jonsson, Anders, 1973-
  • Ram, Vishnu
  • Bellalta, Boris
Without any doubt, Machine Learning (ML) will be an important driver of future communications due to its foreseen performance when applied to complex problems. However, the application of ML to networking systems raises concerns among network operators and other stakeholders, especially regarding trustworthiness and reliability. In this article, we devise the role of network simulators for bridging the gap between ML and communications systems. In particular, we present an architectural integration of simulators in ML-aware networks for training, testing, and validating ML models before being applied to the operative network. Moreover, we provide insights into the main challenges resulting from this integration, and then give hints discussing how they can be overcome. Finally, we illustrate the integration of network simulators into ML-assisted communications through a proof-of-concept testbed implementation of a residential WiFi network., This work has been partially supported by grants MDM-2015-0502, WINDMAL PGC2018-099959- B-I00 (MCIU/AEI/FEDER,UE), 2017-SGR-11888, and by SPOTS project (RTI2018-095438-A-I00) funded by the Spanish Ministry of Science, Innovation and Universities.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Empirically investigating virtual learning companions to enhance social media literacy

  • Theophilou, Emily
  • Schwarze, Veronica
  • Börsting, Johanna
  • Sánchez Reina, Jesús Roberto
  • Scifo, Lidia
  • Lomonaco, Francesco
  • Aprin, Farbod
  • Ognibene, Dimitri
  • Taibi, Davide
  • Hernández Leo, Davinia
  • Eimler, Sabrina
Comunicació presentada a 4th International Conference on Higher Education Learning Methodologies and Technologies Online, celebrat del 21 al 23 de setembre de 2022 a Palerm, Itàlia., Social media platforms provide opportunities for users across the world to connect and communicate between them and engage into acts of social support and entertainment. Yet it can also bring negative consequences as it has been associated with poor mental health and life dissatisfaction. This underlines the importance of delivering social media literacy (SML) interventions that raise awareness of the dangers and threats that are hidden within. To this date, SML initiatives have shown their benefits towards the acquisition of SML skills through the forms of school interventions and mini-games. However, studies on promoting SML through social media platforms need to be also encouraged and innovative approaches to provide interactive scenarios with hands-on experiences need to be formulated. Hence, the project COURAGE introduces a new approach towards SML by proposing the integration of educational opportunities within a controlled social media platform. To provide students the opportunity to learn whilst they naturally explore social media we propose the integration of virtual learning companions. In this paper we report seven empirical approaches towards SML skills acquisition powered by virtual learning companions. The paper concludes with a discussion towards the benefits and limitations of using this type of SML interventions., This work has been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502) and the Volkswagen Stiftung (Courage, ref. 95 566). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Heatmap-guided balanced deep convolution networks for family classification in the wild

  • Aspandi, Decky
  • Martínez, Oriol
  • Binefa i Valls, Xavier
Comunicació presentada a: Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019) celebrat del 14 al 18 de maig a Lille, France., Automatic kinship recognition using Computer Vision, which aims to infer the blood relationship between individuals by only comparing their facial features, has started to gain attention recently. The introduction of large kinship datasets, such as Family In The Wild (FIW), has allowed large scale dataset modeling using state of the art deep learning models. Among other kinship recognition tasks, family classification task is lacking any significant progress due to its increasing difficulty in relation to the family member size. Furthermore, most current state of-the-art approaches do not perform any data pre-processing (which try to improve models accuracy) and are trained without a regularizer (which results in models susceptible to overfitting). In this paper, we present the Deep Family Classifier (DFC), a deep learning model for family classification in the wild. We build our model by combining two sub-networks: internal Image Feature Enhancer which operates by removing the image noise and provides an additional facial heatmap layer and Family Class Estimator trained with strong regularizers and a compound loss. We observe progressive improvement in accuracy during the validation phase, with a state of the art results of 16.89% is obtained for the track 2 in the RFIW2019 challenge and 17.08% of familly classification task on FIW dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Ramon y Cajal programme, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the donation bahi2018-19 to the CMTech at the UPF.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Moving beyond benchmarks and competitions: towards addressing social media challenges in an educational context

  • Ognibene, Dimitri
  • Donabauer, Gregor
  • Theophilou, Emily
  • Buršić, Sathya
  • Lomonaco, Francesco
  • Wilkens, Rodrigo
  • Hernández Leo, Davinia
  • Kruschwitz, Udo
Natural language processing and other areas of artificial intelligence have seen staggering progress in recent years, yet much of this is reported with reference to somewhat limited benchmark datasets. We see the deployment of these techniques in realistic use cases as the next step in this development. In particular, much progress is still needed in educational settings, which can strongly improve users’ safety on social media. We present our efforts to develop multi-modal machine learning algorithms to be integrated into a social media companion aimed at supporting and educating users in dealing with fake news and other social media threats. Inside the companion environment, such algorithms can automatically assess and enable users to contextualize different aspects of their social media experience. They can estimate and display different characteristics of content in supported users’ feeds, such as ‘fakeness’ and ‘sentiment’, and suggest related alternatives to enrich users’ perspectives. In addition, they can evaluate the opinions, attitudes, and neighbourhoods of the users and of those appearing in their feeds. The aim of the latter process is to raise users’ awareness and resilience to filter bubbles and echo chambers, which are almost unnoticeable and rarely understood phenomena that may affect users’ information intake unconsciously and are unexpectedly widespread. The social media environment is rapidly changing and complex. While our algorithms show state-of-the-art performance, they rely on task-specific datasets, and their reliability may decrease over time and be limited against novel threats. The negative impact of these limits may be exasperated by users’ over-reliance on algorithmic tools. Therefore, companion algorithms and educational activities are meant to increase users’ awareness of social media threats while exposing the limits of such algorithms. This will also provide an educational example of the limits affecting the machine-learning components of social media platforms. We aim to devise, implement and test the impact of the companion and connected educational activities in acquiring and supporting conscientious and autonomous social media usage., This work was mainly supported by the project COURAGE: A Social Media Companion Safeguarding and Educating Students funded by the Volkswagen Foundation, grant number 95563, 95564, 95566, 9B145. This work has also been partially funded by the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033, MDM-2015-0502). D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Increasing LPWAN scalability by means of concurrent multiband IoT technologies: an industry 4.0 use case

  • Adame, Toni
  • Bel, Albert
  • Bellalta, Boris
One of the most important challenges of the Internet of Things (IoT) in the next years will be the smooth incorporation of millions of smart devices into its communications paradigm. The greater coverage area of sub-1-GHz low-power wide area networks (LPWANs) makes them a suitable technology to easily encompass hundreds of end devices under a single base station. However, LPWAN inherent simplicity affects negatively on scalability, as these networks are not flexible enough to deal with a high number of nodes unless their traffic load is really low, which limits many potential use-cases. This paper analyzes the scalability issue in LPWAN and proposes the INTER-HARE protocol: a solution based on the use of concurrent multiband IoT technologies, where an 868-MHz LPWAN acts as transparent backhaul for a set of subnetworks working at 2.4 GHz. The implementation of the INTER-HARE protocol on a real IoT platform was assessed both in several laboratory testbeds and in a pilot developed in the premises of an industrial company, proving its suitability in non-delay sensitive monitoring applications with end devices scattered throughout the targeted area., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Open Call of INTER-IoT, Research and Innovation action - Horizon 2020 European Project, Grant Agreement #687283, financed by the European Union. It also received funding from the Catalan government through projects SGR-2017-1188 and SGR-2017-1739, and from the Spanish government under the project TEC2016-79510-P.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

TALN at SemEval-2016 Task 14: semantic taxonomy enrichment via sense-based embeddings

  • Espinosa-Anke, Luis
  • Ronzano, Francesco
  • Saggion, Horacio
This paper describes the participation of the TALN team in SemEval-2016 Task 14: Semantic Taxonomy Enrichment. The purpose of the task is to find the best point of attachment in WordNet for a set of Out of Vocabulary (OOV) terms. These may come, to name a few, from domain specific glossaries, slang or typical jargon from Internet forums and chatrooms. Our contribution takes as input an OOV term, its part of speech and its associated definition, and generates a set of WordNet synset candidates derived from modelling the term’s definition as a sense embedding representation. We leverage a BabelNet-based vector space representation, which allows us to map the algorithm’s prediction to WordNet. Our approach is designed to be generic and fitting to any domain, without exploiting, for instance, HTML markup in source web pages. Our system performs above the median of all submitted systems, and rivals in performance a powerful baseline based on extracting the first word of the definition with the same partof-speech as the OOV term., This work was partially funded by Dr. Inventor (FP7-ICT-2013.8.1611383), and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Latent-based adversarial neural networks for facial affect estimations

  • Aspandi, Decky
  • Mallol Ragolta, Adrià
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), celebrat del 16 al 20 de novembre de 2020 a Buenos Aires, Argentina., There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has recently been accelerated due to the emergence of bigger dataset. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017- 90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

An enhanced adversarial network with combined latent features for spatio-temporal facial affect estimation in the wild

  • Aspandi, Decky
  • Sukno, Federico Mateo
  • Schuller, Björn
  • Binefa i Valls, Xavier
Comunicació presentada al 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, celebrat del 8 al 10 de febrer de 2021 a Setúbal, Portugal., Affective Computing has recently attracted the attention of the research community, due to its numerous applications in diverse areas. In this context, the emergence of video-based data allows to enrich the widely used spatial features with the inclusion of temporal information. However, such spatio-temporal modelling often results in very high-dimensional feature spaces and large volumes of data, making training difficult and time consuming. This paper addresses these shortcomings by proposing a novel model that efficiently extracts both spatial and temporal features of the data by means of its enhanced temporal modelling based on latent features. Our proposed model consists of three major networks, coined Generator, Discriminator, and Combiner, which are trained in an adversarial setting combined with curriculum learning to enable our adaptive attention modules. In our experiments, we show the effectiveness of our approach by reporting our competitive results on both the AFEW-VA and SEWA datasets, suggesting that temporal modelling improves the affect estimates both in qualitative and quantitative terms. Furthermore, we find that the inclusion of attention mechanisms leads to the highest accuracy improvements, as its weights seem to correlate well with the appearance of facial movements, both in terms of temporal localisation and intensity. Finally, we observe the sequence length of around 160 ms to be the optimum one for temporal modelling, which is consistent with other relevant findings utilising similar lengths., This work is partly supported by the Spanish Ministry of Economy and Competitiveness under project grant TIN2017-90124-P, the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and the donation bahi2018-19 to the CMTech at UPF. Further funding has been received from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826506 (sustAGE).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Meshless electrophysiological modeling of cardiac resynchronization therapy: benchmark analysis with finite-element methods in experimental data

  • Albors Lucas, Carlos
  • Lluch Álvarez, Èric
  • Gomez, Juan Francisco
  • Cedilnik, Nicolas
  • Mountris, Konstantinos A.
  • Mansi, Tommaso
  • Khamzin, Svyatoslav
  • Dokuchaev, Arsenii
  • Solovyova, Olga
  • Pueyo, Esther
  • Sermesant, Maxime
  • Sebastian, Rafael
  • Morales, Hernán G.
  • Camara, Oscar
Computational models of cardiac electrophysiology are promising tools for reducing the rates of non-response patients suitable for cardiac resynchronization therapy (CRT) by optimizing electrode placement. The majority of computational models in the literature are mesh-based, primarily using the finite element method (FEM). The generation of patient-specific cardiac meshes has traditionally been a tedious task requiring manual intervention and hindering the modeling of a large number of cases. Meshless models can be a valid alternative due to their mesh quality independence. The organization of challenges such as the CRT-EPiggy19, providing unique experimental data as open access, enables benchmarking analysis of different cardiac computational modeling solutions with quantitative metrics. We present a benchmark analysis of a meshless-based method with finite-element methods for the prediction of cardiac electrical patterns in CRT, based on a subset of the CRT-EPiggy19 dataset. A data assimilation strategy was designed to personalize the most relevant parameters of the electrophysiological simulations and identify the optimal CRT lead configuration. The simulation results obtained with the meshless model were equivalent to FEM, with the most relevant aspect for accurate CRT predictions being the parameter personalization strategy (e.g., regional conduction velocity distribution, including the Purkinje system and CRT lead distribution)., This work was supported in part by the Spanish Ministry of Science and Innovation (TIN2011-28067, REDINSCOR RD06/003/008, PID2019-105674RB-I00), the Spanish Industrial and Technological Development Center (cvREMOD-CEN-20091044), the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), the Government of Aragón (Spain) (LMP94_21), the Directorate General of Science Policy of the Generalitat Valenciana (Spain) (PROMETEU 2016/088), the Seventh Framework Programme (FP7/2007-2013) for research, technological and demonstration under grant agreement VP2HF (no. 611823), by the RSF grant no. 19-14-00134, and by European Regional Development Fund (ERDF) DPI2016-75799-R (AEI/ERDF, EU).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Computing hierarchical finite state controllers with classical planning

  • Segovia-Aguas, Javier
  • Jiménez, Sergio
  • Jonsson, Anders, 1973-
Finite State Controllers (FSCs) are an effective way to compactly represent sequential plans. By imposing appropriate conditions on transitions, FSCs can also represent generalized plans (plans that solve a range of planning problems from a given domain). In this paper we introduce the concept of hierarchical FSCs for planning by allowing controllers to call other controllers. This call mechanism allows hierarchical FSCs to represent generalized plans more compactly than individual FSCs, to compute controllers in a modular fashion or even more, to compute recursive controllers. The paper introduces a classical planning compilation for computing hierarchical FSCs that solve challenging generalized planning tasks. The compilation takes as input a finite set of classical planning problems from a given domain. The output of the compilation is a single classical planning problem whose solution induces: (1) a hierarchical FSC and (2), the corresponding validation of that controller on the input classical planning problems., This work is partially supported by grant TIN2015-67959 and the Maria de Maeztu Units of Excellence Programme MDM-2015-0502, MEC, Spain. Sergio Jiménez is supported by the RYC15/18009, program funded by the Spanish government.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Towards assisted electrocardiogram interpretation using an AI-enabled Augmented Reality headset

  • Lampreave, Paula
  • Jimenez-Perez, Guillermo
  • Sanz-Pérez, Isidro
  • Gomez, Alberto
  • Camara, Oscar
The interpretation of electrocardiograms (ECGs) is key for the diagnosis and monitoring of cardiovascular health. Despite the progressive digital transformation in healthcare, it is still common for clinicians to analyse ECG printed on paper. Although some systems provide signal processing-based ECG classification, clinicians often find it unreliable. Artificial Intelligence (AI) techniques are becoming state-of-the-art for ECG processing but the lack of digitised ECG has hampered the clinical translation of these techniques. Concurrently, we are living a rise in augmented reality (AR) technologies, with an increasing availability of devices. In this work, we present an automatic digitisation and assisted interpretation of ECG based on an AI-enabled Augmented Reality headset. The AR headset is used to acquire an image of the printed ECG, from which the digitised ECG signal is extracted. Afterwards, the digitised ECG is introduced into a Deep Learning (DL) algorithm pre-trained on a public database of 12-lead ECG recordings. The output of the DL algorithm classifies the ECG signal onto different cardiomyopathy categories, which is then visualized back in the AR headset. Preliminary classification results on simulated ECG images (96.5% of accuracy) confirm the potential of the developed approach to contribute on the digital transformation of ECG processing., This work was supported by the Ministerio de Ciencia, Innovación y Universidades under the Retos I+D Programme (RTI2018-101193-B-I00), the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and the Ministerio de Economíay Competitividad under the Programme for the Formation of Doctors (PRE2018-084062). Alberto Gomez acknowl-edges financial support from the Department of Health via the National Institute for Health Research (NIHR) comprehensive Biomedical Research Centre award to Guy’s and St Thomas’ NHS Foundation Trust in partnership with King's College London and King’s College Hospital NHS Foundation Trust.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Effectiveness of a mixed reality system in terms of social interaction behaviors in children with and without autism spectrum condition

  • Galí Pérez, Olga
  • Sayis, Batuhan
  • Parés, Narcís, 1966-
Comunicació presentada a XXI International Conference on Human Computer Interaction (INTERACCIÓN 20/21), celebrada del 22 al 24 de setembre de 2021 a Màlaga, Espanya., The present study analyses the effectiveness of a mixed reality (MR) face-to-face full-body system to foster social interaction behaviors (SIBs) in a child with ASC and a play partner, a child without ASC (non-ASC). An MR system allows the development of an active and dynamic environment in which the therapist does not need to have a direct influence on individuals during the therapy. In this study, as part of a larger project, the main goals are to show (1) whether an MR system is as effective in fostering SIBs and non-stressful contexts of play in children with ASC as well as in non-ASC, and (2) whether an MR system has the potential to foster a higher number of SIBs and lower state anxiety levels compared to a traditional therapy setting (LEGO). Our results show that no significant differences were found in starting a new social sequence ("social initiation"), in externalizing "thoughts aloud" ("externalization"), and in SIBs as a whole ("social interaction") between ASC/non-ASC children both in LEGO and in the MR system. In addition, we found similar results when we compared both systems. There were also no significant differences related to state anxiety levels. These positive results show that an MR system is, at least, as good as a typical social intervention in promoting SIBs, as well as, in creating a non-stressful context of play; while an MR system has greater flexibility and a broad range of potential experiences., This work has been funded by Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Program (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Responsible educational technology research: from open science and open data to ethics and trustworthy learning analytics

  • Hernández Leo, Davinia
  • Amarasinghe, Ishari
  • Beardsley, Marc Yoshimi
  • Hakami, Eyad
  • Ruiz Garcia, Aurelio
  • Santos Rodríguez, Patrícia
This chapter unfolds some elements of responsible research in the educational technology field and provides examples about how these elements have been considered in initiatives by the Interactive and Distributed Technologies for Education (TIDE) research group at Universitat Pompeu Fabra in Barcelona. First, it focuses on open science, an ongoing movement that promotes, on the one hand, transparent and frequent open-access updates of the research progress and the collected data and, on the other hand, reproducible, accurate, and verifiable research, bringing benefits for the individual researchers, the research community, and the society. Second, the chapter discusses ethics perspectives in educational technology research, relevant when collecting and sharing data and also in the design and development of technologies, especially when they are based on data analytics or artificial intelligence techniques. The latter aspects relate to the capacity of educational software systems to support human agency and preserve human well-being., TIDE-UPF acknowledges the support from the National Research Agency of the Spanish Ministry of Science and Innovation (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033), and previously from TIN2017-85179-C3-3-R, MDM-2015-0502, AGAUR (2017 SGR 1698. DHL (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme, PS by the Ramon y Cajal programme and EH by Jazan University, Saudi Arabia.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Emotion embedding spaces for matching music to stories

  • Won, Minz
  • Salamon, Justin
  • Bryan, Nicholas J
  • Mysore, Gautham J
  • Serra, Xavier
Content creators often use music to enhance their stories, as it can be a powerful tool to convey emotion. In this paper, our goal is to help creators find music to match the emotion of their story. We focus on text-based stories that can be auralized (e.g., books), use multiple sentences as input queries, and automatically retrieve matching music. We formalize this task as a cross-modal text-to-music retrieval problem. Both the music and text domains have existing datasets with emotion labels, but mismatched emotion vocabularies prevent us from using mood or emotion annotations directly for matching. To address this challenge, we propose and investigate several emotion embedding spaces, both manually defined (e.g., valence/arousal) and data-driven (e.g., Word2Vec and metric learning) to bridge this gap. Our experiments show that by leveraging these embedding spaces, we are able to successfully bridge the gap between modalities to facilitate cross modal retrieval. We show that our method can leverage the well established valence-arousal space, but that it can also achieve our goal via data-driven embedding spaces. By leveraging data-driven embeddings, our approach has the potential of being generalized to other retrieval tasks that require broader or completely different vocabularies., This work was funded by the predoctoral grant MDM2015-0502-17-2 from the Spanish Ministry of Economy and Competitiveness linked to the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

FastLAS: scalable inductive logic programming incorporating domain-specific optimisation criteria

  • Law, Mark
  • Russo, Alessandra
  • Bertino, Elisa
  • Broda, Krysia
  • Lobo, Jorge
Comunicació presentada a The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20), celebrat del 7 al 12 de febrer de 2020 a Nova York, Estats Units., Inductive Logic Programming (ILP) systems aim to find a set of logical rules, called a hypothesis, that explain a set of examples. In cases where many such hypotheses exist, ILP systems often bias towards shorter solutions, leading to highly general rules being learned. In some application domains like security and access control policies, this bias may not be desirable, as when data is sparse more specific rules that guarantee tighter security should be preferred. This paper presents a new general notion of a scoring function over hypotheses that allows a user to express domain-specific optimisation criteria. This is incorporated into a new ILP system, called FastLAS, that takes as input a learning task and a customised scoring function, and computes an optimal solution with respect to the given scoring function. We evaluate the accuracy of FastLAS over real-world datasets for access control policies and show that varying the scoring function allows a user to target domain-specific performance metrics. We also compare FastLAS to state-of-the-art ILP systems, using the standard ILP bias for shorter solutions, and demonstrate that FastLAS is significantly faster and more scalable., This research was sponsored by the U.S. Army Research Laboratory and the U.K. Ministry of Defence under Agreement Number W911NF-16-3-0001. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Army Research Laboratory, the U.S. Government, the U.K. Ministry of Defence or the U.K. Government. The U.S. and U.K. Governments are authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Jorge Lobo was supported by the Spanish Ministry of Economy and Competitiveness under Grant Numbers TIN201681032P, MDM20150502, and the U.S. Army Research Office under agreement number W911NF1910432.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Seizure onset zone lateralization using a non-linear analysis of micro vs. macro electroencephalographic recordings during seizure-free stages of the sleep-wake cycle from epilepsy patients

  • Martínez, Cristina G. B.
  • Niediek, Johannes
  • Mormann, Florian
  • Andrzejak, Ralph Gregor
The application of non-linear signal analysis techniques to biomedical data is key to improve our knowledge about complex physiological and pathological processes. In particular, the use of non-linear techniques to study electroencephalographic (EEG) recordings can provide an advanced characterization of brain dynamics. In epilepsy these dynamics are altered at different spatial scales of neuronal organization. We therefore apply non-linear signal analysis to EEG recordings from epilepsy patients derived with intracranial hybrid electrodes, which are composed of classical macro contacts and micro wires. Thereby, these electrodes record EEG at two different spatial scales. Our aim is to test the degree to which the analysis of the EEG recorded at these different scales allows us to characterize the neuronal dynamics affected by epilepsy. For this purpose, we retrospectively analyzed long-term recordings performed during five nights in three patients during which no seizures took place. As a benchmark we used the accuracy with which this analysis allows determining the hemisphere that contains the seizure onset zone, which is the brain area where clinical seizures originate. We applied the surrogate-corrected non-linear predictability score (ψ), a non-linear signal analysis technique which was shown previously to be useful for the lateralization of the seizure onset zone from classical intracranial EEG macro contact recordings. Higher values of ψ were found predominantly for signals recorded from the hemisphere containing the seizure onset zone as compared to signals recorded from the opposite hemisphere. These differences were found not only for the EEG signals recorded with macro contacts, but also for those recorded with micro wires. In conclusion, the information obtained from the analysis of classical macro EEG contacts can be complemented by the one of micro wire EEG recordings. This combined approach may therefore help to further improve the degree to which quantitative EEG analysis can contribute to the diagnostics in epilepsy patients., The authors acknowledge funding from the Spanish Ministry of Economy and Competitiveness, Grant No. FIS2014-54177-R (CM and RA) and by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme, MDM-2015-0502 (CM), from the Volkswagen foundation (FM), from the German Research Council (DFG MO 930/8-1, DFG SFB 1089 to FM).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Inferring directed networks using a rank-based connectivity measure

  • Malvestio, Irene
  • Rocamora, Rodrigo
  • Tauste Campo, Adrián Francisco
  • Grau Leguia, Marc
  • González Martínez, Cristina
  • Andrzejak, Ralph Gregor
  • Levnajica, Zoran
Inferring the topology of a network using the knowledge of the signals of each of the interacting units is key to understanding real-world systems. One way to address this problem is using data-driven methods like cross-correlation or mutual information. However, these measures lack the ability to distinguish the direction of coupling. Here, we use a rank-based nonlinear interdependence measure originally developed for pairs of signals. This measure not only allows one to measure the strength but also the direction of the coupling. Our results for a system of coupled Lorenz dynamics show that we are able to consistently infer the underlying network for a subrange of the coupling strength and link density. Furthermore, we report that the addition of dynamical noise can benefit the reconstruction. Finally, we show an application to multichannel electroencephalographic recordings from an epilepsy patient., Peer Reviewed, Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

FSD50K: an open dataset of human-labeled sound events

  • Fonseca, Eduardo
  • Favory, Xavier
  • Pons, Jordi
  • Font, Frederic
  • Serra, Xavier
Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2 M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K , an open dataset containing over 51 k audio clips totalling over 100 h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research., This work was supported in part by European Union’s Horizon 2020 research and innovation programme under Grant Agreement 688382 AudioCommons, in part by two Google Faculty Research Awards 2017 and 2018, and in part by the Maria de Maeztu Units of Excellence Programme under Grant MDM-2015-0502.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

A multiple constraints framework for collaborative learning flow orchestration

  • Manathunga, Kalpani
  • Hernández Leo, Davinia
Paper presented at ICWL 2016, 15th International Conference, Rome, Italy, October 26–29, 2016., Collaborative Learning Flow Patterns (e.g., Jigsaw) offer sound pedagogical strategies to foster fruitful social interactions among learners. The pedagogy behind the patterns involves a set of intrinsic constraints that need to/nbe considered when orchestrating the learning flow. These constraints relate to the organization of the flow (e.g., Jigsaw pattern - a global problem is divided into sub-problems and a constraint is that there need to be at least one expert group working on each sub-problem) and group formation policies (e.g., groups solving the global problem need to have at least one member coming from a different previous expert group). Besides, characteristics of specific learning situations such as learners’ profile and technological tools used provide additional parameters that can be considered as context-related extrinsic constraints relevant to the orchestration (e.g., heterogeneous groups depending on experience or interests). This paper proposes a constraint framework that considers different constraints for orchestration services enabling adaptive computation of orchestration aspects. Substantiation of the framework with a case study demonstrated the feasibility, usefulness and the expressiveness of the framework., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness/n(TIN2014-53199-C3-3-R; MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Robust algorithms with polynomial loss for near-unanimity CSPs

  • Dalmau, Víctor
  • Kozik, Marcin
  • Krokhin, Andrei
  • Makarychev, Konstantin
  • Makarychev, Yury
  • Opršal, Jakub
An instance of the constraint satisfaction problem (CSP) is given by a family of constraints on overlapping sets of variables, and the goal is to assign values from a fixed domain to the variables so that all constraints are satisfied. In the optimization version, the goal is to maximize the number of satisfied constraints. An approximation algorithm for a CSP is called robust if it outputs an assignment satisfying an (1 - g(ϵ))-fraction of constraints on any (1 ϵ)- satisfiable instance, where the loss function g is such that g(ϵ) → 0 as ϵ → 0. We study how the robust approximability of CSPs depends on the set of constraint relations allowed in instances, the so-called constraint language. All constraint languages admitting a robust polynomial-time algorithm (with some g) have been characterized by Barto and Kozik, with the general bound on the loss g being doubly exponential, specifically g(ϵ) = O((log log(1/ϵ))/ log(1/ϵ)). It is natural to ask when a better loss can be achieved, in particular polynomial loss g(ϵ) = O(ϵ1/k) for some constant k. In this paper, we consider CSPs with a constraint language having a near-unanimity polymorphism. This general condition almost matches a known necessary condition for having a robust algorithm with polynomial loss. We give two randomized robust algorithms with polynomial loss for such CSPs: one works for any near-unanimity polymorphism and the parameter k in the loss depends on the size of the domain and the arity of the relations in Γ, while the other works for a special ternary near-unanimity operation called the dual discriminator with k = 2 for any domain size. In the latter case, the CSP is a common generalization of Unique Games with a fixed domain and 2-Sat. In the former case, we use the algebraic approach to the CSP. Both cases use the standard semidefinite programming relaxation for the CSP., The first author's research was partially supported by MINECO under grant TIN2016-76573-C2-1-P and Maria de Maeztu Units of Excellence programme MDM-2015-0502. The fifth author's research was partially supported by NSF awards CAREER CCF-1150062 and IIS-1302662. The sixth author's research was supported by the European Research Council (grant agreement 681988, CSP-Infinity). The research of the second and sixth authors was partially supported by the National Science Centre Poland under grant UMO-2014/13/B/ST6/01812.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

TANGO1 builds a machine for collagen export by recruiting and spatially organizing COPII, tethers and membranes

  • Raote, Ishier
  • Ortega-Bellido, María
  • Santos, António J M
  • Foresti, Ombretta
  • Zhang, Chong
  • Garcia-Parajo, Maria F.
  • Campelo, Felix
  • Malhotra, Vivek
Collagen export from the endoplasmic reticulum (ER) requires TANGO1, COPII coats, and retrograde fusion of ERGIC membranes. How do these components come together to produce a transport carrier commensurate with the bulky cargo collagen? TANGO1 is known to form a ring that corrals COPII coats and we show here how this ring or fence is assembled. Our data reveal that a TANGO1 ring is organized by its radial interaction with COPII, and lateral interactions with cTAGE5, TANGO1-short or itself. Of particular interest is the finding that TANGO1 recruits ERGIC membranes for collagen export via the NRZ (NBAS/RINT1/ZW10) tether complex. Therefore, TANGO1 couples retrograde membrane flow to anterograde cargo transport. Without the NRZ complex, the TANGO1 ring does not assemble, suggesting its role in nucleating or stabilising of this process. Thus, coordinated capture of COPII coats, cTAGE5, TANGO1-short, and tethers by TANGO1 assembles a collagen export machine at the ER., Peer Reviewed, Postprint (author's final draft)
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

In silico optimization of left atrial appendage Occluder implantation using interactive and modeling tools

  • Aguado, Ainhoa M.|||0000-0003-3281-4298
  • Olivares, Andy Luis|||0000-0002-7284-0696
  • Yaguë, Carlos
  • Silva Garcia, Etelvino|||0000-0001-6825-243X
  • Nuñez-Garcia, Marta|||0000-0001-9349-3059
  • Fernandez-Quilez, Alvaro|||0000-0001-7544-0797
  • Mill, Jordi|||0000-0003-0087-7489
  • Genua, Ibai
  • Arzamendi, Dabit|||0000-0001-7543-5867
  • De Potter, Tom|||0000-0003-1424-114X
  • Freixa, Xavier|||0000-0002-3203-9060
  • Camara, Oscar|||0000-0002-5125-6132
According to clinical studies, around one third of patients with atrial fibrillation (AF) will suffer a stroke during their lifetime. Between 70 and 90% of these strokes are caused by thrombus formed in the left atrial appendage. In patients with contraindications to oral anticoagulants, a left atrial appendage occluder (LAAO) is often implanted to prevent blood flow entering in the LAA. A limited range of LAAO devices is available, with different designs and sizes. Together with the heterogeneity of LAA morphology, these factors make LAAO success dependent on clinician's experience. A sub-optimal LAAO implantation can generate thrombi outside the device, eventually leading to stroke if not treated. The aim of this study was to develop clinician-friendly tools based on biophysical models to optimize LAAO device therapies. A web-based 3D interactive virtual implantation platform, so-called VIDAA, was created to select the most appropriate LAAO configurations (type of device, size, landing zone) for a given patient-specific LAA morphology. An initial LAAO configuration is proposed in VIDAA, automatically computed from LAA shape features (centreline, diameters). The most promising LAAO settings and LAA geometries were exported from VIDAA to build volumetric meshes and run Computational Fluid Dynamics (CFD) simulations to assess blood flow patterns after implantation. Risk of thrombus formation was estimated from the simulated hemodynamics with an index combining information from blood flow velocity and complexity. The combination of the VIDAA platform with in silico indices allowed to identify the LAAO configurations associated to a lower risk of thrombus formation; device positioning was key to the creation of regions with turbulent flows after implantation. Our results demonstrate the potential for optimizing LAAO therapy settings during pre-implant planning based on modeling tools and contribute to reduce the risk of thrombus formation after treatment.
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

Characterization of Anorexia Nervosa on Social Media, Textual, Visual, Relational, Behavioral, and Demographical Analysis

  • Ramírez-Cifuentes, Diana|||0000-0003-0742-4773
  • Freire, Ana|||0000-0003-4698-2129
  • Baeza-Yates, Ricardo|||0000-0003-3208-9778
  • Sanz Lamora, Nadia|||0000-0002-2016-1405
  • Àlvarez, Aida|||0000-0001-7991-7548
  • González-Rodríguez, Alexandre|||0000-0003-1855-8566
  • Lozano Rochel, Meritxell|||0000-0002-0995-0235
  • Llobet Vives, Roger|||0000-0003-4863-251X
  • Velazquez Dorta, Diego Alejandro|||0000-0001-6782-4336
  • Gonfaus, Josep M.|||0000-0003-2079-4103
  • Gonzàlez, Jordi|||0000-0001-8033-0306
Eating disorders are psychological conditions characterized by unhealthy eating habits. Anorexia nervosa (AN) is defined as the belief of being overweight despite being dangerously underweight. The psychological signs involve emotional and behavioral issues. There is evidence that signs and symptoms can manifest on social media, wherein both harmful and beneficial content is shared daily. This study aims to characterize Spanish-speaking users showing anorexia signs on Twitter through the extraction and inference of behavioral, demographical, relational, and multimodal data. By using the transtheoretical model of health behavior change, we focus on characterizing and comparing users at the different stages of the model for overcoming AN, including treatment and full recovery periods. We analyzed the writings, posting patterns, social relationships, and images shared by Twitter users who underwent different stages of anorexia nervosa and compared the differences among users going through each stage of the illness and users in the control group (ie, users without AN). We also analyzed the topics of interest of their followees (ie, users followed by study participants). We used a clustering approach to distinguish users at an early phase of the illness (precontemplation) from those that recognize that their behavior is problematic (contemplation) and generated models for the detection of tweets and images related to AN. We considered two types of control users-focused control users, which are those that use terms related to anorexia, and random control users. We found significant differences between users at each stage of the recovery process (P <.001) and control groups. Users with AN tweeted more frequently at night, with a median sleep time tweets ratio (STTR) of 0.05, than random control users (STTR=0.04) and focused control users (STTR=0.03). Pictures were relevant for the characterization of users. Focused and random control users were characterized by the use of text in their profile pictures. We also found a strong polarization between focused control users and users in the first stages of the disorder. There was a strong correlation among the shared interests between users with AN and their followees (ρ =0.96). In addition, the interests of recovered users and users in treatment were more highly correlated to those corresponding to the focused control group (ρ =0.87 for both) than those of AN users (ρ =0.67), suggesting a shift in users' interest during the recovery process. We mapped the signs of AN to social media context. These results support the findings of previous studies that focused on other languages and involved a deep analysis of the topics of interest of users at each phase of the disorder. The features and patterns identified provide a basis for the development of detection tools and recommender systems.
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

3D membrane segmentation and quantification of intact thick cells using cryo soft X-ray transmission microscopy, A pilot study

  • Cárdenes, Rubén
  • Zhang, Chong
  • Klementieva, Oxana|||0000-0003-1782-050X
  • Werner, Stephan
  • Guttmann, Peter
  • Pratsch, Christoph
  • Cladera i Cerdà, Josep|||0000-0002-1724-3477
  • Bijnens, Bart H.|||0000-0003-3130-6937
Structural analysis of biological membranes is important for understanding cell and sub-cellular organelle function as well as their interaction with the surrounding environment. Imaging of whole cells in three dimension at high spatial resolution remains a significant challenge, particularly for thick cells. Cryo-transmission soft X-ray microscopy (cryo-TXM) has recently gained popularity to image, in 3D, intact thick cells (∼10 μm) with details of sub-cellular architecture and organization in near-native state. This paper reports a new tool to segment and quantify structural changes of biological membranes in 3D from cryo-TXM images by tracking an initial 2D contour along the third axis of the microscope, through a multi-scale ridge detection followed by an active contours-based model, with a subsequent refinement along the other two axes. A quantitative metric that assesses the grayscale profiles perpendicular to the membrane surfaces is introduced and shown to be linearly related to the membrane thickness. Our methodology has been validated on synthetic phantoms using realistic microscope properties and structure dimensions, as well as on real cryo-TXM data. Results demonstrate the validity of our algorithms for cryo-TXM data analysis.
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

Sensitivity analysis of in silico fluid simulations to predict thrombus formation after left atrial appendage occlusion

  • Mill, Jordi|||0000-0003-0087-7489
  • Agudelo Montañez, Victor Hugo
  • Olivares, Andy Luis|||0000-0002-7284-0696
  • Pons, Maria Isabel
  • Silva, Etelvino
  • Nuñez-Garcia, Marta|||0000-0001-9349-3059
  • Morales Ferez, Xabier|||0000-0003-1349-2457
  • Arzamendi, Dabit|||0000-0001-7543-5867
  • Freixa, Xavier|||0000-0002-3203-9060
  • Noailly, Jérôme
  • Camara, Oscar|||0000-0002-5125-6132
Atrial fibrillation (AF) is nowadays the most common human arrhythmia and it is consid-ered a marker of an increased risk of embolic stroke. It is known that 99% of AF-related thrombi are generated in the left atrial appendage (LAA), an anatomical structure located within the left atrium (LA). Left atrial appendage occlusion (LAAO) has become a good alternative for nonvalvular AF patients with contraindications to anticoagulants. However, there is a non-negligible number of device-related thrombus (DRT) events, created next to the device surface. In silico fluid simulations can be a powerful tool to better understand the relation between LA anatomy, haemodynamics, and the process of thrombus formation. Despite the increasing literature in LA fluid modelling, a consensus has not been reached yet in the community on the optimal modelling choices and boundary conditions for generating realistic simulations. In this line, we have performed a sensitivity analysis of several boundary conditions scenarios, varying inlet/outlet and LA wall movement configurations, using patient-specific imaging data of six LAAO patients (three of them with DRT at follow-up). Mesh and cardiac cycle convergence were also analysed. The boundary conditions scenario that better predicted DRT cases had echocardiography-based velocities at the mitral valve outlet, a generic pressure wave from an AF patient at the pulmonary vein inlets, and a dynamic mesh approach for LA wall deformation, emphasizing the need for patient-specific data for realistic simulations. The obtained promising results need to be further validated with larger cohorts, ideally with ground truth data, but they already offer unique insights on thrombogenic risk in the left atria.
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

Domain expert evaluation of advanced visual computing solutions and 3D printing for the planning of the left atrial appendage occluder interventions

  • Mill, Jordi|||0000-0003-0087-7489
  • Montoliu, Helena
  • Moustafa, Abdel Hakim|||0000-0001-6077-6888
  • Olivares, Andy Luis|||0000-0002-7284-0696
  • Albors, Carlos
  • Aguado, Ainhoa M.|||0000-0003-3281-4298
  • Medina, Elodie
  • Ceresa, Mario
  • Freixa, Xavier|||0000-0002-3203-9060
  • Arzamendi, Dabit|||0000-0001-7543-5867
  • Cochet, Hubert
  • Camara, Oscar|||0000-0002-5125-6132
Advanced visual computing solutions and three-dimensional (3D) printing are moving from engineering to clinical pipelines for training, planning, and guidance of complex interventions. 3D imaging and rendering, virtual reality (VR), and in-silico simulations, as well as 3D printing technologies provide complementary information to better understand the structure and function of the organs, thereby improving and personalizing clinical decisions. In this study, we evaluated several advanced visual computing solutions, such as web-based 3D imaging visualization, VR, and computational fluid simulations, together with 3D printing, for the planning of the left atrial appendage occluder (LAAO) device implantations. Six cardiologists tested different technologies in pre-operative data of five patients to identify the usability, limitations, and requirements for the clinical translation of each technology through a qualitative questionnaire. The obtained results demonstrate the potential impact of advanced visual computing solutions and 3D printing to improve the planning of LAAO interventions as well as the need for their integration into a single workflow to be used in a clinical environment.