Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 36
Encontrada(s) 1 página(s)

e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

When dialects collide: how socioeconomic mixing affects language use

  • Louf, Thomas
  • Ramasco, Jose J.
  • Sánchez, David
  • Karsai, Márton
The socioeconomic background of people and how they use standard forms of language are not independent, as demonstrated in various sociolinguistic studies. However, the extent to which these correlations may be influenced by the mixing of people from different socioeconomic classes remains relatively unexplored from a quantitative perspective. In this work we leverage geotagged tweets and transferable computational methods to map deviations from standard English across eight UK metropolitan areas. We combine these data with high-resolution income maps to assign a proxy socioeconomic indicator to home-located users. Strikingly, we find a consistent pattern suggesting that the more different socioeconomic classes mix, the less interdependent the frequency of their departures from standard grammar and their income become. Further, we propose an agent-based model of linguistic variety adoption that sheds light on the mechanisms that produce the observations seen in the data., Open access funding provided by HUN-REN Alfréd Rényi Institute of Mathematics. This work was partially supported by the Spanish State Research Agency (MCIN/AEI/10.13039/501100011033) and FEDER (UE) under project APASOS (PID2021-122256NB-C21 and PID2021-122256NB-C22) and the María de Maeztu project CEX2021-001164-M and by the Comunitat Autonoma de les Illes Balears through the Direcció General de Política Universitària i Recerca with funds from the Tourist Stay Tax Law ITS 2017-006 (PDR2020/51). TL is grateful for the support from the EMOMAP CIVICA project. MK was supported by the CHIST-ERA project SAI: FWF I 5205-N; the SoBigData++ H2020-871042; the EPO and EMOMAP CIVICA projects, the National Laboratory of Health Security (RRF-2.3.1-21-2022-00006) and the DATAREDUX project, ANR19-CE46-0008.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Participant behavior and community response in online mental health communities: insights from reddit

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Measuring gender bias in student satisfaction in higher education: a cross-department study

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Student satisfaction surveys are widely accepted for measuring the quality of students’ overall experience with the received teaching and informing the design of improvements in higher education. However, several studies have shown that these surveys have biases that may lead to discrimination or unfair decisions against female academics. Yet it is unclear how these undesirable factors are evolving with time or to what extent they are present in different contexts. In this study, we investigate survey results from a large University in Spain for two academic years, 2021–2022 and 2022–2023. Our analysis examines these gender biases by evaluating the influencing factors from the perspective of professors and students at the level of the entire university and individual centers. The results obtained using this approach provide multifaceted evidence of gender bias disadvantaging women, especially in some academic disciplines, and that is particularly noticeable in the extremes of student satisfaction distributions., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects “SoBigData++” (grant agreement 871042), “FINDHR” (grant agreement 101070212).
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

Institutional, academic, and learning analytics: a bibliometric study

  • Marques, Francielle
  • Ortiz-Beltrán, Ariel
  • Hernández Leo, Davinia
  • Castillo, Carlos
Comunicació presentada al 25th IEEE International Conference on Advanced Learning Technologies (ICALT 2025), celebrada a Changhua (Taiwan) del 14-17 de juliol de 2025, Educational institutions are increasingly adopting data-driven approaches, yet there appears to be insufficient exploration into the development of so-called Institutional and Academic Analytics and how these terms intersect with Learning Analytics (LA). This study conducts a bibliometric analysis (last 10 years) as an initial step to explore this gap. Our results illuminate evolving but inconsistent interest in Institutional and Academic Analytics across time and across publication venues. The results also indicate a need for the LA community to clarify its connections with related applications of data analytics focused on students and their contexts while reflecting on and potentially expanding its areas of impact., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Hunter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects ¿SoBigData++¿ (grant agreement 871042), ¿FINDHR¿ (grant agreement 101070212).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A comparative user study of human predictions in algorithm-supported recidivism risk assessment

  • Portela, Manuel
  • Castillo, Carlos
  • Tolan, Songül
  • Karimi-Haghighi, Marzieh
  • Andrés Pueyo, Antonio
In this paper, we study the effects of using an algorithm-based risk assessment instrument (RAI) to support the prediction of risk of violent recidivism upon release. The instrument we used is a machine learning version of RiskCanvi used by the Justice Department of Catalonia, Spain. It was hypothesized that people can improve their performance on defining the risk of recidivism when assisted with a RAI. Also, that professionals can perform better than non-experts on the domain. Participants had to predict whether a person who has been released from prison will commit a new crime leading to re-incarceration, within the next two years. This user study is done with (1) general participants from diverse backgrounds recruited through a crowdsourcing platform, (2) targeted participants who are students and practitioners of data science, criminology, or social work and professionals who work with RisCanvi. We also run focus groups with participants of the targeted study, including people who use RisCanvi in a professional capacity, to interpret the quantitative results. Among other findings, we observe that algorithmic support systematically leads to more accurate predictions from all participants, but that statistically significant gains are only seen in the performance of targeted participants with respect to that of crowdsourced participants. Among other comments, professional participants indicate that they would not foresee using a fully-automated system in criminal risk assessment, but do consider it valuable for training, standardization, and to fine-tune or double-check their predictions on particularly difficult cases. We found that the revised prediction by using a RAI increases the performance of all groups, while professionals show a better performance in general. And, a RAI can be considered for extending professional capacities and skills along their careers., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially supported by the HUMAINT programme (Human Behaviour and Machine Intelligence), Centre for Advanced Studies, Joint Research Centre, European Commission through the Expect contract CT-EX2019D347180. Additionally, it received the support from the EU-funded project “SoBigData++” (grant agreement 871042).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A framework for assessing algorithmic discrimination risks in training data: a case of pediatric type 1 diabetes

  • Bilionis, Ioannis
  • Berrios, Ricardo C.
  • de Arriba Muñoz, Antonio
  • Fernandez-Luque, Luis
  • Castillo, Carlos
Objectives: To develop a generalizable framework for identifying algorithmic discrimination risks arising from subgroup imbalances in machine learning training data, with relevance to medical informatics applications where heterogeneous real-world data can bias model behavior. Materials and Methods: We introduce a discrimination risk assessment framework for training datasets, a 4-step methodology integrating: (1) controlled representation sampling, (2) ensemble-based model training, (3) multilevel subgroup disparity quantification, and (4) mitigation-oriented interpretation. The framework systematically perturbs training subgroup composition while holding evaluation sets fixed to isolate representation effects. Validation was performed across 7 publicly available pediatric type 1 diabetes datasets using sociodemographic variables and continuous glucose monitoring data to assess robustness under heterogeneous data sources. Results: Representation balance alone does not guarantee stable or equitable model outputs. Ensemble analyses revealed subgroup-dependent volatility, with some groups consistently contributing to model generalization, while others inducing instability despite increased representation. These findings demonstrate structural sensitivity to data composition that is not captured by standard performance-only evaluations. Discussion: The framework exposes disparities and instability patterns that remain hidden under single-model or balanced-data evaluations. By quantifying representation-driven behaviors and subgroup-specific training value, it offers a diagnostic tool for understanding data-induced risks prior to model deployment. Conclusion: This work provides a methodology for assessing discrimination risks in training datasets used in medical informatics. By integrating data composition effects, prediction stability, and subgroup-level disparity analysis, the framework supports more reliable and transparent development of machine learning systems across diverse clinical and nonclinical contexts. Clinical trial registration: This research did not involve any new clinical trial. All analyses were performed on data from previously registered clinical trials, as listed below: PEDAP dataset: The source of the data is the PEDAP Trial Study Group. (2024). PEDAP Public Dataset (Release 4). Retrieved from https://public.jaeb.org/dataset/599. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by PEDAP Trial Study Group. ClinicalTrials.gov Identifier: NCT04796779; registered March 15, 2021. IOBP2 RCT dataset: The source of the data is the Insulin Only Bionic Pancreas Pivotal Trial. Retrieved from https://public.jaeb.org/dataset/579. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Bionic Pancreas Research Group or Beta Bionics. ClinicalTrials.gov Identifier: NCT04200313; registered December 16, 2019. DCLP5 dataset: The source of the data is the University of Virginia. DCLP5 Dataset. Retrieved from http://public.jaeb.org/dataset/535. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. Associated ClinicalTrials.gov Identifier: NCT03844789; registered February 18th, 2019 DCLP3 dataset: The source of the data is the University of Virginia. The International Diabetes Closed Loop (iDCL) trial. DCLP3 Public Dataset (Release 3). Retrieved from http:///public.jaeb.org/dataset/573. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. ClinicalTrials.gov Identifier: NCT03591354; registered July 19, 2018. CITY dataset: The source of the data is the Jaeb Center of Health Research. CGM Intervention in Teens and Young Adults with T1D (CITY Public Dataset). Retrieved from http://public.jaeb.org/dataset/565. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT03263494; registered August 28, 2017. SENCE public dataset: The source of the data is the Jaeb Center of Health Research. SENCE Public Dataset. Retrieved from http://public.jaeb.org/dataset/554. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT02912728; registered September 23, 2016., This work was funded by the Spanish Ministry of Science and Innovation (REF: DIN2021-011865). It was also partially supported by the Department of Research and Universities of the Government of Catalonia (SGR 00930), the EU-funded project SoBigData++ (grant agreement 871042), and MCIN/AEI/ 10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021-001195-M). None of the funders played any role in the study design, data collection, analysis, interpretation of results, or the writing of this manuscript.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Using pre-trained language models for abstractive DBPEDIA summarization: a comparative study

  • Zahera, Hamada M.
  • Vitiugin, Fedor
  • Sherif, Mohamed Ahmed
  • Castillo, Carlos
  • Ngonga Ngomo, Axel-Cyrille
Comunicació presentada a la 19th International Conference on Semantic Systems, celebrada del 20 al 22 de setembre de 2023 a Leipzig, Germany., Purpose: This study addresses the limitations of current short abstracts of DBPEDIA entities, which often lack a comprehensive overview due to their creating method (i.e., selecting the first two-three sentences from the full DBPEDIA abstracts). Methodology: We leverage pre-trained language models to generate abstractive summaries of DBPEDIA abstracts in six languages (English, French, German, Italian, Spanish, and Dutch). We performed several experiments to assess the quality of generated summaries by language models. In particular, we evaluated the generated summaries using human judgments and automated metrics (Self-ROUGE and BERTScore). Additionally, we studied the correlation between human judgments and automated metrics in evaluating the generated summaries under different aspects: informativeness, coherence, conciseness, and fluency. Findings: Pre-trained language models generate summaries more concise and informative than existing short abstracts. Specifically, BART-based models effectively overcome the limitations of DBPEDIA short abstracts, especially for longer ones. Moreover, we show that BERTScore and ROUGE-1 are reliable metrics for assessing the informativeness and coherence of the generated summaries with respect to the full DBPEDIA abstracts. We also find a negative correlation between conciseness and human ratings. Furthermore, fluency evaluation remains challenging without human judgment. Value: This study has significant implications for various applications in machine learning and natural language processing that rely on DBPEDIA resources. By providing succinct and comprehensive summaries, our approach enhances the quality of DBPEDIA abstracts and contributes to the semantic web community., This work has been supported by the German Federal Ministry of Education and Research (BMBF) through the EuroStars project E!114154 PORQUE (grant no 01QE2056C) and the KIAM project (grant no 02L19C115). Additionally, this work has been partially supported by: the Department of Research and Universities of the Government of Catalonia (SGR00930), the Ministry of Science and Innovation of Spain with the project COMCRISIS (reference code PID2019−109064GB−I00), the EU-funded SoBigData++ project under Grant Agreement 871042 and MCIN/AEI /10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021−001195− M).
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

Towards caring institutional analytics: a case study illustrating the exploration of language biases

  • Marques, Francielle
  • Hernández Leo, Davinia
  • Castillo, Carlos
  • Trenchs i Parera, Mireia
Our study focuses on institutional analytics in higher education decision-making and the need of considering contextual biases. We contribute with a case study in a university in Catalonia using (reliable) student grades and satisfaction data from 22 professors who teach at least one course in Catalan and at least one course in English to identify language-related biases or interrelationships. Our study sheds light on the relevance of this perspective and its implications, This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData++" (grant agreement 871042), "FINDHR" (grant agreement 101070212). Trenchs-Parera also acknowledges support from the INCLU-LINGUAM research project (ref. PID2022-141945NB-I00), funded by MCIN/AEI/10.13039/501100011033/ and FEDER, EU.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Human-AI coevolution

  • Pedreschi, Dino
  • Pappalardo, Luca
  • Ferragina, Emanuele
  • Baeza Yates, Ricardo
  • Barabási, Albert-László
  • Dignum, Frank
  • Dignum, Virginia
  • Eliassi-Rad, Tina
  • Giannotti, Fosca
  • Kertész, János
  • Knott, Alistair
  • Ioannidis, Yannis
  • Lukowicz, Paul
  • Passarella, Andrea
  • Pentland, Alex
  • Shawe-Taylor, John
  • Vespignani, Alessandro
Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterises our society, but is understudied in artificial intelligence and complexity science literature. Recommender systems and assistants play a prominent role in human-AI coevolution, as they permeate many facets of daily life and influence human choices through online platforms. The interaction between users and AI results in a potentially endless feedback loop, wherein users' choices generate data to train AI models, which, in turn, shape subsequent user preferences. This human-AI feedback loop has peculiar characteristics compared to traditional human-machine interaction and gives rise to complex and often “unintended” systemic outcomes. This paper introduces human-AI coevolution as the cornerstone for a new field of study at the intersection between AI and complexity science focused on the theoretical, empirical, and mathematical investigation of the human-AI feedback loop. In doing so, we: (i) outline the pros and cons of existing methodologies and highlight shortcomings and potential ways for capturing feedback loop mechanisms; (ii) propose a reflection at the intersection between complexity science, AI and society; (iii) provide real-world examples for different human-AI ecosystems; and (iv) illustrate challenges to the creation of such a field of study, conceptualising them at increasing levels of abstraction, i.e., scientific, legal and socio-political., This work has been partially supported by PNRR - M4C2 - Investimento 1.3, Partenariato Esteso (grant No. PE00000013) - “FAIR - Future Artificial Intelligence Research” - Spoke 1 “Human-centered AI”, funded by the European Commission under the Next Generation EU programme; EU H2020 projects HumaneAI-net G.A. 952026 and SoBigData++ G.A. 871042; European Research Council ERC-2018-ADG 834756 “XAI: Science and technology for the eXplanation of AI decision making”; CHIST-ERA grant CHIST-ERA-19-XAI-010, by MUR (grant No. not available), FWF (grant No. I 5205), EPSRC (grant No. EP/V055712/1), NCN (grant No. 2020/02/Y/ST6/00064), ETAg (grant No. SLTAT21096), BNSF (grant No. KΠ-06-AOO2/5); PNRR (Piano Nazionale di Ripresa e Resilienza) in the context of the research program 20224CZ5X4_PE6_PRIN 2022 “URBAI – Urban Artificial Intelligence” (CUP B53D23012770006), funded by European Union – Next Generation EU; Emanuele Ferragina has been partially supported by a public grant overseen by the French National Research Agency (ANR) as part of the ‘Investissements d'Avenir’ program LIEPP (ANR-11-LABX-0091, ANR-11-IDEX-0005-02) and the Université de Paris IdEx (ANR-18-IDEX-0001). We thank Vincenzo Vivarini for the inspiration about the importance of the feedback loop in complex social systems. There is always a human agent beyond any tactical system. We also thank Daniele Fadda for the support on making the figures. Finally, we thank all members of KDD-Lab for insightful discussions about human-AI coevolution.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The Response of governments and public health agencies to COVID-19 pandemics on social media: a multi-country analysis of Twitter discourse

  • Li, Lan
  • Aldosery, Aisha
  • Vitiugin, Fedor
  • Nathan, Naomi
  • Novillo-Ortiz, David
  • Castillo, Carlos
  • Kostkova, Patty
During the COVID-19 pandemic, information is being rapidly shared by public health experts and researchers through social media platforms. Whilst government policies were disseminated and discussed, fake news and misinformation simultaneously created a corresponding wave of “infodemics.” This study analyzed the discourse on Twitter in several languages, investigating the reactions to government and public health agency social media accounts that share policy decisions and official messages. The study collected messages from 21 official Twitter accounts of governments and public health authorities in the UK, US, Mexico, Canada, Brazil, Spain, and Nigeria, from 15 March to 29 May 2020. Over 2 million tweets in various languages were analyzed using a mixedmethods approach to understand the messages both quantitatively and qualitatively. Using automatic, text-based clustering, five topics were identified for each account and then categorized into 10 emerging themes. Identified themes include political, socio-economic, and population-protection issues, encompassing global, national, and individual levels. A comparison was performed amongst the seven countries analyzed and the United Kingdom (Scotland, Northern Ireland, and England) to find similarities and differences between countries and government agencies. Despite the difference in language, country of origin, epidemiological contexts within the countries, significant similarities emerged. Our results suggest that other than general announcement and reportage messages, the most-discussed topic is evidence-based leadership and policymaking, followed by how to manage socio-economic consequences.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

A causal inference study on the effects of first year workload on the dropout rate of undergraduates

  • Karimi-Haghighi, Marzieh
  • Castillo, Carlos
  • Hernández Leo, Davinia
Comunicació presentada a 23rd International Conference on Artificial Intelligence in Education (AIED 2022), celebrat del 27 al 31 de juliol de 2022 a Durham, Regne Unit., In this work, we evaluate the risk of early dropout in undergraduate studies using causal inference methods, and focusing on groups of students who have a relatively higher dropout risk. We use a large dataset consisting of undergraduates admitted to multiple study programs at eight faculties/schools of our university. Using data available at enrollment time, we develop Machine Learning (ML) methods to predict university dropout and underperformance, which show an AUC of 0.70 and 0.74 for each risk respectively. Among important drivers of dropout over which the first-year students have some control, we find that first year workload (i.e., the number of credits taken) is a key one, and we mainly focus on it. We determine the effect of taking a relatively lighter workload in the first year on dropout risk using causal inference methods: Propensity Score Matching (PSM), Inverse Propensity score Weighting (IPW), Augmented Inverse Propensity Weighted (AIPW), and Doubly Robust Orthogonal Random Forest (DROrthoForest). Our results show that a reduction in workload reduces dropout risk., This work has been partially supported by: the HUMAINT programme (Human Behaviour and Machine Intelligence), Joint Research Centre, European Commission; “la Caixa” Foundation (ID 100010434), under the agreement LCF/PR/PR16/51110009; and the EU-funded “SoBigData++” project, under Grant Agreement 871042. In addition, D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme, and the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033).
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Artículo científico (JournalArticle)

TextFocus: Assessing the Faithfulness of Feature Attribution Methods Explanations in Natural Language Processing

  • Mariotti, Ettore
  • Arias-Duart, Anna
  • Cafagna, Michele
  • Gatt, Albert
  • García-Gasulla, Darío
  • Alonso Moral, José María
Among the existing eXplainable AI (XAI) approaches, Feature Attribution methods are a popular option due to their interpretable nature. However, each method leads to a different solution, thus introducing uncertainty regarding their reliability and coherence with respect to the underlying model. This work introduces TextFocus, a metric for evaluating the faithfulness of Feature Attribution methods for Natural Language Processing (NLP) tasks involving classification. To address the absence of ground truth explanations for such methods, we introduce the concept of textual mosaics. A mosaic is composed of a combination of sentences belonging to different classes, which provides an implicit ground truth for attribution. The accuracy of explanations can be then evaluated by comparing feature attribution scores with the known class labels in the mosaic. The performance of six feature attribution methods is systematically compared on three sentence classification tasks by using TextFocus, with Integrated Gradients being the best overall method in terms of faithfulness and computational requirements. The proposed methodology fills a gap in NLP evaluation, by providing an objective way to assess Feature Attribution methods while finding their optimal parameters.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

A Confusion Matrix for Evaluating Feature Attribution Methods

  • Arias-Duart, Anna
  • Mariotti, Ettore
  • García-Gasulla, Darío
  • Alonso Moral, José María
The increasing use of deep learning models in critical areas of computer vision and the consequent need for insights into model behaviour have led to the development of numerous feature attribution methods. However, these attributions must be both meaningful and plausible to end-users, which is not always the case. Recent research has emphasized the importance of faithfulness in attributions, as plausibility without faithfulness can result in misleading explanations and incorrect decisions. In this work, we propose a novel approach to evaluate the faithfulness of feature attribution methods by constructing an ‘Attribution Confusion Matrix’, which allows us to leverage a wide range of existing metrics from the traditional confusion matrix. This approach effectively introduces multiple evaluation measures for faithfulness in feature attribution methods in a unified and consistent framework. We demonstrate the effectiveness of our approach on various datasets, attribution methods, and models, emphasizing the importance of faithfulness in generating plausible and reliable explanations while also illustrating the distinct behaviour of different feature attribution methods.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Focus! Rating XAI methods and finding biases

  • Arias Duart, Anna|||0000-0002-8819-6735
  • Parés Pont, Ferran
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
  • Giménez Ábalos, Víctor
AI explainability improves the transparency and trustworthiness of models. However, in the domain of images, where deep learning has succeeded the most, explainability is still poorly assessed. In the field of image recognition many feature attribution methods have been proposed with the purpose of explaining a model’s behavior using visual cues. However, no metrics have been established so far to assess and select these methods objectively. In this paper we propose a consistent evaluation score for feature attribution methods—the Focus—designed to quantify their coherency to the task. While most previous work adds outof-distribution noise to samples, we introduce a methodology to add noise from within the distribution. This is done through mosaics of instances from different classes, and the explanations these generate. On those, we compute a visual pseudo-precision metric, Focus. First, we show the robustness of the approach through a set of randomization experiments. Then we use Focus to compare six popular explainability techniques across several CNN architectures and classification datasets. Our results find some methods to be consistently reliable (LRP, GradCAM), while others produce class-agnostic explanations (SmoothGrad, IG). Finally we introduce another application of Focus, using it for the identification and characterization of biases found in models. This empowers bias-management tools, in another small step towards trustworthy AI., This work is supported by the European Union – H2020 Program under the “INFRAIA-01-2018-2019 – Integrating Activities for Advanced Communities”, Grant Agreement n.871042, “SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics” and by the Dept. de Recerca i Universitats of the Generalitat de Catalunya under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Assessing biases through visual contexts

  • Arias Duart, Anna|||0000-0002-8819-6735
  • Giménez Ábalos, Víctor
  • Cortés García, Claudio Ulises|||0000-0003-0192-3096
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
Bias detection in the computer vision field is a necessary task, to achieve fair models. These biases are usually due to undesirable correlations present in the data and learned by the model. Although explainability can be a way to gain insights into model behavior, reviewing explanations is not straightforward. This work proposes a methodology to analyze the model biases without using explainability. By doing so, we reduce the potential noise arising from explainability methods, and we minimize human noise during the analysis of explanations. The proposed methodology combines images of the original distribution with images of potential context biases and analyzes the effect produced in the model’s output. For this work, we first presented and released three new datasets generated by diffusion models. Next, we used the proposed methodology to analyze the context impact on the model’s prediction. Finally, we verified the reliability of the proposed methodology and the consistency of its results. We hope this tool will help practitioners to detect and mitigate potential biases, allowing them to obtain more reliable models., This work received funding from the European Union’s H2020-INFRAIA-2019-1 program under the Grant Agreement n.871042 (SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics) and from the HORIZON-INFRA-2021-DEV-02 program under the Grant Agreement n.101079043 (SoBigData RI Preparatory Phase Project). Additionally, this work was supported by the Departament de Recerca i Universitats of the Generalitat de Catalunya, under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Focus and bias: will it blend?

  • Arias Duart, Anna|||0000-0002-8819-6735
  • Parés Pont, Ferran
  • Giménez Ábalos, Víctor
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
One direct application of explainable AI feature attribution methods is to be used for detecting unwanted biases. To do so, domain experts typically have to review explained inputs, checking for the presence of unwanted biases learnt by the model. However, the huge amount of samples the domain experts must review makes this task more challenging as the size of the dataset grows. In an ideal case, domain experts should be provided only with a small number of selected samples containing potential biases. The recently published Focus score seems a promising tool for the selection of samples containing potential unwanted biases. In this work, we conduct a first study in this direction, analyzing the behavior of the Focus score when applied to a biased model. First, we verified that Focus is indeed sensitive to an induced bias. This is assessed by forcing a spurious correlation, training a model using only cats-indoor and dogs-outdoor. We empirically prove that the model learnt to distinguish the contexts (outdoor vs indoor) instead of cat vs dog classes, so ensuring that the model learnt an unwanted bias. Afterwards, we apply the Focus on this biased model showing how the Focus score decreases when the input contains the aforementioned bias. This analysis sheds light on the Focus behavior when applied to a biased model, highlighting its strengths for its use for bias detection., This work is supported by the European Union – H2020 Program under the “INFRAIA-01-2018-2019 – Integrating Activities for Advanced Communities”, Grant Agreement n.871042, “SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics” and by the Departament de Recerca i Universitats of the Generalitat de Catalunya under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Comparative analysis of geolocation information through mobile-devices under different COVID-19 mobility restriction patterns in Spain

  • Pérez Arnal, Raquel Leandra|||0000-0002-0041-8146
  • Conesa Ortega, David|||0000-0001-5917-2673
  • Álvarez Napagao, Sergio|||0000-0001-9946-9703
  • Suzumura, Toyotaro
  • Català Sabaté, Martí|||0000-0003-3308-9905
  • Álvarez Lacalle, Enrique|||0000-0001-6824-6857
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
The COVID-19 pandemic is changing the world in unprecedented and unpredictable ways. Human mobility, being the greatest facilitator for the spread of the virus, is at the epicenter of this change. In order to study mobility under COVID-19, to evaluate the efficiency of mobility restriction policies, and to facilitate a better response to future crisis, we need to understand all possible mobility data sources at our disposal. Our work studies private mobility sources, gathered from mobile-phones and released by large technological companies. These data are of special interest because, unlike most public sources, it is focused on individuals rather than on transportation means. Furthermore, the sample of society they cover is large and representative. On the other hand, these data are not directly accessible for anonymity reasons. Thus, properly interpreting its patterns demands caution. Aware of that, we explore the behavior and inter-relations of private sources of mobility data in the context of Spain. This country represents a good experimental setting due to both its large and fast pandemic peak and its implementation of a sustained, generalized lockdown. Our work illustrates how a direct and naive comparison between sources can be misleading, as certain days (e.g., Sundays) exhibit a directly adverse behavior. After understanding their particularities, we find them to be partially correlated and, what is more important, complementary under a proper interpretation. Finally, we confirm that mobile-data can be used to evaluate the efficiency of implemented policies, detect changes in mobility trends, and provide insights into what new normality means in Spain., Part of this research has received funding from the European Union Horizon 2020 Programme under the SoBigData++ Project, grant agreement num. 871,042. Martí Català received funding from La Caixa Foundation (ID 100010434), under agreement LCF/PR/GN17/50300003; Martí Català received funding from Ministerio de Ciencia, Innovación y Universidades and FEDER, with the project PGC2018-095456-B-I00.E. A-L EAL thanks support from the Spanish Ministry of Science Innovation and Universities, (SAF2017-88019-C3-3R)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Estudio, informe, memoria (Report)

Healthy Twitter discussions? Time will tell

  • Gnatyshak, Dmitry|||0000-0001-6779-6283
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
  • Álvarez Napagao, Sergio|||0000-0001-9946-9703
  • Arjona Martínez, Jamie|||0000-0003-2585-2392
  • Venturini, Tommaso
Studying misinformation and how to deal with unhealthy behaviours within online discussions has recently become an important field of research within social studies. With the rapid development of social media, and the increasing amount of available information and sources, rigorous manual analysis of such discourses has become unfeasible. Many approaches tackle the issue by studying the semantic and syntactic properties of discussions following a supervised approach, for example using natural language processing on a dataset labeled for abusive, fake or bot-generated content. Solutions based on the existence of a ground truth are limited to those domains which may have ground truth. However, within the context of misinformation, it may be difficult or even impossible to assign labels to instances. In this context, we consider the use of temporal dynamic patterns as an indicator of discussion health. Working in a domain for which ground truth was unavailable at the time (early COVID-19 pandemic discussions) we explore the characterization of discussions based on the the volume and time of contributions. First we explore the types of discussions in an unsupervised manner, and then characterize these types using the concept of ephemerality, which we formalize. In the end, we discuss the potential use of our ephemerality definition for labeling online discourses based on how desirable, healthy and constructive they are., This work is supported by the scheme ‘INFRAIA-01-2018-2019: Research and Innovation action’, Grant Agreement n. 871042 ‘SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics’
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Human-AI coevolution

  • Pedreschi, Dino
  • Pappalardo, Luca
  • Ferragina, Emanuele
  • Baeza Yates, Ricardo
  • Barabási, Albert-László
  • Dignum, Frank
  • Dignum, Virginia
  • Eliassi-Rad, Tina
  • Giannotti, Fosca
  • Kertész, János
  • Knott, Alistair
  • Ioannidis, Yannis
  • Lukowicz, Paul
  • Passarella, Andrea
  • Pentland, Alex
  • Shawe-Taylor, John
  • Vespignani, Alessandro
Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterises our society, but is understudied in artificial intelligence and complexity science literature. Recommender systems and assistants play a prominent role in human-AI coevolution, as they permeate many facets of daily life and influence human choices through online platforms. The interaction between users and AI results in a potentially endless feedback loop, wherein users' choices generate data to train AI models, which, in turn, shape subsequent user preferences. This human-AI feedback loop has peculiar characteristics compared to traditional human-machine interaction and gives rise to complex and often “unintended” systemic outcomes. This paper introduces human-AI coevolution as the cornerstone for a new field of study at the intersection between AI and complexity science focused on the theoretical, empirical, and mathematical investigation of the human-AI feedback loop. In doing so, we: (i) outline the pros and cons of existing methodologies and highlight shortcomings and potential ways for capturing feedback loop mechanisms; (ii) propose a reflection at the intersection between complexity science, AI and society; (iii) provide real-world examples for different human-AI ecosystems; and (iv) illustrate challenges to the creation of such a field of study, conceptualising them at increasing levels of abstraction, i.e., scientific, legal and socio-political., This work has been partially supported by PNRR - M4C2 - Investimento 1.3, Partenariato Esteso (grant No. PE00000013) - “FAIR - Future Artificial Intelligence Research” - Spoke 1 “Human-centered AI”, funded by the European Commission under the Next Generation EU programme; EU H2020 projects HumaneAI-net G.A. 952026 and SoBigData++ G.A. 871042; European Research Council ERC-2018-ADG 834756 “XAI: Science and technology for the eXplanation of AI decision making”; CHIST-ERA grant CHIST-ERA-19-XAI-010, by MUR (grant No. not available), FWF (grant No. I 5205), EPSRC (grant No. EP/V055712/1), NCN (grant No. 2020/02/Y/ST6/00064), ETAg (grant No. SLTAT21096), BNSF (grant No. KΠ-06-AOO2/5); PNRR (Piano Nazionale di Ripresa e Resilienza) in the context of the research program 20224CZ5X4_PE6_PRIN 2022 “URBAI – Urban Artificial Intelligence” (CUP B53D23012770006), funded by European Union – Next Generation EU; Emanuele Ferragina has been partially supported by a public grant overseen by the French National Research Agency (ANR) as part of the ‘Investissements d'Avenir’ program LIEPP (ANR-11-LABX-0091, ANR-11-IDEX-0005-02) and the Université de Paris IdEx (ANR-18-IDEX-0001). We thank Vincenzo Vivarini for the inspiration about the importance of the feedback loop in complex social systems. There is always a human agent beyond any tactical system. We also thank Daniele Fadda for the support on making the figures. Finally, we thank all members of KDD-Lab for insightful discussions about human-AI coevolution.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Measuring gender bias in student satisfaction in higher education: a cross-department study

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Student satisfaction surveys are widely accepted for measuring the quality of students’ overall experience with the received teaching and informing the design of improvements in higher education. However, several studies have shown that these surveys have biases that may lead to discrimination or unfair decisions against female academics. Yet it is unclear how these undesirable factors are evolving with time or to what extent they are present in different contexts. In this study, we investigate survey results from a large University in Spain for two academic years, 2021–2022 and 2022–2023. Our analysis examines these gender biases by evaluating the influencing factors from the perspective of professors and students at the level of the entire university and individual centers. The results obtained using this approach provide multifaceted evidence of gender bias disadvantaging women, especially in some academic disciplines, and that is particularly noticeable in the extremes of student satisfaction distributions., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects “SoBigData++” (grant agreement 871042), “FINDHR” (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Comparative analysis of geolocation information through mobile-devices under different COVID-19 mobility restriction patterns in Spain

  • Pérez Arnal, Raquel Leandra
  • Conesa Ortega, David
  • Álvarez Napagao, Sergio
  • Suzumura, Toyotaro
  • Català Sabaté, Martí
  • Álvarez Lacalle, Enrique
  • Garcia Gasulla, Dario
The COVID-19 pandemic is changing the world in unprecedented and unpredictable ways. Human mobility, being the greatest facilitator for the spread of the virus, is at the epicenter of this change. In order to study mobility under COVID-19, to evaluate the efficiency of mobility restriction policies, and to facilitate a better response to future crisis, we need to understand all possible mobility data sources at our disposal. Our work studies private mobility sources, gathered from mobile-phones and released by large technological companies. These data are of special interest because, unlike most public sources, it is focused on individuals rather than on transportation means. Furthermore, the sample of society they cover is large and representative. On the other hand, these data are not directly accessible for anonymity reasons. Thus, properly interpreting its patterns demands caution. Aware of that, we explore the behavior and inter-relations of private sources of mobility data in the context of Spain. This country represents a good experimental setting due to both its large and fast pandemic peak and its implementation of a sustained, generalized lockdown. Our work illustrates how a direct and naive comparison between sources can be misleading, as certain days (e.g., Sundays) exhibit a directly adverse behavior. After understanding their particularities, we find them to be partially correlated and, what is more important, complementary under a proper interpretation. Finally, we confirm that mobile-data can be used to evaluate the efficiency of implemented policies, detect changes in mobility trends, and provide insights into what new normality means in Spain., Part of this research has received funding from the European Union Horizon 2020 Programme under the SoBigData++ Project, grant agreement num. 871,042. Martí Català received funding from La Caixa Foundation (ID 100010434), under agreement LCF/PR/GN17/50300003; Martí Català received funding from Ministerio de Ciencia, Innovación y Universidades and FEDER, with the project PGC2018-095456-B-I00.E. A-L EAL thanks support from the Spanish Ministry of Science Innovation and Universities, (SAF2017-88019-C3-3R)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication

Healthy Twitter discussions? Time will tell

  • Gnatyshak, Dmitry
  • Garcia Gasulla, Dario
  • Álvarez Napagao, Sergio
  • Arjona Martínez, Jamie
  • Venturini, Tommaso
Studying misinformation and how to deal with unhealthy behaviours within online discussions has recently become an important field of research within social studies. With the rapid development of social media, and the increasing amount of available information and sources, rigorous manual analysis of such discourses has become unfeasible. Many approaches tackle the issue by studying the semantic and syntactic properties of discussions following a supervised approach, for example using natural language processing on a dataset labeled for abusive, fake or bot-generated content. Solutions based on the existence of a ground truth are limited to those domains which may have ground truth. However, within the context of misinformation, it may be difficult or even impossible to assign labels to instances. In this context, we consider the use of temporal dynamic patterns as an indicator of discussion health. Working in a domain for which ground truth was unavailable at the time (early COVID-19 pandemic discussions) we explore the characterization of discussions based on the the volume and time of contributions. First we explore the types of discussions in an unsupervised manner, and then characterize these types using the concept of ephemerality, which we formalize. In the end, we discuss the potential use of our ephemerality definition for labeling online discourses based on how desirable, healthy and constructive they are., This work is supported by the scheme ‘INFRAIA-01-2018-2019: Research and Innovation action’, Grant Agreement n. 871042 ‘SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics’, Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Focus! Rating XAI methods and finding biases

  • Arias Duart, Anna
  • Parés Pont, Ferran
  • Garcia Gasulla, Dario
  • Giménez Ábalos, Víctor
AI explainability improves the transparency and trustworthiness of models. However, in the domain of images, where deep learning has succeeded the most, explainability is still poorly assessed. In the field of image recognition many feature attribution methods have been proposed with the purpose of explaining a model’s behavior using visual cues. However, no metrics have been established so far to assess and select these methods objectively. In this paper we propose a consistent evaluation score for feature attribution methods—the Focus—designed to quantify their coherency to the task. While most previous work adds outof-distribution noise to samples, we introduce a methodology to add noise from within the distribution. This is done through mosaics of instances from different classes, and the explanations these generate. On those, we compute a visual pseudo-precision metric, Focus. First, we show the robustness of the approach through a set of randomization experiments. Then we use Focus to compare six popular explainability techniques across several CNN architectures and classification datasets. Our results find some methods to be consistently reliable (LRP, GradCAM), while others produce class-agnostic explanations (SmoothGrad, IG). Finally we introduce another application of Focus, using it for the identification and characterization of biases found in models. This empowers bias-management tools, in another small step towards trustworthy AI., This work is supported by the European Union – H2020 Program under the “INFRAIA-01-2018-2019 – Integrating Activities for Advanced Communities”, Grant Agreement n.871042, “SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics” and by the Dept. de Recerca i Universitats of the Generalitat de Catalunya under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A framework for assessing algorithmic discrimination risks in training data: a case of pediatric type 1 diabetes

  • Bilionis, Ioannis
  • Berrios, Ricardo C.
  • de Arriba Muñoz, Antonio
  • Fernandez-Luque, Luis
  • Castillo, Carlos
Objectives: To develop a generalizable framework for identifying algorithmic discrimination risks arising from subgroup imbalances in machine learning training data, with relevance to medical informatics applications where heterogeneous real-world data can bias model behavior. Materials and Methods: We introduce a discrimination risk assessment framework for training datasets, a 4-step methodology integrating: (1) controlled representation sampling, (2) ensemble-based model training, (3) multilevel subgroup disparity quantification, and (4) mitigation-oriented interpretation. The framework systematically perturbs training subgroup composition while holding evaluation sets fixed to isolate representation effects. Validation was performed across 7 publicly available pediatric type 1 diabetes datasets using sociodemographic variables and continuous glucose monitoring data to assess robustness under heterogeneous data sources. Results: Representation balance alone does not guarantee stable or equitable model outputs. Ensemble analyses revealed subgroup-dependent volatility, with some groups consistently contributing to model generalization, while others inducing instability despite increased representation. These findings demonstrate structural sensitivity to data composition that is not captured by standard performance-only evaluations. Discussion: The framework exposes disparities and instability patterns that remain hidden under single-model or balanced-data evaluations. By quantifying representation-driven behaviors and subgroup-specific training value, it offers a diagnostic tool for understanding data-induced risks prior to model deployment. Conclusion: This work provides a methodology for assessing discrimination risks in training datasets used in medical informatics. By integrating data composition effects, prediction stability, and subgroup-level disparity analysis, the framework supports more reliable and transparent development of machine learning systems across diverse clinical and nonclinical contexts. Clinical trial registration: This research did not involve any new clinical trial. All analyses were performed on data from previously registered clinical trials, as listed below: PEDAP dataset: The source of the data is the PEDAP Trial Study Group. (2024). PEDAP Public Dataset (Release 4). Retrieved from https://public.jaeb.org/dataset/599. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by PEDAP Trial Study Group. ClinicalTrials.gov Identifier: NCT04796779; registered March 15, 2021. IOBP2 RCT dataset: The source of the data is the Insulin Only Bionic Pancreas Pivotal Trial. Retrieved from https://public.jaeb.org/dataset/579. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Bionic Pancreas Research Group or Beta Bionics. ClinicalTrials.gov Identifier: NCT04200313; registered December 16, 2019. DCLP5 dataset: The source of the data is the University of Virginia. DCLP5 Dataset. Retrieved from http://public.jaeb.org/dataset/535. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. Associated ClinicalTrials.gov Identifier: NCT03844789; registered February 18th, 2019 DCLP3 dataset: The source of the data is the University of Virginia. The International Diabetes Closed Loop (iDCL) trial. DCLP3 Public Dataset (Release 3). Retrieved from http:///public.jaeb.org/dataset/573. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. ClinicalTrials.gov Identifier: NCT03591354; registered July 19, 2018. CITY dataset: The source of the data is the Jaeb Center of Health Research. CGM Intervention in Teens and Young Adults with T1D (CITY Public Dataset). Retrieved from http://public.jaeb.org/dataset/565. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT03263494; registered August 28, 2017. SENCE public dataset: The source of the data is the Jaeb Center of Health Research. SENCE Public Dataset. Retrieved from http://public.jaeb.org/dataset/554. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT02912728; registered September 23, 2016., This work was funded by the Spanish Ministry of Science and Innovation (REF: DIN2021-011865). It was also partially supported by the Department of Research and Universities of the Government of Catalonia (SGR 00930), the EU-funded project SoBigData++ (grant agreement 871042), and MCIN/AEI/ 10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021-001195-M). None of the funders played any role in the study design, data collection, analysis, interpretation of results, or the writing of this manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Using pre-trained language models for abstractive DBPEDIA summarization: a comparative study

  • Zahera, Hamada M.
  • Vitiugin, Fedor
  • Sherif, Mohamed Ahmed
  • Castillo, Carlos
  • Ngonga Ngomo, Axel-Cyrille
Comunicació presentada a la 19th International Conference on Semantic Systems, celebrada del 20 al 22 de setembre de 2023 a Leipzig, Germany., Purpose: This study addresses the limitations of current short abstracts of DBPEDIA entities, which often lack a comprehensive overview due to their creating method (i.e., selecting the first two-three sentences from the full DBPEDIA abstracts). Methodology: We leverage pre-trained language models to generate abstractive summaries of DBPEDIA abstracts in six languages (English, French, German, Italian, Spanish, and Dutch). We performed several experiments to assess the quality of generated summaries by language models. In particular, we evaluated the generated summaries using human judgments and automated metrics (Self-ROUGE and BERTScore). Additionally, we studied the correlation between human judgments and automated metrics in evaluating the generated summaries under different aspects: informativeness, coherence, conciseness, and fluency. Findings: Pre-trained language models generate summaries more concise and informative than existing short abstracts. Specifically, BART-based models effectively overcome the limitations of DBPEDIA short abstracts, especially for longer ones. Moreover, we show that BERTScore and ROUGE-1 are reliable metrics for assessing the informativeness and coherence of the generated summaries with respect to the full DBPEDIA abstracts. We also find a negative correlation between conciseness and human ratings. Furthermore, fluency evaluation remains challenging without human judgment. Value: This study has significant implications for various applications in machine learning and natural language processing that rely on DBPEDIA resources. By providing succinct and comprehensive summaries, our approach enhances the quality of DBPEDIA abstracts and contributes to the semantic web community., This work has been supported by the German Federal Ministry of Education and Research (BMBF) through the EuroStars project E!114154 PORQUE (grant no 01QE2056C) and the KIAM project (grant no 02L19C115). Additionally, this work has been partially supported by: the Department of Research and Universities of the Government of Catalonia (SGR00930), the Ministry of Science and Innovation of Spain with the project COMCRISIS (reference code PID2019−109064GB−I00), the EU-funded SoBigData++ project under Grant Agreement 871042 and MCIN/AEI /10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021−001195− M).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Assessing biases through visual contexts

  • Arias Duart, Anna
  • Giménez Ábalos, Víctor
  • Cortés García, Claudio Ulises
  • Garcia Gasulla, Dario
Bias detection in the computer vision field is a necessary task, to achieve fair models. These biases are usually due to undesirable correlations present in the data and learned by the model. Although explainability can be a way to gain insights into model behavior, reviewing explanations is not straightforward. This work proposes a methodology to analyze the model biases without using explainability. By doing so, we reduce the potential noise arising from explainability methods, and we minimize human noise during the analysis of explanations. The proposed methodology combines images of the original distribution with images of potential context biases and analyzes the effect produced in the model’s output. For this work, we first presented and released three new datasets generated by diffusion models. Next, we used the proposed methodology to analyze the context impact on the model’s prediction. Finally, we verified the reliability of the proposed methodology and the consistency of its results. We hope this tool will help practitioners to detect and mitigate potential biases, allowing them to obtain more reliable models., This work received funding from the European Union’s H2020-INFRAIA-2019-1 program under the Grant Agreement n.871042 (SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics) and from the HORIZON-INFRA-2021-DEV-02 program under the Grant Agreement n.101079043 (SoBigData RI Preparatory Phase Project). Additionally, this work was supported by the Departament de Recerca i Universitats of the Generalitat de Catalunya, under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Focus and bias: will it blend?

  • Arias Duart, Anna
  • Parés Pont, Ferran
  • Giménez Ábalos, Víctor
  • Garcia Gasulla, Dario
One direct application of explainable AI feature attribution methods is to be used for detecting unwanted biases. To do so, domain experts typically have to review explained inputs, checking for the presence of unwanted biases learnt by the model. However, the huge amount of samples the domain experts must review makes this task more challenging as the size of the dataset grows. In an ideal case, domain experts should be provided only with a small number of selected samples containing potential biases. The recently published Focus score seems a promising tool for the selection of samples containing potential unwanted biases. In this work, we conduct a first study in this direction, analyzing the behavior of the Focus score when applied to a biased model. First, we verified that Focus is indeed sensitive to an induced bias. This is assessed by forcing a spurious correlation, training a model using only cats-indoor and dogs-outdoor. We empirically prove that the model learnt to distinguish the contexts (outdoor vs indoor) instead of cat vs dog classes, so ensuring that the model learnt an unwanted bias. Afterwards, we apply the Focus on this biased model showing how the Focus score decreases when the input contains the aforementioned bias. This analysis sheds light on the Focus behavior when applied to a biased model, highlighting its strengths for its use for bias detection., This work is supported by the European Union – H2020 Program under the “INFRAIA-01-2018-2019 – Integrating Activities for Advanced Communities”, Grant Agreement n.871042, “SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics” and by the Departament de Recerca i Universitats of the Generalitat de Catalunya under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A comparative user study of human predictions in algorithm-supported recidivism risk assessment

  • Portela, Manuel
  • Castillo, Carlos
  • Tolan, Songül
  • Karimi-Haghighi, Marzieh
  • Andrés Pueyo, Antonio
In this paper, we study the effects of using an algorithm-based risk assessment instrument (RAI) to support the prediction of risk of violent recidivism upon release. The instrument we used is a machine learning version of RiskCanvi used by the Justice Department of Catalonia, Spain. It was hypothesized that people can improve their performance on defining the risk of recidivism when assisted with a RAI. Also, that professionals can perform better than non-experts on the domain. Participants had to predict whether a person who has been released from prison will commit a new crime leading to re-incarceration, within the next two years. This user study is done with (1) general participants from diverse backgrounds recruited through a crowdsourcing platform, (2) targeted participants who are students and practitioners of data science, criminology, or social work and professionals who work with RisCanvi. We also run focus groups with participants of the targeted study, including people who use RisCanvi in a professional capacity, to interpret the quantitative results. Among other findings, we observe that algorithmic support systematically leads to more accurate predictions from all participants, but that statistically significant gains are only seen in the performance of targeted participants with respect to that of crowdsourced participants. Among other comments, professional participants indicate that they would not foresee using a fully-automated system in criminal risk assessment, but do consider it valuable for training, standardization, and to fine-tune or double-check their predictions on particularly difficult cases. We found that the revised prediction by using a RAI increases the performance of all groups, while professionals show a better performance in general. And, a RAI can be considered for extending professional capacities and skills along their careers., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially supported by the HUMAINT programme (Human Behaviour and Machine Intelligence), Centre for Advanced Studies, Joint Research Centre, European Commission through the Expect contract CT-EX2019D347180. Additionally, it received the support from the EU-funded project “SoBigData++” (grant agreement 871042).
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Towards caring institutional analytics: a case study illustrating the exploration of language biases

  • Marques, Francielle
  • Hernández Leo, Davinia
  • Castillo, Carlos
  • Trenchs i Parera, Mireia
Our study focuses on institutional analytics in higher education decision-making and the need of considering contextual biases. We contribute with a case study in a university in Catalonia using (reliable) student grades and satisfaction data from 22 professors who teach at least one course in Catalan and at least one course in English to identify language-related biases or interrelationships. Our study sheds light on the relevance of this perspective and its implications, This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData++" (grant agreement 871042), "FINDHR" (grant agreement 101070212). Trenchs-Parera also acknowledges support from the INCLU-LINGUAM research project (ref. PID2022-141945NB-I00), funded by MCIN/AEI/10.13039/501100011033/ and FEDER, EU.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A causal inference study on the effects of first year workload on the dropout rate of undergraduates

  • Karimi-Haghighi, Marzieh
  • Castillo, Carlos
  • Hernández Leo, Davinia
Comunicació presentada a 23rd International Conference on Artificial Intelligence in Education (AIED 2022), celebrat del 27 al 31 de juliol de 2022 a Durham, Regne Unit., In this work, we evaluate the risk of early dropout in undergraduate studies using causal inference methods, and focusing on groups of students who have a relatively higher dropout risk. We use a large dataset consisting of undergraduates admitted to multiple study programs at eight faculties/schools of our university. Using data available at enrollment time, we develop Machine Learning (ML) methods to predict university dropout and underperformance, which show an AUC of 0.70 and 0.74 for each risk respectively. Among important drivers of dropout over which the first-year students have some control, we find that first year workload (i.e., the number of credits taken) is a key one, and we mainly focus on it. We determine the effect of taking a relatively lighter workload in the first year on dropout risk using causal inference methods: Propensity Score Matching (PSM), Inverse Propensity score Weighting (IPW), Augmented Inverse Propensity Weighted (AIPW), and Doubly Robust Orthogonal Random Forest (DROrthoForest). Our results show that a reduction in workload reduces dropout risk., This work has been partially supported by: the HUMAINT programme (Human Behaviour and Machine Intelligence), Joint Research Centre, European Commission; “la Caixa” Foundation (ID 100010434), under the agreement LCF/PR/PR16/51110009; and the EU-funded “SoBigData++” project, under Grant Agreement 871042. In addition, D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme, and the National Research Agency of the Spanish Ministry (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Participant behavior and community response in online mental health communities: insights from reddit

Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The Response of governments and public health agencies to COVID-19 pandemics on social media: a multi-country analysis of Twitter discourse

  • Li, Lan
  • Aldosery, Aisha
  • Vitiugin, Fedor
  • Nathan, Naomi
  • Novillo-Ortiz, David
  • Castillo, Carlos
  • Kostkova, Patty
During the COVID-19 pandemic, information is being rapidly shared by public health experts and researchers through social media platforms. Whilst government policies were disseminated and discussed, fake news and misinformation simultaneously created a corresponding wave of “infodemics.” This study analyzed the discourse on Twitter in several languages, investigating the reactions to government and public health agency social media accounts that share policy decisions and official messages. The study collected messages from 21 official Twitter accounts of governments and public health authorities in the UK, US, Mexico, Canada, Brazil, Spain, and Nigeria, from 15 March to 29 May 2020. Over 2 million tweets in various languages were analyzed using a mixedmethods approach to understand the messages both quantitatively and qualitatively. Using automatic, text-based clustering, five topics were identified for each account and then categorized into 10 emerging themes. Identified themes include political, socio-economic, and population-protection issues, encompassing global, national, and individual levels. A comparison was performed amongst the seven countries analyzed and the United Kingdom (Scotland, Northern Ireland, and England) to find similarities and differences between countries and government agencies. Despite the difference in language, country of origin, epidemiological contexts within the countries, significant similarities emerged. Our results suggest that other than general announcement and reportage messages, the most-discussed topic is evidence-based leadership and policymaking, followed by how to manage socio-economic consequences.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Institutional, academic, and learning analytics: a bibliometric study

  • Marques, Francielle
  • Ortiz-Beltrán, Ariel
  • Hernández Leo, Davinia
  • Castillo, Carlos
Comunicació presentada al 25th IEEE International Conference on Advanced Learning Technologies (ICALT 2025), celebrada a Changhua (Taiwan) del 14-17 de juliol de 2025, Educational institutions are increasingly adopting data-driven approaches, yet there appears to be insufficient exploration into the development of so-called Institutional and Academic Analytics and how these terms intersect with Learning Analytics (LA). This study conducts a bibliometric analysis (last 10 years) as an initial step to explore this gap. Our results illuminate evolving but inconsistent interest in Institutional and Academic Analytics across time and across publication venues. The results also indicate a need for the LA community to clarify its connections with related applications of data analytics focused on students and their contexts while reflecting on and potentially expanding its areas of impact., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Hunter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects ¿SoBigData++¿ (grant agreement 871042), ¿FINDHR¿ (grant agreement 101070212).
RUO. Repositorio Institucional de la Universidad de Oviedo
Publication Artículo científico (JournalArticle)

Binary quantification and dataset shift: an experimental investigation

  • González González, Pablo|||0000-0002-9250-0920
  • Moreo, Alejandro
  • Sebastiani, Fabrizio
MINECO (Ministerio de Economía y Competitividad) and FEDER (Fondo Europeo de Desarrollo Regional), grant PID2019-110742RB-I00 (MINECO/FEDER), and by Campus de Excelencia Internacional in collaboration with Santander Bank in the framework of the fnancial aid for mobility of excellence for teachers and researchers at the University of Oviedo. The work by the 2nd and 3rd authors has been supported by the SoBigData++ project, funded by the European Commission (Grant 871042) under the H2020 Programme INFRAIA-2019-1, by the AI4Media project, funded by the European Commission (Grant 951911) under the H2020 Programme ICT-48-2020, and by the SoBigData.it, FAIR, and QuaDaSh (P2022TB5JF) projects funded by the Italian Ministry of University and Research under the NextGenerationEU program.