Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 21
Encontrada(s) 1 página(s)

e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

When dialects collide: how socioeconomic mixing affects language use

  • Louf, Thomas
  • Ramasco, Jose J.
  • Sánchez, David
  • Karsai, Márton
The socioeconomic background of people and how they use standard forms of language are not independent, as demonstrated in various sociolinguistic studies. However, the extent to which these correlations may be influenced by the mixing of people from different socioeconomic classes remains relatively unexplored from a quantitative perspective. In this work we leverage geotagged tweets and transferable computational methods to map deviations from standard English across eight UK metropolitan areas. We combine these data with high-resolution income maps to assign a proxy socioeconomic indicator to home-located users. Strikingly, we find a consistent pattern suggesting that the more different socioeconomic classes mix, the less interdependent the frequency of their departures from standard grammar and their income become. Further, we propose an agent-based model of linguistic variety adoption that sheds light on the mechanisms that produce the observations seen in the data., Open access funding provided by HUN-REN Alfréd Rényi Institute of Mathematics. This work was partially supported by the Spanish State Research Agency (MCIN/AEI/10.13039/501100011033) and FEDER (UE) under project APASOS (PID2021-122256NB-C21 and PID2021-122256NB-C22) and the María de Maeztu project CEX2021-001164-M and by the Comunitat Autonoma de les Illes Balears through the Direcció General de Política Universitària i Recerca with funds from the Tourist Stay Tax Law ITS 2017-006 (PDR2020/51). TL is grateful for the support from the EMOMAP CIVICA project. MK was supported by the CHIST-ERA project SAI: FWF I 5205-N; the SoBigData++ H2020-871042; the EPO and EMOMAP CIVICA projects, the National Laboratory of Health Security (RRF-2.3.1-21-2022-00006) and the DATAREDUX project, ANR19-CE46-0008.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Participant behavior and community response in online mental health communities: insights from reddit

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Measuring gender bias in student satisfaction in higher education: a cross-department study

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Student satisfaction surveys are widely accepted for measuring the quality of students’ overall experience with the received teaching and informing the design of improvements in higher education. However, several studies have shown that these surveys have biases that may lead to discrimination or unfair decisions against female academics. Yet it is unclear how these undesirable factors are evolving with time or to what extent they are present in different contexts. In this study, we investigate survey results from a large University in Spain for two academic years, 2021–2022 and 2022–2023. Our analysis examines these gender biases by evaluating the influencing factors from the perspective of professors and students at the level of the entire university and individual centers. The results obtained using this approach provide multifaceted evidence of gender bias disadvantaging women, especially in some academic disciplines, and that is particularly noticeable in the extremes of student satisfaction distributions., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects “SoBigData++” (grant agreement 871042), “FINDHR” (grant agreement 101070212).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

A comparative user study of human predictions in algorithm-supported recidivism risk assessment

  • Portela, Manuel
  • Castillo, Carlos
  • Tolan, Songül
  • Karimi-Haghighi, Marzieh
  • Andrés Pueyo, Antonio
In this paper, we study the effects of using an algorithm-based risk assessment instrument (RAI) to support the prediction of risk of violent recidivism upon release. The instrument we used is a machine learning version of RiskCanvi used by the Justice Department of Catalonia, Spain. It was hypothesized that people can improve their performance on defining the risk of recidivism when assisted with a RAI. Also, that professionals can perform better than non-experts on the domain. Participants had to predict whether a person who has been released from prison will commit a new crime leading to re-incarceration, within the next two years. This user study is done with (1) general participants from diverse backgrounds recruited through a crowdsourcing platform, (2) targeted participants who are students and practitioners of data science, criminology, or social work and professionals who work with RisCanvi. We also run focus groups with participants of the targeted study, including people who use RisCanvi in a professional capacity, to interpret the quantitative results. Among other findings, we observe that algorithmic support systematically leads to more accurate predictions from all participants, but that statistically significant gains are only seen in the performance of targeted participants with respect to that of crowdsourced participants. Among other comments, professional participants indicate that they would not foresee using a fully-automated system in criminal risk assessment, but do consider it valuable for training, standardization, and to fine-tune or double-check their predictions on particularly difficult cases. We found that the revised prediction by using a RAI increases the performance of all groups, while professionals show a better performance in general. And, a RAI can be considered for extending professional capacities and skills along their careers., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially supported by the HUMAINT programme (Human Behaviour and Machine Intelligence), Centre for Advanced Studies, Joint Research Centre, European Commission through the Expect contract CT-EX2019D347180. Additionally, it received the support from the EU-funded project “SoBigData++” (grant agreement 871042).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

A framework for assessing algorithmic discrimination risks in training data: a case of pediatric type 1 diabetes

  • Bilionis, Ioannis
  • Berrios, Ricardo C.
  • de Arriba Muñoz, Antonio
  • Fernandez-Luque, Luis
  • Castillo, Carlos
Objectives: To develop a generalizable framework for identifying algorithmic discrimination risks arising from subgroup imbalances in machine learning training data, with relevance to medical informatics applications where heterogeneous real-world data can bias model behavior. Materials and Methods: We introduce a discrimination risk assessment framework for training datasets, a 4-step methodology integrating: (1) controlled representation sampling, (2) ensemble-based model training, (3) multilevel subgroup disparity quantification, and (4) mitigation-oriented interpretation. The framework systematically perturbs training subgroup composition while holding evaluation sets fixed to isolate representation effects. Validation was performed across 7 publicly available pediatric type 1 diabetes datasets using sociodemographic variables and continuous glucose monitoring data to assess robustness under heterogeneous data sources. Results: Representation balance alone does not guarantee stable or equitable model outputs. Ensemble analyses revealed subgroup-dependent volatility, with some groups consistently contributing to model generalization, while others inducing instability despite increased representation. These findings demonstrate structural sensitivity to data composition that is not captured by standard performance-only evaluations. Discussion: The framework exposes disparities and instability patterns that remain hidden under single-model or balanced-data evaluations. By quantifying representation-driven behaviors and subgroup-specific training value, it offers a diagnostic tool for understanding data-induced risks prior to model deployment. Conclusion: This work provides a methodology for assessing discrimination risks in training datasets used in medical informatics. By integrating data composition effects, prediction stability, and subgroup-level disparity analysis, the framework supports more reliable and transparent development of machine learning systems across diverse clinical and nonclinical contexts. Clinical trial registration: This research did not involve any new clinical trial. All analyses were performed on data from previously registered clinical trials, as listed below: PEDAP dataset: The source of the data is the PEDAP Trial Study Group. (2024). PEDAP Public Dataset (Release 4). Retrieved from https://public.jaeb.org/dataset/599. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by PEDAP Trial Study Group. ClinicalTrials.gov Identifier: NCT04796779; registered March 15, 2021. IOBP2 RCT dataset: The source of the data is the Insulin Only Bionic Pancreas Pivotal Trial. Retrieved from https://public.jaeb.org/dataset/579. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Bionic Pancreas Research Group or Beta Bionics. ClinicalTrials.gov Identifier: NCT04200313; registered December 16, 2019. DCLP5 dataset: The source of the data is the University of Virginia. DCLP5 Dataset. Retrieved from http://public.jaeb.org/dataset/535. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. Associated ClinicalTrials.gov Identifier: NCT03844789; registered February 18th, 2019 DCLP3 dataset: The source of the data is the University of Virginia. The International Diabetes Closed Loop (iDCL) trial. DCLP3 Public Dataset (Release 3). Retrieved from http:///public.jaeb.org/dataset/573. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. ClinicalTrials.gov Identifier: NCT03591354; registered July 19, 2018. CITY dataset: The source of the data is the Jaeb Center of Health Research. CGM Intervention in Teens and Young Adults with T1D (CITY Public Dataset). Retrieved from http://public.jaeb.org/dataset/565. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT03263494; registered August 28, 2017. SENCE public dataset: The source of the data is the Jaeb Center of Health Research. SENCE Public Dataset. Retrieved from http://public.jaeb.org/dataset/554. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT02912728; registered September 23, 2016., This work was funded by the Spanish Ministry of Science and Innovation (REF: DIN2021-011865). It was also partially supported by the Department of Research and Universities of the Government of Catalonia (SGR 00930), the EU-funded project SoBigData++ (grant agreement 871042), and MCIN/AEI/ 10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021-001195-M). None of the funders played any role in the study design, data collection, analysis, interpretation of results, or the writing of this manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Human-AI coevolution

  • Pedreschi, Dino
  • Pappalardo, Luca
  • Ferragina, Emanuele
  • Baeza Yates, Ricardo
  • Barabási, Albert-László
  • Dignum, Frank
  • Dignum, Virginia
  • Eliassi-Rad, Tina
  • Giannotti, Fosca
  • Kertész, János
  • Knott, Alistair
  • Ioannidis, Yannis
  • Lukowicz, Paul
  • Passarella, Andrea
  • Pentland, Alex
  • Shawe-Taylor, John
  • Vespignani, Alessandro
Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterises our society, but is understudied in artificial intelligence and complexity science literature. Recommender systems and assistants play a prominent role in human-AI coevolution, as they permeate many facets of daily life and influence human choices through online platforms. The interaction between users and AI results in a potentially endless feedback loop, wherein users' choices generate data to train AI models, which, in turn, shape subsequent user preferences. This human-AI feedback loop has peculiar characteristics compared to traditional human-machine interaction and gives rise to complex and often “unintended” systemic outcomes. This paper introduces human-AI coevolution as the cornerstone for a new field of study at the intersection between AI and complexity science focused on the theoretical, empirical, and mathematical investigation of the human-AI feedback loop. In doing so, we: (i) outline the pros and cons of existing methodologies and highlight shortcomings and potential ways for capturing feedback loop mechanisms; (ii) propose a reflection at the intersection between complexity science, AI and society; (iii) provide real-world examples for different human-AI ecosystems; and (iv) illustrate challenges to the creation of such a field of study, conceptualising them at increasing levels of abstraction, i.e., scientific, legal and socio-political., This work has been partially supported by PNRR - M4C2 - Investimento 1.3, Partenariato Esteso (grant No. PE00000013) - “FAIR - Future Artificial Intelligence Research” - Spoke 1 “Human-centered AI”, funded by the European Commission under the Next Generation EU programme; EU H2020 projects HumaneAI-net G.A. 952026 and SoBigData++ G.A. 871042; European Research Council ERC-2018-ADG 834756 “XAI: Science and technology for the eXplanation of AI decision making”; CHIST-ERA grant CHIST-ERA-19-XAI-010, by MUR (grant No. not available), FWF (grant No. I 5205), EPSRC (grant No. EP/V055712/1), NCN (grant No. 2020/02/Y/ST6/00064), ETAg (grant No. SLTAT21096), BNSF (grant No. KΠ-06-AOO2/5); PNRR (Piano Nazionale di Ripresa e Resilienza) in the context of the research program 20224CZ5X4_PE6_PRIN 2022 “URBAI – Urban Artificial Intelligence” (CUP B53D23012770006), funded by European Union – Next Generation EU; Emanuele Ferragina has been partially supported by a public grant overseen by the French National Research Agency (ANR) as part of the ‘Investissements d'Avenir’ program LIEPP (ANR-11-LABX-0091, ANR-11-IDEX-0005-02) and the Université de Paris IdEx (ANR-18-IDEX-0001). We thank Vincenzo Vivarini for the inspiration about the importance of the feedback loop in complex social systems. There is always a human agent beyond any tactical system. We also thank Daniele Fadda for the support on making the figures. Finally, we thank all members of KDD-Lab for insightful discussions about human-AI coevolution.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The Response of governments and public health agencies to COVID-19 pandemics on social media: a multi-country analysis of Twitter discourse

  • Li, Lan
  • Aldosery, Aisha
  • Vitiugin, Fedor
  • Nathan, Naomi
  • Novillo-Ortiz, David
  • Castillo, Carlos
  • Kostkova, Patty
During the COVID-19 pandemic, information is being rapidly shared by public health experts and researchers through social media platforms. Whilst government policies were disseminated and discussed, fake news and misinformation simultaneously created a corresponding wave of “infodemics.” This study analyzed the discourse on Twitter in several languages, investigating the reactions to government and public health agency social media accounts that share policy decisions and official messages. The study collected messages from 21 official Twitter accounts of governments and public health authorities in the UK, US, Mexico, Canada, Brazil, Spain, and Nigeria, from 15 March to 29 May 2020. Over 2 million tweets in various languages were analyzed using a mixedmethods approach to understand the messages both quantitatively and qualitatively. Using automatic, text-based clustering, five topics were identified for each account and then categorized into 10 emerging themes. Identified themes include political, socio-economic, and population-protection issues, encompassing global, national, and individual levels. A comparison was performed amongst the seven countries analyzed and the United Kingdom (Scotland, Northern Ireland, and England) to find similarities and differences between countries and government agencies. Despite the difference in language, country of origin, epidemiological contexts within the countries, significant similarities emerged. Our results suggest that other than general announcement and reportage messages, the most-discussed topic is evidence-based leadership and policymaking, followed by how to manage socio-economic consequences.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

TextFocus: Assessing the Faithfulness of Feature Attribution Methods Explanations in Natural Language Processing

  • Mariotti, Ettore
  • Arias-Duart, Anna
  • Cafagna, Michele
  • Gatt, Albert
  • García-Gasulla, Darío
  • Alonso Moral, José María
Among the existing eXplainable AI (XAI) approaches, Feature Attribution methods are a popular option due to their interpretable nature. However, each method leads to a different solution, thus introducing uncertainty regarding their reliability and coherence with respect to the underlying model. This work introduces TextFocus, a metric for evaluating the faithfulness of Feature Attribution methods for Natural Language Processing (NLP) tasks involving classification. To address the absence of ground truth explanations for such methods, we introduce the concept of textual mosaics. A mosaic is composed of a combination of sentences belonging to different classes, which provides an implicit ground truth for attribution. The accuracy of explanations can be then evaluated by comparing feature attribution scores with the known class labels in the mosaic. The performance of six feature attribution methods is systematically compared on three sentence classification tasks by using TextFocus, with Integrated Gradients being the best overall method in terms of faithfulness and computational requirements. The proposed methodology fills a gap in NLP evaluation, by providing an objective way to assess Feature Attribution methods while finding their optimal parameters.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Assessing biases through visual contexts

  • Arias Duart, Anna|||0000-0002-8819-6735
  • Giménez Ábalos, Víctor
  • Cortés García, Claudio Ulises|||0000-0003-0192-3096
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
Bias detection in the computer vision field is a necessary task, to achieve fair models. These biases are usually due to undesirable correlations present in the data and learned by the model. Although explainability can be a way to gain insights into model behavior, reviewing explanations is not straightforward. This work proposes a methodology to analyze the model biases without using explainability. By doing so, we reduce the potential noise arising from explainability methods, and we minimize human noise during the analysis of explanations. The proposed methodology combines images of the original distribution with images of potential context biases and analyzes the effect produced in the model’s output. For this work, we first presented and released three new datasets generated by diffusion models. Next, we used the proposed methodology to analyze the context impact on the model’s prediction. Finally, we verified the reliability of the proposed methodology and the consistency of its results. We hope this tool will help practitioners to detect and mitigate potential biases, allowing them to obtain more reliable models., This work received funding from the European Union’s H2020-INFRAIA-2019-1 program under the Grant Agreement n.871042 (SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics) and from the HORIZON-INFRA-2021-DEV-02 program under the Grant Agreement n.101079043 (SoBigData RI Preparatory Phase Project). Additionally, this work was supported by the Departament de Recerca i Universitats of the Generalitat de Catalunya, under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Comparative analysis of geolocation information through mobile-devices under different COVID-19 mobility restriction patterns in Spain

  • Pérez Arnal, Raquel Leandra|||0000-0002-0041-8146
  • Conesa Ortega, David|||0000-0001-5917-2673
  • Álvarez Napagao, Sergio|||0000-0001-9946-9703
  • Suzumura, Toyotaro
  • Català Sabaté, Martí|||0000-0003-3308-9905
  • Álvarez Lacalle, Enrique|||0000-0001-6824-6857
  • Garcia Gasulla, Dario|||0000-0001-6732-5641
The COVID-19 pandemic is changing the world in unprecedented and unpredictable ways. Human mobility, being the greatest facilitator for the spread of the virus, is at the epicenter of this change. In order to study mobility under COVID-19, to evaluate the efficiency of mobility restriction policies, and to facilitate a better response to future crisis, we need to understand all possible mobility data sources at our disposal. Our work studies private mobility sources, gathered from mobile-phones and released by large technological companies. These data are of special interest because, unlike most public sources, it is focused on individuals rather than on transportation means. Furthermore, the sample of society they cover is large and representative. On the other hand, these data are not directly accessible for anonymity reasons. Thus, properly interpreting its patterns demands caution. Aware of that, we explore the behavior and inter-relations of private sources of mobility data in the context of Spain. This country represents a good experimental setting due to both its large and fast pandemic peak and its implementation of a sustained, generalized lockdown. Our work illustrates how a direct and naive comparison between sources can be misleading, as certain days (e.g., Sundays) exhibit a directly adverse behavior. After understanding their particularities, we find them to be partially correlated and, what is more important, complementary under a proper interpretation. Finally, we confirm that mobile-data can be used to evaluate the efficiency of implemented policies, detect changes in mobility trends, and provide insights into what new normality means in Spain., Part of this research has received funding from the European Union Horizon 2020 Programme under the SoBigData++ Project, grant agreement num. 871,042. Martí Català received funding from La Caixa Foundation (ID 100010434), under agreement LCF/PR/GN17/50300003; Martí Català received funding from Ministerio de Ciencia, Innovación y Universidades and FEDER, with the project PGC2018-095456-B-I00.E. A-L EAL thanks support from the Spanish Ministry of Science Innovation and Universities, (SAF2017-88019-C3-3R)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Human-AI coevolution

  • Pedreschi, Dino
  • Pappalardo, Luca
  • Ferragina, Emanuele
  • Baeza Yates, Ricardo
  • Barabási, Albert-László
  • Dignum, Frank
  • Dignum, Virginia
  • Eliassi-Rad, Tina
  • Giannotti, Fosca
  • Kertész, János
  • Knott, Alistair
  • Ioannidis, Yannis
  • Lukowicz, Paul
  • Passarella, Andrea
  • Pentland, Alex
  • Shawe-Taylor, John
  • Vespignani, Alessandro
Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterises our society, but is understudied in artificial intelligence and complexity science literature. Recommender systems and assistants play a prominent role in human-AI coevolution, as they permeate many facets of daily life and influence human choices through online platforms. The interaction between users and AI results in a potentially endless feedback loop, wherein users' choices generate data to train AI models, which, in turn, shape subsequent user preferences. This human-AI feedback loop has peculiar characteristics compared to traditional human-machine interaction and gives rise to complex and often “unintended” systemic outcomes. This paper introduces human-AI coevolution as the cornerstone for a new field of study at the intersection between AI and complexity science focused on the theoretical, empirical, and mathematical investigation of the human-AI feedback loop. In doing so, we: (i) outline the pros and cons of existing methodologies and highlight shortcomings and potential ways for capturing feedback loop mechanisms; (ii) propose a reflection at the intersection between complexity science, AI and society; (iii) provide real-world examples for different human-AI ecosystems; and (iv) illustrate challenges to the creation of such a field of study, conceptualising them at increasing levels of abstraction, i.e., scientific, legal and socio-political., This work has been partially supported by PNRR - M4C2 - Investimento 1.3, Partenariato Esteso (grant No. PE00000013) - “FAIR - Future Artificial Intelligence Research” - Spoke 1 “Human-centered AI”, funded by the European Commission under the Next Generation EU programme; EU H2020 projects HumaneAI-net G.A. 952026 and SoBigData++ G.A. 871042; European Research Council ERC-2018-ADG 834756 “XAI: Science and technology for the eXplanation of AI decision making”; CHIST-ERA grant CHIST-ERA-19-XAI-010, by MUR (grant No. not available), FWF (grant No. I 5205), EPSRC (grant No. EP/V055712/1), NCN (grant No. 2020/02/Y/ST6/00064), ETAg (grant No. SLTAT21096), BNSF (grant No. KΠ-06-AOO2/5); PNRR (Piano Nazionale di Ripresa e Resilienza) in the context of the research program 20224CZ5X4_PE6_PRIN 2022 “URBAI – Urban Artificial Intelligence” (CUP B53D23012770006), funded by European Union – Next Generation EU; Emanuele Ferragina has been partially supported by a public grant overseen by the French National Research Agency (ANR) as part of the ‘Investissements d'Avenir’ program LIEPP (ANR-11-LABX-0091, ANR-11-IDEX-0005-02) and the Université de Paris IdEx (ANR-18-IDEX-0001). We thank Vincenzo Vivarini for the inspiration about the importance of the feedback loop in complex social systems. There is always a human agent beyond any tactical system. We also thank Daniele Fadda for the support on making the figures. Finally, we thank all members of KDD-Lab for insightful discussions about human-AI coevolution.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Measuring gender bias in student satisfaction in higher education: a cross-department study

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Student satisfaction surveys are widely accepted for measuring the quality of students’ overall experience with the received teaching and informing the design of improvements in higher education. However, several studies have shown that these surveys have biases that may lead to discrimination or unfair decisions against female academics. Yet it is unclear how these undesirable factors are evolving with time or to what extent they are present in different contexts. In this study, we investigate survey results from a large University in Spain for two academic years, 2021–2022 and 2022–2023. Our analysis examines these gender biases by evaluating the influencing factors from the perspective of professors and students at the level of the entire university and individual centers. The results obtained using this approach provide multifaceted evidence of gender bias disadvantaging women, especially in some academic disciplines, and that is particularly noticeable in the extremes of student satisfaction distributions., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects “SoBigData++” (grant agreement 871042), “FINDHR” (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Comparative analysis of geolocation information through mobile-devices under different COVID-19 mobility restriction patterns in Spain

  • Pérez Arnal, Raquel Leandra
  • Conesa Ortega, David
  • Álvarez Napagao, Sergio
  • Suzumura, Toyotaro
  • Català Sabaté, Martí
  • Álvarez Lacalle, Enrique
  • Garcia Gasulla, Dario
The COVID-19 pandemic is changing the world in unprecedented and unpredictable ways. Human mobility, being the greatest facilitator for the spread of the virus, is at the epicenter of this change. In order to study mobility under COVID-19, to evaluate the efficiency of mobility restriction policies, and to facilitate a better response to future crisis, we need to understand all possible mobility data sources at our disposal. Our work studies private mobility sources, gathered from mobile-phones and released by large technological companies. These data are of special interest because, unlike most public sources, it is focused on individuals rather than on transportation means. Furthermore, the sample of society they cover is large and representative. On the other hand, these data are not directly accessible for anonymity reasons. Thus, properly interpreting its patterns demands caution. Aware of that, we explore the behavior and inter-relations of private sources of mobility data in the context of Spain. This country represents a good experimental setting due to both its large and fast pandemic peak and its implementation of a sustained, generalized lockdown. Our work illustrates how a direct and naive comparison between sources can be misleading, as certain days (e.g., Sundays) exhibit a directly adverse behavior. After understanding their particularities, we find them to be partially correlated and, what is more important, complementary under a proper interpretation. Finally, we confirm that mobile-data can be used to evaluate the efficiency of implemented policies, detect changes in mobility trends, and provide insights into what new normality means in Spain., Part of this research has received funding from the European Union Horizon 2020 Programme under the SoBigData++ Project, grant agreement num. 871,042. Martí Català received funding from La Caixa Foundation (ID 100010434), under agreement LCF/PR/GN17/50300003; Martí Català received funding from Ministerio de Ciencia, Innovación y Universidades and FEDER, with the project PGC2018-095456-B-I00.E. A-L EAL thanks support from the Spanish Ministry of Science Innovation and Universities, (SAF2017-88019-C3-3R)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A framework for assessing algorithmic discrimination risks in training data: a case of pediatric type 1 diabetes

  • Bilionis, Ioannis
  • Berrios, Ricardo C.
  • de Arriba Muñoz, Antonio
  • Fernandez-Luque, Luis
  • Castillo, Carlos
Objectives: To develop a generalizable framework for identifying algorithmic discrimination risks arising from subgroup imbalances in machine learning training data, with relevance to medical informatics applications where heterogeneous real-world data can bias model behavior. Materials and Methods: We introduce a discrimination risk assessment framework for training datasets, a 4-step methodology integrating: (1) controlled representation sampling, (2) ensemble-based model training, (3) multilevel subgroup disparity quantification, and (4) mitigation-oriented interpretation. The framework systematically perturbs training subgroup composition while holding evaluation sets fixed to isolate representation effects. Validation was performed across 7 publicly available pediatric type 1 diabetes datasets using sociodemographic variables and continuous glucose monitoring data to assess robustness under heterogeneous data sources. Results: Representation balance alone does not guarantee stable or equitable model outputs. Ensemble analyses revealed subgroup-dependent volatility, with some groups consistently contributing to model generalization, while others inducing instability despite increased representation. These findings demonstrate structural sensitivity to data composition that is not captured by standard performance-only evaluations. Discussion: The framework exposes disparities and instability patterns that remain hidden under single-model or balanced-data evaluations. By quantifying representation-driven behaviors and subgroup-specific training value, it offers a diagnostic tool for understanding data-induced risks prior to model deployment. Conclusion: This work provides a methodology for assessing discrimination risks in training datasets used in medical informatics. By integrating data composition effects, prediction stability, and subgroup-level disparity analysis, the framework supports more reliable and transparent development of machine learning systems across diverse clinical and nonclinical contexts. Clinical trial registration: This research did not involve any new clinical trial. All analyses were performed on data from previously registered clinical trials, as listed below: PEDAP dataset: The source of the data is the PEDAP Trial Study Group. (2024). PEDAP Public Dataset (Release 4). Retrieved from https://public.jaeb.org/dataset/599. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by PEDAP Trial Study Group. ClinicalTrials.gov Identifier: NCT04796779; registered March 15, 2021. IOBP2 RCT dataset: The source of the data is the Insulin Only Bionic Pancreas Pivotal Trial. Retrieved from https://public.jaeb.org/dataset/579. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Bionic Pancreas Research Group or Beta Bionics. ClinicalTrials.gov Identifier: NCT04200313; registered December 16, 2019. DCLP5 dataset: The source of the data is the University of Virginia. DCLP5 Dataset. Retrieved from http://public.jaeb.org/dataset/535. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. Associated ClinicalTrials.gov Identifier: NCT03844789; registered February 18th, 2019 DCLP3 dataset: The source of the data is the University of Virginia. The International Diabetes Closed Loop (iDCL) trial. DCLP3 Public Dataset (Release 3). Retrieved from http:///public.jaeb.org/dataset/573. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the University of Virginia. ClinicalTrials.gov Identifier: NCT03591354; registered July 19, 2018. CITY dataset: The source of the data is the Jaeb Center of Health Research. CGM Intervention in Teens and Young Adults with T1D (CITY Public Dataset). Retrieved from http://public.jaeb.org/dataset/565. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT03263494; registered August 28, 2017. SENCE public dataset: The source of the data is the Jaeb Center of Health Research. SENCE Public Dataset. Retrieved from http://public.jaeb.org/dataset/554. The analyses content and conclusions presented herein are solely the responsibility of the authors and have not been reviewed or approved by the Jaeb Center of Health Research. ClinicalTrials.gov Identifier: NCT02912728; registered September 23, 2016., This work was funded by the Spanish Ministry of Science and Innovation (REF: DIN2021-011865). It was also partially supported by the Department of Research and Universities of the Government of Catalonia (SGR 00930), the EU-funded project SoBigData++ (grant agreement 871042), and MCIN/AEI/ 10.13039/501100011033 under the Maria de Maeztu Units of Excellence Programme (CEX2021-001195-M). None of the funders played any role in the study design, data collection, analysis, interpretation of results, or the writing of this manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessing biases through visual contexts

  • Arias Duart, Anna
  • Giménez Ábalos, Víctor
  • Cortés García, Claudio Ulises
  • Garcia Gasulla, Dario
Bias detection in the computer vision field is a necessary task, to achieve fair models. These biases are usually due to undesirable correlations present in the data and learned by the model. Although explainability can be a way to gain insights into model behavior, reviewing explanations is not straightforward. This work proposes a methodology to analyze the model biases without using explainability. By doing so, we reduce the potential noise arising from explainability methods, and we minimize human noise during the analysis of explanations. The proposed methodology combines images of the original distribution with images of potential context biases and analyzes the effect produced in the model’s output. For this work, we first presented and released three new datasets generated by diffusion models. Next, we used the proposed methodology to analyze the context impact on the model’s prediction. Finally, we verified the reliability of the proposed methodology and the consistency of its results. We hope this tool will help practitioners to detect and mitigate potential biases, allowing them to obtain more reliable models., This work received funding from the European Union’s H2020-INFRAIA-2019-1 program under the Grant Agreement n.871042 (SoBigData++: European Integrated Infrastructure for Social Mining and Big Data Analytics) and from the HORIZON-INFRA-2021-DEV-02 program under the Grant Agreement n.101079043 (SoBigData RI Preparatory Phase Project). Additionally, this work was supported by the Departament de Recerca i Universitats of the Generalitat de Catalunya, under the Industrial Doctorate Grant DI 2018-100., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A comparative user study of human predictions in algorithm-supported recidivism risk assessment

  • Portela, Manuel
  • Castillo, Carlos
  • Tolan, Songül
  • Karimi-Haghighi, Marzieh
  • Andrés Pueyo, Antonio
In this paper, we study the effects of using an algorithm-based risk assessment instrument (RAI) to support the prediction of risk of violent recidivism upon release. The instrument we used is a machine learning version of RiskCanvi used by the Justice Department of Catalonia, Spain. It was hypothesized that people can improve their performance on defining the risk of recidivism when assisted with a RAI. Also, that professionals can perform better than non-experts on the domain. Participants had to predict whether a person who has been released from prison will commit a new crime leading to re-incarceration, within the next two years. This user study is done with (1) general participants from diverse backgrounds recruited through a crowdsourcing platform, (2) targeted participants who are students and practitioners of data science, criminology, or social work and professionals who work with RisCanvi. We also run focus groups with participants of the targeted study, including people who use RisCanvi in a professional capacity, to interpret the quantitative results. Among other findings, we observe that algorithmic support systematically leads to more accurate predictions from all participants, but that statistically significant gains are only seen in the performance of targeted participants with respect to that of crowdsourced participants. Among other comments, professional participants indicate that they would not foresee using a fully-automated system in criminal risk assessment, but do consider it valuable for training, standardization, and to fine-tune or double-check their predictions on particularly difficult cases. We found that the revised prediction by using a RAI increases the performance of all groups, while professionals show a better performance in general. And, a RAI can be considered for extending professional capacities and skills along their careers., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially supported by the HUMAINT programme (Human Behaviour and Machine Intelligence), Centre for Advanced Studies, Joint Research Centre, European Commission through the Expect contract CT-EX2019D347180. Additionally, it received the support from the EU-funded project “SoBigData++” (grant agreement 871042).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Participant behavior and community response in online mental health communities: insights from reddit

Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The Response of governments and public health agencies to COVID-19 pandemics on social media: a multi-country analysis of Twitter discourse

  • Li, Lan
  • Aldosery, Aisha
  • Vitiugin, Fedor
  • Nathan, Naomi
  • Novillo-Ortiz, David
  • Castillo, Carlos
  • Kostkova, Patty
During the COVID-19 pandemic, information is being rapidly shared by public health experts and researchers through social media platforms. Whilst government policies were disseminated and discussed, fake news and misinformation simultaneously created a corresponding wave of “infodemics.” This study analyzed the discourse on Twitter in several languages, investigating the reactions to government and public health agency social media accounts that share policy decisions and official messages. The study collected messages from 21 official Twitter accounts of governments and public health authorities in the UK, US, Mexico, Canada, Brazil, Spain, and Nigeria, from 15 March to 29 May 2020. Over 2 million tweets in various languages were analyzed using a mixedmethods approach to understand the messages both quantitatively and qualitatively. Using automatic, text-based clustering, five topics were identified for each account and then categorized into 10 emerging themes. Identified themes include political, socio-economic, and population-protection issues, encompassing global, national, and individual levels. A comparison was performed amongst the seven countries analyzed and the United Kingdom (Scotland, Northern Ireland, and England) to find similarities and differences between countries and government agencies. Despite the difference in language, country of origin, epidemiological contexts within the countries, significant similarities emerged. Our results suggest that other than general announcement and reportage messages, the most-discussed topic is evidence-based leadership and policymaking, followed by how to manage socio-economic consequences.
RUO. Repositorio Institucional de la Universidad de Oviedo
Publicación Artículo científico (JournalArticle)

Binary quantification and dataset shift: an experimental investigation

  • González González, Pablo|||0000-0002-9250-0920
  • Moreo, Alejandro
  • Sebastiani, Fabrizio
MINECO (Ministerio de Economía y Competitividad) and FEDER (Fondo Europeo de Desarrollo Regional), grant PID2019-110742RB-I00 (MINECO/FEDER), and by Campus de Excelencia Internacional in collaboration with Santander Bank in the framework of the fnancial aid for mobility of excellence for teachers and researchers at the University of Oviedo. The work by the 2nd and 3rd authors has been supported by the SoBigData++ project, funded by the European Commission (Grant 871042) under the H2020 Programme INFRAIA-2019-1, by the AI4Media project, funded by the European Commission (Grant 951911) under the H2020 Programme ICT-48-2020, and by the SoBigData.it, FAIR, and QuaDaSh (P2022TB5JF) projects funded by the Italian Ministry of University and Research under the NextGenerationEU program.