Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Does fair ranking lead to fair recruitment outcomes? A study of interventions, interfaces, and interactions

  • Fabris, Alessandro
  • Rus, Clara
  • Saldivar Galli, Jorge A.
  • Gatzioura, Anna
  • Biega, Asia J.
  • Castillo, Carlos
Personnel recruitment is increasingly mediated by Applicant Tracking Systems (ATS), which rank candidates for job positions, making them a central decision-support tool in modern Human Resources (HR) processes. Often framed as an information retrieval (IR) problem, the ranking of candidates in ATS is typically driven by relevance to the job position, with algorithms sorting applicants according to a set of predefined criteria. In recent years, fairness-aware ranking methods have emerged to mitigate the risk of indirect discrimination, where the ordering of candidates may inadvertently favor one demographic group over another. These approaches are inspired by browsing models developed for web search and aim to balance candidate exposure based on protected characteristics. However, ATS in recruitment introduce unique challenges due to their high-stakes nature and the decision-making context in which they operate. In this paper, we present a series of user studies that explore the disconnect between fair exposure and fair outcomes in candidate shortlisting. We focus on how factors such as task design (e.g., how recruiters interact with candidate lists), individual representations of candidates (e.g., national origin cues), and ranking order influence both position bias and demographic balance. Our findings show that while demographic balance may be achieved in terms of ranking visibility, this does not necessarily translate to fair outcomes in terms of who gets shortlisted. Through a crowdsourced experiment and in-depth interviews with recruiters, we identify key task-level, individual, and ranking factors that mediate these effects. We conclude that fairness in ATS rankings is contingent not only on algorithmic design but also on the shortlisting tasks they support, as well as the interfaces, strategies, and assumptions that recruiters use when interacting with candidate lists. Based on these insights, we provide implications for the design of algorithms, interfaces, and recruitment processes that support fairer and more equitable recruitment outcomes., This work is supported by the FINDHR project, Horizon Europe grant agreement ID: 101070212 and by the Alexander von Humboldt Foundation.
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

Institutional, academic, and learning analytics: a bibliometric study

  • Marques, Francielle
  • Ortiz-Beltrán, Ariel
  • Hernández Leo, Davinia
  • Castillo, Carlos
Comunicació presentada al 25th IEEE International Conference on Advanced Learning Technologies (ICALT 2025), celebrada a Changhua (Taiwan) del 14-17 de juliol de 2025, Educational institutions are increasingly adopting data-driven approaches, yet there appears to be insufficient exploration into the development of so-called Institutional and Academic Analytics and how these terms intersect with Learning Analytics (LA). This study conducts a bibliometric analysis (last 10 years) as an initial step to explore this gap. Our results illuminate evolving but inconsistent interest in Institutional and Academic Analytics across time and across publication venues. The results also indicate a need for the LA community to clarify its connections with related applications of data analytics focused on students and their contexts while reflecting on and potentially expanding its areas of impact., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Hunter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects ¿SoBigData++¿ (grant agreement 871042), ¿FINDHR¿ (grant agreement 101070212).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Repositorio Digital de la UPF
Publication Capítulo o parte de un libro (BookPart)

Towards caring institutional analytics: a case study illustrating the exploration of language biases

  • Marques, Francielle
  • Hernández Leo, Davinia
  • Castillo, Carlos
  • Trenchs i Parera, Mireia
Our study focuses on institutional analytics in higher education decision-making and the need of considering contextual biases. We contribute with a case study in a university in Catalonia using (reliable) student grades and satisfaction data from 22 professors who teach at least one course in Catalan and at least one course in English to identify language-related biases or interrelationships. Our study sheds light on the relevance of this perspective and its implications, This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData++" (grant agreement 871042), "FINDHR" (grant agreement 101070212). Trenchs-Parera also acknowledges support from the INCLU-LINGUAM research project (ref. PID2022-141945NB-I00), funded by MCIN/AEI/10.13039/501100011033/ and FEDER, EU.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Does fair ranking lead to fair recruitment outcomes? A study of interventions, interfaces, and interactions

  • Fabris, Alessandro
  • Rus, Clara
  • Saldivar Galli, Jorge A.
  • Gatzioura, Anna
  • Biega, Asia J.
  • Castillo, Carlos
Personnel recruitment is increasingly mediated by Applicant Tracking Systems (ATS), which rank candidates for job positions, making them a central decision-support tool in modern Human Resources (HR) processes. Often framed as an information retrieval (IR) problem, the ranking of candidates in ATS is typically driven by relevance to the job position, with algorithms sorting applicants according to a set of predefined criteria. In recent years, fairness-aware ranking methods have emerged to mitigate the risk of indirect discrimination, where the ordering of candidates may inadvertently favor one demographic group over another. These approaches are inspired by browsing models developed for web search and aim to balance candidate exposure based on protected characteristics. However, ATS in recruitment introduce unique challenges due to their high-stakes nature and the decision-making context in which they operate. In this paper, we present a series of user studies that explore the disconnect between fair exposure and fair outcomes in candidate shortlisting. We focus on how factors such as task design (e.g., how recruiters interact with candidate lists), individual representations of candidates (e.g., national origin cues), and ranking order influence both position bias and demographic balance. Our findings show that while demographic balance may be achieved in terms of ranking visibility, this does not necessarily translate to fair outcomes in terms of who gets shortlisted. Through a crowdsourced experiment and in-depth interviews with recruiters, we identify key task-level, individual, and ranking factors that mediate these effects. We conclude that fairness in ATS rankings is contingent not only on algorithmic design but also on the shortlisting tasks they support, as well as the interfaces, strategies, and assumptions that recruiters use when interacting with candidate lists. Based on these insights, we provide implications for the design of algorithms, interfaces, and recruitment processes that support fairer and more equitable recruitment outcomes., This work is supported by the FINDHR project, Horizon Europe grant agreement ID: 101070212 and by the Alexander von Humboldt Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Towards caring institutional analytics: a case study illustrating the exploration of language biases

  • Marques, Francielle
  • Hernández Leo, Davinia
  • Castillo, Carlos
  • Trenchs i Parera, Mireia
Our study focuses on institutional analytics in higher education decision-making and the need of considering contextual biases. We contribute with a case study in a university in Catalonia using (reliable) student grades and satisfaction data from 22 professors who teach at least one course in Catalan and at least one course in English to identify language-related biases or interrelationships. Our study sheds light on the relevance of this perspective and its implications, This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData++" (grant agreement 871042), "FINDHR" (grant agreement 101070212). Trenchs-Parera also acknowledges support from the INCLU-LINGUAM research project (ref. PID2022-141945NB-I00), funded by MCIN/AEI/10.13039/501100011033/ and FEDER, EU.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Institutional, academic, and learning analytics: a bibliometric study

  • Marques, Francielle
  • Ortiz-Beltrán, Ariel
  • Hernández Leo, Davinia
  • Castillo, Carlos
Comunicació presentada al 25th IEEE International Conference on Advanced Learning Technologies (ICALT 2025), celebrada a Changhua (Taiwan) del 14-17 de juliol de 2025, Educational institutions are increasingly adopting data-driven approaches, yet there appears to be insufficient exploration into the development of so-called Institutional and Academic Analytics and how these terms intersect with Learning Analytics (LA). This study conducts a bibliometric analysis (last 10 years) as an initial step to explore this gap. Our results illuminate evolving but inconsistent interest in Institutional and Academic Analytics across time and across publication venues. The results also indicate a need for the LA community to clarify its connections with related applications of data analytics focused on students and their contexts while reflecting on and potentially expanding its areas of impact., This work is co-funded by MICIU/AEI/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33; CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Hunter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects ¿SoBigData++¿ (grant agreement 871042), ¿FINDHR¿ (grant agreement 101070212).