Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Does fair ranking lead to fair recruitment outcomes? A study of interventions, interfaces, and interactions

  • Fabris, Alessandro
  • Rus, Clara
  • Saldivar Galli, Jorge A.
  • Gatzioura, Anna
  • Biega, Asia J.
  • Castillo, Carlos
Personnel recruitment is increasingly mediated by Applicant Tracking Systems (ATS), which rank candidates for job positions, making them a central decision-support tool in modern Human Resources (HR) processes. Often framed as an information retrieval (IR) problem, the ranking of candidates in ATS is typically driven by relevance to the job position, with algorithms sorting applicants according to a set of predefined criteria. In recent years, fairness-aware ranking methods have emerged to mitigate the risk of indirect discrimination, where the ordering of candidates may inadvertently favor one demographic group over another. These approaches are inspired by browsing models developed for web search and aim to balance candidate exposure based on protected characteristics. However, ATS in recruitment introduce unique challenges due to their high-stakes nature and the decision-making context in which they operate. In this paper, we present a series of user studies that explore the disconnect between fair exposure and fair outcomes in candidate shortlisting. We focus on how factors such as task design (e.g., how recruiters interact with candidate lists), individual representations of candidates (e.g., national origin cues), and ranking order influence both position bias and demographic balance. Our findings show that while demographic balance may be achieved in terms of ranking visibility, this does not necessarily translate to fair outcomes in terms of who gets shortlisted. Through a crowdsourced experiment and in-depth interviews with recruiters, we identify key task-level, individual, and ranking factors that mediate these effects. We conclude that fairness in ATS rankings is contingent not only on algorithmic design but also on the shortlisting tasks they support, as well as the interfaces, strategies, and assumptions that recruiters use when interacting with candidate lists. Based on these insights, we provide implications for the design of algorithms, interfaces, and recruitment processes that support fairer and more equitable recruitment outcomes., This work is supported by the FINDHR project, Horizon Europe grant agreement ID: 101070212 and by the Alexander von Humboldt Foundation.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Beyond bias in student satisfaction surveys: exploring the role of grades and satisfaction with the learning design

  • Marques, Francielle
  • Hernández-Leo, Davinia
  • Castillo, Carlos
Course satisfaction surveys play a relevant role in Higher Education, aiding in the quality assessment of courses and informing academic promotions. Nonetheless, understanding potential biases and influential factors within these surveys is crucial to their equitable utilization within universities. This study delves into a deconstruction of satisfaction ratings considering three learning design factors (content, methodology, and workload) and their interplay with student grades. Especially emphasizing the need for institutional analytics to engage in Generative Uncertainty, aiding productive inquiries using data. Institutional analytics of the 2021–2022 and 2022–2023 survey results from a Spanish university revealed that learning design aspects strongly correlate with students’ holistic perception of a course. The correlation between student grades and student satisfaction related to learning design is either weak or moderate. These analytical findings imply that there may be bias in students’ responses to course satisfaction surveys (e.g., lower grades leading to lower satisfaction). However, this bias doesn’t consistently manifest., This work is co-funded by MICIU/AEI/https://doi.org/10.13039/501100011033 (PID2020-112584RB-C33, PID2023-146692OB-C33, CEX2021-001195-M) and the Department of Research and Universities of the Government of Catalonia (SGR 00930). Hernández-Leo (Serra Húnter) also acknowledges the support by ICREA under the ICREA Academia programme. Castillo also acknowledges support from the EU-funded projects "SoBigData + + " (grant agreement 871042), "FINDHR" (grant agreement 101070212).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Does fair ranking lead to fair recruitment outcomes? A study of interventions, interfaces, and interactions

  • Fabris, Alessandro
  • Rus, Clara
  • Saldivar Galli, Jorge A.
  • Gatzioura, Anna
  • Biega, Asia J.
  • Castillo, Carlos
Personnel recruitment is increasingly mediated by Applicant Tracking Systems (ATS), which rank candidates for job positions, making them a central decision-support tool in modern Human Resources (HR) processes. Often framed as an information retrieval (IR) problem, the ranking of candidates in ATS is typically driven by relevance to the job position, with algorithms sorting applicants according to a set of predefined criteria. In recent years, fairness-aware ranking methods have emerged to mitigate the risk of indirect discrimination, where the ordering of candidates may inadvertently favor one demographic group over another. These approaches are inspired by browsing models developed for web search and aim to balance candidate exposure based on protected characteristics. However, ATS in recruitment introduce unique challenges due to their high-stakes nature and the decision-making context in which they operate. In this paper, we present a series of user studies that explore the disconnect between fair exposure and fair outcomes in candidate shortlisting. We focus on how factors such as task design (e.g., how recruiters interact with candidate lists), individual representations of candidates (e.g., national origin cues), and ranking order influence both position bias and demographic balance. Our findings show that while demographic balance may be achieved in terms of ranking visibility, this does not necessarily translate to fair outcomes in terms of who gets shortlisted. Through a crowdsourced experiment and in-depth interviews with recruiters, we identify key task-level, individual, and ranking factors that mediate these effects. We conclude that fairness in ATS rankings is contingent not only on algorithmic design but also on the shortlisting tasks they support, as well as the interfaces, strategies, and assumptions that recruiters use when interacting with candidate lists. Based on these insights, we provide implications for the design of algorithms, interfaces, and recruitment processes that support fairer and more equitable recruitment outcomes., This work is supported by the FINDHR project, Horizon Europe grant agreement ID: 101070212 and by the Alexander von Humboldt Foundation.