Pasar al contenido principal

RETOS DE UN SISTEMA DE ESTIMACION DE MIRADA EMPLEANDO COMPONENTES DE PROPOSITO GENERAL Y REDES NEURONALES (CHETOS)

PID2020-118014RB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD PUBLICA DE NAVARRA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Portable, Low-Cost Eye Tracking System for Predicting Visual Attention During Meal Ingestion

  • Cia, Izaskun
  • Elizaran Mendarte, Amaia
  • Garde, Gonzalo
  • Cabeza, Rafael
  • Almiron-Roig, Eva
  • Villanueva, Arantxa
Obesity is a pressing public health challenge affecting physical and mental health. Understanding the cognitive and socio-economic factors that influence eating behaviors is essential for effective interventions. Visual attention is crucial in food choices, making it critical to study how individuals engage with food in real-life settings. However, current methodologies often rely on static images, limiting their ecological validity and real-world applicability, or are highly intrusive. This work offers a practical solution for tracking visual attention during real-life eating scenarios. We designed a tray with an integrated camera and a calibration pattern to remotely record volunteers during meal consumption. A convolutional neural network (CNN) was employed for the gaze tracking, utilizing a custom-built training database. Models without and with user calibration were provided. Results indicate an accuracy error of 5 cm, which improves to 2 cm with calibration, demonstrating our system’s effectiveness in measuring visual attention in food psychology experiments., This research was supported by the Government of Navarra, Departamento de Universidad, Innovación y Transformación Digital (grant PC139-140, PORTIONS-4). EA-R also received fundingfrom the Centre for Nutrition Research, University of Navarra, Spain. The portion-control platewas kindly provided by Precise Portions LLC, Virginia, USA.Additional funding was provided by the Public University of Navarra and the Spanish Ministryof Science and Innovation under the project “Challenges of Eye Tracking Off-the-Shelf (ChETOS)”(reference PID2020-118014RB-I00)., Peer reviewed
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

Metrics for dataset demographic bias: a case study on facial expression recognition

  • Domínguez Catena, Iris
  • Paternain Dallo, Daniel
  • Galar Idoate, Mikel
Demographic biases in source datasets have been shown as one of the causes of unfairness and discrimination in the predictions of Machine Learning models. One of the most prominent types of demographic bias are statistical imbalances in the representation of demographic groups in the datasets. In this paper, we study the measurement of these biases by reviewing the existing metrics, including those that can be borrowed from other disciplines. We develop a taxonomy for the classification of these metrics, providing a practical guide for the selection of appropriate metrics. To illustrate the utility of our framework, and to further understand the practical characteristics of the metrics, we conduct a case study of 20 datasets used in Facial Emotion Recognition (FER), analyzing the biases present in them. Our experimental results show that many metrics are redundant and that a reduced subset of metrics may be sufficient to measure the amount of demographic bias. The paper provides valuable insights for researchers in AI and related fields to mitigate dataset bias and improve the fairness and accuracy of AI models., This work was supported in part by a predoctoral fellowship from the Research Service of the Universidad Pública de Navarra through open access funding, in part by the Spanish MICIN under Grants PID2019-108392GB-I00, PID2020-118014RB-I00, and PID2022-136627NB-I00/AEI/10.13039/501100011033 FEDER, UE, and in part by the Government of Navarre under Grant 0011-1411-2020-000079 - Emotional Films.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

Accurate pupil center detection in off-the-shelf eye tracking systems using convolutional neural networks

  • Larumbe Bergera, Andoni
  • Garde Lecumberri, Gonzalo
  • Porta Cuéllar, Sonia
  • Cabeza Laguna, Rafael
  • Villanueva Larre, Arantxa
Remote eye tracking technology has suffered an increasing growth in recent years due to its applicability in many research areas. In this paper, a video-oculography method based on convolutional neural networks (CNNs) for pupil center detection over webcam images is proposed. As the first contribution of this work and in order to train the model, a pupil center manual labeling procedure of a facial landmark dataset has been performed. The model has been tested over both real and synthetic databases and outperforms state-of-the-art methods, achieving pupil center estimation errors below the size of a constricted pupil in more than 95% of the images, while reducing computing time by a 8 factor. Results show the importance of use high quality training data and well-known architectures to achieve an outstanding performance., This research was funded by Public University of Navarra (Pre-doctoral research grant) and by the Spanish Ministry of Science and Innovation under Contract 'Challenges of Eye Tracking Off-the-Shelf (ChETOS)' with reference: PID2020-118014RB-I00
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

Less can be more: representational vs. stereotypical gender bias in facial expression recognition

  • Domínguez Catena, Iris
  • Paternain Dallo, Daniel
  • Jurío Munárriz, Aránzazu
  • Galar Idoate, Mikel
Machine learning models can inherit biases from their training data, leading to discriminatory or inaccurate predictions. This is particularly concerning with the increasing use of large, unsupervised datasets for training foundational models. Traditionally, demographic biases within these datasets have not been well-understood, limiting our ability to understand how they propagate to the models themselves. To address this issue, this paper investigates the propagation of demographic biases from datasets into machine learning models. We focus on the gender demographic component, analyzing two types of bias: representational and stereotypical. For our analysis, we consider the domain of facial expression recognition (FER), a field known to exhibit biases in most popular datasets. We use Affectnet, one of the largest FER datasets, as our baseline for carefully designing and generating subsets that incorporate varying strengths of both representational and stereotypical bias. Subsequently, we train several models on these biased subsets, evaluating their performance on a common test set to assess the propagation of bias into the models¿ predictions. Our results show that representational bias has a weaker impact than expected. Models exhibit a good generalization ability even in the absence of one gender in the training dataset. Conversely, stereotypical bias has a significantly stronger impact, primarily concentrated on the biased class, although it can also influence predictions for unbiased classes. These results highlight the need for a bias analysis that differentiates between types of bias, which is crucial for the development of effective bias mitigation strategies., This work was funded by a predoctoral fellowship and open access funding from the Research Service of the Universidad Publica de Navarra, the Spanish MICIN (PID2020-118014RB-I00 and PID2022-136627NB-I00, AEI/10.13039/501100011033 FEDER, UE), the Government of Navarre (0011-1411-2020-000079 - Emotional Films), and the support of the 2024 Leonardo Grant for Researchers and Cultural Creators from the BBVA Foundation.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

DSAP: analyzing bias through demographic comparison of datasets

  • Domínguez Catena, Iris
  • Paternain Dallo, Daniel
  • Galar Idoate, Mikel
In the last few years, Artificial Intelligence (AI) systems have become increasingly widespread. Unfortunately, these systems can share many biases with human decision-making, including demographic biases. Often, these biases can be traced back to the data used for training, where large uncurated datasets have become the norm. Despite our awareness of these biases, we still lack general tools to detect, quantify, and compare them across different datasets. In this work, we propose DSAP (Demographic Similarity from Auxiliary Profiles), a two-step methodology for comparing the demographic composition of datasets. First, DSAP uses existing demographic estimation models to extract a dataset's demographic profile. Second, it applies a similarity metric to compare the demographic profiles of different datasets. While these individual components are well-known, their joint use for demographic dataset comparison is novel and has not been previously addressed in the literature. This approach allows three key applications: the identification of demographic blind spots and bias issues across datasets, the measurement of demographic bias, and the assessment of demographic shifts over time. DSAP can be used on datasets with or without explicit demographic information, provided that demographic information can be derived from the samples using auxiliary models, such as those for image or voice datasets. To show the usefulness of the proposed methodology, we consider the Facial Expression Recognition task, where demographic bias has previously been found. The three applications are studied over a set of twenty datasets with varying properties. The code is available at https://github.com/irisdominguez/DSAP., This work was funded by a predoctoral fellowship from the Research Service of the Universidad Publica de Navarra, the Spanish MICIN (PID2020-118014RB-I00 and PID2022-136627NB-I00/AEI/10.13039/501100011033 FEDER, UE), and the Government of Navarre (0011-1411-2020-000079 - Emotional Films). Open access funding provided by Universidad Pública de Navarra.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

A portable, low-cost eye tracking system for predicting visual attention during meal ingestion

  • Cia Alonso, Izaskun
  • Elizaran Mendarte, Amaia
  • Garde Lecumberri, Gonzalo
  • Cabeza Laguna, Rafael
  • Almiron-Roig, Eva
  • Villanueva Larre, Arantxa
Obesity is a pressing public health challenge affecting physical and mental health. Understanding the cognitive and socio-economic factors that influence eating behaviors is essential for effective interventions. Visual attention is crucial in food choices, making it critical to study how individuals engage with food in real-life settings. However, current methodologies often rely on static images, limiting their ecological validity and real-world applicability, or are highly intrusive. This work offers a practical solution for tracking visual attention during real-life eating scenarios. We designed a tray with an integrated camera and a calibration pattern to remotely record volunteers during meal consumption. A convolutional neural network (CNN) was employed for the gaze tracking, utilizing a custom-built training database. Models without and with user calibration were provided. Results indicate an accuracy error of 5 cm, which improves to 2 cm with calibration, demonstrating our system's effectiveness in measuring visual attention in food psychology experiments., This research was supported by the Government of Navarra, Departamento de Universidad, Innovacion y Transformacion Digital (grant PC139-140, PORTIONS-4) . EA-R also received funding from the Centre for Nutrition Research, University of Navarra, Spain. The portion-control plate was kindly provided by Precise Portions LLC, Virginia, USA.Additional funding was provided by the Public University of Navarra and the Spanish Ministry of Science and Innovation under the project Challenges of Eye Tracking Off-the-Shelf (ChETOS) (reference PID2020-118014RB-I00) .
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Contribución de congreso (ConferenceOutput)

Gender stereotyping impact in facial expression recognition

  • Domínguez Catena, Iris
  • Paternain Dallo, Daniel
  • Galar Idoate, Mikel
Facial Expression Recognition (FER) uses images of faces to identify the emotional state of users, allowing for a closer interaction between humans and autonomous systems. Unfortunately, as the images naturally integrate some demographic information, such as apparent age, gender, and race of the subject, these systems are prone to demographic bias issues. In recent years, machine learning-based models have become the most popular approach to FER. These models require training on large datasets of facial expression images, and their generalization capabilities are strongly related to the characteristics of the dataset. In publicly available FER datasets, apparent gender representation is usually mostly balanced, but their representation in the individual label is not, embedding social stereotypes into the datasets and generating a potential for harm. Although this type of bias has been overlooked so far, it is important to understand the impact it may have in the context of FER. To do so, we use a popular FER dataset, FER+, to generate derivative datasets with different amounts of stereotypical bias by altering the gender proportions of certain labels. We then proceed to measure the discrepancy between the performance of the models trained on these datasets for the apparent gender groups. We observe a discrepancy in the recognition of certain emotions between genders of up to 29 % under the worst bias conditions. Our results also suggest a safety range for stereotypical bias in a dataset that does not appear to produce stereotypical bias in the resulting model. Our findings support the need for a thorough bias analysis of public datasets in problems like FER, where a global balance of demographic representation can still hide other types of bias that harm certain demographic groups., This work was funded by a predoctoral fellowship of the Research Service of Universidad Publica de Navarra, the Spanish MICIN (PID2019-108392GB-I00 and PID2020-118014RB-I00 / AEI / 10.13039/501100011033), and the Government of Navarre (0011-1411-2020-000079 - Emotional Films).