Skip to main content

INTELIGENCIA ARTIFICIAL EXPLICABLE PARA EL ENVEJECIMIENTO SALUDABLE

PID2021-123152OB-C21

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2021
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDADE DE SANTIAGO DE COMPOSTELA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

The role of Speculations for Explainable and Trustworthy Artificial Intelligence: A use case on Art Genre Classification

  • Alonso Moral, José María
  • Costa, Vicent
In this work, we have introduced a new way of speculative reasoning for intelligent systems. In addition, we have illustrated the utility of this way of reasoning in the context of a use case on art genre classification, where explainability and trustworthiness are a matter of major concern. Speculative reasoning is natural for humans and it turns up as a powerful tool, especially in the case of intelligent systems dealing with incomplete, vague, and imprecise information.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

Generating trustworthy explanations with a language model enriched by fuzzy rule-based systems

  • Pérez-Ferreiro, Pablo Miguel
  • Catalá Bolós, Alejandro
  • Bugarín-Diz, Alberto
  • Alonso Moral, José María
In this work, we have developed, validated, and deployed fuzzy-grounded, trustworthy, interactive explanations by combining fuzzy systems with Large Language Models (LLMs). More precisely, we profit from fuzzy systems' ability to deal appropriately with vagueness and uncertainty in approximate reasoning and propose an efficient and effective way to combine fuzzy rule-based systems with the natural language verbalization capabilities of LLMs. The aim is to generate explanations that balance naturalness and faithfulness. The proposed software architecture is open-source and highly modular. We validated our work in the medical field. We observed significant statistical differences with related-samples Wilcoxon signed rank tests (p-value < 0.001) regarding hallucinations in the experimental scenarios under study, which hints at good faithfulness. We also produced significantly more compact narratives, which helps alleviate the usual ‘over-explanation’ issue of LLMs without a penalization in accuracy.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

Evaluation of an Emotion-Aware Persuasive Framework Based on Peripheral Interaction for Reducing Physical Strain in Office Environments

  • Suni-Lopez, Franci
  • Condori Fernández, Nelly
Repetitive Strain Injuries (RSIs) are a leading cause of workplace disability and absenteeism, particularly among office workers engaged in prolonged computer-based tasks. This study evaluates the effectiveness of EMotivA, a persuasive system designed to promote active breaks and mitigate the risk of RSIs. A quantitative pretest-postest design was conducted with 20 office workers over one workweek, during which EMotivA dispatched persuasive notifications every 40 minutes to encourage brief, light physical activities. The system aimed to increase the frequency and regularity of active breaks and reduce musculoskeletal discomfort, measured using the Cornell Musculoskeletal Discomfort Questionnaire (CMDQ). Results showed a significant increase in active breaks and a marked improvement in time dedicated to physical activities. CMDQ scores revealed a significant reduction in musculoskeletal discomfort post-intervention (t(19) = 3.152, p = 0.005, d = 0.705). These findings demonstrate that EMotivA effectively fosters healthier work habits and reduces physical discomfort, emphasizing its potential as a tool for occupational health management.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

A User Study on the Utility of Context-aware Explanations for Assisting Data Scientists in Error Analysis of Fuzzy Decision Trees

  • Fernández, Guillermo
  • Gámez, Jose A.
  • Puerta, Jose M.
  • Aledo, Juan A.
  • Alonso Moral, José María
  • Bugarín-Diz, Alberto
The current growth of interest in the field of eXplainable Artificial Intelligence has led to the rise of multiple explanation generation techniques to bridge the gap between the algorithmic complexity of the most powerful algorithms and their end users, who are expected to take advantage of them. In addition, explanations can assist with other tasks, such as explaining the algorithm to a model designer, who can use that information to fine-tune the system that implements such an algorithm. This gives the model designer some insight into the inner workings of the system to guide design decisions as well as identify and prevent potential errors, resulting in a myriad of improvements regarding model properties such as accuracy, explainability, trustworthiness, coherence with existing knowledge, etc. In this paper, we introduce a method to enrich local explanations of fuzzy decision tree classifications with context information. The goodness of the proposed method was validated with a user study in which 26 participants had to detect classification errors made by a fuzzy decision tree. Reported results show that enriched explanations allowed the participants to be more accurate in detecting errors in the classification system, albeit taking longer to solve the task with respect to participants who were shown regular local explanations.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

CL-XAI: Toward Cognitive Learning through eXplainable Artificial Intelligence

  • Suffian, Muhammad
  • Kuhl, Ulrike
  • Alonso Moral, José María
  • Bogliolo, Alessandro
Artificial Intelligence (AI) is transforming education by providing personalized learning paths that cater to individual needs. Explainable AI (XAI) plays a vital role in assisting learners with limited prior knowledge and skills, offering transparency by elucidating how AI systems reach conclusions. In a co-learning environment, where learners engage collaboratively, the role of XAI becomes even more significant. This transparency not only fosters trust in AI-driven learning but also empowers co-learners to actively participate in and enhance their cognitive learning journey. Providing explanations for novel concepts is recognised as a fundamental aid in the learning process, particularly when addressing challenges stemming from knowledge deficiencies and skill application. Addressing these difficulties involves timely explanations and guidance throughout the learning process, prompting the interest of AI experts in developing explainer models. In this paper, we introduce an intelligent system (CL-XAI) for cognitive learning supported by XAI, focusing on two key research objectives: (i) exploring how human learners comprehend the internal mechanisms of AI models using XAI tools; and (ii) evaluating the effectiveness of such tools through human feedback. The use of CL-XAI is illustrated with a game-inspired virtual use case where learners tackle combinatorial problems to enhance problem-solving skills and deepened their understanding of complex concepts. The analysis of a pilot study of 21 participants indicates improved learning outcomes with explanations, showing a positive correlation with the complexity of tasks. Notably, over 60% of the participants expressed satisfaction, recognizing explanations as valuable aids in achieving learning targets. This paper is a pathway highlighting the potential for transformative advances in cognitive learning and co-learning.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

Beyond Prediction Similarity: ShapGAP for Evaluating Faithful Surrogate Models in XAI

  • Mariotti, Ettore
  • Sivaprasad, Adarsa
  • Alonso Moral, José María
The growing importance of Explainable Artificial Intelligence (XAI) has highlighted the need to understand the decision-making processes of black-box models. Surrogation, emulating a black-box model (BB) with a white-box model (WB), is crucial in applications where BBs are unavailable due to security or practical concerns. Traditional fidelity measures only evaluate the similarity of the final predictions, which can lead to a significant limitation: considering a WB faithful even when it has the same prediction as the BB but with a completely different rationale. Addressing this limitation is crucial to develop Trustworthy AI practical applications beyond XAI. To address this issue, we introduce ShapGAP, a novel metric that assesses the faithfulness of surrogate models by comparing their reasoning paths, using SHAP explanations as a proxy. We validate the effectiveness of ShapGAP by applying it to real-world datasets from healthcare and finance domains, comparing its performance against traditional fidelity measures. Our results show that ShapGAP enables better understanding and trust in XAI systems, revealing the potential dangers of relying on models with high task accuracy but unfaithful explanations. ShapGAP serves as a valuable tool for identifying faithful surrogate models, paving the way for more reliable and Trustworthy AI applications.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

Logs Based Verification Tool of Serious Game for Autistic Children

  • Nur Rohmah, Arini
  • Condori Fernández, Nelly
Serious games are referred to as entertaining tools with a purpose of education. The correct implementation of serious games is very important to ensure a high level of adoption of the competencies by the game users, which can be even more challenging if we target autistic children. Understanding the actual needs of Children with Autism Spectrum Disorder (ASD) and supporting their learning activity through serious games can be a burden. This paper presents the architecture of logs based Verification tool, named GVT, to identify potential scenes of the serious game that might be causing any negative emotion on the autistic children. GVT architecture follows a client sever model, which enables to merge the game logs with the emotional data logs. The data analysis and visualization, carried out at the server side, should provide relevant information to support developers to enhance the quality of serious games for autistic people.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

AffeX: a real-time emotion monitoring and visualization tool

  • Méndez Flórez, Juan Camilo
  • Condori Fernández, Nelly
  • Catalá Bolós, Alejandro
  • Alonso Moral, José María
  • Figueroa Vásquez, Salvador Alonso
Non-invasive, real-time emotion detection enables continuous and discreet monitoring of affective states, supporting system adaptability while safeguarding user privacy, an essential feature in clinical, educational, and research contexts. This paper presents AffeX, an intuitive tool for the real-time visualization and analysis of facial emotions, designed with a focus on privacy and data transparency. It offers customizable visual feedback, allowing the exploration of emotional responses without compromising identity. Unlike commercial solutions, AffeX ensures full control over data handling, enabling further analysis and multimodal integration, making it especially suitable for privacy-aware and adaptable research scenarios.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

Virtual Assistant supported by Fusion of Fuzzy Rule-based Explainers

  • Pérez-Ferreiro, Pablo Miguel
  • Catalá Bolós, Alejandro
  • Bugarín-Diz, Alberto
  • Alonso Moral, José María
In this work, we introduce a novel methodology for combining different explanatory inputs into a singular coherent narrative in the medical domain. As proof of concept, we have implemented a prototype ready to diagnose diabetes and heart disease. The proposal is validated with a user study in which we collected 48 valid responses to a given questionnaire. We compared four different strategies for explanation fusion, considering explanations coming from two different fuzzy rule bases. The winner strategy (i.e., verbalizing common antecedents as the main factors of the diagnosis and adding any non-common antecedents as supporting evidence) was perceived as trustworthy, useful, and natural by most participants in the study.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Capítulo o parte de un libro (BookPart)

A Confusion Matrix for Evaluating Feature Attribution Methods

  • Arias-Duart, Anna
  • Mariotti, Ettore
  • García-Gasulla, Darío
  • Alonso Moral, José María
The increasing use of deep learning models in critical areas of computer vision and the consequent need for insights into model behaviour have led to the development of numerous feature attribution methods. However, these attributions must be both meaningful and plausible to end-users, which is not always the case. Recent research has emphasized the importance of faithfulness in attributions, as plausibility without faithfulness can result in misleading explanations and incorrect decisions. In this work, we propose a novel approach to evaluate the faithfulness of feature attribution methods by constructing an ‘Attribution Confusion Matrix’, which allows us to leverage a wide range of existing metrics from the traditional confusion matrix. This approach effectively introduces multiple evaluation measures for faithfulness in feature attribution methods in a unified and consistent framework. We demonstrate the effectiveness of our approach on various datasets, attribution methods, and models, emphasizing the importance of faithfulness in generating plausible and reliable explanations while also illustrating the distinct behaviour of different feature attribution methods.