Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

TECNALIA Publications
Publication Artículo científico (JournalArticle)

Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence

  • Holzinger, Andreas
  • Dehmer, Matthias
  • Emmert-Streib, Frank
  • Cucchiara, Rita
  • Augenstein, Isabelle
  • Ser, Javier Del
  • Samek, Wojciech
  • Jurisica, Igor
  • Díaz-Rodríguez, Natalia
Medical artificial intelligence (AI) systems have been remarkably successful, even outperforming human performance at certain tasks. There is no doubt that AI is important to improve human health in many ways and will disrupt various medical workflows in the future. Using AI to solve problems in medicine beyond the lab, in routine environments, we need to do more than to just improve the performance of existing AI methods. Robust AI solutions must be able to cope with imprecision, missing and incorrect information, and explain both the result and the process of how it was obtained to a medical expert. Using conceptual knowledge as a guiding model of reality can help to develop more robust, explainable, and less biased machine learning models that can ideally learn from less data. Achieving these goals will require an orchestrated effort that combines three complementary Frontier Research Areas: (1) Complex Networks and their Inference, (2) Graph causal models and counterfactuals, and (3) Verification and Explainability methods. The goal of this paper is to describe these three areas from a unified view and to motivate how information fusion in a comprehensive and integrative manner can not only help bring these three areas together, but also have a transformative role by bridging the gap between research and practical applications in the context of future trustworthy medical AI. This makes it imperative to include ethical and legal aspects as a cross-cutting discipline, because all future solutions must not only be ethically responsible, but also legally compliant.
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

On generating trustworthy counterfactual explanations

  • Del Ser, Javier
  • Barredo Arrieta, Alejandro
  • Díaz Rodríguez, Natalia Ana|||0000-0003-3362-9326
  • Herrera Triguero, Francisco|||0000-0002-7283-312X
  • Saranti, Anna
  • Holzinger, Andreas
Deep learning models like chatGPT exemplify AI success but necessitate a deeper understanding of trust in critical sectors. Trust can be achieved using counterfactual explanations, which is how humans become familiar with unknown processes; by understanding the hypothetical input circumstances under which the output changes. We argue that the generation of counterfactual explanations requires several aspects of the generated counterfactual instances, not just their counterfactual ability. We present a framework for generating counterfactual explanations that formulate its goal as a multiobjective optimization problem balancing three objectives: plausibility; the intensity of changes; and adversarial power. We use a generative adversarial network to model the distribution of the input, along with a multiobjective counterfactual discovery solver balancing these objectives. We demonstrate the usefulness of six classification tasks with image and 3D data confirming with evidence the existence of a trade-off between the objectives, the consistency of the produced counterfactual explanations with human knowledge, and the capability of the framework to unveil the existence of concept-based biases and misrepresented attributes in the input domain of the audited model. Our pioneering effort shall inspire further work on the generation of plausible counterfactual explanations in real-world scenarios where attribute-/concept-based annotations are available for the domain under analysis., Basque Government (Eusko Jaurlaritza) through the Consolidated Research Group MATHMODE (IT1256-22), Centro para el Desarrollo Tecnologico Industrial (CDTI), European Union (AI4ES project, grant no. CER-20211030), Austrian Science Fund (FWF), Project: P-32554, European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826078 (Feature Cloud), Juan de la Cierva Incorporación contract (IJC2019-039152-I), Google Research Scholar Programme 2021, Marie Skłodowska-Curie Actions (MSCA) Postdoctoral Fellowship with agreement ID: 101059332
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence

  • Holzinger, Andreas
  • Dehmer, Matthias
  • Emmert-Streib, Frank
  • Cucchiara, Rita
  • Augenstein, Isabelle
  • Del Ser, Javier
  • Samek, Wojciech
  • Jurisica, Igor
  • Díaz Rodríguez, Natalia Ana|||0000-0003-3362-9326
Andreas Holzinger acknowledges funding support from the Austrian Science Fund (FWF), Project: P-32554 explainable Artificial Intelligence and from the European Union's Horizon 2020 research and innovation program under grant agreement 826078 (Feature Cloud). This publication reflects only the authors' view and the European Commission is not responsible for any use that may be made of the information it contains; Natalia Diaz-Rodriguez is supported by the Spanish Government Juan de la Cierva Incorporacion contract (IJC2019-039152-I); Isabelle Augenstein's research is partially funded by a DFF Sapere Aude research leader grant; Javier Del Ser acknowledges funding support from the Basque Government through the ELKARTEK program (3KIA project, KK-2020/00049) and the consolidated research group MATHMODE (ref. T1294-19); Wojciech Samek acknowledges funding support from the European Union's Horizon 2020 research and innovation program under grant agreement No. 965221 (iToBoS), and the German Federal Ministry of Education and Research (ref. 01IS18025 A, ref. 01IS18037I and ref. 0310L0207C); Igor Jurisica acknowledges funding support from Ontario Research Fund (RDI 34876), Natural Sciences Research Council (NSERC 203475), CIHR Research Grant (93579), Canada Foundation for Innovation (CFI 29272, 225404, 33536), IBM, Ian Lawson van Toch Fund, the Schroeder Arthritis Institute via the Toronto General and Western Hospital Foundation., Medical artificial intelligence (AI) systems have been remarkably successful, even outperforming human performance at certain tasks. There is no doubt that AI is important to improve human health in many ways and will disrupt various medical workflows in the future. Using AI to solve problems in medicine beyond the lab, in routine environments, we need to do more than to just improve the performance of existing AI methods. Robust AI solutions must be able to cope with imprecision, missing and incorrect information, and explain both the result and the process of how it was obtained to a medical expert. Using conceptual knowledge as a guiding model of reality can help to develop more robust, explainable, and less biased machine learning models that can ideally learn from less data. Achieving these goals will require an orchestrated effort that combines three complementary Frontier Research Areas: (1) Complex Networks and their Inference, (2) Graph causal models and counterfactuals, and (3) Verification and Explainability methods. The goal of this paper is to describe these three areas from a unified view and to motivate how information fusion in a comprehensive and integrative manner can not only help bring these three areas together, but also have a transformative role by bridging the gap between research and practical applications in the context of future trustworthy medical AI. This makes it imperative to include ethical and legal aspects as a cross-cutting discipline, because all future solutions must not only be ethically responsible, but also legally compliant., Austrian Science Fund (FWF) P-32554, European Union's Horizon 2020 research and innovation program 826078 965221, Spanish Government Juan de la Cierva Incorporacion IJC2019-039152-I, DFF Sapere Aude research leader grant, Basque Government KK-2020/00049, consolidated research group MATHMODE T1294-19, Federal Ministry of Education & Research (BMBF) 01IS18025 A 01IS18037I 0310L0207C, Ontario Research Fund RDI 34876, Natural Sciences Research Council NSERC 203475, Canadian Institutes of Health Research (CIHR) 93579, Canada Foundation for Innovation CGIAR CFI 29272 225404 33536, International Business Machines (IBM), Ian Lawson van Toch Fund, Schroeder Arthritis Institute via the Toronto General and Western Hospital Foundation
Digibug. Repositorio Institucional de la Universidad de Granada
Publication Artículo científico (JournalArticle)

On the disagreement problem in Human-in-the-Loop federated machine learning

  • Huelser, Matthias
  • Mueller, Heimo
  • Díaz Rodríguez, Natalia Ana|||0000-0003-3362-9326
  • Holzinger, Andreas
The popularity of Artificial Intelligence (AI) has risen sharply in recent years, revolutionizing applications in most sectors with unprecedented functionalities. Milestones and achievements like ChatGPT demonstrate not only the impressive capabilities of AI, but also how accessible such technologies have become in recent times. However, the success of AI applications depends heavily on the underlying information integration processes. Among the most important processes are the training of the AI model at the core of the application and the collection and pre-processing of training data. In particular, the task of collecting high-quality training data can be very costly and resource-intensive, as in many cases large amounts of data have to be annotated manually. Human annotators must have extensive expertise for certain tasks in order to provide high-quality training data. In this paper, we present a framework to maximize the efficiency of human experts in a Machine Learning (ML) scenario, with the aim of optimizing the use of human expertise in active learning. This is done by constantly measuring the quality of human experts’ input, as well as by involving human annotators only when needed. We showcase the benefits of our proposed framework by applying it to a problem in image classification, proving its usefulness to reduce the cost of annotating training data. The source code of the framework is publicly available at https://github.com/human-centered-ai-lab/app-HITL-annotator., Austrian Science Fund (FWF), Project: P-32554, European Union’s Horizon 2020 research and innovation programme under grant agreement No. 826078 (Feature Cloud), European Union’s Horizon 2020 research and innovation programme under grant agreement No. 101079183 (BioMedAI TWINNING), Knowledge Generation Project PID2023-149128NB-I00, funded by the Ministry of Science, Innovation and Universities of Spain (Proyectos de generación de conocimiento n◦ PID2023-149128NB-I00)