DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Artículo científico (JournalArticle)
Justifcatory explanations in machine learning: for increased transparency through documenting how key concepts drive and underpin design and engineering decisions
Given the pervasiveness of AI systems and their potential negative efects on people’s lives (especially among already marginalised groups), it becomes imperative to comprehend what goes on when an AI system generates a result, and based on what reasons, it is achieved. There are consistent technical eforts for making systems more “explainable” by reducing their opaqueness and increasing their interpretability and explainability. In this paper, we explore an alternative non-technical
approach towards explainability that complement existing ones. Leaving aside technical, statistical, or data-related issues, we focus on the very conceptual underpinnings of the design decisions made by developers and other stakeholders during the lifecycle of a machine learning project. For instance, the design and development of an app to track snoring to detect possible health risks presuppose some picture or another of “health”, which is a key notion that conceptually underpins the project.
We take it as a premise that these key concepts are necessarily present during design and development, albeit perhaps tacitly. We argue that by providing “justifcatory explanations” about how the team understands the relevant key concepts behind its design decisions, interested parties could gain valuable insights and make better sense of the workings and outcomes of
systems. Using the concept of “health”, we illustrate how a particular understanding of it might infuence decisions during the design and development stages of a machine learning project, and how making this explicit by incorporating it into ex-post explanations might increase the explanatory and justifcatory power of these explanations. We posit that a greater conceptual awareness of the key concepts that underpin design and development decisions may be benefcial to any attempt to develop
explainability methods. We recommend that “justifcatory explanations” are provided as technical documentation. These are declarative statements that contain at its simplest: (1) a high-level account of the understanding of the relevant key concepts a team possess related to a project’s main domain, (2) how these understandings drive decision-making during the life-cycle stages, and (3) it gives reasons (which could be implicit in the account) that the person or persons doing the explanation
consider to have plausible justifcatory power for the decisions that were made during the project., Open Access Funding provided by Universitat Autonoma de Barcelona. This work has been partially funded by the Ministry of Science, Innovation and Universities within the State Subprogram of Knowledge Generation through the research project FFI2017-85711-P Epistemic innovation: the case of biomedical sciences; and by the BBVA Foundation for SARS-CoV-2 and COVID-19 Research in Humanities (Detección y eliminación de sesgos en algoritmos de triaje y localización para la COVID-19). David Casacuberta and Cristian Moyano-Fernández are part of the consolidated research network “Grup d’Estudis Humanístics de Ciència I Tecnologia” (GEHUCT) (“Humanistic Studies of Science and Technology Research Group”), recognised and funded by the Generalitat de Catalunya, reference 2017 SGR 568. Ariel Guersenzvaig is part of the emergent research network “Human, Information, Material, Technology and Society Research” (HIMTS), recognised and funded by the Generalitat de Catalunya, reference 2017 SGR 1773., Peer reviewed