Pasar al contenido principal

ANALISIS DE ESTRATEGIAS PARA INCORPORAR HUMANOS AL PROCESO DE APRENDIZAJE AUTOMATICO Y SU APLICACION A LA INVESTIGACION DEL CANCER PANCREATICO

PID2019-107194GB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Evaluating Explanatory Capabilities of Machine Learning Models in Medical Diagnostics: A Human-in-the-Loop Approach

  • Bobes-Bascarán, José
  • Mosqueira-Rey, Eduardo
  • Fernández-Leal, Ángel
  • Alonso Ríos, David
  • Figueirido Arnoso, Israel
  • Vidal-Ínsua, Yolanda
The results published here are in whole or part based upon data generated by the TCGA Research Network: https://www.cancer.gov/tcga, accessed on 5 January 2024., [Abstract]: This paper presents a broad study on the evaluation of explanatory capabilities of machine learning models, with a focus on Decision Trees, Random Forest, and XGBoost using a pancreatic cancer data set. We use Human-in-the-Loop-related techniques and medical guidelines as a source of domain knowledge to establish the importance of the different features that are relevant to select a pancreatic cancer treatment. These features are not only used as a dimensionality reduction approach for the machine learning models but also as a way to evaluate the explainability capabilities of the different models using agnostic and non-agnostic explainability techniques. To facilitate the interpretation of explanatory results, we propose the use of similarity measures such as the Weighted Jaccard Similarity coefficient. The goal is to select not only the best performing model but also the one that can best explain its conclusions and better aligns with human domain knowledge., This work has been supported by the State Research Agency of the Spanish Government (Grant PID2019-107194GB-I00/AEI/10.13039/501100011033 and Grant PID2023-147422OB-I00) and by the Xunta de Galicia (Grant ED431C 2022/44), supported by the EU European Regional Development Fund (ERDF). We wish to acknowledge support received from the Centro de Investigación de Galicia CITIC, funded by the Xunta de Galicia and ERDF (Grant ED431G 2023/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Segmentation, classification and interpretation of breast cancer medical images using human-in-the-loop machine learning

  • Vázquez Lema, David
  • Mosqueira-Rey, Eduardo
  • Hernández-Pereira, Elena
  • Fernández-Lozano, Carlos
  • Seara-Romera, Fernando
  • Pombo-Otero, Jorge
Data availability: The dataset analyzed during the current study is available in the TCGA repository, URL: https://portal.gdc.cancer.gov/projects/ TCGA-BRCA. The images analyzed during the current study is available in the TCIA repository, URL: https://www.cancerimagingarchive.net/collection/ tcga-brca/., This is an Accepted Manuscript. This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use (https://www.springernature.com/gp/open-science/policies/accepted-manuscript-terms), but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s00521-024-10799-7 ., [Abstract]: This paper explores the application of Human-in-the-Loop (HITL) strategies in the training of machine learning models in the medical domain. In this case, a doctor-in-the-loop approach is proposed to leverage human expertise in dealing with large and complex data. Specifically, the paper deals with the use of Whole Slide Imaging (WSI) for the analysis and prediction of the genomic subtype of breast cancer. Three different tasks were developed: segmentation of histopathological images, classification of these images regarding the genomic subtype of the cancer, and finally, interpretation of the machine learning results. The involvement of a pathologist helped us to develop a better segmentation model trying to group areas to make it more useful for further diagnosis. Because the classification models underperformed due to the complexity of the problem and insufficient data for certain cancer types, we focus our efforts in using the feedback from the pathologist to enhance model interpretability through a HITL hyperparameter optimization process., Xunta de Galicia; ED431C 2022/44, This work has been supported by the State Research Agency of the Spanish Government (Grants PID2019-107194GBI00/ AEI/10.13039/501100011033 and Project PID2023-147422OB-I00) and by the Xunta de Galicia (Grant ED431C 2022/44), supported by the EU European Regional Development Fund (ERDF). We wish to acknowledge support received from the Centro de Investigación de Galicia CITIC, funded by the Xunta de Galicia and ERDF (Grant ED431C 2022/44). The results published here are in whole or part based upon data generated by the TCGA Research Network: https://www.cancer.gov/tcga .
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Integrating Iterative Machine Teaching and Active Learning into the Machine Learning Loop

  • Mosqueira-Rey, Eduardo
  • Alonso Ríos, David
  • Baamonde-Lozano, Andrés
[Abstract] Scholars and practitioners are defining new types of interactions between humans and machine learning algorithms that we can group under the umbrella term of Human-in-the-Loop Machine Learning (HITL-ML). This paper is focused on implementing two approaches to this topic—Iterative Machine Teaching (iMT) and Active Learning (AL)—and analyzing how to integrate them in the learning loop. iMT is a variation of Machine Teaching in which a machine acts as a teacher that tries to transfer knowledge to a machine learning model. The focus of the problem in iMT is how to obtain the optimal training set given a machine learning algorithm and a target model. The idea is to learn a target concept with a minimal number of iterations with the smallest dataset. Active Learning, in contrast, is a specialized type of supervised learning in which humans are incorporated in the loop to act as oracles that analyze unlabeled data. AL allows us to achieve greater accuracy with less data and less training. Our proposal to incorporate iMT and AL into the machine learning loop is to use iMT as a technique to obtain the “Minimum Viable Data (MVD)” for training a learning model, that is, a dataset that allows us to increase speed and reduce complexity in the learning process by allowing to build early prototypes. Next, we will use AL to refine this first prototype by adding new data in an iterative and incremental way. We carried out several experiments to test the feasibility of our proposed approach. They show that the algorithms trained with the teachers converge faster than those that have been trained in a conventional way. Also, AL helps the model to avoid getting stuck and to keep improving after the first few iterations. The two approaches investigated in this paper can be considered complementary, as they correspond to different stages in the learning process., This work has been supported by the State Research Agency of the Spanish Government (grant PID2019-107194GB-I00 / AEI / 10.13039/501100011033) and by the Xunta de Galicia (grant ED431C 2018/34) with the European Union ERDF funds. We wish to acknowledge the support received from the Centro de Investigaci ́on de Galicia “CITIC”, funded by Xunta de Galicia and the European Union (European Regional Development Fund- Galicia 2014-2020 Program, grant ED431G 2019/01), Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Human-in-the-loop machine learning: a state of the art

  • Mosqueira-Rey, Eduardo
  • Hernández-Pereira, Elena
  • Alonso Ríos, David
  • Bobes-Bascarán, José
  • Fernández-Leal, Ángel
[Abstract]: Researchers are defining new types of interactions between humans and machine learning algorithms generically called human-in-the-loop machine learning. Depending on who is in control of the learning process, we can identify: active learning, in which the system remains in control; interactive machine learning, in which there is a closer interaction between users and learning systems; and machine teaching, where human domain experts have control over the learning process. Aside from control, humans can also be involved in the learning process in other ways. In curriculum learning human domain experts try to impose some structure on the examples presented to improve the learning; in explainable AI the focus is on the ability of the model to explain to humans why a given solution was chosen. This collaboration between AI models and humans should not be limited only to the learning process; if we go further, we can see other terms that arise such as Usable and Useful AI. In this paper we review the state of the art of the techniques involved in the new forms of relationship between humans and ML algorithms. Our contribution is not merely listing the different approaches, but to provide definitions clarifying confusing, varied and sometimes contradictory terms; to elucidate and determine the boundaries between the different methods; and to correlate all the techniques searching for the connections and influences between them., This work has been supported by the State Research Agency of the Spanish Government, Grant (PID2019-107194GB-I00/AEI/10.13039/501100011033) and by the Xunta de Galicia, Grant (ED431C 2022/44) with the European Union ERDF funds. We wish to acknowledge the support received from the Centro de Investigación de Galicia “CITIC”, funded by Xunta de Galicia and the European Union (European Regional Development Fund- Galicia 2014-2020 Program), by Grant ED431G 2019/01., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Addressing the data bottleneck in medical deep learning models using a human-in-the-loop machine learning approach

  • Mosqueira-Rey, Eduardo
  • Hernández-Pereira, Elena
  • Bobes-Bascarán, José
  • Alonso Ríos, David
  • Pérez-Sánchez, Alberto
  • Fernández-Leal, Ángel
  • Moret-Bonillo, Vicente
  • Vidal-Ínsua, Yolanda
  • Vázquez-Rivera, Francisca
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Any machine learning (ML) model is highly dependent on the data it uses for learning, and this is even more important in the case of deep learning models. The problem is a data bottleneck, i.e. the difficulty in obtaining an adequate number of cases and quality data. Another issue is improving the learning process, which can be done by actively introducing experts into the learning loop, in what is known as human-in-the-loop (HITL) ML. We describe an ML model based on a neural network in which HITL techniques were used to resolve the data bottleneck problem for the treatment of pancreatic cancer. We first augmented the dataset using synthetic cases created by a generative adversarial network. We then launched an active learning (AL) process involving human experts as oracles to label both new cases and cases by the network found to be suspect. This AL process was carried out simultaneously with an interactive ML process in which feedback was obtained from humans in order to develop better synthetic cases for each iteration of training. We discuss the challenges involved in including humans in the learning process, especially in relation to human–computer interaction, which is acquiring great importance in building ML models and can condition the success of a HITL approach. This paper also discusses the methodological approach adopted to address these challenges., This work has been supported by the State Research Agency of the Spanish Government (Grant PID2019-107194GB-I00/AEI/10.13039/501100011033) and by the Xunta de Galicia (Grant ED431C 2022/44), supported in turn by the EU European Regional Development Fund. We wish to acknowledge support received from the Centro de Investigación de Galicia CITIC, funded by the Xunta de Galicia and the European Regional Development Fund (Galicia 2014–2020 Program; Grant ED431G 2019/01). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01