Skip to main content

CARACTERIZACION DE NEOPLASIAS DE CELULAS FUSIFORMES EN IMAGENES HISTOLOGICAS

PID2019-105142RB-C21

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2019
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSITAT POLITÈCNICA DE VALÈNCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 17
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

A Deep Embedded Framework for Spitzoid Neoplasm Classification Using DNA Methylation Data

  • del Amor, Rocío
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Monteagudo, Carlos
  • Garzón, María José
  • García-Giménez, José Luis
[EN] Spitzoid melanocytic tumors (SMT) are a group of neoplasms that represent a formidable diagnostic challenge for dermatopathologists. DNA methylation (DNAm) is a welldefined epigenetic factor that has an important role in the development of these lesions. In this work, we propose different deep-learning-based approaches to address the Spitzoid neoplasms detection from DNAm. We use an autoencoder and a variational autoencoder for dimensionality reduction with a subsequently supervised classification. Additionally, we present a deep embedded refined clustering algorithm able to optimize the latent space at the same time that the non-supervised classification task is performed. This novel approach in DNAm supposes a step forward in the SMT detection as suggest the obtained results (acc = 0.9). Additionally, making use of the resulting model, we present a subspace-prototypical-based approach for the prognostic prediction of uncertain malignant potential samples, which is nowadays the hottest open area in SMT detection., This work has received funding from Horizon 2020, the European Union¿s Framework Programme for Research and Innovation, under grant agreement No. 860627 (CLARIFY), the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and SICAP (DPI2016-77869-C2-1-R) and GVA through project PROMETEO/2019/109
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A fusocelular skin dataset with whole slide images for deep learning models

  • del Amor, Rocío
  • López-Pérez, Miguel|||0000-0003-2965-0624
  • Meseguer-Esbrí, Pablo|||0000-0001-7821-6168
  • Morales, Sandra|||0000-0003-0763-1545
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Terradez, Liria
  • Aneiros-Fernandez, Jose
  • Mateos, Javier
  • Molina, Rafael
[EN] Cutaneous spindle cell (CSC) lesions encompass a spectrum from benign to malignant neoplasms, often posing significant diagnostic challenges. Computer-aided diagnosis systems offer a promising solution to make pathologists' decisions objective and faster. These systems usually require large-scale datasets with curated labels for effective training; however, manual annotation is time-consuming and expensive. To overcome this challenge, crowdsourcing has emerged as a popular and valuable strategy to scale up the labeling process by distributing the effort among different non-expert annotators. This work introduces AI4SkIN, the first public dataset Whole Slide Images (WSIs) for CSC neoplasms, annotated using an innovative crowdsourcing protocol. AI4SkIN dataset contains 641 Hematoxylin and Eosin stained WSIs with multiclass labels from both expert and trainee pathologists. The dataset improves CSC neoplasm diagnosis using advanced machine learning and crowdsourcing based on Gaussian Processes, showing that models trained on non-expert labels perform comparably to those using expert labels. In conclusion, we illustrate that AI4SkIN provides a good resource for developing and validating methods for multiclass CSC neoplasm classification., This work has received funding from the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 and PID2019-105142RB-C22 (AI4SkIN) and PID2022-140189OB-C21 and PID2022-140189OB-C22 (ASSIST), and Generalitat Valenciana through project COM-TACTS2 (CIPROM/2022/20). The work of Rocio del Amor was supported by the Spanish Ministry of Universities (FPU20/05263). The work of Pablo Meseguer was funded by valgrAI - Valencian Graduate School and Research Network of Artificial Intelligence. The work of Sandra Morales was co-funded by the Universitat Politecnica de Valencia through the program PAID-10-20. The work of M. Lopez-Perez was supported by the grant JDC2022-048318-I funded by MICIU/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Annotation protocol and crowdsourcing multiple instance learning classification of skin histological images: The CR-AI4SkIN dataset

  • del Amor, Rocío
  • Morales, Sandra|||0000-0003-0763-1545
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Pérez-Cano, Jose
  • López-Pérez, Miguel
  • Terradez, Liria
  • Aneiros-Fernandez, Jose
  • Mateos, Javier
  • Molina, Rafael
[EN] Digital Pathology (DP) has experienced a significant growth in recent years and has become an essential tool for diagnosing and prognosis of tumors. The availability of Whole Slide Images (WSIs) and the implementation of Deep Learning (DL) algorithms have paved the way for the appearance of Artificial Intelligence (AI) systems that support the diagnosis process. These systems require extensive and varied data for their training to be successful. However, creating labeled datasets in histopathology is laborious and time-consuming. We have developed a crowdsourcing-multiple instance labeling/learning protocol that is applied to the creation and use of the CR-AI4SkIN dataset.2 CR-AI4SkIN contains 271 WSIs of 7 Cutaneous Spindle Cell (CSC) neoplasms with expert and non-expert labels at region and WSI levels. It is the first dataset of these types of neoplasms made available. The regions selected by the experts are used to learn an automatic extractor of Regions of Interest (ROIs) from WSIs. To produce the embedding of each WSI, the representations of patches within the ROIs are obtained using a contrastive learning method, and then combined. Finally, they are fed to a Gaussian process-based crowdsourcing classifier, which utilizes the noisy non-expert WSI labels. We validate our crowdsourcing-multiple instance learning method in the CR-AI4SkIN dataset, addressing a binary classification problem (malign vs. benign). The proposed method obtains an F1 score of 0.7911 on the test set, outperforming three widely used aggregation methods for crowdsourcing tasks. Furthermore, our crowdsourcing method also outperforms the supervised model with expert labels on the test set (F1-score = 0.6035). The promising results support the proposed crowdsourcing multiple instance learning annotation protocol. It also validates the automatic extraction of interest regions and the use of contrastive embedding and Gaussian process classification to perform crowdsourcing classification tasks., This work has received funding from the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and Spanish Ministry of Science and Innovation through project PID2022-140189OB-C22, from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under the grant agreement No. 860627 (CLARIFY) , grant B-TIC-324-UGR20 funded by Consejeria de Universidad, Investigacion e Innovacion (Junta de Andalucia) and by "ERDF A way of making Europe", and GVA through the project INNEST/2021/321 (SAMUEL) . The work of Rocio del Amor has been supported by the Spanish Ministry of Universities (FPU20/05263) . The work of Miguel Lopez Perez has been supported by the University of Granada postdoctoral program "Contrato Puente". The work of Sandra Morales has been co-funded by the Universitat Politecnica de Valencia through the program PAID-10-20.r Union's Framework Programme for Research and Innovation, under the grant agreement No. 860627 (CLARIFY) , grant B-TIC-324-UGR20 funded by Consejeria de Universidad, Investigacion e Innovacion (Junta de Andalucia) and by "ERDF A way of making Europe", and GVA through the project INNEST/2021/321 (SAMUEL) . The work of Rocio del Amor has been supported by the Spanish Ministry of Universities (FPU20/05263) . The work of Miguel Lopez Perez has been supported by the University of Granada postdoctoral program "Contrato Puente". The work of Sandra Morales has been co-funded by the Universitat Politecnica de Valencia through the program PAID-10-20.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Proportion constrained weakly supervised histopathology image classification

  • Silva-Rodríguez, Julio
  • Schmidt, Arne
  • Sales, María A.
  • Molina, Rafael
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Multiple instance learning (MIL) deals with data grouped into bags of instances, of which only the global information is known. In recent years, this weakly supervised learning paradigm has become very popular in histological image analysis because it alleviates the burden of labeling all cancerous regions of large Whole Slide Images (WSIs) in detail. However, these methods require large datasets to perform properly, and many approaches only focus on simple binary classification. This often does not match the real-world problems where multi-label settings are frequent and possible constraints must be taken into account. In this work, we propose a novel multi-label MIL formulation based on inequality constraints that is able to incorporate prior knowledge about instance proportions. Our method has a theoretical foundation in optimization with log-barrier extensions, applied to bag-level class proportions. This encourages the model to respect the proportion ordering during training. Extensive experiments on a new public dataset of prostate cancer WSIs analysis, SICAP-MIL, demonstrate that using the prior proportion information we can achieve instance-level results similar to supervised methods on datasets of similar size. In comparison with prior MIL settings, our method allows for similar to 13% improvements in instance-level accuracy, and similar to 3% in the multi-label mean area under the ROC curve at the bag-level., This work was supported by the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C2. The work of A. Schmidt was funded from the European Union's Horizon 2020 research and innovation programme under the Marie SkAodowska Curie grant agreement No 860627 (CLARIFY Project). The hardware NVIDIA DGXA100 used in the experimental part of this work was funded by Generalitat Valenciana/European Union through the European Regional Development Fund (ERDF) of the Valencian Community (IDIFEDER/2020/030). Funding for open access charge: Universitat Politecnica de Valencia.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Constrained multiple instance learning for ulcerative colitis prediction using histological images

  • del Amor, Rocío
  • Meseguer-Esbrí, Pablo|||0000-0001-7821-6168
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Lorenzo Parigi, Tommaso
  • Villanacci, Vincenzo
  • Launet, Laetitia
  • Bazarova, Alina
  • Tontini, Gian Eugenio
  • Bisschops, Raf
  • De Hertogh, Gert
  • Ferraz, Jose G.
  • Götz, Martin
  • Gui, Xianyong
  • Hayee, Bu Hussain
  • Lazarev, Mark
[EN] Background and Objective: Ulcerative colitis (UC) is an inflammatory bowel disease (IBD) affecting the colon and the rectum characterized by a remitting-relapsing course. To detect mucosal inflammation as-sociated with UC, histology is considered the most stringent criteria. In turn, histologic remission (HR) correlates with improved clinical outcomes and has been recently recognized as a desirable treatment target. The leading biomarker for assessing histologic remission is the presence or absence of neutrophils. Therefore, the finding of this cell in specific colon structures indicates that the patient has UC activity. However, no previous studies based on deep learning have been developed to identify UC based on neu-trophils detection using whole-slide images (WSI). Methods: The methodological core of this work is a novel multiple instance learning (MIL) framework with location constraints able to determine the presence of UC activity using WSI. In particular, we put forward an effective way to introduce constraints about positive instances to effectively explore additional weakly supervised information that is easy to obtain and enjoy a significant boost to the learning process. In addition, we propose a new weighted embedding to enlarge the relevance of the positive instances. Results: Extensive experiments on a multi-center dataset of colon and rectum WSIs, PICASSO-MIL, demon-strate that using the location information we can improve considerably the results at WSI-level. In com-parison with prior MIL settings, our method allows for 10% improvements in bag-level accuracy. Conclusion : Our model, which introduces a new form of constraints, surpass the results achieved from current state-of-the-art methods that focus on the MIL paradigm. Our method can be applied to other histological concerns where the morphological features determining a positive WSI are tiny and similar to others in the image., This work has received funding from Horizon 2020, the European Unions Framework Programme for Research and Innovation, under grant agreement No. 860627 (CLARIFY) , the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and GVA through projects PROMETEO/2019/109 and INNEST/2021/321 (SAMUEL) . Roco del Amor and Adrin Colomer work have also been supported by the Spanish Government under FPU Grant (FPU20/05263) and the Universitat Politcnica de Valncia (PAID-10-21-Subprograma 1), respectively. We gratefully acknowledge the support from the Generalitat Valenciana (GVA) with the donation of the DGX A100 used for this work, action co-financed by the European Union through the Operational Program of the European Regional Development Fund of the Comunitat Valenciana 2014¿2020 (IDIFEDER/2020/030).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Self-learning for weakly supervised Gleason grading of local patterns

  • Silva-Rodríguez, Julio
  • Dolz, Jose
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Prostate cancer is one of the main diseases affecting men worldwide. The gold standard for diagnosis and prognosis is the Gleason grading system. In this process, pathologists manually analyze prostate histology slides under microscope, in a high time-consuming and subjective task. In the last years, computer-aided-diagnosis (CAD) systems have emerged as a promising tool that could support pathologists in the daily clinical practice. Nevertheless, these systems are usually trained using tedious and prone-to-error pixel-level annotations of Gleason grades in the tissue. To alleviate the need of manual pixel-wise labeling, just a handful of works have been presented in the literature. Furthermore, despite the promising results achieved on global scoring the location of cancerous patterns in the tissue is only qualitatively addressed. These heatmaps of tumor regions, however, are crucial to the reliability of CAD systems as they provide explainability to the system's output and give confidence to pathologists that the model is focusing on medical relevant features. Motivated by this, we propose a novel weakly-supervised deeplearning model, based on self-learning CNNs, that leverages only the global Gleason score of gigapixel whole slide images during training to accurately perform both, grading of patch-level patterns and biopsy-level scoring. To evaluate the performance of the proposed method, we perform extensive experiments on three different external datasets for the patch-level Gleason grading, and on two different test sets for global Grade Group prediction. We empirically demonstrate that our approach outperforms its supervised counterpart on patch-level Gleason grading by a large margin, as well as state-of-the-art methods on global biopsylevel scoring. Particularly, the proposed model brings an average improvement on the Cohen's quadratic kappa (kappa) score of nearly 18% compared to full-supervision for the patch-level Gleason grading task. This suggests that the absence of the annotator's bias in our approach and the capability of using large weakly labeled datasets during training leads to higher performing and more robust models. Furthermore, raw features obtained from the patchlevel classifier showed to generalize better than previous approaches in the literature to the subjective global biopsylevel scoring., This work was supported by the Spanish Ministry of Economy and Competitiveness through Projects DPI2016-77869 and PID2019-105142RB-C21.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Federating Medical Deep Learning Models from Private Jupyter Notebooks to Distributed Institutions

  • Launet, Laetitia Mariana
  • Wang, Yuandou
  • Koulouzis, Spiros
  • Bianchi, Riccardo
  • Mosquera-Zamudio, Andrés
  • Monteagudo, Carlos
  • Zhao, Zhiming
  • Colomer, Adrián|||0000-0002-7616-6029
  • Igual García, Jorge|||0000-0003-3408-4014
  • Pulgarín-Ospina, Cristian Camilo|||0000-0002-9759-3791
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Deep learning-based algorithms have led to tremendous progress over the last years, but they face a bottleneck as their optimal development highly relies on access to large datasets. To mitigate this limitation, cross-silo federated learning has emerged as a way to train collaborative models among multiple institutions without having to share the raw data used for model training. However, although artificial intelligence experts have the expertise to develop state-of-the-art models and actively share their code through notebook environments, implementing a federated learning system in real-world applications entails significant engineering and deployment efforts. To reduce the complexity of federation setups and bridge the gap between federated learning and notebook users, this paper introduces a solution that leverages the Jupyter environment as part of the federated learning pipeline and simplifies its automation, the Notebook Federator. The feasibility of this approach is then demonstrated with a collaborative model solving a digital pathology image analysis task in which the federated model reaches an accuracy of 0.8633 on the test set, as compared to the centralized configurations for each institution obtaining 0.7881, 0.6514, and 0.8096, respectively. As a fast and reproducible tool, the proposed solution enables the deployment of a cross-country federated environment in only a few minutes., This work has been partially funded by the European Union s Horizon 2020 research and innovation programme with the project CLARIFY under Marie Sklodowska-Curie (860627), ENVRI-FAIR (824068), BlueCloud (862409), and ARTICONF (825134). This work is also supported by LifeWatch ERIC, GVA through projects PROMETEO/2019/109 and INNEST/2021/321 (SAMUEL), and the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN). The work of Adrián Colomer has been supported by the ValgrAI Valencian Graduate School and Research Network for Artificial Intelligence & Generalitat Valenciana and Universitat Politècnica de València (PAID-PD-22).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A novel self-learning framework for bladder cancer grading using histopathological images

  • García-Pardo, José Gabriel
  • Esteve, Anna
  • Ramos, David
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] In recent times, bladder cancer has increased significantly in terms of incidence and mortality. Currently, two subtypes are known based on tumour growth: non-muscle invasive (NMIBC) and muscle-invasive bladder cancer (MIBC). In this work, we focus on the MIBC subtype because it has the worst prognosis and can spread to adjacent organs. We present a self-learning framework to grade bladder cancer from histological images stained by immunohistochemical techniques. Specifically, we propose a novel Deep Convolutional Embedded Attention Clustering (DCEAC) which allows for the classification of histological patches into different levels of disease severity, according to established patterns in the literature. The proposed DCEAC model follows a fully unsupervised two-step learning methodology to discern between non-tumour, mild and infiltrative patterns from high-resolution 512 x 512 pixel samples. Our system outperforms previous clustering-based methods by including a convolutional attention module, which enables the refinement of the features of the latent space prior to the classification stage. The proposed network surpasses state-of-the-art approaches by 2-3% across different metrics, reaching a final average accuracy of 0.9034 in a multi-class scenario. Furthermore, the reported class activation maps evidence that our model is able to learn by itself the same patterns that clinicians consider relevant, without requiring previous annotation steps. This represents a breakthrough in MIBC grading that bridges the gap with respect to training the model on labelled data., This work has been partially funded by the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska Curie grant agreement No 860627 (CLARIFY Project), the State Research Spanish Agency under the AI4SKIN project (PID2019- 105142RB-C21) and GVA through project PROMETEO/2019/109. The work of Gabriel García has been supported by the State Research Spanish Agency PTA2017-14610-I. The equipment used for this research has been funded by the European Union within the operating Program ERDF of the Valencian Community 2014-2020 with the grant number IDIFEDER/2020/030.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Labeling confidence for uncertainty-aware histology image classification

  • del Amor, Rocío
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Silva-Rodríguez, Julio
[EN] Deep learning-based models applied to digital pathology require large, curated datasets with high-quality (HQ) annotations to perform correctly. In many cases, recruiting expert pathologists to annotate large databases is not feasible, and it is necessary to collect additional labeled data with varying label qualities, e.g., pathologists-in-training (henceforth, non-expert annotators). Learning from datasets with noisy labels is more challenging in medical applications since medical imaging datasets tend to have instance-dependent noise and suffer from high inter/intra-observer variability. In this paper, we design an uncertainty-driven labeling strategy with which we generate soft labels from 10 non-expert annotators for multi-class skin cancer classification. Based on this soft annotation, we propose an uncertainty estimation-based framework to handle these noisy labels. This framework is based on a novel formulation using a dual-branch min-max entropy calibration to penalize inexact labels during the training. Comprehensive experiments demonstrate the promising performance of our labeling strategy. Results show a consistent improvement by using soft labels with standard cross-entropy loss during training (similar to 4.0% F1-score) and increases when calibrating the model with the proposed min-max entropy calibration (similar to 6.6% F1-score). These improvements are produced at negligible cost, both in terms of annotation and calculation., Funding from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under the grant agreement No. 860627 (CLARIFY) , the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and GVA through the project INNEST/2021/321 (SAMUEL). The work of Rocio del Amor has been supported by the Spanish Ministry of Universities (FPU20/05263). The work of J. Silva-Rodriguez was carried out during his previous position at Universitat Politecnica de Valencia.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

ProGleason-GAN: Conditional Progressive Growing GAN for prostatic cancer Gleason Grade patch synthesis

  • Golfe-San Martín, Alejandro|||0000-0001-5095-9904
  • del Amor, Rocío
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Sales, María A.
  • Terradez, Liria
[EN] Background and objective: Prostate cancer is one of the most common diseases affecting men. The main diagnostic and prognostic reference tool is the Gleason scoring system. An expert pathologist assigns a Gleason grade to a sample of prostate tissue. As this process is very time-consuming, some artificial intelligence applications were developed to automatize it. The training process is often confronted with insufficient and unbalanced databases which affect the generalisability of the models. Therefore, the aim of this work is to develop a generative deep learning model capable of synthesising patches of any selected Gleason grade to perform data augmentation on unbalanced data and test the improvement of classification models.Methodology: The methodology proposed in this work consists of a conditional Progressive Growing GAN (ProGleason-GAN) capable of synthesising prostate histopathological tissue patches by selecting the desired Gleason Grade cancer pattern in the synthetic sample. The conditional Gleason Grade information is introduced into the model through the embedding layers, so there is no need to add a term to the Wasserstein loss function. We used minibatch standard deviation and pixel normalisation to improve the performance and stability of the training process.Results: The reality assessment of the synthetic samples was performed with the Frechet Inception Distance (FID). We obtained an FID metric of 88.85 for non-cancerous patterns, 81.86 for GG3, 49.32 for GG4 and 108.69 for GG5 after post-processing stain normalisation. In addition, a group of expert pathologists was selected to perform an external validation of the proposed framework. Finally, the application of our proposed framework improved the classification results in SICAPv2 dataset, proving its effectiveness as a data augmentation method.Conclusions: ProGleason-GAN approach combined with a stain normalisation post-processing provides state-of-the-art results regarding Frechet's Inception Distance. This model can synthesise samples of noncancerous patterns, GG3, GG4 or GG5. The inclusion of conditional information about the Gleason grade during the training process allows the model to select the cancerous pattern in a synthetic sample. The proposed framework can be used as a data augmentation method., This work has received funding & nbsp;from Horizon 2020 , the European Union's Framework Programme for Research and Innovation, under grant agreement no. 860627 (CLARIFY), the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and GVA through projects PROME-TEO/2019/109 and INNEST/2021/321 (SAMUEL). The work of Adrian Colomer has been supported by the ValgrAI - Valencian Graduate School and Research Network for Artificial Intelligence & Generalitat Valenciana and Universitat Politecnica de Valencia (PAID-PD-22). Rocio del Amor has been supported by the Spanish Government under FPU Grant (FPU20/05263).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

MICIL: Multiple-Instance Class-Incremental Learning for skin cancer whole slide images

  • Meseguer-Esbrí, Pablo|||0000-0001-7821-6168
  • del Amor, Rocío
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Artificial intelligence (AI) agents encounter the problem of catastrophic forgetting when they are trained in sequentially with new data batches. This issue poses a barrier to the implementation of AI -based models in tasks that involve ongoing evolution, such as cancer prediction. Moreover, whole slide images (WSI) play a crucial role in cancer management, and their automated analysis has become increasingly popular in assisting pathologists during the diagnosis process. Incremental learning (IL) techniques aim to develop algorithms capable of retaining previously acquired information while also acquiring new insights to predict future data. Deep IL techniques need to address the challenges posed by the gigapixel scale of WSIs, which often necessitates the use of multiple instance learning (MIL) frameworks. In this paper, we introduce an IL algorithm tailored for analyzing WSIs within a MIL paradigm. The proposed M ultiple I nstance C lass- I ncremental L earning ( MICIL ) algorithm combines MIL with class-IL for the first time, allowing for the incremental prediction of multiple skin cancer subtypes from WSIs within a class-IL scenario. Our framework incorporates knowledge distillation and data rehearsal, along with a novel embedding-level distillation, aiming to preserve the latent space at the aggregated WSI level. Results demonstrate the algorithm's effectiveness in addressing the challenge of balancing IL-specific metrics, such as intransigence and forgetting, and solving the plasticity-stability dilemma., This work has received funding from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under grant agreement No. 860627 (CLARIFY), the Spanish Ministry of Economy and Competitiveness through projects PID2019-105142RB-C21(AI4SKIN) and PID2022-140189OB-C21 (ASSIST), and GVA through the project INNEST/2021/321 (SAMUEL). The work of Rocio del Amorand Pablo Meseguer has been supported by the Spanish Ministry of Universities under an FPU Grant (FPU20/05263) and valgrAI - Valencian Graduate School and Research Network of Artificial Intelligence, respectively.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Efficient Cancer Classification by Coupling Semi Supervised and Multiple Instance Learning

  • Schmidt, Arne
  • Silva-Rodríguez, Julio
  • Molina, Rafael
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] The annotation of large datasets is often the bottleneck in the successful application of artificial intelligence in computational pathology. For this reason recently Multiple Instance Learning (MIL) and Semi Supervised Learning (SSL) approaches are gaining popularity because they require fewer annotations. In this work we couple SSL and MIL to train a deep learning classifier that combines the advantages of both methods and overcomes their limitations. Our method is able to learn from the global WSI diagnosis and a combination of labeled and unlabeled patches. Furthermore, we propose and evaluate an efficient labeling paradigm that guarantees a strong classification performance when combined with our learning framework. We compare our method to SSL and MIL baselines, the state-of-the-art and completely supervised training. With only a small percentage of patch labels our proposed model achieves a competitive performance on SICAPv2 (Cohen's kappa of 0.801 with 450 patch labels), PANDA (Cohen's kappa of 0.794 with 22,023 patch labels) and Camelyon16 (ROC AUC of 0.913 with 433 patch labels). Our code is publicly available at https://github.com/arneschmidt/ssl_and_mil_cancer_classification., This work was supported in part by the European Union's Horizon 2020 Research and Innovation Program through the Marie Skodowska Curie (Cloud Artificial Intelligence For pathologY (CLARIFY) Project) under Grant 860627, and in part by the Spanish Ministry of Science and Innovation under Project PID2019-105142RB-C22.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

WeGleNet: A Weakly-Supervised Convolutional Neural Network for the Semantic Segmentation of Gleason Grades in Prostate Histology Images

  • Silva-Rodríguez, Julio
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Background and objective: Prostate cancer is one of the main diseases affecting men worldwide. The Gleason scoring system is the primary diagnostic tool for prostate cancer. This is obtained via the visual analysis of cancerous patterns in prostate biopsies performed by expert pathologists, and the aggregation of the main Gleason grades in a combined score. Computer-aided diagnosis systems allow to reduce the workload of pathologists and increase the objectivity. Nevertheless, those require a large number of labeled samples, with pixel level annotations performed by expert pathologists, to be developed. Recently, efforts have been made in the literature to develop algorithms aiming the direct estimation of the global Gleason score at biopsy/core level with global labels. However, these algorithms do not cover the accurate localization of the Gleason patterns into the tissue. These location maps are the basis to provide a reliable computer-aided diagnosis system to the experts to be used in clinical practice by pathologists. In this work, we propose a deep-learning-based system able to detect local cancerous patterns in the prostate tissue using only the global-level Gleason score obtained from clinical records during training. Methods: The methodological core of this work is the proposed weakly-supervised-trained convolutional neural network, WeGleNet, based on a multi-class segmentation layer after the feature extraction module, a global aggregation, and the slicing of the background class for the model loss estimation during training. Results: Using a public dataset of prostate tissue-micro arrays, we obtained a Cohen's quadratic kappa (kappa) of 0.67 for the pixel-level prediction of cancerous patterns in the validation cohort. We compared the model performance for semantic segmentation of Gleason grades with supervised state-of-the-art architectures in the test cohort. We obtained a pixel-level kappa of 0.61 and a macro-averaged f1-score of 0.58, at the same level as fully-supervised methods. Regarding the estimation of the core-level Gleason score, we obtained a kappa of 0.76 and 0.67 between the model and two different pathologists. Conclusions: WeGleNet is capable of performing the semantic segmentation of Gleason grades similarly to fully supervised methods without requiring pixel-level annotations. Moreover, the model reached a performance at the same level as inter-pathologist agreement for the global Gleason scoring of the cores., This work was supported by the Spanish Ministry of Economy and Competitiveness through projects DPI2016-77869 and PID2019-105142RB-C21.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A deep embedded refined clustering approach for breast cancer distinction based on DNA methylation

  • del Amor, Rocío
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Monteagudo, Carlos
[EN] Epigenetic alterations have an important role in the development of several types of cancer. Epigenetic studies generate a large amount of data, which makes it essential to develop novel models capable of dealing with large-scale data. In this work, we propose a deep embedded refined clustering method for breast cancer differentiation based on DNA methylation. In concrete, the deep learning system presented here uses the levels of CpG island methylation between 0 and 1. The proposed approach is composed of two main stages. The first stage consists in the dimensionality reduction of the methylation data based on an autoencoder. The second stage is a clustering algorithm based on the soft assignment of the latent space provided by the autoencoder. The whole method is optimized through a weighted loss function composed of two terms: reconstruction and classification terms. To the best of the authors¿ knowledge, no previous studies have focused on the dimensionality reduction algorithms linked to classification trained end-to-end for DNA methylation analysis. The proposed method achieves an unsupervised clustering accuracy of 0.9927 and an error rate (%) of 0.73 on 137 breast tissue samples. After a second test of the deep-learning-based method using a different methylation database, an accuracy of 0.9343 and an error rate (%) of 6.57 on 45 breast tissue samples are obtained. Based on these results, the proposed algorithm outperforms other state-of-the-art methods evaluated under the same conditions for breast cancer classification based on DNA methylation data., This work has received funding from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under grant Agreement No. 860627 (CLARIFY), the Spanish Ministry of Economy and Competitiveness through project PID2019105142RB-C21 (AI4SKIN) and SICAP (DPI2016-77869-C2-1-R) and GVA through Project PROMETEO/2019/109.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A Spitzoid Tumor dataset with clinical metadata and Whole Slide Images for Deep Learning models

  • Mosquera-Zamudio, Andrés
  • Launet, Laetitia Mariana
  • Moscardó, Anaïs
  • Monteagudo, Carlos
  • del Amor, Rocío
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Spitzoid tumors (ST) are a group of melanocytic tumors of high diagnostic complexity. Since 1948, when Sophie Spitz first described them, the diagnostic uncertainty remains until now, especially in the intermediate category known as Spitz tumor of unknown malignant potential (STUMP) or atypical Spitz tumor. Studies developing deep learning (DL) models to diagnose melanocytic tumors using whole slide imaging (WSI) are scarce, and few used ST for analysis, excluding STUMP. To address this gap, we introduce SOPHIE: the first ST dataset with WSIs, including labels as benign, malignant, and atypical tumors, along with the clinical information of each patient. Additionally, we explain two DL models implemented as validation examples using this database., This work has received funding from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under the grant agreement No. 860627 (CLARIFY), PI20/ 00094, Instituto de Salud Carlos III and FEDER European Funds, INNEST/2021/321 (SAMUEL) and the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN). The work of Rocio del Amor has been supported by the Spanish Ministry of Universities (FPU20/05263), and that of Adrian Colomer has been supported by the ValgrAI - Valencian Graduate School and Research Network for Artificial Intelligence & Generalitat Valenciana and Universitat Politecnica de Valencia (PAID-PD-22).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

HistoColAi: An open-source web platform for collaborative digital histology image annotation with AI-driven predictive integration

  • Pulgarín-Ospina, Cristian Camilo|||0000-0002-9759-3791
  • del Amor, Rocío
  • Colomer, Adrián|||0000-0002-7616-6029
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
  • Silva-Rodríguez, Julio José
[EN] Digital pathology is now a standard component of the pathology workflow, offering numerous benefits such as high-detail whole slide images and the capability for immediate case sharing between hospitals. Recent advances in deep learning-based methods for image analysis make them a potential aid in digital pathology. However, A significant challenge in developing computer-aided diagnostic systems for pathology is the lack of intuitive, open-source web applications for data annotation. This paper proposes a web service that efficiently provides a tool to visualize and annotate digitized histological images, integrating AI-driven predictive insights. While the tool is capable of handling various image formats, its primary use case is for Whole Slide Imaging (WSI) in the TIFF format, specifically tailored for histopathology applications. This innovative integration not only revolutionizes accessibility but also democratizes the utilization of complex deep-learning models for pathologists unfamiliar with such tools. Moreover, to demonstrate the effectiveness of this approach, we present a use case centered on the diagnosis of spindle cell skin neoplasm involving multiple annotators. Additionally, we conduct a usability study, showing the feasibility of the developed tool., This work has received funding from Horizon 2020, the European Union's Framework Programme for Research and Innovation, under the grant agreement No. 860627 (CLARIFY) , the Spanish Ministry of Economy and Competitiveness through project PID2019-105142RB-C21 (AI4SKIN) and GVA through the project INNEST/2021/321 (SAMUEL) . he work of Cristian Camilo Pulgarin Ospina has been supported by the Spanish State Research Agency (PRE2020-093271) . The work of Rocio del Amor has been supported by the Spanish Ministry of Universities (FPU20/05263) . The work of J. Silva-Rodriguez was carried out during his previous position at Universitat Politecnica de Valencia. We gratefully acknowledge the support from the Generalitat Valenciana (GVA) with the donation of the DGX A100 used for this work, an action co-financed by the European Union through the Operational Program of the European Regional Development Fund of the Comunitat Valenciana 2014 2020 (IDIFEDER/2020/030).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Automatic Segmentation of the Retinal Nerve Fiber Layer by Means of Mathematical Morphology and Deformable Models in 2D Optical Coherence Tomography Imaging

  • Berenguer-Vidal, Rafael
  • Verdú-Monedero, Rafael
  • Morales-Sánchez, Juan
  • Sellés-Navarro, Inmaculada
  • García-Pardo, José Gabriel
  • del Amor, Rocío
  • Naranjo Ornedo, Valeriana|||0000-0002-0181-3412
[EN] Glaucoma is a neurodegenerative disease process that leads to progressive damage of the optic nerve to produce visual impairment and blindness. Spectral-domain OCT technology enables peripapillary circular scans of the retina and the measurement of the thickness of the retinal nerve fiber layer (RNFL) for the assessment of the disease status or progression in glaucoma patients. This paper describes a new approach to segment and measure the retinal nerve fiber layer in peripapillary OCT images. The proposed method consists of two stages. In the first one, morphological operators robustly detect the coarse location of the layer boundaries, despite the speckle noise and diverse artifacts in the OCT image. In the second stage, deformable models are initialized with the results of the previous stage to perform a fine segmentation of the boundaries, providing an accurate measurement of the entire RNFL. The results of the RNFL segmentation were qualitatively assessed by ophthalmologists, and the measurements of the thickness of the RNFL were quantitatively compared with those provided by the OCT inbuilt software as well as the state-of-the-art methods., This work was partially funded by Spanish National projects AES2017-PI17/00771 and AES2017-PI17/00821 (Instituto de Salud Carlos III), PID2019-105142RB-C21 (AI4SKIN) (Spanish Ministry of Economy and Competitiveness), PTA2017-14610-I (State Research Spanish Agency), regional project 20901/PI/18 (Fundacion Seneca) and Polytechnic University of Valencia (PAID-01-20).