Pasar al contenido principal

INTELIGENCIA ARTIFICIAL INSESGADA Y EXPLICABLE PARA IMAGENES MEDICAS

PID2020-116907RB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 48
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer's disease and neurodegeneration stratified by sex

  • Cumplido-Mayoral, Irene
  • Operto, Grégory
  • Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Minguillón, Carolina
  • Suárez-Calvet, Marc
  • Gispert, Juan Domingo
  • OASIS study
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer's disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD, and OASIS. Brain-age delta was associated with abnormal amyloid-β, more advanced stages (AT) of AD pathology and APOE-ε4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging in non-demented individuals with abnormal levels of biomarkers of AD and axonal injury., The project leading to these results has received funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa-17–519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2017-SGR-892 and the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033. FB is supported by the NIHR biomedical research center at UCLH. MSC receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677), the Instituto de Salud Carlos III (PI19/00155), and from a fellowship from ”la Caixa” Foundation (ID 100010434) and from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Neuroimaging-derived biological brain age and its associations with glial reactivity and synaptic dysfunction cerebrospinal fluid biomarkers

  • Cumplido-Mayoral, Irene
  • Sánchez Benavides, Gonzalo
  • Vilor Tejedor, Natàlia, 1988-
  • López-Martos, David
  • Brugulat Serrat, Anna, 1986-
  • Milà Alomà, Marta
  • Falcón, Carles
  • Cacciaglia, Raffaele
  • Minguillón, Carolina
  • Fauria, Karine
  • Kollmorgen, Gwendlyn
  • Quijano-Rubio, Clara
  • Molinuevo, José Luis
  • Grau, Oriol (Grau Rivera)
  • Suárez-Calvet, Marc
  • Vilaplana, Verónica
  • Gispert, Juan Domingo
  • ALFA Study
  • ADNI
Magnetic resonance Imaging (MRI)-derived brain-age prediction is a promising biomarker of biological brain aging. Accelerated brain aging has been found in Alzheimer's disease (AD) and other neurodegenerative diseases. However, no previous studies have investigated the relationship between specific pathophysiological pathways in AD and biological brain aging. Here, we studied whether glial reactivity and synaptic dysfunction are associated with biological brain aging in the earliest stages of the Alzheimer's continuum, and if these mechanisms are differently associated with AD-related cortical atrophy. We further evaluated their effects on cognitive decline. We included 380 cognitively unimpaired individuals from the ALFA+ study, for which we computed their brain-age deltas by subtracting chronological age from their brain age predicted by machine learning algorithms. We studied the cross-sectional linear associations between brain-age delta and cerebrospinal fluid (CSF) biomarkers of synaptic dysfunction (neurogranin, GAP43, synaptotagmin-1, SNAP25, and α-synuclein), glial reactivity (sTREM2, YKL-40, GFAP, and S100b) and inflammation (interleukin-6). We also studied the cross-sectional linear associations between AD signature and these CSF biomarkers, We further evaluated the mechanisms linking baseline brain-age delta and longitudinal cognitive decline by performing mediation analyses. To reproduce our findings on an independent cohort, we included 152 cognitively unimpaired and 310 mild cognitive impaired (MCI) individuals from the ADNI study. We found that higher CSF sTREM2 was associated with a younger brain-age after adjusting for AD pathology, both in ALFA+ cognitively unimpaired and in ADNI MCI individuals. Furthermore, we found that CSF sTREM2 fully mediated the link between older brain-age and cognitive decline in ALFA+. In summary, we showed that the protective microglial state reflected by higher CSF sTREM2 has a beneficial impact on biological brain aging that may partly explains the variability in cognitive decline in early AD stages, independently of AD pathology., The study was approved by the Independent Ethics Committee “Parc de Salut Mar,” Barcelona, and all participants gave written informed consent. The ALFA+ study receives funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2021 SGR 009132017-SGR-892. MS-C receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677); ERA PerMed (ERAPERMED2021-184); Project “PI19/00155” and “PI22/00456, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER); and from a fellowship from ”la Caixa” Foundation (ID 100010434) and the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004). DLM is supported by the project PI19/00117, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER). VV has been supported by the project PID2020-116907RB-I00, funded by the Ministry of Science and Innovation - State Research Agency, MCIN/ AEI /10.13039/501100011033. GSB is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2020-119556RA-I00 and by the Instituto de Salud Carlos III (ISCIII) through the project CP23/00039 (Miguel Servet contract), co-funded by the European Union (FSE+). OGR receives funding from the Alzheimer’s Association Research Fellowship Program (2019-AARF-644568), from Instituto de Salud Carlos III co-funded by the European Union (FEDER) (PI19/00117) and from Ministry of Science and Innovation - State Research Agency MCIN/ AEI /10.13039/501100011033 co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043417-I). NV-T is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033, co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043216-I). In addition, NV-T receives funding from the Alzheimer’s Disease Data Initiative (ADDI) through the William H. Gates Sr. Fellowship program, and the PID2022-143106OA-I00 project, funded by MCIN/AEI /10.13039/501100011033 and co-funded by the European Union (FEDER). RC is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2021-125433OA-100 (co-funded by the European Union (FEDER)) and a Ramón y Cajal contract (RYC2021-031128-I, co-funded by the European Union «NextGenerationEU»/PRTR).
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

DigiPatICS: Digital Pathology Transformation of the Catalan Health Institute Network of 8 hospitals—planification, implementation, and preliminary results

  • Temprana Salvador, Jordi
  • López García, Pablo
  • Castellví Vives, Josep
  • Haro Martín, Luis de
  • Ballesta Carbonell, Eudald
  • Rojas Abusleme, Matias
  • Arrufat Vila, Miquel
  • Marqués Acosta, Fernando|||0000-0001-8311-1168
  • Casas Pla, Josep Ramon|||0000-0003-4639-6904
  • Gallego Pérez, Carles
Complete digital pathology transformation for primary histopathological diagnosis is a challenging yet rewarding endeavor. Its advantages are clear with more efficient workflows, but there are many technical and functional difficulties to be faced. The Catalan Health Institute (ICS) has started its DigiPatICS project, aiming to deploy digital pathology in an integrative, holistic, and comprehensive way within a network of 8 hospitals, over 168 pathologists, and over 1 million slides each year. We describe the bidding process and the careful planning that was required, followed by swift implementation in stages. The purpose of the DigiPatICS project is to increase patient safety and quality of care, improving diagnosis and the efficiency of processes in the pathological anatomy departments of the ICS through process improvement, digital pathology, and artificial intelligence tools., This project was funded by European Regional Development Funds, Programa operatiu FEDER de Catalunya 2014–2020 and SA18-014623 DIGIPATICS. UPC activity in this project was partially supported by PID2020-116907RB-I00 and funded by MCIN/AEI/10.13039/501100011033, Peer Reviewed, Article signat per 18 autors/es: Jordi Temprana-Salvador (1), Pablo López-García (2), Josep Castellví Vives (1),Lluís de Haro (2), Eudald Ballesta (2), Matias Rojas Abusleme (3), Miquel Arrufat (4), Ferran Marques (5), Josep R. Casas (5),Carlos Gallego (6), Laura Pons (7), José Luis Mate (7), Pedro Luis Fernández (7), Eugeni López-Bonet (8), Ramon Bosch (9), Salomé Martínez (10), Santiago Ramón y Cajal (1), and Xavier Matias-Guiu (11,12) // (1) Department of Pathology, Vall d’Hebron University Hospital, CIBERONC, 08035 Barcelona, Spain; (2) Functional Competence Center, Information Systems, Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (3) Center for Telecommunications and Information Technology (Centre de Telecomunicacions i Tecnologies de la Informació, CTTI), Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (4) Economic and Financial Management, Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (5) Image Processing Group, Technical University of Catalonia (UPC), 08034 Barcelona, Spain; (6) Digital Medical Imaging System of Catalonia (SIMDCAT), TIC Salut, 08005 Barcelona, Spain, (7) Department of Pathology, Germans Trias i Pujol University Hospital, 08916 Badalona, Spain; (8) Department of Pathology, Doctor Josep Trueta Hospital of Girona, 17007 Girona, Spain; (9) Department of Pathology, Verge de la Cinta Hospital of Tortosa, 43500 Tarragona, Spain; (10) Department of Pathology, Joan XXIII University Hospital of Tarragona, 43005 Tarragona, Spain; (11) Department of Pathology, Arnau de Vilanova University Hospital, 25198 Lleida, Spain, (12) Department of Pathology, Bellvitge University Hospital, CIBERONC, 08907 Barcelona, Spain
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Structural networks for brain age prediction

  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Cumplido Mayoral, Irene
  • Cacciaglia, Raffaele
  • González-de-Echávarri, Jose María
  • Gispert López, Juan Domingo
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Biological networks have gained considerable attention within the Deep Learning community because of the promising framework of Graph Neural Networks (GNN), neural models that operate in complex networks. In the context of neuroimaging, GNNs have successfully been employed for functional MRI processing but their application to ROI-level structural MRI (sMRI) remains mostly unexplored. In this work we analyze the implementation of these geometric models with sMRI by building graphs of ROIs (ROI graphs) using tools from Graph Signal Processing literature and evaluate their performance in a downstream supervised task, age prediction. We first make a qualitative and quantitative comparison of the resulting networks obtained with common graph topology learning strategies. In a second stage, we train GNN-based models for brain age prediction. Since the order of every ROI graph is exactly the same and each vertex is an entity by itself (a ROI), we evaluate whether including ROI information during message-passing or global pooling operations is beneficial and compare the performance of GNNs against a Fully-Connected Neural Network baseline. The results show that ROI-level information is needed during the global pooling operation in order to achieve competitive results. However, no relevant improvement has been detected when it is incorporated during the message passing. These models achieve a MAE of 4.27 in hold-out test data, which is a performance very similar to the baseline, suggesting that the inductive bias included with the obtained graph connectivity is relevant and useful to reduce the dimensionality of the problem., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

The mediating role of neuroimaging-derived biological brain age in the association between risk factors for dementia and cognitive decline in middle-aged and older individuals without cognitive impairment: a cohort study

  • Cumplido Mayoral, Irene
  • Brugulat Serrat, Anna
  • Sánchez Benavides, Gonzalo
  • González Escalante, Armand
  • Anastasi, Federica
  • Milà Alomà, Marta
  • López Martos, David
  • Akinci, Muge
  • Falcón Falcón, Carles
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Background: Neuroimaging-based brain-age delta has been shown to be a mediator linking cardiovascular risk factors to cognitive function. We aimed to assess the mediating role of brain-age delta in the association between modifiable risk factors of dementia and longitudinal cognitive decline in middle-aged and older individuals who are asymptomatic, stratified by Alzheimer's disease pathology. We also explored whether the mediation effect is specific to cognitive domain. Methods: In this cohort study, we included participants from the ALFA+ cohort aged between 45 years and 65 years who were cognitively unimpaired and who had available structural MRI, cerebrospinal fluid ß-amyloid (Aß)42 and Aß40 measurements obtained within 1 year of each other, modifiable risk factors assessment, and cognitive evaluation over 3 years. Participants were recruited from the Barcelonaßeta Brain Research Center (Barcelona, Spain). Included individuals underwent a first assessment between Oct 25, 2016, and Jan 28, 2020, and a follow-up cognitive assessment 3·28 (SD 0·27) years later. We computed brain-age delta and composites of different cognitive function domains (preclinical Alzheimer's cognitive composite [PACC], attention, executive function, episodic memory, visual processing, and language). We used partial least squares path modelling to explore mediation effects in the associations between modifiable risk factors (including cardiovascular, mental health, mood, metabolic or endocrine history, and alcohol use) and changes in cognitive composites. To assess the role of Alzheimer's disease pathology, we computed separate models for Aß-negative and Aß-positive individuals. Findings: Of the 419 participants enrolled in ALFA+, 302 met our inclusion criteria, of which 108 participants were classified as Aß-positive and 194 as Aß-negative. In Aß-positive individuals, brain-age delta partially mediated (percent mediation proportion 15·73% [95% CI 14·22–16·66]) the association between modifiable risk factors and decline in overall cognition (across cognitive domains). Brain-age delta fully mediated (mediation proportion 28·03% [26·25–29·21]) the effect of modifiable risk factors on the PACC, wherein increased values for risk factors correlated with an older brain-age delta, and, consequently, an older brain-age delta was linked to greater PACC decline. This effect appears to be primarily driven by memory decline. Mediation was not significant in Aß-negative individuals (3·52% [0·072–4·17]) on PACC, although path coefficients were not significantly different from those in the Aß-positive group. Interpretation: Our findings suggest that brain-age delta captures the association between modifiable risk factors and longitudinal cognitive decline in middle-aged and older people. In asymptomatic middle-aged and older individuals who are Aß-positive, the pathology might be the strongest driver of cognitive decline, whereas the effect of risk factors is smaller. Our results highlight the potential of brain-age delta as an objective outcome measure for preventive lifestyle interventions targeting cognitive decline., The ALFA+ study receives funding from La Caixa Foundation (100010434; LCF/PR/GN17/50300004) and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government (2021 SGR 009132017-SGR-892). MS-C receives funding from the European Research Council under the EU Horizon 2020 research and innovation programme (948677; project PI19/00155), funded by Instituto de Salud Carlos III and co-funded by the EU, and from a fellowship from La Caixa Foundation (100010434) and from the EU Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant (847648; LCF/BQ/PR21/11840004). DL-M is supported by Instituto de Salud Carlos III (PI19/00117; co-funded by European Regional Development Fund, European Social Fund A Way to Make Europe, and Investing in your Future). EMA-U is supported by the Spanish Ministry of Science and Innovation State Research Agency (RYC2018-026053-I), cofunded by the European Social Fund and the Spanish Ministry of Science and Innovation (PID2019-111514RA-I00). VV has been supported by the Spanish Research Agency (PID2020-116907RB-I00 of the call MCIN/ AEI/10.13039/501100011033). JDG is supported by the Spanish Ministry of Science and Innovation (RYC-2013-13054). JDG has also received research support from the EU and European Federation of Pharmaceutical Industries and Associations Innovative Medicines Initiative Joint Undertaking AMYPAD (115952), European Institute of Innovation and Technology Digital (2021), and from Ministerio de Ciencia y Universidades (RTI2018-102261). GS-B receives funding from the Ministerio de Ciencia e Innovacion, Spanish Research Agency (PID2020119556RA-I00). OG-R receives funding from the Alzheimer’s Association Research Fellowship (2019-AARF-644568), from Instituto de Salud Carlos III (PI19/00117), and from the Spanish Ministry of Science, Innovation and Universities (Juan de la Cierva programme IJC2020-043417-I)., Peer Reviewed, Article signat per 19 autors/autores: Irene Cumplido-Mayoral, Anna Brugulat-Serrat, Gonzalo Sánchez-Benavides, Armand González-Escalante, Federica Anastasi, Marta Milà-Alomà, David López-Martos, Muge Akinci, Carles Falcón, Mahnaz Shekari, Raffaele Cacciaglia, Eider M Arenaza-Urquijo, Carolina Minguillón, Karine Fauria, José Luis Molinuevo, Marc Suárez-Calvet, Oriol Grau-Rivera, Verónica Vilaplana, Juan Domingo Gispert, on behalf of the ALFA study*. * Membres del grup "ALFA study": Annabella Beteta, Alba Cañas, Marta del Campo, Carme Deulofeu, Ruth Dominguez, Maria Emilio, Ana Fernández-Arcos, Sherezade Fuentes, Patricia Genius, Laura Hernández, Jordi Huguet, Wiesje Pelkmans, Albina Polo, Sandra Pradas, Blanca Rodríguez-Fernández, Anna Soteras, Laura Stankeviciute, Marc Vilanova, Natalia Vilor-Tejedor.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Context-unsupervised adversarial network for video sensors

  • Canet Tarrés, Gemma
  • Pardàs Feliu, Montse|||0000-0002-5861-6356
This paper is an extended version of our conference paper: Pardàs, M. and Canet, G. Refinement Network for unsupervised on the scene Foreground Segmentation. In Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands , 18–21 January 2021., Foreground object segmentation is a crucial first step for surveillance systems based on networks of video sensors. This problem in the context of dynamic scenes has been widely explored in the last two decades, but it still has open research questions due to challenges such as strong shadows, background clutter and illumination changes. After years of solid work based on statistical background pixel modeling, most current proposals use convolutional neural networks (CNNs) either to model the background or to make the foreground/background decision. Although these new techniques achieve outstanding results, they usually require specific training for each scene, which is unfeasible if we aim at designing software for embedded video systems and smart cameras. Our approach to the problem does not require specific context or scene training, and thus no manual labeling. We propose a network for a refinement step on top of conventional state-of-the-art background subtraction systems. By using a statistical technique to produce a rough mask, we do not need to train the network for each scene. The proposed method can take advantage of the specificity of the classic techniques, while obtaining the highly accurate segmentation that a deep learning system provides. We also show the advantage of using an adversarial network to improve the generalization ability of the network and produce more consistent results than an equivalent non-adversarial network. The results provided were obtained by training the network on a common database, without fine-tuning for specific scenes. Experiments on the unseen part of the CDNet database provided 0.82 a F-score, and 0.87 was achieved for LASIESTA databases, which is a database unrelated to the training one. On this last database, the results outperformed by 8.75% those available in the official table. The results achieved for CDNet are well above those of the methods not based on CNNs, and according to the literature, among the best for the context-unsupervised CNNs systems., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Bridging domains in melanoma diagnostics: predicting BRAF mutations and sentinel lymph node positivity with attention-based models in histological images

  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Jiménez Martín, Lauren|||0009-0002-5824-7893
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Whole Slide Images (WSIs) have significantly advanced the field of pathology by providing highly detailed views of tissue samples. Integrating Deep Learning (DL) into this area of research, particularly through transformer-based foundational models, has marked a new era in automated image analysis. These foundational models are adept at extracting features from WSIs, an essential step in their analysis process. The subsequent application of weakly supervised learning techniques combines these features to predict critical biomarkers, such as BRAF mutations and sentinel lymph node (SLN) biopsy positivity, which are vital in guiding patient treatment strategies. However, the limited availability of labelled datasets in pathology hinders the usefulness of DL models. Domain adaptation strategies adeptly overcome this hurdle, enabling model knowledge transfer between different tissue types, thus addressing data scarcity. Our study employs a form of domain adaptation by fine-tuning two DINOv2 models, one pre-trained on natural images and the other on WSI of colorectal cancer from the TCGA dataset, adapting them for melanoma analysis. We also incorporate a comparison with features extracted by a third DINOv1 model trained solely on WSIs of breast cancer. With this approach, we find some notable success in detecting BRAF mutations. Nonetheless, predicting SLN positivity presents a more intricate challenge, largely due to the indirect correlation between local histopathological features in WSIs of primary tumours and lymph node metastasis manifestation. This dual-faceted approach not only combats the issue of limited data but also showcases the potential for enhanced accuracy in the field of digital pathology., This research was supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the project 718/C/2019 with id 201923-30 and 201923-31 funded by Fundació la Marato de TV3. Also by the FI-AGAUR ( 2022 FI B 00634 ) grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya and the European Social Fund., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Biological brain age prediction using machine learning on structural neuroimaging data: multi-cohort validation against biomarkers of Alzheimer's disease and neurodegeneration stratified by sex

  • Cumplido Mayoral, Irene
  • García Prat, Marina
  • Operto, Grégory
  • Falcón Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Lorenzini, Luigi
  • Ingala, Silvia
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer's disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD and OASIS. Brain-age delta was associated with abnormal amyloid-b, more advanced stages (AT) of AD pathology and APOE-e4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging in non-demented individuals with abnormal levels of biomarkers of AD and axonal injury., Marc Suárez-Calvet: Horizon 2020 - Research and Innovation Framework Programme 948677, Instituto de Salud Carlos III PI19/00155, La Caixa Foundation 100010434, Horizon 2020 - Research and Innovation Framework Programme 847648 / Juan Domingo Gispert: EU/EFPIA Innovative Medicines Initiative Joint Undertaking AMYPAD 115952 / Marc Suárez-Calvet: La Caixa Foundation 100010434; LCF/PR/ GN17/50300004 / Irene Cumplido-Mayoral: TriBEKa Imaging Platform project TriBEKa-17-519007, Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government 2017-SGR-892 / Juan Domingo Gispert: EIT Digital Grant 2021, Spanish Ministry of Science and Innovation (MCIN)/Spanish Research Agency (AEI) MCIN/AEI /10.13039/501100011033 RTI2018-102261, cofunded by the European Regional Development Fund (FEDER) / Marc Suárez-Calvet: NIHR biomedical research center at UCLH Frederik Barkhof Instituto de Salud Carlos III PI22/00456 / Raffaele Cacciaglia: Spanish Ministry of Science and Innovation (MCIN)/Spanish Research Agency (AEI) MCIN/ AEI/10.13039/501100011033 PID2021-125433OA-100 / Verónica Vilaplana: Spanish Research Agency (AEI) PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033, Peer Reviewed, Article signat per 27 autors/es: Irene Cumplido-Mayoral, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Marina García-Prat, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Grégory Operto, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Carles Falcon, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Mahnaz Shekari, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Raffaele Cacciaglia, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Marta Milà-Alomà, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Luigi Lorenzini, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Silvia Ingala, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Alle Meije Wink, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Henk JMM Mutsaerts, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Carolina Minguillón, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Karine Fauria, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; José Luis Molinuevo, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Sven Haller, CIRD Centre d'Imagerie Rive Droite, Geneva, Switzerland; Gael Chetelat, Normandie Univ, UNICAEN, INSERM, U1237, Caen, France; Adam Waldman, Centre for Dementia Prevention, University of Edinburgh, Edinburgh, United Kingdom; Adam J Schwarz, Takeda Pharmaceutical Company Ltd, Cambridge, United States; Frederik Barkhof, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Ivonne Suridjan, Roche Diagnostics International Ltd, Rotkreuz, Switzerland; Gwendlyn Kollmorgen, Roche Diagnostics GmbH, Penzberg, Germany; Anna Bayfield, Roche Diagnostics GmbH, Penzberg, Germany; Henrik Zetterberg, Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, Sweden; Kaj Blennow, Institute of Neuroscience and Physiology, University of Gothenburg, Mölndal, Sweden; Marc Suárez-Calvet, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Verónica Vilaplana, Department of Signal Theory and Communications, Universitat Politècnica de Catalunya, Barcelona, Spain; Juan Domingo Gispert López, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Combining graph neural networks and computer vision methods for cell nuclei classification in lung tissue

  • Pérez Cano, Jose
  • Sansano Valero, Irene
  • Anglada Rotger, David|||0009-0009-9792-5889
  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Salembier Clairon, Philippe Jean|||0000-0001-8884-9604
  • Marqués Acosta, Fernando|||0000-0001-8311-1168
The detection of tumoural cells from whole slide images is an essential task in medical diagnosis and research. In this article, we propose and analyse a novel approach that combines computer vision-based models with graph neural networks to improve the accuracy of automated tumoural cell detection in lung tissue. Our proposal leverages the inherent structure and relationships between cells in the tissue. Experimental results on our own curated dataset show that modelling the problem with graphs gives the model a clear advantage over just working at pixel level. This change in perspective provides extra information that makes it possible to improve the performance. The reduction of dimensionality that comes from working with the graph also allows us to increase the field of view with low computational requirements. Code is available at https://github.com/Jerry-Master/lung-tumour-study, models are uploaded to https://huggingface.co/Jerry-Master/Hovernet-plus-Graphs, and the dataset is published on Zenodo https://zenodo.org/doi/10.5281/zenodo.8368122., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

SEG-ESRGAN: A multi-task network for super-resolution and semantic segmentation of remote sensing images

  • Salgueiro Romero, Luis Fernando|||0000-0003-4048-8330
  • Marcello Ruiz, Javier
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
The production of highly accurate land cover maps is one of the primary challenges in remote sensing, which depends on the spatial resolution of the input images. Sometimes, high-resolution imagery is not available or is too expensive to cover large areas or to perform multitemporal analysis. In this context, we propose a multi-task network to take advantage of the freely available Sentinel-2 imagery to produce a super-resolution image, with a scaling factor of 5, and the corresponding high-resolution land cover map. Our proposal, named SEG-ESRGAN, consists of two branches: the super-resolution branch, that produces Sentinel-2 multispectral images at 2 m resolution, and an encoder–decoder architecture for the semantic segmentation branch, that generates the enhanced land cover map. From the super-resolution branch, several skip connections are retrieved and concatenated with features from the different stages of the encoder part of the segmentation branch, promoting the flow of meaningful information to boost the accuracy in the segmentation task. Our model is trained with a multi-loss approach using a novel dataset to train and test the super-resolution stage, which is developed from Sentinel-2 and WorldView-2 image pairs. In addition, we generated a dataset with ground-truth labels for the segmentation task. To assess the super-resolution improvement, the PSNR, SSIM, ERGAS, and SAM metrics were considered, while to measure the classification performance, we used the IoU, confusion matrix and the F1-score. Experimental results demonstrate that the SEG-ESRGAN model outperforms different full segmentation and dual network models (U-Net, DeepLabV3+, HRNet and Dual_DeepLab), allowing the generation of high-resolution land cover maps in challenging scenarios using Sentinel-2 10 m bands., This work was funded by the Spanish Agencia Estatal de Investigación (AEI) under projects ARTEMISAT-2 (CTM 2016-77733-R), PID2020-117142GB-I00 and PID2020-116907RB-I00 (MCIN/AEI call 10.13039/501100011033). L.S. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Self-supervised graph representations of WSIs

  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
In this manuscript we propose a framework for the analysis of whole slide images (WSI) on the cell entity space with self-supervised deep learning on graphs and explore its representation quality at different levels of application. It consists of a two step process in which the cell level analysis is performed locally, by clusters of nearby cells that can be seen as small regions of the image, in order to learn representations that capture the cell environment and distribution. In a second stage, a WSI graph is generated with these regions as nodes and the representations learned as initial node embeddings. The graph is leveraged for a downstream task, region of interest (ROI) detection addressed as a graph clustering. The representations outperform the evaluation baselines at both levels of application, which has been carried out predicting whether a cell, or region, is tumor or not based on its learned representations with a logistic regressor., This work has been supported by the Spanish Research Agency (AEI) under project PID2020- 116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Capítulo o parte de un libro (BookPart)

Breast cancer molecular subtyping from H&E whole slide images using foundation models and transformers

  • Jiménez Martín, Lauren|||0009-0002-5824-7893
  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
This study tackles the challenge of classifying breast cancer molecular subtypes using H&E-stained Whole Slide Images (WSI), avoiding the cost and labor limitations of the commonly used immunohistochemistry. We leverage the Attention-Challenging Multiple Instance Learning framework and introduce a variant, ACTrans, which utilizes a transformer aggregator for a more flexible feature aggregation. We also compare two publicly available foundation feature extractors pre-trained on large pathology datasets. A comparison of the impact of two different patch sizes at two different resolutions is made. The results obtained in our in-house dataset demonstrate that ACTrans yields superior results than existing methods, particularly with the UNI model at lower resolutions and larger patch sizes. In this setting, ACTrans achieves an average F1 score of 0.687, a precision of 0.755, a recall of 0.667, and an AUC of 0.812. Furthermore, these approaches enhance interpretability when displaying the attention weights. This method can potentially advance breast cancer diagnostics by leveraging the rich information within H&E-stained WSIs., This research was supported by the Spanish Research Agency (AEI) under projects PID2020-116907RB-I00 and PID2023-148614OB-I00 of the calls MCIN/ AEI /10.13039/501100011033, (Challenges of Society 2020 and Knowledge Generation 2023) and the FI-AGAUR (2022 FI_B 00634) grant funded by Direcció General de Recerca (DGR), Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya and the European Social Fund., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Cell-DETR: Efficient cell detection and classification in WSIs with transformers

  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Dorca, Eduard
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Understanding cell interactions and subpopulation distribution is crucial for pathologists to support their diagnoses. This cell information is traditionally extracted from segmentation methods, which poses significant computational challenges on processing Whole Slide Images (WSIs) due to their giga-size nature. Nonetheless, the clinically relevant tasks are nuclei detection and classification rather than segmentation. In this manuscript, we undertake a comprehensive exploration of the applicability of detection transformers for cell detection and classification (Cell-DETR). Not only do we demonstrate the effectiveness of the method by achieving state-of-the-art performance on well-established benchmarks, but we also develop a pipeline to tackle these tasks on WSIs at scale to enable the development of downstream applications. We show its efficiency and feasibility by reporting a x3.4 faster inference time on a dataset featuring large WSIs. By addressing the challenges associated with large-scale cell detection, our work contributes valuable insights that paves the way for the development of scalable diagnosis pipelines based on cell-level information., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

BCN20000: dermoscopic lesions in the wild

  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Combalia Escudero, Marc
  • Podlipnik, Sebastian
  • Codella, Noel C. F.
  • Rotemberg, Veronica
  • Halpern, Allan C.
  • Reiter, Ofer
  • Carrera Álvarez, Cristina
  • Barreiro Capurro, Alicia
  • Helba, Brian
  • Puig Sardá, Susana
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
  • Malvehy Guilera, Josep
Advancements in dermatological artificial intelligence research require high-quality and comprehensive datasets that mirror real-world clinical scenarios. We introduce a collection of 18,946 dermoscopic images spanning from 2010 to 2016, collated at the Hospital Clínic in Barcelona, Spain. The BCN20000 dataset aims to address the problem of unconstrained classification of dermoscopic images of skin cancer, including lesions in hard-to-diagnose locations such as those found in nails and mucosa, large lesions which do not fit in the aperture of the dermoscopy device, and hypo-pigmented lesions. Our dataset covers eight key diagnostic categories in dermoscopy, providing a diverse range of lesions for artificial intelligence model training. Furthermore, a ninth out-of-distribution (OOD) class is also present on the test set, comprised of lesions which could not be distinctively classified as any of the others. By providing a comprehensive collection of varied images, BCN20000 helps bridge the gap between the training data for machine learning models and the day-to-day practice of medical practitioners. Additionally, we present a set of baseline classifiers based on state-of-the-art neural networks, which can be extended by other researchers for further experimentation., We acknowledge the support of the International Skin Imaging Collaboration (ISIC). This research was supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the project 718/C/2019 with id 201923-30 and 201923-31, funded by Fundació la Marató de TV3, iTOBOs grant from the European Union’s Horizon 2020 research and innovation programme num 965221. Other funding sources include the Melanoma Research Alliance Young Investigator Award 614197. This research was funded in part through the NIH/NCI Cancer Center Support Grant P30 CA008748., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Neuroimaging-derived biological brain age and its associations with glial reactivity and synaptic dysfunction cerebrospinal fluid biomarkers

  • Cumplido Mayoral, Irene
  • Sánchez Benavides, Gonzalo
  • Vilor Tejedor, Natalia
  • López Martos, David
  • Brugulat Serrat, Anna
  • Milà Alomà, Marta
  • Falcón Falcón, Carles
  • Cacciaglia, Raffaele
  • Minguillón Gil, Carolina
  • Fauria, Karine
  • Kollmorgen, Gwendlyn
  • Quijano Rubio, Clara
  • Molinuevo Guix, José Luis
  • Grau Rivera, Oriol
  • Suárez Calvet, Marc
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
  • Domingo Gispert, Juan
Magnetic resonance Imaging (MRI)-derived brain-age prediction is a promising biomarker of biological brain aging. Accelerated brain aging has been found in Alzheimer’s disease (AD) and other neurodegenerative diseases. However, no previous studies have investigated the relationship between specific pathophysiological pathways in AD and biological brain aging. Here, we studied whether glial reactivity and synaptic dysfunction are associated with biological brain aging in the earliest stages of the Alzheimer’s continuum, and if these mechanisms are differently associated with AD-related cortical atrophy. We further evaluated their effects on cognitive decline. We included 380 cognitively unimpaired individuals from the ALFA+ study, for which we computed their brain-age deltas by subtracting chronological age from their brain age predicted by machine learning algorithms. We studied the cross-sectional linear associations between brain-age delta and cerebrospinal fluid (CSF) biomarkers of synaptic dysfuncton(neurogranin, GAP43, synaptotagmin-1, SNAP25, and a-synuclein), glial reactivity (sTREM2, YKL-40, GFAP, and S100b) and inflammation (interleukin-6). We also studied the cross-sectional linear associations between AD signature and these CSF biomarkers, We further evaluated the mechanisms linking baseline brain-age delta and longitudinal cognitive decline by performing mediation analyses. To reproduce our findings on an independent cohort, we included 152 cognitively unimpaired and 310 mild cognitive impaired (MCI) individuals from the ADNI study. We found that higher CSF sTREM2 was associated with a younger brain-age after adjusting for AD pathology, both in ALFA+ cognitively unimpaired and in ADNI MCI individuals. Furthermore, we found that CSF sTREM2 fully mediated the link between older brain-age and cognitive decline in ALFA+. In summary, we showed that the protective microglial state reflected by higher CSF sTREM2 has a beneficial impact on biological brain aging that may partly explains the variability in cognitive decline in early AD stages, independently of AD pathology., The ALFA+ study receives funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/ 50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2021 SGR 009132017-SGR-892. MS-C receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677); ERA PerMed (ERAPERMED2021-184); Project “PI19/00155” and “PI22/00456, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER); and from a fellowship from ”la Caixa” Foundation (ID 100010434) and the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004). DLM is supported by the project PI19/00117, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER). VV has been supported by the project PID2020-116907RB-I00, funded by the Ministry of Science and Innovation - State Research Agency, MCIN/ AEI /10.13039/ 501100011033. GSB is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2020-119556RA-I00 and by the Instituto de Salud Carlos III (ISCIII) through the project CP23/00039 (Miguel Servet contract), co-funded by the European Union (FSE +). OGR receives funding from the Alzheimer’s Association Research Fellowship Program (2019-AARF-644568), from Instituto de Salud Carlos III co-funded by the European Union (FEDER) (PI19/00117) and from Ministry of Science and Innovation - State Research Agency MCIN/ AEI /10.13039/501100011033 co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043417-I). NV-T is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/ 10.13039/501100011033, co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043216-I). In addition, NV-T receives funding from the Alzheimer’s Disease Data Initiative (ADDI) through the William H. Gates Sr. Fellowship program, and the PID2022-143106OA-I00 project, funded by MCIN/AEI /10.13039/ 501100011033 and co-funded by the European Union (FEDER). RC is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/ 10.13039/501100011033 through the project PID2021-125433OA-100 (co-funded by the European Union (FEDER)) and a Ramón y Cajal contract (RYC2021-031128-I, cofunded by the European Union «NextGenerationEU»/PRTR)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Feature propagation as self-supervision signals on graphs

  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Self-supervised learning is gaining considerable attention as a solution to avoid the requirement of extensive annotations in representation learning on graphs. Current algorithms are based on contrastive learning, which is computation an memory expensive, and the assumption of invariance under certain graph augmentations. However, graph transformations such as edge sampling may modify the semantics of the data so that the invariance assumption may be incorrect. We introduce Regularized Graph Infomax (RGI), a simple yet effective framework for node level self-supervised learning that trains a graph neural network encoder by maximizing the mutual information between output node embeddings and their propagation through the graph, which encode the nodes’ local and global context, respectively. RGI do not use graph data augmentations but instead generates self-supervision signals with feature propagation, is non-contrastive and does not depend on a two branch architecture. We run RGI on both transductive and inductive settings with popular graph benchmarks and show that it can achieve state-of-the-art performance regardless of its simplicity., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/ 10.13039/501100011033 and the FI-AGAUR 2021-FI-B-00845 grant funded by Secretaria d’Universitats i Recerca de la Generalitat de Catalunya and the European Social Fund (ESF)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Enhancing Ki-67 cell segmentation with Dual U-Net models: a step towards uncertainty-informed active learning

  • Anglada Rotger, David|||0009-0009-9792-5889
  • Sala Prat, Júlia
  • Marqués Acosta, Fernando|||0000-0001-8311-1168
  • Salembier Clairon, Philippe Jean|||0000-0001-8884-9604
  • Pardàs Feliu, Montse|||0000-0002-5861-6356
The diagnosis and prognosis of breast cancer relies on histopathology image analysis where markers such as Ki-67 are increasingly important. The diagnosis using this marker is based on quantification of proliferation, which implies counting of Ki-67 positive and negative tumoral cells, excluding stromal cells. A common problem for automatic quantification of these images derives from overlapping and clustering of cells. We propose in this paper an automatic segmentation and classification system that overcomes this problem using two Convolutional Neural Networks (Dual U-Net), whose results are combined with a watershed algorithm. Taking into account that a major issue for the development of reliable neural networks is the availability of labeled databases, we also introduce an approach for epistemic uncertainty estimation that can be used for active learning in instance segmentation applications. We use Monte Carlo Dropout within our networks to quantify the model's confidence across its predictions, offering insights into areas of high uncertainty. Our results show how the postprocessed uncertainty maps can be used to refine ground truth annotations and to generate new labeled data with reduced annotation effort. To initialize the labeling and further reduce this effort, we propose a tool for groundtruth generation which is based on candidate generation with maxtree. Candidates are filtered based on extracted features which can be adjusted for the specific image typology, thereby facilitating precise model training and evaluation., This reseach has been funded by the project PID2020-116907RB-100 [AIMING] and PID2020-117142GB-I00 [DeeLight] by MCIN/ AEI /10.13039/ 501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Color deconvolution applied to domain adaptation in HER2 histopathological images

  • Anglada Rotger, David|||0009-0009-9792-5889
  • Marqués Acosta, Fernando|||0000-0001-8311-1168
  • Pardàs Feliu, Montse|||0000-0002-5861-6356
Breast cancer early detection is crucial for improving patient outcomes. The Institut Catala de la Salut (ICS) has launched‘ the DigiPatICS project to develop and implement artificial intelligence algorithms to assist with the diagnosis of cancer. In this paper, we propose a new approach for facing the color normalization problem in HER2-stained histopathological images of breast cancer tissue, posed as an style transfer problem. We combine the Color Deconvolution technique with the Pix2Pix GAN network to present a novel approach to correct the color variations between different HER2 stain brands. Our approach focuses on maintaining the HER2 score of the cells in the transformed images, which is crucial for the HER2 analysis. Results demonstrate that our final model outperforms the state-of-the-art image style transfer methods in maintaining the cell classes in the transformed images and is as effective as them in generating realistic images., This reseach has been partially funded by the project DigiPatICS, from ICS, and the project PID2020-116907RB-100 AIMING, funded by MCIN/ AEI /10.13039/ 501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer’s disease and neurodegeneration stratified by sex

  • Cumplido Mayoral, Irene
  • García Prat, Marina
  • Operto, Grégory
  • Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Lorenzini, Luigi
  • Ingala, Silvia
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer’s disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD and OASIS. Brain-age delta was associated with abnormal amyloid-b, more advanced stages (AT) of AD pathology and APOE-e4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging related to markers of AD and neurodegeneration., The project leading to these results has received funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa-17-519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2017-SGR-892 and the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033. FB is supported by the NIHR biomedical research center at UCLH. MSC receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677), the Instituto de Salud Carlos III (PI19/00155), and from a fellowship from ”la Caixa” Foundation (ID 100010434) and from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004)., Report de recerca signat per 27 autors/es: Irene Cumplido-Mayoral 1,2; Marina García-Prat 1; Grégory Operto 1,3,4; Carles Falcon 1,3,5; Mahnaz Shekari 1,2,3; Raffaele Cacciaglia 1,3,4; Marta Milà-Alomà 1,2,3,4; Luigi Lorenzini 6; Silvia Ingala 6; Alle Meije Wink 6; Henk JMM Mutsaerts 6; Carolina Minguillón 1,3,4; Karine Fauria 1,4; José Luis Molinuevo 1; Sven Haller 7; Gael Chetelat 8,10; Adam Waldman 9; Adam Schwarz 10; Frederik Barkhof 6,11; Ivonne Suridjan 12, 11; Gwendlyn Kollmorgen 13; Anna Bayfield 13; Henrik Zetterberg 14,15,16,17,18; Kaj Blennow 14,15 12; Marc Suárez-Calvet 1,3,4,19; Verónica Vilaplana 20; Juan Domingo Gispert 1,3,5; ALFA study; EPAD study; ADNI study; OASIS study // 1) Barcelonaβeta Brain Research Center (BBRC), Pasqual Maragall Foundation, Barcelona, Spain; 2) Universitat Pompeu Fabra, Barcelona, Spain; 3) IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain; 4) CIBER Fragilidad y Envejecimiento Saludable (CIBERFES), Madrid, Spain; 5) Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain; 6) Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands; 7) CIRD Centre d'Imagerie Rive Droite, Geneva, Switzerland; 8) Normandie Univ, UNICAEN, INSERM, U1237, PhIND "Physiopathology and Imaging of Neurological Disorders", Institut Blood and Brain @ Caen-Normandie, Cyceron, Caen, France; 9) Centre for Dementia Prevention, Edinburgh Imaging, and UK Dementia Research Institute at The University of Edinburgh, Edinburgh, UK; 10) Takeda Pharmaceutical Company Ltd, Cambridge, MA, USA; 11) Institutes of Neurology and Healthcare Engineering, University College London, London, UK; 12) Roche Diagnostics International Ltd, Rotkreuz, Switzerland; 13) Roche Diagnostics GmbH, Penzberg, Germany; 14) Institute of Neuroscience and Physiology, University of Gothenburg, Mölndal, Sweden; 15) Clinical Neurochemistry Laboratory, Sahlgrenska University Hospital, Mölndal, Sweden; 16) Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, United Kingdom; 17) UK Dementia Research Institute at UCL, London, United Kingdom; 18) Hong Kong Center for Neurodegenerative Diseases, Hong Kong, China; 19) Servei de Neurologia, Hospital del Mar, Barcelona, Spain; 20) Department of Signal Theory and Communications, Universitat Politècnica de Catalunya, Barcelona, Spain.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Stromal tissue segmentation in Ki67 histology images based on cytokeratin-19 stain translation

  • Pardàs Feliu, Montse|||0000-0002-5861-6356
  • Anglada Rotger, David|||0009-0009-9792-5889
  • Espina Boronat, Maria
  • Marqués Acosta, Fernando|||0000-0001-8311-1168
  • Salembier Clairon, Philippe Jean|||0000-0001-8884-9604
Purpose: The diagnosis and prognosis of breast cancer relies on histopathology image analysis. In this context, proliferation markers, especially Ki67, are increasingly important. The diagnosis using these markers is based on the quantification of proliferation, which implies the counting of Ki67 positive and negative tumoral cells in epithelial regions, thus excluding stromal cells. However, stromal cells are often very difficult to distinguish from negative tumoral cells in Ki67 images and often lead to errors when automatic analysis is used. Approach: We study the use of automatic semantic segmentation based on convolutional neural networks (CNNs) to separate stromal and epithelial areas on Ki67 stained images. CNNs need to be accurately trained with extensive databases with associated ground truth. As such databases are not publicly available, we propose a method to produce them with minimal manual labelling effort. Inspired by the procedure used by pathologists, we have produced the database relying on knowledge transfer from cytokeratin-19 images to Ki67 using an image-to-image (I2I) translation network. Results: The automatically produced stroma masks are manually corrected and used to train a CNN that predicts very accurate stroma masks for unseen Ki67 images. An F-score value of 0.87 is achieved. Examples of effect on the KI67 score show the importance of the stroma segmentation. Conclusions: An I2I translation method has proved very useful for building ground-truth labeling in a task where manual labeling is unfeasible. With reduced correction effort, a dataset can be built to train neural networks for the difficult problem of separating epithelial regions from stroma in stained images where separation is very hard without additional information., This work was supported by the Spanish Research Agency (AEI) (Project No. PID2020-116907RB-I00) of the call MCIN/AEI/10.13039/50110001103 and the European Regional Development Funds under program FEDER Catalunya 2014–2020 and SA18-014623 DIGIPATICS., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

SurvLIMEpy: a Python package implementing SurvLIME

  • Pachón García, Cristian|||0000-0001-9518-4874
  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Delicado Useros, Pedro Francisco|||0000-0003-3933-4852
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
© 2024 Elsevier. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/, In this paper we present SurvLIMEpy, an open-source Python package that implements the SurvLIME algorithm. This method allows to compute local feature importance for machine learning algorithms designed for modelling Survival Analysis data. The presented implementation uses a matrix-wise formulation, which allows to speed up the execution time. Additionally, SurvLIMEpy assists the user with visualisation tools to better understand the result of the algorithm. The package supports a wide variety of survival models, from the Cox Proportional Hazards Model to deep learning models such as DeepHit or DeepSurv. Two types of experiments are presented in this paper. First, by means of simulated data, we study the ability of the algorithm to capture the importance of the features. Second, we use three open source survival datasets together with a set of survival algorithms in order to demonstrate how SurvLIMEpy behaves when applied to different models., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Unsupervised domain adaptation for multi-stain cell detection in breast cancer with transformers

  • Pina Benages, Òscar|||0009-0003-9755-6629
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
The complexity of digital pathology image analysis arises from histopathological slide variability, including tissue specimen differences and stain variations. While publicly available datasets primarily focus on hematoxylin and eosin (H&E) staining, pathologists often require analysis across multiple stains for comprehensive diagnosis. Deep learning pipelines' implementation in clinical settings is hindered by poor cross-stain generalization, necessitating exhaustive annotations for each stain, which are time-consuming to obtain. In this work, we address these challenges by focusing on breast cancer analysis across four crucial stains: ER, PR, HER2, and Ki-67. Given the necessity of cell-level information for diagnosis, we concentrate on cell detection tasks with detection transformers. Leveraging unsupervised domain adaptation techniques, we bridge the gap between publicly available, annotated H&E datasets and unlabeled data in other stains. We demonstrate the superiority of adversarial feature learning over source-only and image-level generative methods. Our work contributes to improving digital pathology image analysis by enabling robust and efficient computer-aided diagnosis pipelines across multiple stains, thereby improving diagnostic accuracy in practical settings. The code can be found at https://github.com/oscar97pina/stain-celldetr. © 2024 IEEE., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FIAGAUR grant funded by Direccio General de Recerca ´ (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Capítulo o parte de un libro (BookPart)

Interpreting machine learning models for survival analysis: a study of cutaneous melanoma using the SEER database

  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Pachón García, Cristian|||0000-0001-9518-4874
  • Delicado Useros, Pedro Francisco|||0000-0003-3933-4852
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
In this study, we train and compare three types of machine learning algorithms for Survival Analysis: Random Survival Forest, DeepSurv and DeepHit, using the SEER database to model cutaneous malignant melanoma. Additionally, we employ SurvLIMEpy library, a Python package designed to provide explainability for survival machine learning models, to analyse feature importance. The results demonstrate that machine learning algorithms outperform the Cox Proportional Hazards Model. Our work underscores the importance of explainability methods for interpreting black-box models and provides insights into important features related to melanoma prognosis., This research was supported by the Spanish Research Agency (AEI) under projects PID2020-116294GB-I00 and PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033, the project 718/C/2019 with id 201923-31 funded by Fundació la Marato de TV3 and the grant 2020 FI SDUR 306 funded by AGAUR., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Capítulo o parte de un libro (BookPart)

Contrastive and attention-based multiple instance learning for the prediction of sentinel lymph node status from histopathologies of primary melanoma tumours

  • Hernández Pérez, Carlos|||0000-0002-0054-8573
  • Combalia Escudero, Marc
  • Puig Sardá, Susana
  • Malvehy Guilera, Josep
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
Sentinel lymph node status is a crucial prognosis factor for melanomas; nonetheless, the invasive surgery required to obtain it always puts the patient at risk. In this study, we develop a Deep Learning-based approach to predict lymph node metastasis from Whole Slide Images of primary tumours. Albeit very informative, these images come with complexities that hamper their use in machine learning applications, namely their large size and limited datasets. We propose a pre-training strategy based on self-supervised contrastive learning to extract better image feature representations and an attention-based Multiple Instance Learning approach to enhance the model’s performance. With this work, we quantitatively demonstrate that combining both methods improves various classification metrics and qualitatively show that contrastive learning encourages the network to output higher attention scores to tumour tissue and lower scores to image artifacts., Work supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/10.13039/501100011033 and the project 718/C/ 2019 funded by Fundació la Marato de TV3., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

SurvLIMEpy: a Python package implementing SurvLIME

  • Pachón García, Cristian
  • Hernández Pérez, Carlos
  • Delicado Useros, Pedro Francisco
  • Vilaplana Besler, Verónica
© 2024 Elsevier. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/, In this paper we present SurvLIMEpy, an open-source Python package that implements the SurvLIME algorithm. This method allows to compute local feature importance for machine learning algorithms designed for modelling Survival Analysis data. The presented implementation uses a matrix-wise formulation, which allows to speed up the execution time. Additionally, SurvLIMEpy assists the user with visualisation tools to better understand the result of the algorithm. The package supports a wide variety of survival models, from the Cox Proportional Hazards Model to deep learning models such as DeepHit or DeepSurv. Two types of experiments are presented in this paper. First, by means of simulated data, we study the ability of the algorithm to capture the importance of the features. Second, we use three open source survival datasets together with a set of survival algorithms in order to demonstrate how SurvLIMEpy behaves when applied to different models., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Breast cancer molecular subtyping from H&E whole slide images using foundation models and transformers

  • Jiménez Martín, Lauren
  • Hernández Pérez, Carlos
  • Vilaplana Besler, Verónica
This study tackles the challenge of classifying breast cancer molecular subtypes using H&E-stained Whole Slide Images (WSI), avoiding the cost and labor limitations of the commonly used immunohistochemistry. We leverage the Attention-Challenging Multiple Instance Learning framework and introduce a variant, ACTrans, which utilizes a transformer aggregator for a more flexible feature aggregation. We also compare two publicly available foundation feature extractors pre-trained on large pathology datasets. A comparison of the impact of two different patch sizes at two different resolutions is made. The results obtained in our in-house dataset demonstrate that ACTrans yields superior results than existing methods, particularly with the UNI model at lower resolutions and larger patch sizes. In this setting, ACTrans achieves an average F1 score of 0.687, a precision of 0.755, a recall of 0.667, and an AUC of 0.812. Furthermore, these approaches enhance interpretability when displaying the attention weights. This method can potentially advance breast cancer diagnostics by leveraging the rich information within H&E-stained WSIs., This research was supported by the Spanish Research Agency (AEI) under projects PID2020-116907RB-I00 and PID2023-148614OB-I00 of the calls MCIN/ AEI /10.13039/501100011033, (Challenges of Society 2020 and Knowledge Generation 2023) and the FI-AGAUR (2022 FI_B 00634) grant funded by Direcció General de Recerca (DGR), Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya and the European Social Fund., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Stromal tissue segmentation in Ki67 histology images based on cytokeratin-19 stain translation

  • Pardàs Feliu, Montse
  • Anglada Rotger, David
  • Espina Boronat, Maria
  • Marqués Acosta, Fernando
  • Salembier Clairon, Philippe Jean
Purpose: The diagnosis and prognosis of breast cancer relies on histopathology image analysis. In this context, proliferation markers, especially Ki67, are increasingly important. The diagnosis using these markers is based on the quantification of proliferation, which implies the counting of Ki67 positive and negative tumoral cells in epithelial regions, thus excluding stromal cells. However, stromal cells are often very difficult to distinguish from negative tumoral cells in Ki67 images and often lead to errors when automatic analysis is used. Approach: We study the use of automatic semantic segmentation based on convolutional neural networks (CNNs) to separate stromal and epithelial areas on Ki67 stained images. CNNs need to be accurately trained with extensive databases with associated ground truth. As such databases are not publicly available, we propose a method to produce them with minimal manual labelling effort. Inspired by the procedure used by pathologists, we have produced the database relying on knowledge transfer from cytokeratin-19 images to Ki67 using an image-to-image (I2I) translation network. Results: The automatically produced stroma masks are manually corrected and used to train a CNN that predicts very accurate stroma masks for unseen Ki67 images. An F-score value of 0.87 is achieved. Examples of effect on the KI67 score show the importance of the stroma segmentation. Conclusions: An I2I translation method has proved very useful for building ground-truth labeling in a task where manual labeling is unfeasible. With reduced correction effort, a dataset can be built to train neural networks for the difficult problem of separating epithelial regions from stroma in stained images where separation is very hard without additional information., This work was supported by the Spanish Research Agency (AEI) (Project No. PID2020-116907RB-I00) of the call MCIN/AEI/10.13039/50110001103 and the European Regional Development Funds under program FEDER Catalunya 2014–2020 and SA18-014623 DIGIPATICS., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Cell-DETR: Efficient cell detection and classification in WSIs with transformers

  • Pina Benages, Òscar
  • Dorca, Eduard
  • Vilaplana Besler, Verónica
Understanding cell interactions and subpopulation distribution is crucial for pathologists to support their diagnoses. This cell information is traditionally extracted from segmentation methods, which poses significant computational challenges on processing Whole Slide Images (WSIs) due to their giga-size nature. Nonetheless, the clinically relevant tasks are nuclei detection and classification rather than segmentation. In this manuscript, we undertake a comprehensive exploration of the applicability of detection transformers for cell detection and classification (Cell-DETR). Not only do we demonstrate the effectiveness of the method by achieving state-of-the-art performance on well-established benchmarks, but we also develop a pipeline to tackle these tasks on WSIs at scale to enable the development of downstream applications. We show its efficiency and feasibility by reporting a x3.4 faster inference time on a dataset featuring large WSIs. By addressing the challenges associated with large-scale cell detection, our work contributes valuable insights that paves the way for the development of scalable diagnosis pipelines based on cell-level information., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Contrastive and attention-based multiple instance learning for the prediction of sentinel lymph node status from histopathologies of primary melanoma tumours

  • Hernández Pérez, Carlos
  • Combalia Escudero, Marc
  • Puig Sardá, Susana
  • Malvehy Guilera, Josep
  • Vilaplana Besler, Verónica
Sentinel lymph node status is a crucial prognosis factor for melanomas; nonetheless, the invasive surgery required to obtain it always puts the patient at risk. In this study, we develop a Deep Learning-based approach to predict lymph node metastasis from Whole Slide Images of primary tumours. Albeit very informative, these images come with complexities that hamper their use in machine learning applications, namely their large size and limited datasets. We propose a pre-training strategy based on self-supervised contrastive learning to extract better image feature representations and an attention-based Multiple Instance Learning approach to enhance the model’s performance. With this work, we quantitatively demonstrate that combining both methods improves various classification metrics and qualitatively show that contrastive learning encourages the network to output higher attention scores to tumour tissue and lower scores to image artifacts., Work supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/10.13039/501100011033 and the project 718/C/ 2019 funded by Fundació la Marato de TV3., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Self-supervised graph representations of WSIs

  • Pina Benages, Òscar
  • Vilaplana Besler, Verónica
In this manuscript we propose a framework for the analysis of whole slide images (WSI) on the cell entity space with self-supervised deep learning on graphs and explore its representation quality at different levels of application. It consists of a two step process in which the cell level analysis is performed locally, by clusters of nearby cells that can be seen as small regions of the image, in order to learn representations that capture the cell environment and distribution. In a second stage, a WSI graph is generated with these regions as nodes and the representations learned as initial node embeddings. The graph is leveraged for a downstream task, region of interest (ROI) detection addressed as a graph clustering. The representations outperform the evaluation baselines at both levels of application, which has been carried out predicting whether a cell, or region, is tumor or not based on its learned representations with a logistic regressor., This work has been supported by the Spanish Research Agency (AEI) under project PID2020- 116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer’s disease and neurodegeneration stratified by sex

  • Cumplido Mayoral, Irene
  • García Prat, Marina
  • Operto, Grégory
  • Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Lorenzini, Luigi
  • Ingala, Silvia
  • Vilaplana Besler, Verónica
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer’s disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD and OASIS. Brain-age delta was associated with abnormal amyloid-b, more advanced stages (AT) of AD pathology and APOE-e4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging related to markers of AD and neurodegeneration., The project leading to these results has received funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa-17-519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2017-SGR-892 and the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033. FB is supported by the NIHR biomedical research center at UCLH. MSC receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677), the Instituto de Salud Carlos III (PI19/00155), and from a fellowship from ”la Caixa” Foundation (ID 100010434) and from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004)., Report de recerca signat per 27 autors/es: Irene Cumplido-Mayoral 1,2; Marina García-Prat 1; Grégory Operto 1,3,4; Carles Falcon 1,3,5; Mahnaz Shekari 1,2,3; Raffaele Cacciaglia 1,3,4; Marta Milà-Alomà 1,2,3,4; Luigi Lorenzini 6; Silvia Ingala 6; Alle Meije Wink 6; Henk JMM Mutsaerts 6; Carolina Minguillón 1,3,4; Karine Fauria 1,4; José Luis Molinuevo 1; Sven Haller 7; Gael Chetelat 8,10; Adam Waldman 9; Adam Schwarz 10; Frederik Barkhof 6,11; Ivonne Suridjan 12, 11; Gwendlyn Kollmorgen 13; Anna Bayfield 13; Henrik Zetterberg 14,15,16,17,18; Kaj Blennow 14,15 12; Marc Suárez-Calvet 1,3,4,19; Verónica Vilaplana 20; Juan Domingo Gispert 1,3,5; ALFA study; EPAD study; ADNI study; OASIS study // 1) Barcelonaβeta Brain Research Center (BBRC), Pasqual Maragall Foundation, Barcelona, Spain; 2) Universitat Pompeu Fabra, Barcelona, Spain; 3) IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain; 4) CIBER Fragilidad y Envejecimiento Saludable (CIBERFES), Madrid, Spain; 5) Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain; 6) Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands; 7) CIRD Centre d'Imagerie Rive Droite, Geneva, Switzerland; 8) Normandie Univ, UNICAEN, INSERM, U1237, PhIND "Physiopathology and Imaging of Neurological Disorders", Institut Blood and Brain @ Caen-Normandie, Cyceron, Caen, France; 9) Centre for Dementia Prevention, Edinburgh Imaging, and UK Dementia Research Institute at The University of Edinburgh, Edinburgh, UK; 10) Takeda Pharmaceutical Company Ltd, Cambridge, MA, USA; 11) Institutes of Neurology and Healthcare Engineering, University College London, London, UK; 12) Roche Diagnostics International Ltd, Rotkreuz, Switzerland; 13) Roche Diagnostics GmbH, Penzberg, Germany; 14) Institute of Neuroscience and Physiology, University of Gothenburg, Mölndal, Sweden; 15) Clinical Neurochemistry Laboratory, Sahlgrenska University Hospital, Mölndal, Sweden; 16) Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, London, United Kingdom; 17) UK Dementia Research Institute at UCL, London, United Kingdom; 18) Hong Kong Center for Neurodegenerative Diseases, Hong Kong, China; 19) Servei de Neurologia, Hospital del Mar, Barcelona, Spain; 20) Department of Signal Theory and Communications, Universitat Politècnica de Catalunya, Barcelona, Spain., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Context-unsupervised adversarial network for video sensors

  • Canet Tarrés, Gemma
  • Pardàs Feliu, Montse
This paper is an extended version of our conference paper: Pardàs, M. and Canet, G. Refinement Network for unsupervised on the scene Foreground Segmentation. In Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands , 18–21 January 2021., Foreground object segmentation is a crucial first step for surveillance systems based on networks of video sensors. This problem in the context of dynamic scenes has been widely explored in the last two decades, but it still has open research questions due to challenges such as strong shadows, background clutter and illumination changes. After years of solid work based on statistical background pixel modeling, most current proposals use convolutional neural networks (CNNs) either to model the background or to make the foreground/background decision. Although these new techniques achieve outstanding results, they usually require specific training for each scene, which is unfeasible if we aim at designing software for embedded video systems and smart cameras. Our approach to the problem does not require specific context or scene training, and thus no manual labeling. We propose a network for a refinement step on top of conventional state-of-the-art background subtraction systems. By using a statistical technique to produce a rough mask, we do not need to train the network for each scene. The proposed method can take advantage of the specificity of the classic techniques, while obtaining the highly accurate segmentation that a deep learning system provides. We also show the advantage of using an adversarial network to improve the generalization ability of the network and produce more consistent results than an equivalent non-adversarial network. The results provided were obtained by training the network on a common database, without fine-tuning for specific scenes. Experiments on the unseen part of the CDNet database provided 0.82 a F-score, and 0.87 was achieved for LASIESTA databases, which is a database unrelated to the training one. On this last database, the results outperformed by 8.75% those available in the official table. The results achieved for CDNet are well above those of the methods not based on CNNs, and according to the literature, among the best for the context-unsupervised CNNs systems., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Unsupervised domain adaptation for multi-stain cell detection in breast cancer with transformers

  • Pina Benages, Òscar
  • Vilaplana Besler, Verónica
The complexity of digital pathology image analysis arises from histopathological slide variability, including tissue specimen differences and stain variations. While publicly available datasets primarily focus on hematoxylin and eosin (H&E) staining, pathologists often require analysis across multiple stains for comprehensive diagnosis. Deep learning pipelines' implementation in clinical settings is hindered by poor cross-stain generalization, necessitating exhaustive annotations for each stain, which are time-consuming to obtain. In this work, we address these challenges by focusing on breast cancer analysis across four crucial stains: ER, PR, HER2, and Ki-67. Given the necessity of cell-level information for diagnosis, we concentrate on cell detection tasks with detection transformers. Leveraging unsupervised domain adaptation techniques, we bridge the gap between publicly available, annotated H&E datasets and unlabeled data in other stains. We demonstrate the superiority of adversarial feature learning over source-only and image-level generative methods. Our work contributes to improving digital pathology image analysis by enabling robust and efficient computer-aided diagnosis pipelines across multiple stains, thereby improving diagnostic accuracy in practical settings. The code can be found at https://github.com/oscar97pina/stain-celldetr. © 2024 IEEE., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FIAGAUR grant funded by Direccio General de Recerca ´ (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Combining graph neural networks and computer vision methods for cell nuclei classification in lung tissue

  • Pérez Cano, Jose
  • Sansano Valero, Irene
  • Anglada Rotger, David
  • Pina Benages, Òscar
  • Salembier Clairon, Philippe Jean
  • Marqués Acosta, Fernando
The detection of tumoural cells from whole slide images is an essential task in medical diagnosis and research. In this article, we propose and analyse a novel approach that combines computer vision-based models with graph neural networks to improve the accuracy of automated tumoural cell detection in lung tissue. Our proposal leverages the inherent structure and relationships between cells in the tissue. Experimental results on our own curated dataset show that modelling the problem with graphs gives the model a clear advantage over just working at pixel level. This change in perspective provides extra information that makes it possible to improve the performance. The reduction of dimensionality that comes from working with the graph also allows us to increase the field of view with low computational requirements. Code is available at https://github.com/Jerry-Master/lung-tumour-study, models are uploaded to https://huggingface.co/Jerry-Master/Hovernet-plus-Graphs, and the dataset is published on Zenodo https://zenodo.org/doi/10.5281/zenodo.8368122., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Feature propagation as self-supervision signals on graphs

  • Pina Benages, Òscar
  • Vilaplana Besler, Verónica
Self-supervised learning is gaining considerable attention as a solution to avoid the requirement of extensive annotations in representation learning on graphs. Current algorithms are based on contrastive learning, which is computation an memory expensive, and the assumption of invariance under certain graph augmentations. However, graph transformations such as edge sampling may modify the semantics of the data so that the invariance assumption may be incorrect. We introduce Regularized Graph Infomax (RGI), a simple yet effective framework for node level self-supervised learning that trains a graph neural network encoder by maximizing the mutual information between output node embeddings and their propagation through the graph, which encode the nodes’ local and global context, respectively. RGI do not use graph data augmentations but instead generates self-supervision signals with feature propagation, is non-contrastive and does not depend on a two branch architecture. We run RGI on both transductive and inductive settings with popular graph benchmarks and show that it can achieve state-of-the-art performance regardless of its simplicity., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/ 10.13039/501100011033 and the FI-AGAUR 2021-FI-B-00845 grant funded by Secretaria d’Universitats i Recerca de la Generalitat de Catalunya and the European Social Fund (ESF)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

BCN20000: dermoscopic lesions in the wild

  • Hernández Pérez, Carlos
  • Combalia Escudero, Marc
  • Podlipnik, Sebastian
  • Codella, Noel C. F.
  • Rotemberg, Veronica
  • Halpern, Allan C.
  • Reiter, Ofer
  • Carrera Álvarez, Cristina
  • Barreiro Capurro, Alicia
  • Helba, Brian
  • Puig Sardá, Susana
  • Vilaplana Besler, Verónica
  • Malvehy Guilera, Josep
Advancements in dermatological artificial intelligence research require high-quality and comprehensive datasets that mirror real-world clinical scenarios. We introduce a collection of 18,946 dermoscopic images spanning from 2010 to 2016, collated at the Hospital Clínic in Barcelona, Spain. The BCN20000 dataset aims to address the problem of unconstrained classification of dermoscopic images of skin cancer, including lesions in hard-to-diagnose locations such as those found in nails and mucosa, large lesions which do not fit in the aperture of the dermoscopy device, and hypo-pigmented lesions. Our dataset covers eight key diagnostic categories in dermoscopy, providing a diverse range of lesions for artificial intelligence model training. Furthermore, a ninth out-of-distribution (OOD) class is also present on the test set, comprised of lesions which could not be distinctively classified as any of the others. By providing a comprehensive collection of varied images, BCN20000 helps bridge the gap between the training data for machine learning models and the day-to-day practice of medical practitioners. Additionally, we present a set of baseline classifiers based on state-of-the-art neural networks, which can be extended by other researchers for further experimentation., We acknowledge the support of the International Skin Imaging Collaboration (ISIC). This research was supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the project 718/C/2019 with id 201923-30 and 201923-31, funded by Fundació la Marató de TV3, iTOBOs grant from the European Union’s Horizon 2020 research and innovation programme num 965221. Other funding sources include the Melanoma Research Alliance Young Investigator Award 614197. This research was funded in part through the NIH/NCI Cancer Center Support Grant P30 CA008748., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Biological brain age prediction using machine learning on structural neuroimaging data: multi-cohort validation against biomarkers of Alzheimer's disease and neurodegeneration stratified by sex

  • Cumplido Mayoral, Irene
  • García Prat, Marina
  • Operto, Grégory
  • Falcón Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Lorenzini, Luigi
  • Ingala, Silvia
  • Vilaplana Besler, Verónica
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer's disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD and OASIS. Brain-age delta was associated with abnormal amyloid-b, more advanced stages (AT) of AD pathology and APOE-e4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging in non-demented individuals with abnormal levels of biomarkers of AD and axonal injury., Marc Suárez-Calvet: Horizon 2020 - Research and Innovation Framework Programme 948677, Instituto de Salud Carlos III PI19/00155, La Caixa Foundation 100010434, Horizon 2020 - Research and Innovation Framework Programme 847648 / Juan Domingo Gispert: EU/EFPIA Innovative Medicines Initiative Joint Undertaking AMYPAD 115952 / Marc Suárez-Calvet: La Caixa Foundation 100010434; LCF/PR/ GN17/50300004 / Irene Cumplido-Mayoral: TriBEKa Imaging Platform project TriBEKa-17-519007, Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government 2017-SGR-892 / Juan Domingo Gispert: EIT Digital Grant 2021, Spanish Ministry of Science and Innovation (MCIN)/Spanish Research Agency (AEI) MCIN/AEI /10.13039/501100011033 RTI2018-102261, cofunded by the European Regional Development Fund (FEDER) / Marc Suárez-Calvet: NIHR biomedical research center at UCLH Frederik Barkhof Instituto de Salud Carlos III PI22/00456 / Raffaele Cacciaglia: Spanish Ministry of Science and Innovation (MCIN)/Spanish Research Agency (AEI) MCIN/ AEI/10.13039/501100011033 PID2021-125433OA-100 / Verónica Vilaplana: Spanish Research Agency (AEI) PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033, Peer Reviewed, Article signat per 27 autors/es: Irene Cumplido-Mayoral, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Marina García-Prat, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Grégory Operto, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Carles Falcon, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Mahnaz Shekari, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Raffaele Cacciaglia, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Marta Milà-Alomà, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Luigi Lorenzini, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Silvia Ingala, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Alle Meije Wink, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Henk JMM Mutsaerts, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Carolina Minguillón, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Karine Fauria, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; José Luis Molinuevo, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Sven Haller, CIRD Centre d'Imagerie Rive Droite, Geneva, Switzerland; Gael Chetelat, Normandie Univ, UNICAEN, INSERM, U1237, Caen, France; Adam Waldman, Centre for Dementia Prevention, University of Edinburgh, Edinburgh, United Kingdom; Adam J Schwarz, Takeda Pharmaceutical Company Ltd, Cambridge, United States; Frederik Barkhof, Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands; Ivonne Suridjan, Roche Diagnostics International Ltd, Rotkreuz, Switzerland; Gwendlyn Kollmorgen, Roche Diagnostics GmbH, Penzberg, Germany; Anna Bayfield, Roche Diagnostics GmbH, Penzberg, Germany; Henrik Zetterberg, Institute of Neuroscience and Physiology, University of Gothenburg, Gothenburg, Sweden; Kaj Blennow, Institute of Neuroscience and Physiology, University of Gothenburg, Mölndal, Sweden; Marc Suárez-Calvet, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain; Verónica Vilaplana, Department of Signal Theory and Communications, Universitat Politècnica de Catalunya, Barcelona, Spain; Juan Domingo Gispert López, Barcelonaβeta Brain Research Center, Pasqual Maragall Foundation, Barcelona, Spain, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The mediating role of neuroimaging-derived biological brain age in the association between risk factors for dementia and cognitive decline in middle-aged and older individuals without cognitive impairment: a cohort study

  • Cumplido Mayoral, Irene
  • Brugulat Serrat, Anna
  • Sánchez Benavides, Gonzalo
  • González Escalante, Armand
  • Anastasi, Federica
  • Milà Alomà, Marta
  • López Martos, David
  • Akinci, Muge
  • Falcón Falcón, Carles
  • Vilaplana Besler, Verónica
Background: Neuroimaging-based brain-age delta has been shown to be a mediator linking cardiovascular risk factors to cognitive function. We aimed to assess the mediating role of brain-age delta in the association between modifiable risk factors of dementia and longitudinal cognitive decline in middle-aged and older individuals who are asymptomatic, stratified by Alzheimer's disease pathology. We also explored whether the mediation effect is specific to cognitive domain. Methods: In this cohort study, we included participants from the ALFA+ cohort aged between 45 years and 65 years who were cognitively unimpaired and who had available structural MRI, cerebrospinal fluid ß-amyloid (Aß)42 and Aß40 measurements obtained within 1 year of each other, modifiable risk factors assessment, and cognitive evaluation over 3 years. Participants were recruited from the Barcelonaßeta Brain Research Center (Barcelona, Spain). Included individuals underwent a first assessment between Oct 25, 2016, and Jan 28, 2020, and a follow-up cognitive assessment 3·28 (SD 0·27) years later. We computed brain-age delta and composites of different cognitive function domains (preclinical Alzheimer's cognitive composite [PACC], attention, executive function, episodic memory, visual processing, and language). We used partial least squares path modelling to explore mediation effects in the associations between modifiable risk factors (including cardiovascular, mental health, mood, metabolic or endocrine history, and alcohol use) and changes in cognitive composites. To assess the role of Alzheimer's disease pathology, we computed separate models for Aß-negative and Aß-positive individuals. Findings: Of the 419 participants enrolled in ALFA+, 302 met our inclusion criteria, of which 108 participants were classified as Aß-positive and 194 as Aß-negative. In Aß-positive individuals, brain-age delta partially mediated (percent mediation proportion 15·73% [95% CI 14·22–16·66]) the association between modifiable risk factors and decline in overall cognition (across cognitive domains). Brain-age delta fully mediated (mediation proportion 28·03% [26·25–29·21]) the effect of modifiable risk factors on the PACC, wherein increased values for risk factors correlated with an older brain-age delta, and, consequently, an older brain-age delta was linked to greater PACC decline. This effect appears to be primarily driven by memory decline. Mediation was not significant in Aß-negative individuals (3·52% [0·072–4·17]) on PACC, although path coefficients were not significantly different from those in the Aß-positive group. Interpretation: Our findings suggest that brain-age delta captures the association between modifiable risk factors and longitudinal cognitive decline in middle-aged and older people. In asymptomatic middle-aged and older individuals who are Aß-positive, the pathology might be the strongest driver of cognitive decline, whereas the effect of risk factors is smaller. Our results highlight the potential of brain-age delta as an objective outcome measure for preventive lifestyle interventions targeting cognitive decline., The ALFA+ study receives funding from La Caixa Foundation (100010434; LCF/PR/GN17/50300004) and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government (2021 SGR 009132017-SGR-892). MS-C receives funding from the European Research Council under the EU Horizon 2020 research and innovation programme (948677; project PI19/00155), funded by Instituto de Salud Carlos III and co-funded by the EU, and from a fellowship from La Caixa Foundation (100010434) and from the EU Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant (847648; LCF/BQ/PR21/11840004). DL-M is supported by Instituto de Salud Carlos III (PI19/00117; co-funded by European Regional Development Fund, European Social Fund A Way to Make Europe, and Investing in your Future). EMA-U is supported by the Spanish Ministry of Science and Innovation State Research Agency (RYC2018-026053-I), cofunded by the European Social Fund and the Spanish Ministry of Science and Innovation (PID2019-111514RA-I00). VV has been supported by the Spanish Research Agency (PID2020-116907RB-I00 of the call MCIN/ AEI/10.13039/501100011033). JDG is supported by the Spanish Ministry of Science and Innovation (RYC-2013-13054). JDG has also received research support from the EU and European Federation of Pharmaceutical Industries and Associations Innovative Medicines Initiative Joint Undertaking AMYPAD (115952), European Institute of Innovation and Technology Digital (2021), and from Ministerio de Ciencia y Universidades (RTI2018-102261). GS-B receives funding from the Ministerio de Ciencia e Innovacion, Spanish Research Agency (PID2020119556RA-I00). OG-R receives funding from the Alzheimer’s Association Research Fellowship (2019-AARF-644568), from Instituto de Salud Carlos III (PI19/00117), and from the Spanish Ministry of Science, Innovation and Universities (Juan de la Cierva programme IJC2020-043417-I)., Peer Reviewed, Article signat per 19 autors/autores: Irene Cumplido-Mayoral, Anna Brugulat-Serrat, Gonzalo Sánchez-Benavides, Armand González-Escalante, Federica Anastasi, Marta Milà-Alomà, David López-Martos, Muge Akinci, Carles Falcón, Mahnaz Shekari, Raffaele Cacciaglia, Eider M Arenaza-Urquijo, Carolina Minguillón, Karine Fauria, José Luis Molinuevo, Marc Suárez-Calvet, Oriol Grau-Rivera, Verónica Vilaplana, Juan Domingo Gispert, on behalf of the ALFA study*. * Membres del grup "ALFA study": Annabella Beteta, Alba Cañas, Marta del Campo, Carme Deulofeu, Ruth Dominguez, Maria Emilio, Ana Fernández-Arcos, Sherezade Fuentes, Patricia Genius, Laura Hernández, Jordi Huguet, Wiesje Pelkmans, Albina Polo, Sandra Pradas, Blanca Rodríguez-Fernández, Anna Soteras, Laura Stankeviciute, Marc Vilanova, Natalia Vilor-Tejedor., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Structural networks for brain age prediction

  • Pina Benages, Òscar
  • Cumplido Mayoral, Irene
  • Cacciaglia, Raffaele
  • González-de-Echávarri, Jose María
  • Gispert López, Juan Domingo
  • Vilaplana Besler, Verónica
Biological networks have gained considerable attention within the Deep Learning community because of the promising framework of Graph Neural Networks (GNN), neural models that operate in complex networks. In the context of neuroimaging, GNNs have successfully been employed for functional MRI processing but their application to ROI-level structural MRI (sMRI) remains mostly unexplored. In this work we analyze the implementation of these geometric models with sMRI by building graphs of ROIs (ROI graphs) using tools from Graph Signal Processing literature and evaluate their performance in a downstream supervised task, age prediction. We first make a qualitative and quantitative comparison of the resulting networks obtained with common graph topology learning strategies. In a second stage, we train GNN-based models for brain age prediction. Since the order of every ROI graph is exactly the same and each vertex is an entity by itself (a ROI), we evaluate whether including ROI information during message-passing or global pooling operations is beneficial and compare the performance of GNNs against a Fully-Connected Neural Network baseline. The results show that ROI-level information is needed during the global pooling operation in order to achieve competitive results. However, no relevant improvement has been detected when it is incorporated during the message passing. These models achieve a MAE of 4.27 in hold-out test data, which is a performance very similar to the baseline, suggesting that the inductive bias included with the obtained graph connectivity is relevant and useful to reduce the dimensionality of the problem., This work has been supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the FI-AGAUR grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer's disease and neurodegeneration stratified by sex

  • Cumplido-Mayoral, Irene
  • Operto, Grégory
  • Falcón, Carles
  • Shekari, Mahnaz
  • Cacciaglia, Raffaele
  • Milà Alomà, Marta
  • Minguillón, Carolina
  • Suárez-Calvet, Marc
  • Gispert, Juan Domingo
  • OASIS study
Brain-age can be inferred from structural neuroimaging and compared to chronological age (brain-age delta) as a marker of biological brain aging. Accelerated aging has been found in neurodegenerative disorders like Alzheimer's disease (AD), but its validation against markers of neurodegeneration and AD is lacking. Here, imaging-derived measures from the UK Biobank dataset (N=22,661) were used to predict brain-age in 2,314 cognitively unimpaired (CU) individuals at higher risk of AD and mild cognitive impaired (MCI) patients from four independent cohorts with available biomarker data: ALFA+, ADNI, EPAD, and OASIS. Brain-age delta was associated with abnormal amyloid-β, more advanced stages (AT) of AD pathology and APOE-ε4 status. Brain-age delta was positively associated with plasma neurofilament light, a marker of neurodegeneration, and sex differences in the brain effects of this marker were found. These results validate brain-age delta as a non-invasive marker of biological brain aging in non-demented individuals with abnormal levels of biomarkers of AD and axonal injury., The project leading to these results has received funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa-17–519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2017-SGR-892 and the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033. FB is supported by the NIHR biomedical research center at UCLH. MSC receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677), the Instituto de Salud Carlos III (PI19/00155), and from a fellowship from ”la Caixa” Foundation (ID 100010434) and from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Color deconvolution applied to domain adaptation in HER2 histopathological images

  • Anglada Rotger, David
  • Marqués Acosta, Fernando
  • Pardàs Feliu, Montse
Breast cancer early detection is crucial for improving patient outcomes. The Institut Catala de la Salut (ICS) has launched‘ the DigiPatICS project to develop and implement artificial intelligence algorithms to assist with the diagnosis of cancer. In this paper, we propose a new approach for facing the color normalization problem in HER2-stained histopathological images of breast cancer tissue, posed as an style transfer problem. We combine the Color Deconvolution technique with the Pix2Pix GAN network to present a novel approach to correct the color variations between different HER2 stain brands. Our approach focuses on maintaining the HER2 score of the cells in the transformed images, which is crucial for the HER2 analysis. Results demonstrate that our final model outperforms the state-of-the-art image style transfer methods in maintaining the cell classes in the transformed images and is as effective as them in generating realistic images., This reseach has been partially funded by the project DigiPatICS, from ICS, and the project PID2020-116907RB-100 AIMING, funded by MCIN/ AEI /10.13039/ 501100011033., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Neuroimaging-derived biological brain age and its associations with glial reactivity and synaptic dysfunction cerebrospinal fluid biomarkers

  • Cumplido-Mayoral, Irene
  • Sánchez Benavides, Gonzalo
  • Vilor Tejedor, Natàlia, 1988-
  • López-Martos, David
  • Brugulat Serrat, Anna, 1986-
  • Milà Alomà, Marta
  • Falcón, Carles
  • Cacciaglia, Raffaele
  • Minguillón, Carolina
  • Fauria, Karine
  • Kollmorgen, Gwendlyn
  • Quijano-Rubio, Clara
  • Molinuevo, José Luis
  • Grau, Oriol (Grau Rivera)
  • Suárez-Calvet, Marc
  • Vilaplana, Verónica
  • Gispert, Juan Domingo
  • ALFA Study
  • ADNI
Magnetic resonance Imaging (MRI)-derived brain-age prediction is a promising biomarker of biological brain aging. Accelerated brain aging has been found in Alzheimer's disease (AD) and other neurodegenerative diseases. However, no previous studies have investigated the relationship between specific pathophysiological pathways in AD and biological brain aging. Here, we studied whether glial reactivity and synaptic dysfunction are associated with biological brain aging in the earliest stages of the Alzheimer's continuum, and if these mechanisms are differently associated with AD-related cortical atrophy. We further evaluated their effects on cognitive decline. We included 380 cognitively unimpaired individuals from the ALFA+ study, for which we computed their brain-age deltas by subtracting chronological age from their brain age predicted by machine learning algorithms. We studied the cross-sectional linear associations between brain-age delta and cerebrospinal fluid (CSF) biomarkers of synaptic dysfunction (neurogranin, GAP43, synaptotagmin-1, SNAP25, and α-synuclein), glial reactivity (sTREM2, YKL-40, GFAP, and S100b) and inflammation (interleukin-6). We also studied the cross-sectional linear associations between AD signature and these CSF biomarkers, We further evaluated the mechanisms linking baseline brain-age delta and longitudinal cognitive decline by performing mediation analyses. To reproduce our findings on an independent cohort, we included 152 cognitively unimpaired and 310 mild cognitive impaired (MCI) individuals from the ADNI study. We found that higher CSF sTREM2 was associated with a younger brain-age after adjusting for AD pathology, both in ALFA+ cognitively unimpaired and in ADNI MCI individuals. Furthermore, we found that CSF sTREM2 fully mediated the link between older brain-age and cognitive decline in ALFA+. In summary, we showed that the protective microglial state reflected by higher CSF sTREM2 has a beneficial impact on biological brain aging that may partly explains the variability in cognitive decline in early AD stages, independently of AD pathology., The study was approved by the Independent Ethics Committee “Parc de Salut Mar,” Barcelona, and all participants gave written informed consent. The ALFA+ study receives funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2021 SGR 009132017-SGR-892. MS-C receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677); ERA PerMed (ERAPERMED2021-184); Project “PI19/00155” and “PI22/00456, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER); and from a fellowship from ”la Caixa” Foundation (ID 100010434) and the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004). DLM is supported by the project PI19/00117, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER). VV has been supported by the project PID2020-116907RB-I00, funded by the Ministry of Science and Innovation - State Research Agency, MCIN/ AEI /10.13039/501100011033. GSB is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2020-119556RA-I00 and by the Instituto de Salud Carlos III (ISCIII) through the project CP23/00039 (Miguel Servet contract), co-funded by the European Union (FSE+). OGR receives funding from the Alzheimer’s Association Research Fellowship Program (2019-AARF-644568), from Instituto de Salud Carlos III co-funded by the European Union (FEDER) (PI19/00117) and from Ministry of Science and Innovation - State Research Agency MCIN/ AEI /10.13039/501100011033 co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043417-I). NV-T is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033, co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043216-I). In addition, NV-T receives funding from the Alzheimer’s Disease Data Initiative (ADDI) through the William H. Gates Sr. Fellowship program, and the PID2022-143106OA-I00 project, funded by MCIN/AEI /10.13039/501100011033 and co-funded by the European Union (FEDER). RC is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2021-125433OA-100 (co-funded by the European Union (FEDER)) and a Ramón y Cajal contract (RYC2021-031128-I, co-funded by the European Union «NextGenerationEU»/PRTR).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Neuroimaging-derived biological brain age and its associations with glial reactivity and synaptic dysfunction cerebrospinal fluid biomarkers

  • Cumplido Mayoral, Irene
  • Sánchez Benavides, Gonzalo
  • Vilor Tejedor, Natalia
  • López Martos, David
  • Brugulat Serrat, Anna
  • Milà Alomà, Marta
  • Falcón Falcón, Carles
  • Cacciaglia, Raffaele
  • Minguillón Gil, Carolina
  • Fauria, Karine
  • Kollmorgen, Gwendlyn
  • Quijano Rubio, Clara
  • Molinuevo Guix, José Luis
  • Grau Rivera, Oriol
  • Suárez Calvet, Marc
  • Vilaplana Besler, Verónica
  • Domingo Gispert, Juan
Magnetic resonance Imaging (MRI)-derived brain-age prediction is a promising biomarker of biological brain aging. Accelerated brain aging has been found in Alzheimer’s disease (AD) and other neurodegenerative diseases. However, no previous studies have investigated the relationship between specific pathophysiological pathways in AD and biological brain aging. Here, we studied whether glial reactivity and synaptic dysfunction are associated with biological brain aging in the earliest stages of the Alzheimer’s continuum, and if these mechanisms are differently associated with AD-related cortical atrophy. We further evaluated their effects on cognitive decline. We included 380 cognitively unimpaired individuals from the ALFA+ study, for which we computed their brain-age deltas by subtracting chronological age from their brain age predicted by machine learning algorithms. We studied the cross-sectional linear associations between brain-age delta and cerebrospinal fluid (CSF) biomarkers of synaptic dysfuncton(neurogranin, GAP43, synaptotagmin-1, SNAP25, and a-synuclein), glial reactivity (sTREM2, YKL-40, GFAP, and S100b) and inflammation (interleukin-6). We also studied the cross-sectional linear associations between AD signature and these CSF biomarkers, We further evaluated the mechanisms linking baseline brain-age delta and longitudinal cognitive decline by performing mediation analyses. To reproduce our findings on an independent cohort, we included 152 cognitively unimpaired and 310 mild cognitive impaired (MCI) individuals from the ADNI study. We found that higher CSF sTREM2 was associated with a younger brain-age after adjusting for AD pathology, both in ALFA+ cognitively unimpaired and in ADNI MCI individuals. Furthermore, we found that CSF sTREM2 fully mediated the link between older brain-age and cognitive decline in ALFA+. In summary, we showed that the protective microglial state reflected by higher CSF sTREM2 has a beneficial impact on biological brain aging that may partly explains the variability in cognitive decline in early AD stages, independently of AD pathology., The ALFA+ study receives funding from “la Caixa” Foundation (ID 100010434), under agreement LCF/PR/GN17/ 50300004 and the Alzheimer’s Association and an international anonymous charity foundation through the TriBEKa Imaging Platform project (TriBEKa 17 519007). Additional support has been received from the Universities and Research Secretariat, Ministry of Business and Knowledge of the Catalan Government under the grant no. 2021 SGR 009132017-SGR-892. MS-C receives funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 948677); ERA PerMed (ERAPERMED2021-184); Project “PI19/00155” and “PI22/00456, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER); and from a fellowship from ”la Caixa” Foundation (ID 100010434) and the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 847648 (LCF/BQ/PR21/11840004). DLM is supported by the project PI19/00117, funded by Instituto de Salud Carlos III (ISCIII) and co-funded by the European Union (FEDER). VV has been supported by the project PID2020-116907RB-I00, funded by the Ministry of Science and Innovation - State Research Agency, MCIN/ AEI /10.13039/ 501100011033. GSB is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/10.13039/501100011033 through the project PID2020-119556RA-I00 and by the Instituto de Salud Carlos III (ISCIII) through the project CP23/00039 (Miguel Servet contract), co-funded by the European Union (FSE +). OGR receives funding from the Alzheimer’s Association Research Fellowship Program (2019-AARF-644568), from Instituto de Salud Carlos III co-funded by the European Union (FEDER) (PI19/00117) and from Ministry of Science and Innovation - State Research Agency MCIN/ AEI /10.13039/501100011033 co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043417-I). NV-T is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/ 10.13039/501100011033, co-funded by the the European Union «NextGenerationEU»/PRTR (IJC2020-043216-I). In addition, NV-T receives funding from the Alzheimer’s Disease Data Initiative (ADDI) through the William H. Gates Sr. Fellowship program, and the PID2022-143106OA-I00 project, funded by MCIN/AEI /10.13039/ 501100011033 and co-funded by the European Union (FEDER). RC is supported by the Spanish Ministry of Science and Innovation - State Research Agency MCIN/AEI/ 10.13039/501100011033 through the project PID2021-125433OA-100 (co-funded by the European Union (FEDER)) and a Ramón y Cajal contract (RYC2021-031128-I, cofunded by the European Union «NextGenerationEU»/PRTR)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Enhancing Ki-67 cell segmentation with Dual U-Net models: a step towards uncertainty-informed active learning

  • Anglada Rotger, David
  • Sala Prat, Júlia
  • Marqués Acosta, Fernando
  • Salembier Clairon, Philippe Jean
  • Pardàs Feliu, Montse
The diagnosis and prognosis of breast cancer relies on histopathology image analysis where markers such as Ki-67 are increasingly important. The diagnosis using this marker is based on quantification of proliferation, which implies counting of Ki-67 positive and negative tumoral cells, excluding stromal cells. A common problem for automatic quantification of these images derives from overlapping and clustering of cells. We propose in this paper an automatic segmentation and classification system that overcomes this problem using two Convolutional Neural Networks (Dual U-Net), whose results are combined with a watershed algorithm. Taking into account that a major issue for the development of reliable neural networks is the availability of labeled databases, we also introduce an approach for epistemic uncertainty estimation that can be used for active learning in instance segmentation applications. We use Monte Carlo Dropout within our networks to quantify the model's confidence across its predictions, offering insights into areas of high uncertainty. Our results show how the postprocessed uncertainty maps can be used to refine ground truth annotations and to generate new labeled data with reduced annotation effort. To initialize the labeling and further reduce this effort, we propose a tool for groundtruth generation which is based on candidate generation with maxtree. Candidates are filtered based on extracted features which can be adjusted for the specific image typology, thereby facilitating precise model training and evaluation., This reseach has been funded by the project PID2020-116907RB-100 [AIMING] and PID2020-117142GB-I00 [DeeLight] by MCIN/ AEI /10.13039/ 501100011033., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

DigiPatICS: Digital Pathology Transformation of the Catalan Health Institute Network of 8 hospitals—planification, implementation, and preliminary results

  • Temprana Salvador, Jordi
  • López García, Pablo
  • Castellví Vives, Josep
  • Haro Martín, Luis de
  • Ballesta Carbonell, Eudald
  • Rojas Abusleme, Matias
  • Arrufat Vila, Miquel
  • Marqués Acosta, Fernando
  • Casas Pla, Josep Ramon
  • Gallego Pérez, Carles
Complete digital pathology transformation for primary histopathological diagnosis is a challenging yet rewarding endeavor. Its advantages are clear with more efficient workflows, but there are many technical and functional difficulties to be faced. The Catalan Health Institute (ICS) has started its DigiPatICS project, aiming to deploy digital pathology in an integrative, holistic, and comprehensive way within a network of 8 hospitals, over 168 pathologists, and over 1 million slides each year. We describe the bidding process and the careful planning that was required, followed by swift implementation in stages. The purpose of the DigiPatICS project is to increase patient safety and quality of care, improving diagnosis and the efficiency of processes in the pathological anatomy departments of the ICS through process improvement, digital pathology, and artificial intelligence tools., This project was funded by European Regional Development Funds, Programa operatiu FEDER de Catalunya 2014–2020 and SA18-014623 DIGIPATICS. UPC activity in this project was partially supported by PID2020-116907RB-I00 and funded by MCIN/AEI/10.13039/501100011033, Peer Reviewed, Article signat per 18 autors/es: Jordi Temprana-Salvador (1), Pablo López-García (2), Josep Castellví Vives (1),Lluís de Haro (2), Eudald Ballesta (2), Matias Rojas Abusleme (3), Miquel Arrufat (4), Ferran Marques (5), Josep R. Casas (5),Carlos Gallego (6), Laura Pons (7), José Luis Mate (7), Pedro Luis Fernández (7), Eugeni López-Bonet (8), Ramon Bosch (9), Salomé Martínez (10), Santiago Ramón y Cajal (1), and Xavier Matias-Guiu (11,12) // (1) Department of Pathology, Vall d’Hebron University Hospital, CIBERONC, 08035 Barcelona, Spain; (2) Functional Competence Center, Information Systems, Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (3) Center for Telecommunications and Information Technology (Centre de Telecomunicacions i Tecnologies de la Informació, CTTI), Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (4) Economic and Financial Management, Catalan Health Institute (Institut Català de la Salut), 08006 Barcelona, Spain; (5) Image Processing Group, Technical University of Catalonia (UPC), 08034 Barcelona, Spain; (6) Digital Medical Imaging System of Catalonia (SIMDCAT), TIC Salut, 08005 Barcelona, Spain, (7) Department of Pathology, Germans Trias i Pujol University Hospital, 08916 Badalona, Spain; (8) Department of Pathology, Doctor Josep Trueta Hospital of Girona, 17007 Girona, Spain; (9) Department of Pathology, Verge de la Cinta Hospital of Tortosa, 43500 Tarragona, Spain; (10) Department of Pathology, Joan XXIII University Hospital of Tarragona, 43005 Tarragona, Spain; (11) Department of Pathology, Arnau de Vilanova University Hospital, 25198 Lleida, Spain, (12) Department of Pathology, Bellvitge University Hospital, CIBERONC, 08907 Barcelona, Spain, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Bridging domains in melanoma diagnostics: predicting BRAF mutations and sentinel lymph node positivity with attention-based models in histological images

  • Hernández Pérez, Carlos
  • Jiménez Martín, Lauren
  • Vilaplana Besler, Verónica
Whole Slide Images (WSIs) have significantly advanced the field of pathology by providing highly detailed views of tissue samples. Integrating Deep Learning (DL) into this area of research, particularly through transformer-based foundational models, has marked a new era in automated image analysis. These foundational models are adept at extracting features from WSIs, an essential step in their analysis process. The subsequent application of weakly supervised learning techniques combines these features to predict critical biomarkers, such as BRAF mutations and sentinel lymph node (SLN) biopsy positivity, which are vital in guiding patient treatment strategies. However, the limited availability of labelled datasets in pathology hinders the usefulness of DL models. Domain adaptation strategies adeptly overcome this hurdle, enabling model knowledge transfer between different tissue types, thus addressing data scarcity. Our study employs a form of domain adaptation by fine-tuning two DINOv2 models, one pre-trained on natural images and the other on WSI of colorectal cancer from the TCGA dataset, adapting them for melanoma analysis. We also incorporate a comparison with features extracted by a third DINOv1 model trained solely on WSIs of breast cancer. With this approach, we find some notable success in detecting BRAF mutations. Nonetheless, predicting SLN positivity presents a more intricate challenge, largely due to the indirect correlation between local histopathological features in WSIs of primary tumours and lymph node metastasis manifestation. This dual-faceted approach not only combats the issue of limited data but also showcases the potential for enhanced accuracy in the field of digital pathology., This research was supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033 and the project 718/C/2019 with id 201923-30 and 201923-31 funded by Fundació la Marato de TV3. Also by the FI-AGAUR ( 2022 FI B 00634 ) grant funded by Direcció General de Recerca (DGR) of Departament de Recerca i Universitats (REU) of the Generalitat de Catalunya and the European Social Fund., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Interpreting machine learning models for survival analysis: a study of cutaneous melanoma using the SEER database

  • Hernández Pérez, Carlos
  • Pachón García, Cristian
  • Delicado Useros, Pedro Francisco
  • Vilaplana Besler, Verónica
In this study, we train and compare three types of machine learning algorithms for Survival Analysis: Random Survival Forest, DeepSurv and DeepHit, using the SEER database to model cutaneous malignant melanoma. Additionally, we employ SurvLIMEpy library, a Python package designed to provide explainability for survival machine learning models, to analyse feature importance. The results demonstrate that machine learning algorithms outperform the Cox Proportional Hazards Model. Our work underscores the importance of explainability methods for interpreting black-box models and provides insights into important features related to melanoma prognosis., This research was supported by the Spanish Research Agency (AEI) under projects PID2020-116294GB-I00 and PID2020-116907RB-I00 of the call MCIN/ AEI /10.13039/501100011033, the project 718/C/2019 with id 201923-31 funded by Fundació la Marato de TV3 and the grant 2020 FI SDUR 306 funded by AGAUR., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

SEG-ESRGAN: A multi-task network for super-resolution and semantic segmentation of remote sensing images

  • Salgueiro Romero, Luis Fernando
  • Marcello Ruiz, Javier
  • Vilaplana Besler, Verónica
The production of highly accurate land cover maps is one of the primary challenges in remote sensing, which depends on the spatial resolution of the input images. Sometimes, high-resolution imagery is not available or is too expensive to cover large areas or to perform multitemporal analysis. In this context, we propose a multi-task network to take advantage of the freely available Sentinel-2 imagery to produce a super-resolution image, with a scaling factor of 5, and the corresponding high-resolution land cover map. Our proposal, named SEG-ESRGAN, consists of two branches: the super-resolution branch, that produces Sentinel-2 multispectral images at 2 m resolution, and an encoder–decoder architecture for the semantic segmentation branch, that generates the enhanced land cover map. From the super-resolution branch, several skip connections are retrieved and concatenated with features from the different stages of the encoder part of the segmentation branch, promoting the flow of meaningful information to boost the accuracy in the segmentation task. Our model is trained with a multi-loss approach using a novel dataset to train and test the super-resolution stage, which is developed from Sentinel-2 and WorldView-2 image pairs. In addition, we generated a dataset with ground-truth labels for the segmentation task. To assess the super-resolution improvement, the PSNR, SSIM, ERGAS, and SAM metrics were considered, while to measure the classification performance, we used the IoU, confusion matrix and the F1-score. Experimental results demonstrate that the SEG-ESRGAN model outperforms different full segmentation and dual network models (U-Net, DeepLabV3+, HRNet and Dual_DeepLab), allowing the generation of high-resolution land cover maps in challenging scenarios using Sentinel-2 10 m bands., This work was funded by the Spanish Agencia Estatal de Investigación (AEI) under projects ARTEMISAT-2 (CTM 2016-77733-R), PID2020-117142GB-I00 and PID2020-116907RB-I00 (MCIN/AEI call 10.13039/501100011033). L.S. would like to acknowledge the BECAL (Becas Carlos Antonio López) scholarship for the financial support., Peer Reviewed, Postprint (published version)