Skip to main content

CUANTIFICACION Y CARACTERIZACION COMPUTACIONAL DE IMAGEN MULTIMODAL OFTALMOLOGICA: ESTUDIOS EN ESCLEROSIS MULTIPLE

PID2019-108435RB-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2019
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 78
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Data Augmentation Approaches Using Cycle-Consistent Adversarial Networks for Improving COVID-19 Screening in Portable Chest X-Ray Images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The current COVID-19 pandemic, that has caused more than 100 million cases as well as more than two million deaths worldwide, demands the development of fast and accurate diagnostic methods despite the lack of available samples. This disease mainly affects the respiratory system of the patients and can lead to pneumonia and to severe cases of acute respiratory syndrome that result in the formation of several pathological structures in the lungs. These pathological structures can be explored taking advantage of chest X-ray imaging. As a recommendation for the health services, portable chest X-ray devices should be used instead of conventional fixed machinery, in order to prevent the spread of the pathogen. However, portable devices present several problems (specially those related with capture quality). Moreover, the subjectivity and the fatigue of the clinicians lead to a very difficult diagnostic process. To overcome that, computer-aided methodologies can be very useful even taking into account the lack of available samples that the COVID-19 affectation shows. In this work, we propose an improvement in the performance of COVID-19 screening, taking advantage of several cycle generative adversarial networks to generate useful and relevant synthetic images to solve the lack of COVID-19 samples, in the context of poor quality and low detail datasets obtained from portable devices. For validating this proposal for improved COVID-19 screening, several experiments were conducted. The results demonstrate that this data augmentation strategy improves the performance of a previous COVID-19 screening proposal, achieving an accuracy of 98.61% when distinguishing among NON-COVID-19 (i.e. normal control samples and samples with pathologies others than COVID-19) and genuine COVID-19 samples. It is remarkable that this methodology can be extrapolated to other pulmonary pathologies and even other medical imaging domains to overcome the data scarcity., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Multi-Stage Transfer Learning for Lung Segmentation Using Portable X-Ray Devices for Patients With COVID-19

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] One of the main challenges in times of sanitary emergency is to quickly develop computer aided diagnosis systems with a limited number of available samples due to the novelty, complexity of the case and the urgency of its implementation. This is the case during the current pandemic of COVID-19. This pathogen primarily infects the respiratory system of the afflicted, resulting in pneumonia and in a severe case of acute respiratory distress syndrome. This results in the formation of different pathological structures in the lungs that can be detected by the use of chest X-rays. Due to the overload of the health services, portable X-ray devices are recommended during the pandemic, preventing the spread of the disease. However, these devices entail different complications (such as capture quality) that, together with the subjectivity of the clinician, make the diagnostic process more difficult and suggest the necessity for computer-aided diagnosis methodologies despite the scarcity of samples available to do so. To solve this problem, we propose a methodology that allows to adapt the knowledge from a well-known domain with a high number of samples to a new domain with a significantly reduced number and greater complexity. We took advantage of a pre-trained segmentation model from brain magnetic resonance imaging of a unrelated pathology and performed two stages of knowledge transfer to obtain a robust system able to segment lung regions from portable X-ray devices despite the scarcity of samples and lesser quality. This way, our methodology obtained a satisfactory accuracy of 0.9761 ± 0.0100 for patients with COVID-19, 0.9801 ± 0.0104 for normal patients and 0.9769 ± 0.0111 for patients with pulmonary diseases with similar characteristics as COVID-19 (such as pneumonia) but not genuine COVID-19., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant Ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant Ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant Ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01).
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Adapted generative latent diffusion models for accurate pathological analysis in chest X-ray images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Funding for open access charge: Universidade da Coruña/CISUG, [Absctract]: Respiratory diseases have a significant global impact, and assessing these conditions is crucial for improving patient outcomes. Chest X-ray is widely used for diagnosis, but expert evaluation can be challenging. Automatic computer-aided diagnosis methods can provide support for clinicians in these tasks. Deep learning has emerged as a set of algorithms with exceptional potential in such tasks. However, these algorithms require a vast amount of data, often scarce in medical imaging domains. In this work, a new data augmentation methodology based on adapted generative latent diffusion models is proposed to improve the performance of an automatic pathological screening in two high-impact scenarios: tuberculosis and lung nodules. The methodology is evaluated using three publicly available datasets, representative of real-world settings. An ablation study obtained the highest-performing image generation model configuration regarding the number of training steps. The results demonstrate that the novel set of generated images can improve the performance of the screening of these two highly relevant pathologies, obtaining an accuracy of 97.09%, 92.14% in each dataset of tuberculosis screening, respectively, and 82.19% in lung nodules. The proposal notably improves on previous image generation methods for data augmentation, highlighting the importance of the contribution in these critical public health challenges., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Impact of the Region of Analysis on the Performance of the Automatic Epiretinal Membrane Segmentation in OCT Images

  • Gende, M.
  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Eurocast 2022, 18th International Conference on Computer Aided Systems Theory. Museo Elder de la Ciencia y la Tecnología, Las Palmas de Gran Canaria, Spain, 20-25 February 2022., [Absctract]: The Epiretinal Membrane (ERM) is an ocular pathology that can cause permanent visual loss if left untreated for long. Despite its transparency, it is possible to visualise the ERM in Optical Coherence Tomography (OCT) images. In this work, we present a study on the impact of the analysis region on the performance of an automatic ERM segmentation methodology using OCT images. For this purpose, we tested 5 different sliding windows sizes ranging from to pixels to calibrate the impact of the field of view under analysis. Furthermore, 3 different approaches are proposed to enable the analysis of the regions close to the edges of the images. The proposed approaches provided satisfactory results, with each of them interacting differently with the variations in window size., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019- 108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24] and predoctoral grants [ED481A 2021/161] and [ED481A 2021/196]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia ref. [ED431G 2019/01] receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Intra- and Inter-expert Validation of an Automatic Segmentation Method for Fluid Regions Associated with Central Serous Chorioretinopathy in OCT Images

  • Gende, M.
  • Castelo Martínez, Lúa
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Central Serous Chorioretinopathy (CSC) is a retinal disorder caused by the accumulation of fluid, resulting in vision distortion. The diagnosis of this disease is typically performed through Optical Coherence Tomography (OCT) imaging, which displays any fluid buildup between the retinal layers. Currently, these fluid regions are manually detected by visual inspection a time-consuming and subjective process that can be prone to errors. A series of six deep learning-based automatic segmentation architectural configurations of different levels of complexity were trained and compared in order to determine the best model intended for the automatic segmentation of CSC-related lesions in OCT images. The best performing models were then evaluated in an external validation study. Furthermore, an intra- and inter-expert analysis was conducted in order to compare the manual segmentation performed by expert ophthalmologists with the automatic segmentation provided by the models. Test results of the best performing configuration achieved a mean Dice of in the internal dataset. In the external validation set, these models achieved a level of agreement with human experts of up to 0.960 in terms of Kappa coefficient, contrasting with a value of 0.951 for agreement between human experts. Overall, the models reached a better agreement with either of the human experts than these experts with each other, suggesting that automatic segmentation models for the detection of CSC-related lesions in OCT imaging can be useful tools for assessing this disease, reducing the workload of manual inspection and leading to a more robust and objective diagnosis method., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research was funded by Instituto de Salud Carlos III, Government of Spain (research project DTS18/00136); Ministerio de Ciencia e Innovación, Government of Spain (research projects PID2019-108435RB-I00, TED2021-131201B-I00, PDC2022-133132-I00); Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva (grant number ED431C 2020/24) and predoctoral grant (grant number ED481A 2021/161); and CITIC, Centro de Investigación de Galicia (grant number ED431G 2019/01), and receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding sources had no role in the development of this work., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Deep learning for segmentation of optic disc and retinal layers in peripapillary optical coherence tomography images

  • Rivas Vázquez, Estefanía
  • Barreira, Noelia
  • López-Varela, Emilio
  • Penedo, Manuel
This version of the conference paper has been accepted for publication, after peer review in Proceedings SPIE 12701, Fifteenth International Conference on Machine Vision (ICMV 2022), 127011A, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1117/12.2680545., [Abstract]: Optical coherence tomography (OCT) is a non-invasive technique that allows the retina to be studied with precision, the analysis of the features of its layers and other structures such as the macula or the optic nerve. This is why it is used in the diagnosis and monitoring of eye diseases such as glaucoma and optic neuritis. A crucial step in this process is the segmentation of the different layers, which is a great challenge due to its complexity. In this work, a methodology based on deep learning and transfer learning will be developed to automatically segment nine retinal layers in OCT images centred on the optic disc. In addition, the thickness of each retinal layer will be measured along each B-scan. For this purpose, OCT images from a public dataset and a dataset collected from depth-enhanced images will be used. The proposed method achieves a Dice score of 83.6%, similar to that obtained in the state of the art, segmenting the nine retinal layers and the optic disc in both sets of images. In addition, the different layers are represented in three different graphical formats., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Fully-automatic segmentation of the ciliary muscle using anterior segment optical coherence tomography images

  • Goyanes, Elena
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Ortega Hortas, Marcos
This version of the paper has been accepted for publication. The final published paper is available online at: https://doi.org/10.1109/IJCNN55064.2022.9892316, [Abstract]: The study of the ciliary muscle represents a fundamental step in the diagnosis and treatment of many high-incidence diseases, such as glaucoma or myopia. Currently, Anterior Segment Optical Coherence Tomography (AS-OCT) is widely used by clinicians to analyse the morphological changes that affect this important ocular structure. AS-OCT is a non-invasive imaging technique that produces high-resolution cross-sectional images, allowing a precise visualization of the main ocular tissues of the anterior segment of the eye. In this work, we propose a novel methodology for the ciliary muscle segmentation using AS-OCT images, an emerging ophthalmic imaging technology with great potential to support early diagnosis of relevant ocular conditions. For this purpose, we have analysed the performance of the U-Net architecture with two different encoders (ResNet-18 and ResNet-34) combined with a transfer learning-based approach. The validation of the proposed system was performed through different and representative experiments, using an AS-OCT dataset that was specifically designed for this work. The results demonstrated that the proposed system is robust and reliable, achieving an average Precision of 0.8902 ± 0.0815, an average Recall of 0.8237 ± 0.1239, an average Accuracy of 0.9961 ± 0.0021, an average Jaccard of 0.7431 ± 0.1116 and an average Dice of 0.8445 ± 0.0870. These results demonstrate that the proposed method has a satisfactory performance that can help the clinicians to make a more accurate diagnosis and proceed with appropriate treatments of different diseases of interest., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Sistema automático para a segmentación das capas da retina en pacientes con glaucoma mediante OCT

  • Gende, M.
  • Moura, Joaquim de
  • Robles, Patricia
  • Fernández-Vigo, José Ignacio
  • Martínez-de-la-Casa, José María
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
BIOINTEGRASAÚDE 2023, celebrada en A Coruña o día 14 de Decembro de 2023, organizada polo Instituto de Investigación Biomédica da Coruña (INIBIC), o Instituto de Investigación Sanitaria de Santiago de Compostela (IDIS) e o Instituto de Investigación Sanitaria Galicia Sur (IISGS), É fundamental realizar unha diagnose precoz do glaucoma para preservar a saúde visual dos pacientes. Mediante distintos patróns de Tomografía de Coherencia Óptica (OCT), é posible medir o grosor das capas do tecido nervioso en diferentes partes da retina, extraendo información sobre o seu estado e a súa evolución. Neste traballo, presentamos dúas aproximacións automáticas baseadas en aprendizaxe profunda para a segmentación das capas da retina nos tres patróns OCT máis comúns para a diagnose do glaucoma: escaneos circulares ao redor do disco óptico, radiais a través do disco óptico, e volumétricos extraídos sobre a superficie macular. A primeira aproximación aproveita a similitude entre as distintas vistas da retina para adestrar un único modelo multi-vista capaz de realizar a segmentación en calquera dos patróns. A segunda aproximación utiliza unha serie de modelos especificamente adestrados para maximizar a precisión en cada unha das vistas, precedido por unha fase de decisión na que se determina automaticamente o modelo axeitado para analizar cada imaxe. Obtivéronse resultados satisfactorios, cunha precisión de 0.85±0.07 e 0.88±0.09, así coma unha exhaustividade de 0.87±0.06 e 0.87±0.07, respectivamente, para a primeira e segunda aproximación. O uso destes sistemas pode resultar de gran utilidade á hora de acadar unha diagnose precoz desta patoloxía, axudando a preservar a calidade de vida dos pacientes., Este traballo foi financiado polo Ministerio de Ciencia e Innovación y Universidades, Gobierno de España (refs. PID2019-108435RB-I00, TED2021-131201B-I00, e PDC2022-133132-I00); Consellería de Cultura, Educación e Universidade, Xunta de Galicia a través de grupos de referencia competitiva con ref. ED431C 2020/24 e da axuda predoutoral con ref. ED481A 2021/161.
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Generation of Synthetic Intermediate Slices in 3D OCT Cubes for Improving Pathology Detection and Monitoring

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Arroyo Castillo, María Rosa
  • Penedo, Manuel
Funding for open access charge: Universidade da Coruña/CISUG, [Absctract]: OCT is a non-invasive imaging technique commonly used to obtain 3D volumes of the ocular structure. These volumes allow the monitoring of ocular and systemic diseases through the observation of subtle changes in the different structures present in the eye. In order to observe these changes it is essential that the OCT volumes have a high resolution in all axes, but unfortunately there is an inverse relationship between the quality of the OCT images and the number of slices of the cube. This results in routine clinical examinations using cubes that generally contain high-resolution images with few slices. This lack of slices complicates the monitoring of changes in the retina hindering the diagnostic process and reducing the effectiveness of 3D visualizations. Therefore, increasing the cross-sectional resolution of OCT cubes would improve the visualization of these changes aiding the clinician in the diagnostic process. In this work we present a novel fully automatic methodology to perform the synthesis of intermediate slices of OCT image volumes in an unsupervised manner. To perform this synthesis, we propose a fully convolutional neural network architecture that uses information from two adjacent slices to generate the intermediate synthetic slice. We also propose a training methodology, where we use three adjacent slices to train the network by contrastive learning and image reconstruction. We test our methodology with three different types of OCT volumes commonly used in the clinical setting and validate the quality of the synthetic slices created with several medical experts and using an expert system., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG ., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Automatic Segmentation and Visualisation of the Epirretinal Membrane in OCT Scans Using Densely Connected Convolutional Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The Epiretinal Membrane (ERM) is an ocular disease that appears as a fibro-cellular layer of tissue over the retina, specifically, over the Inner Limiting Membrane (ILM). It causes vision blurring and distortion, and its presence can be indicative of other ocular pathologies, such as diabetic macular edema. The ERM diagnosis is usually performed by visually inspecting Optical Coherence Tomography (OCT) images, a manual process which is tiresome and prone to subjectivity. In this work, we present a methodology for the automatic segmentation and visualisation of the ERM in OCT volumes using deep learning. By employing a Densely Connected Convolutional Network, every pixel in the ILM can be classified into either healthy or pathological. Thus, a segmentation of the region susceptible to ERM appearance can be produced. This methodology also produces an intuitive colour map representation of the ERM presence over a visualisation of the eye fundus created from the OCT volume. In a series of representative experiments conducted to evaluate this methodology, it achieved a Dice score of 0.826±0.112 and a Jaccard index of 0.714±0.155. The results that were obtained demonstrate the competitive performance of the proposed methodology when compared to other works in the state of the art., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/161 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

End-To-End Multi-Task Learning for Simultaneous Optic Disc and Cup Segmentation and Glaucoma Classification in Eye Fundus Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The automated analysis of eye fundus images is crucial towards facilitating the screening and early diagnosis of glaucoma. Nowadays, there are two common alternatives for the diagnosis of this disease using deep neural networks. One is the segmentation of the optic disc and cup followed by the morphological analysis of these structures. The other is to directly address the diagnosis as an image classification task. The segmentation approach presents the advantage of using pixel-level labels with precise morphological information for training. However, while this detailed training feedback is not available for the classification approach, in this case the image-level labels may allow the discovery of additional non-morphological cues that are also relevant for the diagnosis. In this work, we propose a novel multi-task approach for the simultaneous classification of glaucoma and segmentation of the optic disc and cup. This approach can improve the overall performance by taking advantage of both pixel-level and image-level labels during the network training. Additionally, the segmentation maps that are predicted together with the diagnosis allow the extraction of relevant biomarkers such as the cup-to-disc ratio. The proposed methodology presents two relevant technical novelties. First, a network architecture for simultaneous segmentation and classification that increases the number of shared parameters between both tasks. Second, a multi-adaptive optimization strategy that ensures that both tasks contribute similarly to the parameter updates during training, avoiding the use of loss weighting hyperparameters. To validate our proposal, an exhaustive experimentation was performed on the public REFUGE and DRISHTI-GS datasets. The results show that our proposal outperforms comparable multi-task baselines and is highly competitive with existing state-of-the-art approaches. Additionally, the provided ablation study shows that both the network architecture and the optimization approach are independently advantageous for multi-task learning., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, through grant ref. IN845D 2020/38; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Spain . Funding for open access charge: Universidade da Coruña/CISUG, Spain., Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

High/Low Quality Style Transfer for Mutual Conversion of OCT Images Using Contrastive Unpaired Translation Generative Adversarial Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
21st International Conference, Lecce, Italy, May 23–27, 2022, [Absctract]: Recent advances in artificial intelligence and deep learning models are contributing to the development of advanced computer-aided diagnosis (CAD) systems. In the context of medical imaging, Optical Coherence Tomography (OCT) is a valuable technique that is able to provide cross-sectional visualisations of the ocular tissue. However, OCT is constrained by a limitation between the quality of the visualisations that it can produce and the overall amount of tissue that can be analysed at once. This limitation leads to a scarcity of high quality data, a problem that is very prevalent when developing machine learning-based CAD systems intended for medical imaging. To mitigate this problem, we present a novel methodology for the unpaired conversion of OCT images acquired with a low quality extensive scanning preset into the visual style of those taken with a high quality intensive scan and vice versa. This is achieved by employing contrastive unpaired translation generative adversarial networks to convert between the visual styles of the different acquisition presets. The results we obtained in the validation experiments show that these synthetic generated images can mirror the visual features of the original ones while preserving the natural tissue texture, effectively increasing the total number of available samples that can be used to train robust machine learning-based CAD systems., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24], predoctoral grant [ED481A 2021/161]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Portable Chest X-ray Synthetic Image Generation for the COVID-19 Screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The global pandemic of COVID-19 raises the importance of having fast and reliable methods to perform an early detection and to visualize the evolution of the disease in every patient, which can be assessed with chest X-ray imaging. Moreover, in order to reduce the risk of cross contamination, radiologists are asked to prioritize the use of portable chest X-ray devices that provide a lower quality and lower level of detail in comparison with the fixed machinery. In this context, computer-aided diagnosis systems are very useful. During the last years, for the case of medical imaging, they are widely developed using deep learning strategies. However, there is a lack of sufficient representative datasets of the COVID-19 affectation, which are critical for supervised learning when training deep models. In this work, we propose a fully automatic method to artificially increase the size of an original portable chest X-ray imaging dataset that was specifically designed for the COVID-19 diagnosis, which can be developed in a non-supervised manner and without requiring paired data. The results demonstrate that the method is able to perform a reliable screening despite all the problems associated with images provided by portable devices, providing an overall accuracy of 92.50%., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Multimodal Image Encoding Pre-training for Diabetic Retinopathy Grading

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Diabetic retinopathy is an increasingly prevalent eye disorder that can lead to severe vision impairment. The severity grading of the disease using retinal images is key to provide an adequate treatment. However, in order to learn the diverse patterns and complex relations that are required for the grading, deep neural networks require very large annotated datasets that are not always available. This has been typically addressed by reusing networks that were pre-trained for natural image classification, hence relying on additional annotated data from a different domain. In contrast, we propose a novel pre-training approach that takes advantage of unlabeled multimodal visual data commonly available in ophthalmology. The use of multimodal visual data for pre-training purposes has been previously explored by training a network in the prediction of one image modality from another. However, that approach does not ensure a broad understanding of the retinal images, given that the network may exclusively focus on the similarities between modalities while ignoring the differences. Thus, we propose a novel self-supervised pre-training that explicitly teaches the networks to learn the common characteristics between modalities as well as the characteristics that are exclusive to the input modality. This provides a complete comprehension of the input domain and facilitates the training of downstream tasks that require a broad understanding of the retinal images, such as the grading of diabetic retinopathy. To validate and analyze the proposed approach, we performed an exhaustive experimentation on different public datasets. The transfer learning performance for the grading of diabetic retinopathy is evaluated under different settings while also comparing against previous state-of-the-art pre-training approaches. Additionally, a comparison against relevant state-of-the-art works for the detection and grading of diabetic retinopathy is also provided. The results show a satisfactory performance of the proposed approach, which outperforms previous pre-training alternatives in the grading of diabetic retinopathy., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Automatic Deep Learning-based Models for Retinal Layer Thickness Analysis as a Biomarker for Neurodegenerative Diseases

  • Gende, M.
  • Moura, Joaquim de
  • Cordón Ciordia, Beatriz
  • Viladés, Elisa
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
The ARVO Annual Meeting is the premiere gathering for eye and vision scientists at all career stages, students, and those in affiliated fields to share the latest research findings and collaborate on innovative solutions. For 2023, the Meeting will be hosted April 23 – 27 in New Orleans, La., Purpose : The retina is the most accessible part of the central nervous system, allowing its non-invasive exploration and measurement. Optical Coherence Tomography (OCT) offers an objective monitoring method of progression in Neurodegenerative Disease (NDD), enabling the extraction of biomarkers such as retinal layer thickness. Machine learning models allow the automatic and repeatable measurement of the retinal layers and enable an early diagnosis of NDD. These need to be trained on annotated images representative of the visual patterns that characterise these diseases. We present a study in the automatic measurement of retinal layer thickness in patients of different NDDs and an assessment of the mutual compatibility of models trained in representative images of these diseases. Methods : Five independent samples of multiple sclerosis, Alzheimer's disease, Parkinson's disease and essential tremor patients, along with healthy controls were prospectively recruited (N=50). Macula centred OCT volumes from these patients were annotated with the area of the Retinal Nerve Fibre Layer (RNFL) and between the Ganglion Cell Layer and Bruch's Membrane (GCL-BM), for 1250 B-scans in total. In a first experiment, a series of deep learning models were trained on every NDD but one and evaluated in terms of their ability to segment the retinal layers of the unseen NDD. In a second experiment, the models were trained on images from a specific NDD and then evaluated on each of the other ones. Results : The average thickness for each layer was measured and separately compared for each NDD using a one-way ANOVA test. This test found no significant differences between the thickness of either RNFL or GCL-BM (p>0.05). The results show that the models are able to accurately segment the retinal layers, with an overall Dice coefficient of 0.96±0.02 for Experiment 1 and 0.95±0.03 for Experiment 2. However, these results do not translate equally for every NDD. The models trained in diseases such as Alzheimer's and essential tremor can better generalise to other NDDs, while healthy control images achieved the second worst results. Conclusions : Patients of different NDDs may present visual differences in their retinal OCTs, which affect the performance of automatic retinal layer segmentation models., This research was funded by Instituto de Salud Carlos III, Government of Spain, [research projects PI17/01726 and PI20/00437]; Inflammatory Disease Network (RICORS) [research project RD21/0002/0050]; Ministerio de Ciencia e Innovación, Government of Spain [research projects RTI2018-095894-B-I00, PID2019-108435RB-I00 and TED2021-131201B-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/161]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding organisations had no role in the design or conduct of this research., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Capítulo o parte de un libro (BookPart)

Fully Automatic Epiretinal Membrane Segmentation in OCT Scans Using Convolutional Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: The epiretinal membrane (ERM) is an ocular pathology that can cause visual distortions. To prevent a loss of vision, symptomatic ERM needs to be removed before it can cause irreversible damage. In order to do this, the ERM needs to be located early, so that it can be peeled from the retina. This chapter explores an automatic methodology for ERM segmentation, as well as its intuitive visualization in the form of colour maps. To do this, visual features that are compatible with ERM presence are extracted from ophthalmologic images by using computer vision algorithms and deep learning models. This methodology achieved satisfactory results, reaching a dice coefficient of 0.826 and a Jaccard index of 0.714, contributing to highlight the applicability of deep learning models for the detection of pathological signs in medical images., This research was funded by Instituto de Salud Carlos III, Government of Spain, [research project DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [research project RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain [research project PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [grant ref. ED431C 2020/24], predoctoral [grant ref. ED481A 2021/161] and postdoctoral [grant ref. ED481B 113 Fully Automatic Epiretinal Membrane Segmentation 2021/059]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant ref. IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant ref. ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Capítulo o parte de un libro (BookPart)

Generation of Novel Synthetic Portable Chest X-Ray Images for Automatic COVID-19 Screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
in: Rajae El Ouazzani, Mohammed Fattah, Nabil Benamar (eds.) AI Applications for Disease Diagnosis and Treatment, IGI Global, 2022, [Abstract]: The diagnosis and the study of the evolution of COVID-19 is crucial to tackle the challenge that this disease represents for healthcare services. Chest x-ray imaging allows us to visualize the pulmonary regions, where COVID-19 causes its main affectation. In order to reduce the risk of cross-contamination, a crucial aspect in the pandemic, portable chest x-ray devices are advantageous being easier to decontaminate in comparison with the fixed machinery, despite offering a lower image quality. Furthermore, the recent emergence of COVID-19 implies a data scarcity that must be tackled. In this chapter, the authors present the analysis of a strategy that generates novel synthetic portable chest x-ray images using the CycleGAN, an architecture for image translation that is trained with unpaired data. The novel set of images is then added to the original dataset, improving the performance of the classification model., This research was funded by Instituto de Salud Carlos III, Government of Spain, [grant number DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [grant number RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant number PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts [grant number ED481A 2021/196] and [grant number ED481B 2021/059], respectively; and Grupos de Referencia Competitiva, [grant number ED431C 2020/24]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant number IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481B 2021/059
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Fully-Automatic 3D Intuitive Visualization of Age-Related Macular Degeneration Fluid Accumulations in OCT Cubes

  • López-Varela, Emilio
  • Vidal, Plácido
  • Olivier Pascual, Nuria
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Age-related macular degeneration is the leading cause of vision loss in developed countries, and wet-type AMD requires urgent treatment and rapid diagnosis because it causes rapid irreversible vision loss. Currently, AMD diagnosis is mainly carried out using images obtained by optical coherence tomography. This diagnostic process is performed by human clinicians, so human error may occur in some cases. Therefore, fully automatic methodologies are highly desirable adding a layer of robustness to the diagnosis. In this work, a novel computer-aided diagnosis and visualization methodology is proposed for the rapid identification and visualization of wet AMD. We adapted a convolutional neural network for segmentation of a similar domain of medical images to the problem of wet AMD segmentation, taking advantage of transfer learning, which allows us to work with and exploit a reduced number of samples. We generate a 3D intuitive visualization where the existence, position and severity of the fluid were represented in a clear and intuitive way to facilitate the analysis of the clinicians. The 3D visualization is robust and accurate, obtaining satisfactory 0.949 and 0.960 Dice coefficients in the different evaluated OCT cube configurations, allowing to quickly assess the presence and extension of the fluid associated to wet AMD., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG. The research was funded by Instituto de Salud Carlos III, Government of Spain through the PI17/00940 and DTS18/00136 research projects, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, unta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). Emilio López Varela acknowledges its support under FPI Grant Program through the PID2019-108435RB-I00 project., Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Portable chest X-ray image generation for the improvement of the automatic COVID-19 screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
V XoveTIC Conference. XoveTIC 2022, A Coruña, 5 y 6 de octubre de 2022., [Abstract]: COVID-19 is a disease whose gold standard diagnosis tool, RT-PCR, is unable to provide accurate quantification of its severity in a given patient. Currently, this assessment can be performed with the help of chest X-ray imaging visualization that, however, is a manual, tedious and time-consuming task. In this context, Computer-Aided Diagnosis (CAD) systems are very useful to facilitate the work of clinical specialists in these complex diagnostic tasks, especially in view of recent advances in deep learning techniques in the field of medical image analysis. Despite their great potential, deep learning strategies require a large amount of labelled data, which is often scarce in the context of COVID-19 pandemic. To mitigate these problems, in this work we propose the use of a image translation paradigm, the Cycle-Consistent Adversarial Networks (CycleGAN) to generate a novel set of synthetic images with the aim to improve an automatic COVID-19 screening system using portable chest X-ray images., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/196; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Deep Learning Models for Justified Referral in AI Glaucoma Screening

  • Casado-García, Ángela
  • Heras, Jónathan
  • Ortega Hortas, Marcos
  • Ramos, Lucía
Presented at: 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 27-30 May 2024, Athens, Greece This version of the article has been accepted for publication, after peer review. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The Version of Record is available online at: https://doi.org/10.1109/ISBI56570.2024.10635680, [Abstract]: Glaucoma is an optic disease that leads to blindness, but this might be avoided with an early diagnosis thanks to a screening test. The JustRAIGS Challenge was organised to develop solutions for glaucoma screening from retinal fundus images that not only classify fundus images as "referrable"or "no referable"but also identify specific characteristics or abnormalities that may be present in the fundus images of glaucoma patients. In this work, we present our solution to this challenge based on the study of several combinations of fundus images and their associated optic disc and cup. For the binary task, our solution consists of the ensemble of a ConvNext model and a Swin model that achieves a sensitivity at 95% specificity of 0.8570; whereas, for the multi-label task, our ConvNext model achieved a Hamming Loss of 0.1930., This work was partially supported by Grant PID2020-115225RBI00 funded by MCIN/AEI/10.13039/501100011033, and by Ministerio de Ciencia e Innovación, Government of Spain through the research project with grant number PID2019-108435RB-I00. Ángela Casado-García has a FPI grant from Community of La Rioja 2020, at the moment, she is in the Postdoctoral Orientation Period (POP).
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Visualization of pathological changes in retinal layer thickness using optical coherence tomography

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
[Abstract]: Optical Coherence Tomography (OCT) is a non-invasive imaging technique that provides high-resolution cross-sectional images of biological tissues. Biomarkers such as the thickness of retinal layers can be used for the evaluation of several diseases such as glaucoma or multiple sclerosis. In this work, we create the thickness profiles of healthy and pathological eyes using a statistical model and developed a methodology to compare the thickness profiles of OCT images with the models and visually inspect the abnormal areas. This approach allows for a quick assessment of the retinal layers health, assisting clinicians and easing the diagnostic burden., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Emilio López Varela acknowledges its support under FPI PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Phytoplankton detection and recognition in freshwater digital microscopy images using deep learning object detectors

  • Figueroa, Jorge
  • Rivas-Villar, David
  • Rouco, José
  • Novo Buján, Jorge
[Absctract]: Water quality can be negatively affected by the presence of some toxic phytoplankton species, whose toxins are difficult to remove by conventional purification systems. This creates the need for periodic analyses, which are nowadays manually performed by experts. These labor-intensive processes are affected by subjectivity and expertise, causing unreliability. Some automatic systems have been proposed to address these limitations. However, most of them are based on classical image processing pipelines with not easily scalable designs. In this context, deep learning techniques are more adequate for the detection and recognition of phytoplankton specimens in multi-specimen microscopy images, as they integrate both tasks in a single end-to-end trainable module that is able to automatize the adaption to such a complex domain. In this work, we explore the use of two different object detectors: Faster R-CNN and RetinaNet, from the one-stage and two-stage paradigms respectively. We use a dataset composed of multi-specimen microscopy images captured using a systematic protocol. This allows the use of widely available optical microscopes, also avoiding manual adjustments on a per-specimen basis, which would require expert knowledge. We have made our dataset publicly available to improve the reproducibility and to foment the development of new alternatives in the field. The selected Faster R-CNN methodology reaches maximum recall levels of 95.35%, 84.69%, and 79.81%, and precisions of 94.68%, 89.30% and 82.61%, for W. naegeliana, A. spiroides, and D. sociale, respectively. The system is able to adapt to the dataset problems and improves the results overall with respect to the reference state-of-the-art work. In addition, the proposed system improves the automation and abstraction from the domain and simplifies the workflow and adjustment., This research was funded by Ministerio de Innovación, Government of Spain [research projects PDC2022-133132-I00, PID2019-108435RB-I00 and TED2021-131201B-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts ref. ED481A 2021/147 and ED481A 2023/059, and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481A 2023/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

COVID-19 Lung Radiography Segmentation by Means of Multiphase Transfer Learning

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] COVID-19 is characterized by its impact on the respiratory system and, during the global outbreak of 2020, specific protocols had to be designed to contain its spread within hospitals. This required the use of portable X-ray devices that allow for a greater flexibility in terms of their arrangement in rooms not specifically designed for such purpose. However, their poor image quality, together with the subjectivity of the expert, can hinder the diagnosis process. Therefore, the use of automatic methodologies is advised. Even so, their development is challenging due to the scarcity of available samples. For this reason, we present a COVID-19-specific methodology able to segment these portable chest radiographs with a reduced number of samples via multiple transfer learning phases. This allows us to extract knowledge from two related fields and obtain a robust methodology with limited data from the target domain. Our proposal aims to help both experts and other computer-aided diagnosis systems to focus their attention on the region of interest, ignoring unrelated information., Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Multi-task localization of the hemidiaphragms and lung segmentation in portable chest X-ray images of COVID-19 patients

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Aslani, Shahab
  • Jacob, Joseph
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Background: The COVID-19 can cause long-term symptoms in the patients after they overcome the disease. Given that this disease mainly damages the respiratory system, these symptoms are often related with breathing problems that can be caused by an affected diaphragm. The diaphragmatic function can be assessed with imaging modalities like computerized tomography or chest X-ray. However, this process must be performed by expert clinicians with manual visual inspection. Moreover, during the pandemic, the clinicians were asked to prioritize the use of portable devices, preventing the risk of cross-contamination. Nevertheless, the captures of these devices are of a lower quality. Objectives: The automatic quantification of the diaphragmatic function can determine the damage of COVID-19 on each patient and assess their evolution during the recovery period, a task that could also be complemented with the lung segmentation. Methods: We propose a novel multi-task fully automatic methodology to simultaneously localize the position of the hemidiaphragms and to segment the lung boundaries with a convolutional architecture using portable chest X-ray images of COVID-19 patients. For that aim, the hemidiaphragms’ landmarks are located adapting the paradigm of heatmap regression. Results: The methodology is exhaustively validated with four analyses, achieving an 82.31% +- 2.78% of accuracy when localizing the hemidiaphragms’ landmarks and a Dice score of 0.9688 +- 0.0012 in lung segmentation. Conclusions: The results demonstrate that the model is able to perform both tasks simultaneously, being a helpful tool for clinicians despite the lower quality of the portable chest X-ray images., The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). This research was funded in whole or in part by the Wellcome Trust [209553/Z/17/Z]. For the purpose of open access, the author has applied a CC-BY public copyright licence to any author accepted manuscript version arising from this submission., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A 2021/196, Wellcome Trust; 209553/Z/17/Z
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Context encoder self-supervised approaches for eye fundus analysis

  • Iglesias Morís, Daniel
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
© 2021 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/IJCNN52387.2021.9533567, Proceedings of the International Joint Conference on Neural NetworksVolume 2021-July18 July 2021 2021 International Joint Conference on Neural Networks, IJCNN 2021Virtual, Shenzhen, 18 July 2021 through 22 July 2021, Code 171891, [Abstract]: The broad availability of medical images in current clinical practice provides a source of large image datasets. In order to use these datasets for training deep neural networks in detection and segmentation tools, it is necessary to provide pixel-wise annotations associated to each image. However, the image annotation is a tedious, time consuming and error prone process that requires the participation of experienced specialists. In this work, we propose different complementary context encoder self-supervised approaches to learn relevant characteristics for the restricted medical imaging domain of retinographies. In particular, we propose a patch-wise approach, inspired in the previous proposal of broad domain context encoders, and complementary fully convolutional approaches. These approaches take advantage of the restricted application domain to learn the relevant features of the eye fundus, situation that can be extrapolated to many medical imaging issues. Different representative experiments were conducted in order to evaluate the performance of the trained models, demonstrating the suitability of the proposed approaches in the understanding of the eye fundus characteristics. The proposed self-supervised models can serve as reference to support other domain-related issues through transfer or multi-task learning paradigms, like the detection and evaluation of the retinal structures or anomaly detections in the context of pathological analysis., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, the predoctoral grant contract ref. ED481A-2017/328; Ministe-rio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Análisis de datos multimodales para la toma de decisiones clínicas utilizando Inteligencia Artificial en el contexto de la COVID-19

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Míguez-Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
BIOINTEGRASAÚDE 2023, celebrada en A Coruña o día 14 de Decembro de 2023, organizada polo Instituto de Investigación Biomédica da Coruña (INIBIC), o Instituto de Investigación Sanitaria de Santiago de Compostela (IDIS) e o Instituto de Investigación Sanitaria Galicia Sur (IISGS), [Abstract]: La COVID-19 es una enfermedad pulmonar infecciosa causante de la pandemia mundial del año 2020. En los momentos críticos de las emergencias sanitarias, el equipo médico debe tomar decisiones importantes en un contexto de recursos limitados. En este contexto, los métodos de diagnóstico asistido por ordenador pueden ayudar en esa toma de decisiones, permitiendo identificar a los pacientes de alto riesgo. Esto se puede realizar utilizando información extraída de historiales clínicos electrónicos, tests de laboratorio o estudios de imagen. En este trabajo, presentamos un nuevo método eficiente y totalmente automático para estimar el riesgo de pacientes COVID-19, utilizando la fusión de datos multimodales con características clínicas y características profundas extraídas a partir de imágenes de radiografía torácica. Esta estimación se efectúa en 2 escenarios críticos: riesgo de hospitalización y riesgo de fallecimiento. Los resultados demuestran un gran desempeño por parte de los clasificadores, estimando ambos riesgos con una gran precisión y utilizando únicamente un subconjunto muy reducido de un conjunto de características originales notablemente más extenso. Esta reducción de la dimensionalidad en el conjunto de datos es muy ventajosa en escenarios donde los recursos computacionales son limitados. Este método totalmente automático presenta un potencial prometedor para mejorar el proceso de toma de decisiones clínicas y una mejor gestión de los recursos médicos, no solo en el contexto de la COVID-19 sino también en otros escenarios clínicos., Este trabajo está financiado por el Ministerio de Ciencia e Innovación, Gobierno de España por medio del proyecto de investigación con los códigos [RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 y PDC2022-133132-I00]; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [código ED431C 2020/24], ayuda predoctoral [código ED481A 2021/196]., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Context encoder transfer learning approaches for retinal image analysis

  • Iglesias Morís, Daniel
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: During the last years, deep learning techniques have emerged as powerful alternatives to solve biomedical image analysis problems. However, the training of deep neural networks usually needs great amounts of labeled data to be done effectively. This is even more critical in the case of biomedical imaging due to the added difficulty of obtaining data labeled by experienced clinicians. To mitigate the impact of data scarcity, one of the most commonly used strategies is transfer learning. Nevertheless, the success of this approach depends on the effectiveness of the available pre-training techniques for learning from little or no labeled data. In this work, we explore the application of the Context Encoder paradigm for transfer learning in the domain of retinal image analysis. To this aim, we propose several approaches that allow to work with full resolution images and improve the recognition of the retinal structures. In order to validate the proposals, the Context Encoder pre-trained models are fine-tuned to perform two relevant tasks in the domain: vessels segmentation and fovea localization. The experiments performed on different public datasets demonstrate that the proposed Context Encoder approaches allow mitigating the impact of data scarcity, being superior to previous alternatives in this domain., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Gov- ernment of Spain, DTS18/00136 research project; Ministerio de Cien- cia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Univer- sidade, Xunta de Galicia, Spain through the predoctoral grant contract ref. ED481A 2021/196 and postdoctoral grant contract ref. ED481B- 2022-025; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

ConKeD: multiview contrastive descriptor learning for keypoint-based retinal image registration

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Retinal image registration is of utmost importance due to its wide applications in medical practice. In this context, we propose ConKeD, a novel deep learning approach to learn descriptors for retinal image registration. In contrast to current registration methods, our approach employs a novel multi-positive multi-negative contrastive learning strategy that enables the utilization of additional information from the available training samples. This makes it possible to learn high-quality descriptors from limited training data. To train and evaluate ConKeD, we combine these descriptors with domain-specific keypoints, particularly blood vessel bifurcations and crossovers, that are detected using a deep neural network. Our experimental results demonstrate the benefits of the novel multi-positive multi-negative strategy, as it outperforms the widely used triplet loss technique (single-positive and single-negative) as well as the single-positive multi-negative alternative. Additionally, the combination of ConKeD with the domain-specific keypoints produces comparable results to the state-of-the-art methods for retinal image registration, while offering important advantages such as avoiding pre-processing, utilizing fewer training samples, and requiring fewer detected keypoints, among others. Therefore, ConKeD shows a promising potential towards facilitating the development and application of deep learning-based methods for retinal image registration., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24, predoctoral fellowship ref. ED481A 2021/147 and the postdoctoral fellowship ref. ED481B-2022-025; and Instituto de Salud Carlos III (ISCIII) under the grant FORT23/00010 as part of the Programa FORTALECE of Ministerio de Ciencia e Innovación. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481B-2022-025
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Comprehensive fully-automatic multi-depth grading of the clinical types of macular neovascularization in OCTA images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Almuina Varela, Pablo
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
  • Novo Buján, Jorge
[Abstract]: Optical Coherence Tomography Angiography or OCTA represents one of the main means of diagnosis of Age-related Macular Degeneration (AMD), the leading cause of blindness in developed countries. This eye disease is characterized by Macular Neovascularization (MNV), the formation of vessels that tear through the retinal tissues. Four types of MNV can be distinguished, each representing different levels of severity. Both the aggressiveness of the treatment and the recovery of the patient rely on an early detection and correct diagnosis of the stage of the disease. In this work, we propose the first fully-automatic grading methodology that considers all the four clinical types of MNV at the three most relevant OCTA scanning depths for the diagnosis of AMD. We perform both a comprehensive ablation study on the contribution of said depths and an analysis of the attention maps of the network in collaboration with experts of the domain. Our proposal aims to ease the diagnosis burden and decrease the influence of subjectivity on it, offering a explainable grading through the visualization of the attention of the expert models. Our grading proposal achieved satisfactory results with an AUC of 0.9224 ± 0.0381. Additionally, the qualitative analysis performed in collaboration with experts revealed the relevance of the avascular plexus in the grading of all three types of MNV (despite not being directly involved in some of them). Thus, our proposal is not only able to robustly detect MNV in complex scenarios, but also aided to discover previously unconsidered relationships between plexuses., Funding for open access charge: Universidade da Coruña/CISUG. This research was funded by Instituto de Salud Carlos III, Government of Spain, PI17/00940 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271 and Ayudas complementarias de movilidad destinadas a beneficiarios del programa de Formación del Profesorado Universitario (FPU) EST22/00696; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38;CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Clinical Decision Support Tool for the Identification of Pathological Structures Associated with Age-Related Macular Degeneration

  • Barrientos Lema, Iván
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Penedo, Manuel
18th International Conference on Computer Aided Systems Theory, EUROCAST 2022, Las Palmas de Gran Canaria, 20 - 25 February 2022, This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature's AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-25312-6_48, [Abstract]: In the field of ophthalmology, different imaging modalities are commonly used to carry out different clinical diagnostic procedures. Currently, both optical coherence tomography (OCT) and optical coherence tomography angiography (OCT-A) have made great advances in the study of the posterior pole of the eye and are essential for the diagnosis and monitoring of the treatment of different ocular and systemic diseases. On the other hand, the development of clinical decision support systems is an emerging field, in which clinical and technological advances are allowing clinical specialists to diagnose various pathologies with greater precision, which translates into more appropriate treatment and, consequently, an improvement in the quality of life of patients. This paper presents a clinical decision support tool for the identification of different pathological structures associated with age-related macular degeneration using OCT and OCT-A images. The system provides a useful tool that facilitates clinical decision-making in the diagnosis and treatment of this relevant disease., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 and PI17/00940 research projects; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and postdoctoral grant ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Con-sellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Robust deep learning-based approach for retinal layer segmentation in optical coherence tomography images

  • Budiño, Alejandro
  • Ramos, Lucía
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Penedo, Manuel
  • Ortega Hortas, Marcos
18th International Conference on Computer Aided Systems Theory, EUROCAST 2022,Las Palmas de Gran Canaria,20 February 2022 through 25 February 2022, This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-25312-6_50, [Abstract]: In recent years, the medical image analysis field has experienced remarkable growth. Advances in computational power have made it possible to create increasingly complex diagnostic support systems based on deep learning. In ophthalmology, optical coherence tomography (OCT) enables the capture of highly detailed images of the retinal morphology, being the reference technology for the analysis of relevant ocular structures. This paper proposes a new methodology for the automatic segmentation of the main retinal layers using OCT images. The system provides a useful tool that facilitates the clinical evaluation of key ocular structures, such as the choroid, vitreous humour or inner retinal layers, as potential computational biomarkers for the analysis of different neurodegenerative disorders, including multiple sclerosis and Alzheimer’s disease., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and postdoctoral grant ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Instituto de Salud Carlos III; DTS18/00136, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Transformer-Based Multi-Prototype Approach for Diabetic Macular Edema Analysis in OCT Images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Cardoso, Jaime S.
© 2023 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/ICASSP49357.2023.10095039, Presentado en: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 04-10 June 2023, [Abstract]: Optical Coherence Tomography (OCT) is the major diagnostic tool for the leading cause of blindness in developed countries: Diabetic Macular Edema (DME). Depending on the type of fluid accumulations, different treatments are needed. In particular, Cystoid Macular Edemas (CMEs) represent the most severe scenario, while Diffuse Retinal Thickening (DRT) is an early indicator of the disease but a challenging scenario to detect. While methodologies exist, their explanatory power is limited to the input sample itself. However, due to the complexity of these accumulations, this may not be enough for a clinician to assess the validity of the classification. Thus, in this work, we propose a novel approach based on multi-prototype networks with vision transformers to obtain an example-based explainable classification. Our proposal achieved robust results in two representative OCT devices, with a mean accuracy of 0.9099 ± 0.0083 and 0.8582 ± 0.0126 for CME and DRT-type fluid accumulations, respectively., This research was funded by Instituto de Salud Carlos III, Government of Spain, PI17/00940 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271 and Ayudas complementarias de movilidad destinadas a beneficiarios del programa de Formación del Profesorado Universitario (FPU) EST22/00696; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38;CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Fully-automatic end-to-end approaches for 3D drusen segmentation in Optical Coherence Tomography images

  • Goyanes, Elena
  • Leyva Santarén, Saúl
  • Herrero, Paula
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at: 28th International Conference on Knowledge Based and Intelligent information and Engineering Systems (KES 2024), [Abstract]: Drusen, small lipid deposits located below the retina, are early biomarkers of age-related macular degeneration (AMD), a condition that leads to visual impairment worldwide, especially among the elderly. The presence of AMD is linked with Alzheimer’s Disease (AD) and dense deposit disease (DDD), emphasizing the critical need for early and accurate detection of drusen in retinal tissues. Optical Coherence Tomography (OCT), with its non-invasive and high-resolution imaging capabilities, stands as a pivotal tool for early AMD diagnosis through the identification of drusen. However, the reliance on manual segmentation of drusen in 3D OCT images introduces significant challenges: it is not only time-consuming but also subject to inter-observer variability, severely constraining its efficacy for widespread screening applications. These limitations underscore the critical need for an automated solution that can improve diagnostic workflows, ensure consistency across interpretations, and facilitate the processing of large datasets with improved accuracy and efficiency. In response, we propose a new deep learning-based, fully-automatic end-to-end approach for the segmentation of drusen in 3D OCT volumes. Complementary, a pivotal aspect of our research involves the first detailed comparative analysis between 2D and 3D end-to-end approaches. This comparison is crucial for understanding the impact of dimensional spatial information on the accuracy of drusen segmentation within OCT scans. The findings demonstrate that the 3D approach, by leveraging the depth and complexity of spatial data available in 3D OCT volumes, markedly surpasses the 2D approach. This superior performance underlines the importance of 3D spatial information in enhancing diagnostic precision. Through automating the segmentation process, our proposal not only makes AMD screening more efficient and precise but also significantly advances the diagnosis of retinal diseases, potentially enriching our understanding of systemic conditions connected through retinal biomarkers., This work was supported by Ministerio de Ciencia e Innovacion, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educacion, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24] and predoctoral grant [grant number ED481A-2023-152]. Furthermore, this work was supported by the Instituto de Salud Carlos III (ISCIII) under the grant [FORT23/00010] as part of the Programa FORTALECE del Ministerio de Ciencia e Innovacion., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Self-Supervised Multimodal Reconstruction Pre-training for Retinal Computer-Aided Diagnosis

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Computer-aided diagnosis using retinal fundus images is crucial for the early detection of many ocular and systemic diseases. Nowadays, deep learning-based approaches are commonly used for this purpose. However, training deep neural networks usually requires a large amount of annotated data, which is not always available. In practice, this issue is commonly mitigated with different techniques, such as data augmentation or transfer learning. Nevertheless, the latter is typically faced using networks that were pre-trained on additional annotated data. An emerging alternative to the traditional transfer learning source tasks is the use of self-supervised tasks that do not require manually annotated data for training. In that regard, we propose a novel self-supervised visual learning strategy for improving the retinal computer-aided diagnosis systems using unlabeled multimodal data. In particular, we explore the use of a multimodal reconstruction task between complementary retinal imaging modalities. This allows to take advantage of existent unlabeled multimodal data in the medical domain, improving the diagnosis of different ocular diseases with additional domain-specific knowledge that does not rely on manual annotation. To validate and analyze the proposed approach, we performed several experiments aiming at the diagnosis of different diseases, including two of the most prevalent impairing ocular disorders: glaucoma and age-related macular degeneration. Additionally, the advantages of the proposed approach are clearly demonstrated in the comparisons that we perform against both the common fully-supervised approaches in the literature as well as current self-supervised alternatives for retinal computer-aided diagnosis. In general, the results show a satisfactory performance of our proposal, which improves existing alternatives by leveraging the unlabeled multimodal visual data that is commonly available in the medical field., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening

  • Iglesias Morís, Daniel
  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Versión aceptada de: D. I. Morís, M. Gende, J. de Moura, J. Novo, M. Ortega, "Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening", 18th International Conference on Computer Aided Systems Theory - EUROCAST'22, 108-109, Las Palmas de Gran Canaria, Spain, 2022, Extended abstracts, [Abstract]: This manuscript presents a performance analysis of chest Xray synthetic image generation for COVID-19 screening. The proposed system translates chest X-ray images from Normal to COVID-19 and vice versa, without needing paired data, representing a powerful data augmentation approach. To this end, we analyze the performance of 3 representative state of the art architectures for image translation, assessing the impact of oversampling on improving the performance of automatic COVID-19 screening., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts refs. ED481A 2021/196, ED481A 2021/161 and postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Fully Automatic Deep Convolutional Approaches for the Analysis of COVID-19 Using Chest X-Ray Images

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Covid-19 is a new infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the seriousness of the situation, the World Health Organization declared a global pandemic as the Covid-19 rapidly around the world. Among its applications, chest X-ray images are frequently used for an early diagnostic/screening of Covid-19 disease, given the frequent pulmonary impact in the patients, critical issue to prevent further complications caused by this highly infectious disease. In this work, we propose 4 fully automatic approaches for the classification of chest X-ray images under the analysis of 3 different categories: Covid-19, pneumonia and healthy cases. Given the similarity between the pathological impact in the lungs between Covid-19 and pneumonia, mainly during the initial stages of both lung diseases, we performed an exhaustive study of differentiation considering different pathological scenarios. To address these classification tasks, we evaluated 6 representative state-of-the-art deep network architectures on 3 different public datasets: (I) Chest X-ray dataset of the Radiological Society of North America (RSNA); (II) Covid-19 Image Data Collection; (III) SIRM dataset of the Italian Society of Medical Radiology. To validate the designed approaches, several representative experiments were performed using 6,070 chest X-ray radiographs. In general, satisfactory results were obtained from the designed approaches, reaching a global accuracy values of 0.9706 ± 0.0044, 0.9839 ± 0.0102, 0.9744 ± 0.0104 and 0.9744 ± 0.0104, respectively, thus helping the work of clinicians in the diagnosis and consequently in the early treatment of this relevant pandemic pathology., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the postdoctoral grant contract ref. ED481B-2021-059; and Grupos de Referencia Competitiva, Spain, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, Spain, and the remaining 20% by “Secretaría Xeral de Universidades, Spain ” (Grant ED431G 2019/01). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Evolutionary mosaicking for high-resolution wide-field optical coherence tomography angiography

  • Martínez-Río, Javier
  • Carmona, Enrique J.
  • Cancelas, Daniel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a noninvasive imaging modality that produces retinal blood flow images. However, the limited field of view (FOV) of typical high-resolution scan poses challenges for comprehensive analysis. This work presents a fully automatic method for generating high-resolution wide-field OCTA mosaics from overlapping scans, addressing the need for wider FOVs without requiring advanced OCTA equipment or manual mosaicking. The proposed approach consists of a three-stage pipeline: an initial mosaic is constructed using correlation-based template matching, refined with an evolutionary algorithm to optimize vascular continuity at seams, and finalized with a blending stage to improve overall quality. Unlike existing methods, our approach avoids keypoint extraction or input image preprocessing, making it robust against noise and artifacts typically present in clinical OCTA images. Using a correlation-based metric that measures the degree of vascular continuity at the seams in each mosaic, we obtained a mean and standard deviation equal to (before blending) for all the mosaics analyzed. The proposed method presented robust results, producing high-resolution wide-field OCTA mosaics., This work was supported by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894- B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 and PDC2022- 133132-I00 research projects; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24. Two of the authors of this work also receive financial support from the European Social Fund, through the predoctoral contract ref. PEJD-2019-PRE/TIC-17030 and research assistant contract ref. PEJ-2019-AI/TIC-13771., Xunta de Galicia; ED431C 2020/24, Comunidad de Madrid; PEJD-2019-PRE/TIC-17030, Comunidad de Madrid; PEJ-2019-AI/TIC-13771
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Fully automatic segmentation and monitoring of choriocapillaris flow voids in OCTA images

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive ophthalmic imaging modality that is widely used in clinical practice. Recent technological advances in OCTA allow imaging of blood flow deeper than the retinal layers, at the level of the choriocapillaris (CC), where a granular image is obtained showing a pattern of bright areas, representing blood flow, and a pattern of small dark regions, called flow voids (FVs). Several clinical studies have reported a close correlation between abnormal FVs distribution and multiple diseases, so quantifying changes in FVs distribution in CC has become an area of interest for many clinicians. However, CC OCTA images present very complex features that make it difficult to correctly compare FVs during the monitoring of a patient. In this work, we propose fully automatic approaches for the segmentation and monitoring of FVs in CC OCTA images. First, a baseline approach, in which a fully automatic segmentation methodology based on local contrast enhancement and global thresholding is proposed to segment FVs and measure changes in their distribution in a straightforward manner. Second, a robust approach in which, prior to the use of our segmentation methodology, an unsupervised trained neural network is used to perform a deformable registration that aligns inconsistencies between images acquired at different time instants. The proposed approaches were tested with CC OCTA images collected during a clinical study on the response to photodynamic therapy in patients affected by chronic central serous chorioretinopathy (CSC), demonstrating their clinical utility. The results showed that both approaches are accurate and robust, surpassing the state of the art, therefore improving the efficacy of FVs as a biomarker to monitor the patient treatments. This gives great potential for the clinical use of our methods, with the possibility of extending their use to other pathologies or treatments associated with this type of imaging., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with references PID2019-108435RB-I00; TED2021-131201B-I00 and PDC2022-133132-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80 % through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20 % by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Joint keypoint detection and description network for color fundus image registration

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
[Absctract]: Background: Retinal imaging is widely used to diagnose many diseases, both systemic and eye-specific. In these cases, image registration, which is the process of aligning images taken from different viewpoints or moments in time, is fundamental to compare different images and to assess changes in their appearance, commonly caused by disease progression. Currently, the field of color fundus registration is dominated by classical methods, as deep learning alternatives have not shown sufficient improvement over classic methods to justify the added computational cost. However, deep learning registration methods are still considered beneficial as they can be easily adapted to different modalities and devices following a data-driven learning approach. Methods: In this work, we propose a novel methodology to register color fundus images using deep learning for the joint detection and description of keypoints. In particular, we use an unsupervised neural network trained to obtain repeatable keypoints and reliable descriptors. These keypoints and descriptors allow to produce an accurate registration using RANdom SAmple Consensus (RANSAC). We train the method using the Messidor dataset and test it with the Fundus Image Registration Dataset (FIRE) dataset, both of which are publicly accessible. Results: Our work demonstrates a color fundus registration method that is robust to changes in imaging devices and capture conditions. Moreover, we conduct multiple experiments exploring several of the method’s parameters to assess their impact on the registration performance. The method obtained an overall Registration Score of 0.695 for the whole FIRE dataset (0.925 for category S, 0.352 for P, and 0.726 for A). Conclusions: Our proposal improves the results of previous deep learning methods in every category and surpasses the performance of classical approaches in category A which has disease progression and thus represents the most relevant scenario for clinical practice as registration is commonly used in patients with diseases for disease monitoring purposes., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade Xunta de Galicia through the Grupos de Referencia Competitiva grant (Ref. ED431C 2020/24), the predoctoral fellowship (Ref. ED481A 2021/147) and the postdoctoral fellowship (Ref. ED481B-2022-025); CITIC, Centro de Investigación de Galicia (Ref. ED431G 2019/01), itself received financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Cycle generative adversarial network approaches to produce novel portable chest X-rays images for covid-19 diagnosis

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
© 2021 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/ICASSP39728.2021.9414031, Presentado en: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada, 2021, [Abstract]: Coronavirus Disease 2019 (COVID-19), declared a global pandemic by the World Health Organization, mainly affects the pulmonary tissues, playing chest X-ray images an important role for its screening and early detection. In this context, portable X-ray devices are widely used, representing an alternative to fixed devices in order to reduce risks of cross-contamination. However, they provide lower quality and detailed images in terms of spatial resolution and contrast. In this work, given the low availability of images of this recent disease, we present new approaches to artificially increase the dimensionality of portable chest X-ray datasets for COVID-19 diagnosis. Hence, we combined 3 complementary CycleGAN architectures to perform a simultaneous oversampling using an unsupervised strategy and without the necessity of paired data. Despite the poor quality of the portable X-ray images, we provide an overall accuracy of 92.50% in a COVID-19 screening context, proving their suitability for COVID-19 diagnostic tasks., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Automatic simultaneous ciliary muscle segmentation and biomarker extraction in AS-OCT images using deep learning-based approaches

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Recent clinical studies have emphasized the importance of understanding the morphology and mechanics of the ciliary muscle. The ciliary muscle plays a vital role in various functions related to the anterior segment of the eye, including the regulation of intraocular pressure and the maintenance of the shape of the crystalline lens. To advance research in this area, we propose a fully automated methodology for the segmentation and biomarker measurement of the ciliary muscle in two different scan depths (6 mm and 16 mm), which are commonly used by clinicians to analyze biomarkers. Our methodology aims to provide repeatable, and immediate results through an exhaustive analysis of different network architectures, encoders, and transfer learning strategies. We also extracted a comprehensive set of relevant biomarkers, including parameters that provide essential information about its behavior during the accommodation process, overall dimensions, and biomechanical properties. These biomarkers can help clinicians and researchers in the diagnoses and monitor of different ocular diseases such as glaucoma, myopia, and presbyopia and develop new therapeutic strategies, potentially leading to more effective treatments and improved patient outcomes. Our methodology achieved accurate qualitative and quantitative results, with high accuracy values of 0.9665 ± 0.1280 and 0.9772 ± 0.0873 for the best combinations for 6 mm and 16 mm, respectively. Our proposed system provides a valuable and automatic tool for clinicians and researchers in the segmentation and analysis of the ciliary muscle in AS-OCT images., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B–I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24]; predoctoral grant [grant number ED481A-2023-152]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Capítulo o parte de un libro (BookPart)

Computerized tool for the automatic segmentation of DRT edemas using OCT scans

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Part of Photo Acoustic and Optical Coherence Tomography Imaging, Volume 1: Diabetic retinopathy (pp. 1-1). Bristol, UK: IOP Publishing. https://doi.org/10.1088/978-0-7503-2052-8, [Abstract]: This chapter presents a software tool for the automated segmentation of diffuse retinal thickening regions from optical coherence tomography (OCT) images. For this purpose, two retinal regions were defined and extracted: the inner retina and the outer retina. Then, a learning process was used to analyze a comprehensive and heterogeneous subset of relevant patterns in the OCT scans. Finally, two complementary post-processing stages were applied to improve the obtained performance and the overall efficiency of the presented tool. The presented tool achieved satisfactory performance, which demonstrates the suitability of the adopted solution., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018–095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant reference FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant reference ED431C 2020/24 and through the postdoctoral grant contract reference ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant reference IN845D 2020/38; CITIC, Centro de Investigación de Galicia reference ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Deep feature analysis in a transfer learning approach for the automatic COVID-19 screening using chest X-ray images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: COVID-19 is a challenging disease that was declared as global pandemic in March 2020. As the main impact of this disease is located in the pulmonary regions, chest X-ray devices are very useful to understand the severity of the disease on each patient. In order to reduce the risk of cross-contamination, the radiologists are recommended to use portable devices instead of fixed machinery, as these devices are easier to decontaminate. Moreover, the development of reliable and robust methodologies of computer-aided diagnosis systems is very relevant to reduce the workload that expert clinicians are experiencing in the current moment. In this work, we propose a comprehensive analysis of the deep features extracted from portable chest X-ray captures to perform a COVID-19 screening. We also study the optimal characterization of the problem with a lower dimensionality, contrasting the results of the feature selection methods that were chosen. Results demonstrated that the proposed approach is robust and reliable, obtaining a 90.43% of accuracy for the test set, using only 46.85% of the deep features in the context of poor quality and low detail X-ray images obtained from portable devices., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secre-taría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Sistema automático para la evaluación de enfermedades neurodegenerativas en imágenes OCT mediante deep learning

  • Álvarez-Rodríguez, Lorena
  • Pueyo-Bestué, Ana
  • Moura, Joaquim de
  • Viladés, Elisa
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
O IDIS, INIBIC e IIS Galicia Sur organizaron Biointegrasaúde 2023, celebrado no Complexo Hospitalario Universitario de A Coruña (CHUAC), 14 de dicembro de 2023., El Alzhéimer (AD), el temblor esencial (ET), la esclerósis múltiple (MS) o el Párkinson (PD) son enfermedades neurodegenerativas (END) que están correlacionadas con cambios en algunas capas retinales clave. Las tomografías de coherencia óptica (OCT) pueden proporcionar información detallada desde diferentes perspectivas para analizar esas capas. Proponemos un sistema automático que: Segmenta las capas RNFL y GCL-BM de vólumenes 3D e imágenes OCT retinales de mácula y disco óptico. Extrae biomarcadores computacionales como deep features o grosor. Hace un cribado combinando información de ambas vistas OCT., Esta investigación ha sido subvencionada por el Instituto de Salud Carlos III, Gobierno de Spain, [proyectos de investigación PI17/01726 y PI20/00437]; Inflammatory Disease Network (RICORS) [proyecto RD21/0002/0050]; Ministerio de Ciencia e Innovación, Gobierno de Spain [proyectos de investigación PDC2022-133132-I00, PID2019-108435RB-I00 y TED2021-131201B-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, a través de Grupos de Referencia Competitiva [subvención ED431C 2020/24]. Las organizaciones financiadoras no participaron en el dise˜no o ejecución de esta investigación., Gobierno de Aragón; RD21/0002/0050, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Explainable learning to analyze the outcome of COVID-19 patients using clinical data

  • Olañeta Fariña, Daniel
  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Míguez-Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Patients at high risk of contracting COVID-19 require specialized monitoring throughout their illness to ensure optimal treatment at each stage. To support this monitoring, Computer-Aided Diagnosis (CAD) methods analyze clinical data to estimate the most likely outcome for each patient, using various clinical variables such as symptoms, medical history, and laboratory results to predict outcomes. Despite the numerous proposals for COVID-19 diagnosis using CAD methods, the lack of explainability in many machine learning models poses a challenge in incorporating these methods into clinical practice. Additionally, other crucial tasks such as estimating the risk of death or severe forms of the disease must be considered to identify cases that require greater monitoring. To overcome these challenges, we propose an explainable methodology for estimating the risk of hospitalization and death in COVID-19 patients using clinical data. Our methodology employs four machine learning algorithms, three feature selection methods, and a decision tree to provide explainability. Our approach achieves an accuracy of 86.16% ± 0.74% for the estimation of hospitalization risk with 29 features, and an accuracy of 86.40% ± 1.80% for the estimation of the risk of death with 26 features. Moreover, our methodology provides valuable insights into the relationship between clinical variables and patient outcomes, which can inform more robust and informed clinical decision-making and improve our understanding of the disease. We demonstrate the potential of our transparent and effective CAD methods to support clinical decision-making in COVID-19 patient care and further research, offering a promising solution to overcome the challenges in incorporating CAD methods into clinical practice., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Con-sellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secre-taría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Evolutionary multi-target neural network architectures for flow void analysis in optical coherence tomography angiography

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • García-Feijóo, Julián
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive imaging modality used to evaluate the retinal microvasculature. Recent advances in OCTA allows to visualize the blood flow within the choriocapillaris region, where a granular image is obtained showing a pattern of small dark regions, called flow voids (FVs). Given its relevance, numerous clinical studies have linked the changes in FVs distribution to multiple diseases. The granular structure of these images makes accurate labeling and segmentation difficult, which can be overcome by using a multi-target perspective. However, manually designing a neural architecture that can accurately predict all targets in a balanced way is a major challenge. In this work, we propose a novel methodology based on evolutionary multi-target optimized networks that, through a set of evolutionary operators, traverses a search space of architectures in a deep but efficient way. This methodology allows us to discover efficient and accurate multi-target architectures tailored to our problem, but which are also adaptable to other tasks due to their robustness. To validate and analyze our methodology and the discovered network model, we performed extensive experimentation with cases from a real clinical study, achieving better results than the state of the art and manually designed architectures., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021- 131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Pulmonary-Restricted COVID-19 Informative Visual Screening Using Chest X-ray Images from Portable Devices

  • Vidal, Plácido
  • Moura, Joaquim de
  • Ortega Hortas, Marcos
This version of the conference paper has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-06427-2_6., The conference was held during May 23-27, 2022, in Lecce, Italy., [Abstract]: In the recent COVID-19 outbreak, chest X-rays were the main tool for diagnosing and monitoring the pathology. To prevent further spread of this disease, special circuits had to be implemented in the healthcare services. For this reason, these chest X-rays were captured with portable X-ray devices that compensate its lower quality and limitations with more deployment flexibility. However, most of the proposed computer-aided diagnosis methodologies were designed to work with traditional fixed X-ray machines and their performance is diminished when faced with these portable images. Additionally, given that the equipment needed to properly treat the disease (such as for life support and monitoring of vital signs) most of these systems learnt to identify these artifacts in the images instead of real clinically-significant variables. In this work, we present the first methodology forced to extract features exclusively from the pulmonary region of interest that is specially designed to work with these difficult portable images. Additionally, we generate a class activation map so the methodology also provides explainability to the results returned to the clinician. To ensure the robustness of our proposal, we tested the methodology with chest radiographs from patients diagnosed with COVID-19, pathologies similar to COVID-19 (such as other types of viral pneumonias) and healthy patients in different combinations with three convolutional networks from the state of the art (for a total of 9 studied scenarios). The experimentation confirms that our proposal is able to separate COVID-19 cases, reaching a 94.7% ± 1.34% of accuracy., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Recurrent Task Specialization Network for Segmentation-aided Vascular Landmarks Detection in Retinal Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Sánchez, Clara I.
  • Ortega Hortas, Marcos
Presented at the 27th European Conference on Artificial Intelligence, ECAI 2024, Santiago de Compostela 19-24 October 2024., [Abstract]: The detection of vessel crossings and bifurcations in eye fundus images plays an important role in numerous applications, including the diagnosis of ophthalmic and systemic diseases, biometric authentication, and retinal image registration. Nowadays, deep neural networks are successfully used for the detection of these vascular landmarks. However, existing approaches could be limited by the lack of understanding of the retinal anatomy and the intricate retinal vasculature. In this context, we propose Recurrent Task Specialization, a novel approach that performs a recurrent forward process with two forward passes through the same network, each of them specialized in a different task. We apply the proposed approach to the detection of vessel crossings and bifurcations in the retina via heatmap regression, using the segmentation of the retinal vasculature as the auxiliary task. To validate our proposal, we perform comparative experiments on two public datasets, including common alternatives to leverage auxiliary tasks, such as standard multi-task learning and transfer learning. The proposed approach outperforms existing alternatives and achieves the best results in the state-of-the-art for the detection of vessel crossings and bifurcations in retinal images. In this regard, our experiments demonstrate the potential of the proposed approach to improve the performance of deep neural networks in applications where adequate auxiliary tasks can be constructed., This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24 and the postdoctoral fellowship ref. ED481B-2022-025; and Instituto de Salud Carlos III under the grant [FORT23/00010] as part of Programa FORTALECE from Ministerio de Ciencia e Innovación., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Robust multi-view approaches for retinal layer segmentation in glaucoma patients via transfer learning

  • Gende, M.
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Martínez-de-la-Casa, José María
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Background: Glaucoma is the leading global cause of irreversible blindness. Glaucoma patients experience a progressive deterioration of the retinal nervous tissues that begins with a loss of peripheral vision. An early diagnosis is essential in order to prevent blindness. Ophthalmologists measure the deterioration caused by this disease by assessing the retinal layers in different regions of the eye, using different optical coherence tomography (OCT) scanning patterns to extract images, generating different views from multiple parts of the retina. These images are used to measure the thickness of the retinal layers in different regions. Methods: We present two approaches for the multi-region segmentation of the retinal layers in OCT images of glaucoma patients. These approaches can extract the relevant anatomical structures for glaucoma assessment from three different OCT scan patterns: circumpapillary circle scans, macular cube scans and optic disc (OD) radial scans. By employing transfer learning to take advantage of the visual patterns present in a related domain, these approaches use state-of-the-art segmentation modules to achieve a robust, fully automatic segmentation of the retinal layers. The first approach exploits inter-view similarities by using a single module to segment all of the scan patterns, considering them as a single domain. The second approach uses view-specific modules for the segmentation of each scan pattern, automatically detecting the suitable module to analyse each image. Results: The proposed approaches produced satisfactory results with the first approach achieving a dice coefficient of 0.85±0.06 and the second one 0.87±0.08 for all segmented layers. The first approach produced the best results for the radial scans. Concurrently, the view-specific second approach achieved the best results for the better represented circle and cube scan patterns. Conclusions: To the extent of our knowledge, this is the first proposal in the literature for the multi-view segmentation of the retinal layers of glaucoma patients, demonstrating the applicability of machine learning-based systems for aiding in the diagnosis of this relevant pathology., This work was supported by Ministerio de Ciencia e Innovación y Universidades, Government of Spain (grant number RTI2018-095894-B-I00); Ministerio de Ciencia e Innovación, Government of Spain through the research project with (grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00); Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, Grupos de Referencia Competitiva (grant number ED431C 2020/24), predoctoral grant (grant number ED481A 2021/161); CITIC, Centro de Investigación de Galicia (grant number ED431G 2019/01), and receives financial support from Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening

  • Iglesias Morís, Daniel
  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Versión aceptada de: Morís, D.I., Gende, M., de Moura, J., Novo, J., Ortega, M. (2022). Performance Analysis of GAN Approaches in the Portable Chest X-Ray Synthetic Image Generation for COVID-19 Screening. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2022. EUROCAST 2022. Lecture Notes in Computer Science, vol 13789. Springer, Cham. https://doi.org/10.1007/978-3-031-25312-6_47, [Abstract]: COVID-19 mainly affects lung tissues, aspect that makes chest X-ray imaging useful to visualize this damage. In the context of the global pandemic, portable devices are advantageous for the daily practice. Furthermore, Computer-aided Diagnosis systems developed with Deep Learning algorithms can support the clinicians while making decisions. However, data scarcity is an issue that hinders this process. Thus, in this work, we propose the performance analysis of 3 different stateof-the-art Generative Adversarial Networks (GAN) approaches that are used for synthetic image generation to improve the task of automatic COVID-19 screening using chest X-ray images provided by portable devices. Particularly, the results demonstrate a significant improvement in terms of accuracy, that raises 5.28% using the images generated by the best image translation model., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts refs. ED481A 2021/196, ED481A 2021/161 and postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Enhanced multiple sclerosis diagnosis using high-resolution 3D OCT volumes with synthetic slices

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Santos Bueso, Enrique
  • Barreira, Noelia
[Abstract]: Optical Coherence Tomography (OCT), known for its micron-level resolution and non-invasive nature, is essential in diagnosing Multiple Sclerosis (MS). Accurate MS diagnosis through OCT is facilitated by identifying changes in retinal layer thickness, which serve as biomarkers, such as the retinal nerve fiber layer and the macular ganglion cell layer. To adequately diagnose MS, it is crucial to detect thickness changes in specific small regions of the retina, necessitating extensive retinal coverage with minimal granularity. However, a significant challenge in using OCT for MS diagnosis is the inverse relationship between the number of slices and the image quality of OCT volumes. High-resolution images require longer acquisition times, which limits the number of slices that can be obtained and results in covering a smaller area of the retina. Conversely, increasing the number of slices reduces individual image quality, impairing the detection of retinal layer structures. To address this issue, we propose a novel approach for the automatic detection of MS using high-resolution synthetic 3D OCT volumes. Our methodology involves using a generative network to synthesize intermediate slices, thereby enhancing retinal coverage without degrading image quality. This synthetic augmentation improves cross-sectional resolution, providing more comprehensive retinal details. Then we use a segmentation network to extract biomarkers and multiple 3D classification models to directly detect MS automatically. Our results demonstrate significant improvements in accuracy and reliability. Integrating synthetic slices into OCT volumes enhances the detection of MS, underscoring the potential of generative models for better clinical outcomes in MS diagnosis., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universi- dade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014– 2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Enhancing Pathological Detection and Monitoring in OCT Volumes with Limited Slices using Convolutional Neural Networks and 3D Visualization Techniques

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Penedo, Manuel
Cursos e Congresos, C-155, [Abstract] Optical Coherence Tomography (OCT) is a non-invasive imaging technique with a crucial role in the monitoring of a wide range of diseases. In order to make a good diagnosis it is essential that clinicians can observe any subtle changes that appear in the multiple ocular structures, so it is imperative that the 3D OCT volumes have good resolution in each axis. Unfortunately, there is a trade-off between image quality and the number of volume slices. In this work, we use a convolutional neural network to generate the intermediate synthetic slices of the OTC volumes and we propose a few variants of a 3D reconstruction algorithm to create visualizations that emphasize the changes present in multiple retinal structures to aid clinicians in the diagnostic process, Xunta de Galicia; ED431C 2020/24, This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ”Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by ”Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Automatic Segmentation of Retinal Layers in Multiple Neurodegenerative Disorder Scenarios

  • Gende, M.
  • Mallén Gracia, Victor
  • Moura, Joaquim de
  • Cordón Ciordia, Beatriz
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Open Access provided by ‘Universidade da Coruña/CISUG’ within the CRUI-CARE Agreement, [Absctract]: Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND., This work was supported in part by Instituto de Salud Carlos III, Government of Spain, under Grants PI17/01726 and PI20/00437, in part by Inflammatory Disease Network (RICORS) under Grant RD21/0002/0050, in part by the Ministerio de Ciencia e Innovación, Government of Spain under Grants PDC2022-133132-I00, RTI2018-095894-B-I00, PID2019- 108435RB-I00, and TED2021-131201B-I00, in part by the Consellería de Cultura, Educación e Universidade, Xunta de Galicia through Grupos de Referencia Competitiva under Grant ED431C 2020/24 and predoctoral under Grant ED481A 2021/161, in part by CITIC, Centro de Investigación de Galicia under Grant ED431G 2019/01, and in part by Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Comparative and Behavioural Analysis of a Diffuse Paradigm for the Evaluation of Diabetic Macular Edema in OCT images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Díaz, Macarena
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
The conference was held during June 7 to 9, 2021 Aveiro, Portugal., This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/CBMS52027.2021.00010, [Abstract]: Nowadays, Diabetic Macular Edema (DME) is one of the leading causes of blindness in developed countries, and its characterized by the presence of pathological fluid accumulations inside the retinal layers. Currently, the main way to detect these fluid accumulations (as well as their severity) is through the use of Optical Coherence Tomography (OCT) imaging. In particular, this ophthalmological image modality allows a precise non-invasive analysis of the morphology of the retina and its structures. Due to the complexity of attempting to successfully segment these fluid accumulations, an alternative paradigm for their detection has been recently proposed. This paradigm, based on a diffuse representation of the pathological regions, creates an intuitive representation of the pathological regions based on a confidence map. Currently, there are only two approaches for this paradigm: one based on a predefined library of texture and intensity features with established machine learning algorithms and other based on deep learning methods. Both approaches have proven to offer satisfactory results, but each one of them performs better in different scenarios. In this work, we perform a complete analysis and comparison on the behaviour and performance of both strategies in a clinical screening scenario to evaluate the suitability of both approaches for the clinical practice as well as their performance as computer vision strategies., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00 ; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 ; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38 ; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Retinal Microaneurysms Detection Using Adversarial Pre-training With Unlabeled Multimodal Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The detection of retinal microaneurysms is crucial for the early detection of important diseases such as diabetic retinopathy. However, the detection of these lesions in retinography, the most widely available retinal imaging modality, remains a very challenging task. This is mainly due to the tiny size and low contrast of the microaneurysms in the images. Consequently, the automated detection of microaneurysms usually relies on extensive ad-hoc processing. In this regard, although microaneurysms can be more easily detected using fluorescein angiography, this alternative imaging modality is invasive and not adequate for regular preventive screening. In this work, we propose a novel deep learning methodology that takes advantage of unlabeled multimodal image pairs for improving the detection of microaneurysms in retinography. In particular, we propose a novel adversarial multimodal pre-training consisting in the prediction of fluorescein angiography from retinography using generative adversarial networks. This pre-training allows learning about the retina and the microaneurysms without any manually annotated data. Additionally, we also propose to approach the microaneurysms detection as a heatmap regression, which allows an efficient detection and precise localization of multiple microaneurysms. To validate and analyze the proposed methodology, we perform an exhaustive experimentation on different public datasets. Additionally, we provide relevant comparisons against different state-of-the-art approaches. The results show a satisfactory performance of the proposal, achieving an Average Precision of 64.90%, 31.36%, and 33.55% in the E-Ophtha, ROC, and DDR public datasets. Overall, the proposed approach outperforms existing deep learning alternatives while providing a more straightforward detection method that can be effectively applied to raw unprocessed retinal images., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia, Spain and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Automatic Segmentation and Intuitive Visualisation of the Epiretinal Membrane in 3D OCT Images Using Deep Convolutional Approaches

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Epiretinal Membrane (ERM) is a disease caused by a thin layer of scar tissue that is formed on the surface of the retina. When this membrane appears over the macula, it can cause distorted or blurred vision. Although normally idiopathic, its presence can also be indicative of other pathologies such as diabetic macular edema or vitreous haemorrhage. ERM removal surgery can preserve more visual acuity the earlier it is performed. For this purpose, we present a fully automatic segmentation system that can help the clinicians to determine the ERM presence and location over the eye fundus using 3D Optical Coherence Tomography (OCT) volumes. The proposed system uses a convolutional neural network architecture to classify patches of the retina surface. All the 2D OCT slices of the 3D OCT volume of a patient are combined to produce an intuitive colour map over the 2D fundus reconstruction, providing a visual representation of the presence of ERM which therefore facilitates the diagnosis and treatment of this relevant eye disease. A total of 2.428 2D OCT slices obtained from 20 OCT 3D volumes was used in this work. To validate the designed methodology, several representative experiments were performed. We obtained satisfactory results with a Dice Coefficient of 0.826 ± 0.112 and a Jaccard Index of 0.714 ± 0.155, proving its applicability for diagnosis purposes. The proposed system also demonstrated its simplicity and competitive performance with respect to other state-of-the-art approaches., 10.13039/501100004587-Instituto de Salud Carlos III, Government of Spain, research project (Grant Number: DTS18/00136), 10.13039/501100004837-Ministerio de Ciencia e Innovación y Universidades, Government of Spain, research project (Grant Number: RTI2018-095894-B-I00), 10.13039/501100004837-Ministerio de Ciencia e Innovación, Government of Spain through the research project (Grant Number: PID2019-108435RB-I00), 10.13039/501100008425-Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva (Grant Number: ED431C 2020/24), 10.13039/501100010769-Axencia Galega de Innovación (GAIN), Xunta de Galicia (Grant Number: IN845D 2020/38), 10.13039/501100008425-CITIC, Centro de Investigación de Galicia, receives financial support from the Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%) (Grant Number: ED431G 2019/01), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Multi-Adaptive Optimization for multi-task learning with deep neural networks

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Multi-task learning is a promising paradigm to leverage task interrelations during the training of deep neural networks. A key challenge in the training of multi-task networks is to adequately balance the complementary supervisory signals of multiple tasks. In that regard, although several task-balancing approaches have been proposed, they are usually limited by the use of per-task weighting schemes and do not completely address the uneven contribution of the different tasks to the network training. In contrast to classical approaches, we propose a novel Multi-Adaptive Optimization (MAO) strategy that dynamically adjusts the contribution of each task to the training of each individual parameter in the network. This automatically produces a balanced learning across tasks and across parameters, throughout the whole training and for any number of tasks. To validate our proposal, we perform comparative experiments on real-world datasets for computer vision, considering different experimental settings. These experiments allow us to analyze the performance obtained in several multi-task scenarios along with the learning balance across tasks, network layers and training steps. The results demonstrate that MAO outperforms previous task-balancing alternatives. Additionally, the performed analyses provide insights that allow us to comprehend the advantages of this novel approach for multi-task learning., This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24 and the postdoctoral fellowship ref. ED481B-2022-025. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Efficient semi-supervised hierarchical training for segmenting choroidal vessels and other structures on OCT images of multiple sclerosis patients

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Barreira, Noelia
[Abstract]: Optical coherence tomography (OCT) is a non-invasive imaging technique used to diagnose ocular and systemic diseases. Recently, several clinical studies have linked changes in different ocular layers to the development of multiple sclerosis (MS), so accurate segmentation of these structures has become an essential task. Unfortunately, segmenting the entire set of structures involved is a very difficult task, due to their large number and variability. These two factors hinder the labeling of images and therefore severely restrict the ability to achieve a large dataset with all structures manually annotated, limiting the use of a standard supervised approach. In this paper, we propose a semi-supervised learning methodology to robustly segment ocular structures in OCT images using a limited number of partially labeled images. Our methodology maximizes the information we can extract from labeled images through hierarchical learning, where multiple decoders are used to extract segmented structures progressively. We use a reconstruction loss function to provide structural coherence to the segmentation and a teacher–student strategy to effectively leverage the information present in the set of unlabeled images. In addition to the segmentation of labeled structures, this hierarchical approach allows segmenting structures that are not labeled in the dataset such as the choroidal vessels. To validate the proposed methodology, we have carried out extensive experimentation using two datasets with different characteristics. These experiments have demonstrated a great potential of this methodology to train networks efficiently with partially labeled images, which allows to accurately extract the main biomarkers linked to the development of MS., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, PDC2022-133132-I00 and TED2021-1312 01B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades, Spain’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI, Spain Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Multi-task Convolutional Neural Networks for the End-to-end Simultaneous Segmentation and Screening of the Epiretinal Membrane in OCT Images

  • Gende, M.
  • Moura, Joaquim de
  • Penedo, Manuel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), 5 y 6 de octubre de 2022, A Coruña., [Absctract]: The Epiretinal Membrane (ERM) is an ocular pathology that causes visual distortion. In order to detect and treat the ERM, ophthalmologists visually inspect Optical Coherence Tomography (OCT) images.This is a costly and subjective process. In this work, we present three different fully automatic, end-to-end approaches that make use of multi-task learning to simultaneously screen for and segment ERM symptoms in OCT images. These approaches were implemented into three architectures that capitalise on the way the models share a single architecture for the two complementary tasks., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24], predoctoral grant [ED481A 2021/161]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Deep Multi-Segmentation Approach for the Joint Classification and Segmentation of the Retinal Arterial and Venous Trees in Color Fundus Images

  • Morano, José
  • Hervella, Álvaro S.
  • Novo Buján, Jorge
  • Rouco, José
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The analysis of the retinal vasculature represents a crucial stage in the diagnosis of several diseases. An exhaustive analysis involves segmenting the retinal vessels and classifying them into veins and arteries. In this work, we present an accurate approach, based on deep neural networks, for the joint segmentation and classification of the retinal veins and arteries from color fundus images. The presented approach decomposes this joint task into three related subtasks: the segmentation of arteries, veins and the whole vascular tree. The experiments performed show that our method achieves competitive results in the discrimination of arteries and veins, while clearly enhancing the segmentation of the different structures. Moreover, unlike other approaches, our method allows for the straightforward detection of vessel crossings, and preserves the continuity of the arterial and venous vascular trees at these locations., This work was funded by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Xunta de Galicia and European Social Fund (ESF) of the EU through the predoctoral grant contracts ED481A-2017/328 and ED481A 2021/140; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, is funded by Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED481A 2021/140, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Feature Definition and Comprehensive Analysis on the Robust Identification of Intraretinal Cystoid Regions Using Optical Coherence Tomography Images

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Rouco, José
  • Penedo, Manuel
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Currently, optical coherence tomography is one of the most used medical imaging modalities, offering cross-sectional representations of the studied tissues. This image modality is specially relevant for the analysis of the retina, since it is the internal part of the human body that allows an almost direct examination without invasive techniques. One of the most representative cases of use of this medical imaging modality is for the identification and characterization of intraretinal fluid accumulations, critical for the diagnosis of one of the main causes of blindness in developed countries: the Diabetic Macular Edema. The study of these fluid accumulations is particularly interesting, both from the point of view of pattern recognition and from the different branches of health sciences. As these fluid accumulations are intermingled with retinal tissues, they present numerous variants according to their severity, and change their appearance depending on the configuration of the device; they are a perfect subject for an in-depth research, as they are considered to be a problem without a strict solution. In this work, we propose a comprehensive and detailed analysis of the patterns that characterize them. We employed a pool of 11 different texture and intensity feature families (giving a total of 510 markers) which we have analyzed using three different feature selection strategies and seven complementary classification algorithms. By doing so, we have been able to narrow down and explain the factors affecting this kind of accumulations and tissue lesions by means of machine learning techniques with a pipeline specially designed for this purpose., Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Analysis of Imbalanced Datasets in the Performance of Deep Learning Approaches for COVID-19 Screening from Chest X-ray Imaging: Impact of Sex and Age Factors

  • Álvarez-Rodríguez, Lorena
  • Moura, Joaquim de
  • Ramos, Lucía
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Comunicación presentada al V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), tendrá lugar los días 5 y 6 de octubre de 2022, [Absctract]: In this work, we analysed 11 imbalance scenarios with female and male COVID-19 patients present in different proportions for the sex analysis, and 6 scenarios where only one specific age range was used for training for the age factor. In each study, 3 different approaches for automatic COVID-19 screening were used: (I) Normal vs COVID-19, (II) Pneumonia vs COVID-19 and (III) Non-COVID-19 vs COVID-19. The present study was validated using two representative public chest X-ray datasets, allowing a reliable analysis to support the clinical decision-making process. The results for the sex-related analysis indicate this factor slightly affects the COVID- 19 deep learning-based systems, although the identified differences are not relevant enough to considerably worsen the system. Regarding the age-related analysis, this factor was observed to be influencing the system in a more consistent way than the sex factor, as it was present in all considered scenarios., This research was funded by: Instituto de Salud Carlos III - DTS18/00136; Ministerio de Ciencia e Innovación y Universidades, Gov. of Spain - RTI2018-095894-B-I00; Ministerio de Ciencia e Innovación, Gov. of Spain - PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva - ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia - N845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; N845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Comprehensive Analysis of the Screening of COVID-19 Approaches in Chest X-ray Images from Portable Devices

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
ESANN 2021 Proceedings - 29th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine LearningOpen AccessPages 165 - 1702021 29th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2021Virtual, Online 6 October 2021 through 8 October 2021 Code 178821, [Abstract]: Computer-aided diagnosis plays an important role in the COVID-19 pandemic. Currently, it is recommended to use X-ray imaging to diagnose and assess the evolution in patients. Particularly, radiologists are asked to use portable acquisition devices to minimize the risk of cross-infection, facilitating an effective separation of suspected patients with other low-risk cases. In this work, we present an automatic COVID-19 screening, considering 6 representative state-of-the-art deep network architectures on a portable chest X-ray dataset that was specifically designed for this proposal. Exhaustive experimentation demonstrates that the models can separate COVID-19 cases from NON-COVID-19 cases, achieving a 97.68% of global accuracy., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Comprehensive analysis of clinical data for COVID-19 outcome estimation with machine learning models

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Funding for open access charge: Universidade da Coruña/CISUG., [Abstract]: COVID-19 is a global threat for the healthcare systems due to the rapid spread of the pathogen that causes it. In such situation, the clinicians must take important decisions, in an environment where medical resources can be insufficient. In this task, the computer-aided diagnosis systems can be very useful not only in the task of supporting the clinical decisions but also to perform relevant analyses, allowing them to understand better the disease and the factors that can identify the high risk patients. For those purposes, in this work, we use several machine learning algorithms to estimate the outcome of COVID-19 patients given their clinical information. Particularly, we perform 2 different studies: the first one estimates whether the patient is at low or at high risk of death whereas the second estimates if the patient needs hospitalization or not. The results of the analyses of this work show the most relevant features for each studied scenario, as well as the classification performance of the considered machine learning models. In particular, the XGBoost algorithm is able to estimate the need for hospitalization of a patient with an AUC-ROC of 0.8415± 0.0217 while it can also estimate the risk of death with an AUC-ROC of 0.7992±0.0104. Results have demonstrated the great potential of the proposal to determine those patients that need a greater amount of medical resources for being at a higher risk. This provides the healthcare services with a tool to better manage their resources., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/196; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Unsupervised Deformable Image Registration in a Landmark Scarcity Scenario: Choroid OCTA

  • López-Varela, Emilio
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • Ortega Hortas, Marcos
This version of the conference paper has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-06427-2_8., [Abstract]: Recent advances in OCTA allow the imaging of blood flow deeper than the retinal layers at the level of the choriocapillaris (CC), where a pattern of small dark areas represents the absence of flow, called flow voids. The distribution of flow voids can be used as a biomarker to diagnose and monitor the progression of relevant pathologies or the efficacy of applied treatments. A pixel-to-pixel comparison can help to carry out this monitoring effectively, although in order to carry out this comparison, the used images must be perfectly aligned. CC images are characterized by their granularity, presenting numerous and complex local deformations, so a deformable registration is necessary to carry out a reliable comparison. However, CC OCTA images also present a characteristic absence of visually significant anatomical structures. This landmark scarcity hardens drastically the identification of points of interest to achieve an accurate registration. Based on this context, we designed a methodology to accurately perform this deformable registration in this challenging scenario. Hence, we propose a convolutional neural network model trained by unsupervised learning to register images in a real clinical scenario, being obtained at different time instants from patients with central serous chorioretinopathy (CSC) treated with photodynamic therapy. Our methodology produces superior alignment to those achieved with other proven methods, helping to improve the monitoring of the efficacy of photodynamic therapy applied to patients with CSC. Our robust and adaptable methodology can also be exploited in other similar scenarios of complex registrations with anatomical landmark scarcity., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning

  • Morano, José
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Ortega Hortas, Marcos
[Abstract]: Background and Objectives: Age-related macular degeneration (AMD) is a degenerative disorder affecting the macula, a key area of the retina for visual acuity. Nowadays, AMD is the most frequent cause of blindness in developed countries. Although some promising treatments have been proposed that effectively slow down its development, their effectiveness significantly diminishes in the advanced stages. This emphasizes the importance of large-scale screening programs for early detection. Nevertheless, implementing such programs for a disease like AMD is usually unfeasible, since the population at risk is large and the diagnosis is challenging. For the characterization of the disease, clinicians have to identify and localize certain retinal lesions. All this motivates the development of automatic diagnostic methods. In this sense, several works have achieved highly positive results for AMD detection using convolutional neural networks (CNNs). However, none of them incorporates explainability mechanisms linking the diagnosis to its related lesions to help clinicians to better understand the decisions of the models. This is specially relevant, since the absence of such mechanisms limits the application of automatic methods in the clinical practice. In that regard, we propose an explainable deep learning approach for the diagnosis of AMD via the joint identification of its associated retinal lesions. Methods: In our proposal, a CNN with a custom architectural setting is trained end-to-end for the joint identification of AMD and its associated retinal lesions. With the proposed setting, the lesion identification is directly derived from independent lesion activation maps; then, the diagnosis is obtained from the identified lesions. The training is performed end-to-end using image-level labels. Thus, lesion-specific activation maps are learned in a weakly-supervised manner. The provided lesion information is of high clinical interest, as it allows clinicians to assess the developmental stage of the disease. Additionally, the proposed approach allows to explain the diagnosis obtained by the models directly from the identified lesions and their corresponding activation maps. The training data necessary for the approach can be obtained without much extra work on the part of clinicians, since the lesion information is habitually present in medical records. This is an important advantage over other methods, including fully-supervised lesion segmentation methods, which require pixel-level labels whose acquisition is arduous. Results: The experiments conducted in 4 different datasets demonstrate that the proposed approach is able to identify AMD and its associated lesions with satisfactory performance. Moreover, the evaluation of the lesion activation maps shows that the models trained using the proposed approach are able to identify the pathological areas within the image and, in most cases, to correctly determine to which lesion they correspond. Conclusions: The proposed approach provides meaningful information—lesion identification and lesion activation maps—that conveniently explains and complements the diagnosis, and is of particular interest to clinicians for the diagnostic process. Moreover, the data needed to train the networks using the proposed approach is commonly easy to obtain, what represents an important advantage in fields with particularly scarce data, such as medical imaging., Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A 2021/140, Xunta de Galicia; ED431G 2019/01, This work was funded by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Conselleria de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, ref. ED431C 2020/24, the predoctoral grant ref. ED481A 2021/140, and the postdoctoral grant ref. ED481B-2022-025; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, is funded by Conselleria de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaria Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Sistema automático para la predicción de la respuesta a la terapia fotodinámica en la coriorretinopatía serosa central

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Resumen] Se presenta un innovador método de deep learning para la segmentación automatizada en 3D de las regiones de fluido en imágenes de Tomografía de Coherencia ´Óptica (OCT) de pacientes con coriorretinopatía serosa central (CSCR), seguida de un análisis de respuesta a la Terapia Fotodinámica (PDT) en pacientes con CSCR. Este método no solo reduce sustancialmente el tiempo y esfuerzo requeridos para la segmentación, sino que también ofrece una técnica estandarizada, fomentando estudios de investigación a gran escala. Para llevar a cabo el trabajo utilizamos un conjunto de datos robusto compuesto por 2,769 imágenes OCT, logrando resultados altamente satisfactorios que superan a las demás propuestas del estado del arte. Esta investigación impulsa la integración del deep learning en la práctica clínica, mejorando la gestión de la CSCR al permitir la formulación de estrategias de tratamiento personalizadas y una atención optimizada al paciente., Este trabajo está financiado por el Ministerio de Ciencia e Innovación, Gobierno de España por medio del proyecto de investigación con los códigos [RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 y PDC2022-133132-I00]; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [código ED431C 2020/24], ayuda predoctoral [ED481A-2023-152]., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Region of interest-bounded COVID-19 lung screening using images from portable X-ray devices

  • Vidal, Plácido
  • Moura, Joaquim de
  • Ramos, Lucía
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Comunicación presentada al V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), os días 5 y 6 de octubre de 2022, [Abstract]: X-ray analysis of the lungs was the main method to assess the degree of affliction of SARS-COV-2. Due to the high contagiousness of this pathology, this assessment was conducted using portable X-ray devices. Automatic methodologies were proposed to compensate the image quality of said portable X-ray devices. However, these methodologies were shown to be exploiting external information (such as pacemakers or ventilators present in the images) to determine the severity. For this reason, we present a methodology specially designed to reduce the effect on an automatic methodology of these extraneous artifacts. We extract the lung region and we perform a screening of the presence of the pathology using only the pulmonary region. Finally, to ascertain the performance of the system (and provide explainability to the clinical experts), we generate the corresponding activation maps. The presented methodology has achieved a more than satisfactory performance in all the scenarios and the activation maps clearly indicate that the system is successfully using information from the lung region while excluding elements unrelated to the disease., This research was funded by: Instituto de Salud Carlos III - DTS18/00136; Ministerio de Ciencia e Innovación y Universidades, Gov. of Spain - RTI2018-095894-B-I00, Ayudas para la formación de prof. universitario (FPU)- FPU18/02271; Ministerio de Ciencia e Innovación, Gov. of Spain - PID2019-108435RB-I00; Conselleria de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva - ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia - IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; IN845D 2020/38
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Explainable artificial intelligence for the automated assessment of the retinal vascular tortuosity

  • Hervella, Álvaro S.
  • Ramos, Lucía
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Retinal vascular tortuosity is an excessive bending and twisting of the blood vessels in the retina that is associated with numerous health conditions. We propose a novel methodology for the automated assessment of the retinal vascular tortuosity from color fundus images. Our methodology takes into consideration several anatomical factors to weigh the importance of each individual blood vessel. First, we use deep neural networks to produce a robust extraction of the different anatomical structures. Then, the weighting coefficients that are required for the integration of the different anatomical factors are adjusted using evolutionary computation. Finally, the proposed methodology also provides visual representations that explain the contribution of each individual blood vessel to the predicted tortuosity, hence allowing us to understand the decisions of the model. We validate our proposal in a dataset of color fundus images providing a consensus ground truth as well as the annotations of five clinical experts. Our proposal outperforms previous automated methods and offers a performance that is comparable to that of the clinical experts. Therefore, our methodology demonstrates to be a viable alternative for the assessment of the retinal vascular tortuosity. This could facilitate the use of this biomarker in clinical practice and medical research., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work is supported by Ministerio de Ciencia e Innovación, Government of Spain (RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects); Consellería de Cultura, Educación e Universidade, Xunta de Galicia (Grupos de Referencia Competitiva ref. ED431C 2020/24 and postdoctoral fellowship ref. ED481B-2022-025). CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Automated segmentation of the central serous chorioretinopathy fluid regions using optical coherence tomography scans

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Barreira, Noelia
  • Charlón, Pablo
2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), Aveiro, Portugal, 2021, This version of the article has been accepted for publication, after peer review. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The Version of Record is available online at: https://doi.org/10.1109/CBMS52027.2021.00008, [Abstract]: Central serous chorioretinopathy is one of the most frequent causes of vision impairment among middle-aged adults. Optical Coherence Tomography (OCT) is a non-invasive diagnostic technique that is commonly used for the monitoring of this relevant eye disease. In this context, this paper proposes a fully automatic system for the characterization of intraretinal pathological fluid regions associated with central serous chori-oretinopathy using OCT scans. To achieve this, we adapted an end-to-end fully convolutional architecture for semantic pixel-wise segmentation. The proposed methodology was tested using a heterogeneous set of 100 OCT scans of different patients. Satisfactory results were obtained, reaching values of 0.9954pm 0.0007, 0.8792 \pm 0.0079 and 0.9651 \pm 0.0041 for the mean Accuracy, mean Jaccard index and mean Dice coefficient, respectively. The proposed system also demonstrated its competitive performance with respect to other state-of-the-art approaches., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovacion´ y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovacion, Government of Spain through ´ the research project with reference PID2019-108435RB-I00; Conseller´ıa de Cultura, Educacion e Universidade, Xunta de Galicia, Grupos de Referencia ´ Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovacion´ (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigacion de Galicia ref. ED431G 2019/01, receives financial support from ´ Consellería de Educacion, Universidade e Formación Profesional, Xunta de ´ Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Simultaneous Segmentation and Classification of the Retinal Arteries and Veins From Color Fundus Images

  • Morano, José
  • Hervella, Álvaro S.
  • Novo Buján, Jorge
  • Rouco, José
[Abstract] Background and objectives: The study of the retinal vasculature represents a fundamental stage in the screening and diagnosis of many high-incidence diseases, both systemic and ophthalmic. A complete retinal vascular analysis requires the segmentation of the vascular tree along with the classification of the blood vessels into arteries and veins. Early automatic methods approach these complementary segmentation and classification tasks in two sequential stages. However, currently, these two tasks are approached as a joint semantic segmentation, because the classification results highly depend on the effectiveness of the vessel segmentation. In that regard, we propose a novel approach for the simultaneous segmentation and classification of the retinal arteries and veins from eye fundus images. Methods: We propose a novel method that, unlike previous approaches, and thanks to the proposal of a novel loss, decomposes the joint task into three segmentation problems targeting arteries, veins and the whole vascular tree. This configuration allows to handle vessel crossings intuitively and directly provides accurate segmentation masks of the different target vascular trees. Results: The provided ablation study on the public Retinal Images vessel Tree Extraction (RITE) dataset demonstrates that the proposed method provides a satisfactory performance, particularly in the segmentation of the different structures. Furthermore, the comparison with the state of the art shows that our method achieves highly competitive results in the artery/vein classification, while significantly improving the vascular segmentation. Conclusions: The proposed multi-segmentation method allows to detect more vessels and better segment the different structures, while achieving a competitive classification performance. Also, in these terms, our approach outperforms the approaches of various reference works. Moreover, in contrast with previous approaches, the proposed method allows to directly detect the vessel crossings, as well as preserving the continuity of both arteries and veins at these complex locations., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

3D Features Fusion for Automated Segmentation of Fluid Regions in CSCR Patients: An OCT-based Photodynamic Therapy Response Analysis

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Central Serous Chorioretinopathy (CSCR) is a significant cause of vision impairment worldwide, with Photodynamic Therapy (PDT) emerging as a promising treatment strategy. The capability to precisely segment fluid regions in Optical Coherence Tomography (OCT) scans and predict the response to PDT treatment can substantially augment patient outcomes. This paper introduces a novel deep learning (DL) methodology for automated 3D segmentation of fluid regions in OCT scans, followed by a subsequent PDT response analysis for CSCR patients. Our approach utilizes the rich 3D contextual information from OCT scans to train a model that accurately delineates fluid regions. This model not only substantially reduces the time and effort required for segmentation but also offers a standardized technique, fostering further large-scale research studies. Additionally, by incorporating pre- and post-treatment OCT scans, our model is capable of predicting PDT response, hence enabling the formulation of personalized treatment strategies and optimized patient management. To validate our approach, we employed a robust dataset comprising 2,769 OCT scans (124 3D volumes), and the results obtained were significantly satisfactory, outperforming the current state-of-the-art methods. This research signifies an important milestone in the integration of DL advancements with practical clinical applications, propelling us a step closer towards improved management of CSCR. Furthermore, the methodologies and systems developed can be adapted and extrapolated to tackle similar challenges in the diagnosis and treatment of other retinal pathologies, favoring more comprehensive and personalized patient care., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A-2023-152]. Furthermore, this work was supported by the Instituto de Salud Carlos III (ISCIII) under the grant [FORT23/00010] as part of the Programa FORTALECE del Ministerio de Ciencia e Innovación. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

3D Point Cloud Analysis via Transformer-Based Graph Learning for Multiple Sclerosis Screening in OCT Images

  • Álvarez-Rodríguez, Lorena
  • García Prego, Iván
  • Moura, Joaquim de
  • Pueyo-Bestué, Ana
  • Viladés, Elisa
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at: 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2024), [Abstract]: Multiple Sclerosis (MS), the leading cause of non-traumatic neurological impairment in young adults, manifests morphological changes in the retina observable in Optical Coherence Tomography (OCT) images. These changes in the Retinal Nerve Fibre Layer (RNFL) and the Ganglion Cell Layer - Bruch’s Membrane (GCL-BM) serve as potential computational biomarkers for MS. In this work, we propose a transformer-based graph learning approach for analyzing 3D point clouds generated from RNFL and GCL-BM contours, marking a first in the application of geometric deep learning (GDL) to MS diagnosis via OCT scans. Our proposal, tailored for efficiency, synergizes the global contextual strengths of transformers with the detailed, structure-aware capabilities of graph neural networks. Such integration allows for the nuanced analysis of complex retinal structures, significantly boosting the precision of MS detection by uncovering patterns not discernible to the human eye. Additionally, we conducted a comprehensive study on the optimal downsampling size of input 3D point clouds, ensuring efficient data processing without compromising diagnostic accuracy. Our optimal configuration achieved a test F1-Score of 0.88, using only 4.0% of total 3D points, showcasing the effectiveness of our method despite the higher computational demands compared to less complex, albeit less precise, configurations. These promising results are the first in the study of 3D analysis and transformer-based geometric deep learning for MS screening based on OCT images, which are revolutionizing neurophtalmological research., Funded by Instituto de Salud Carlos III (ISCIII), Government of Spain, [projects PI17/01726 and PI20/00437]; Inflammatory Disease Network (RICORS) [project RD21/0002/0050]; Ministerio de Ciencia e Innovacion, Government of Spain [ projects PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educacion, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24]. Also supported by the ISCIII under the grant [FORT23/00010] as part of the Programa FORTALECE of Ministerio de Ciencia e Innovacion., Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

Detecting, Characterizing and Visualizing Multiple Sclerosis in Optical Coherence Tomography Through Biomarker Selection

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Rouco, José
[Abstract]: Multiple sclerosis (MS) is a chronic neurodegenerative disease affecting the central nervous system, which is the primary cause of non-traumatic neurological disability among young adults. Diagnosing MS is challenging yet crucial for effective patient treatment. Optical Coherence Tomography (OCT) has emerged as a non-invasive and efficient tool for analysing optic nerv alterations and assessing neurodegeneration in MS, particularly through changes in retinal thickness of layers such as the retinal nerve fiber layer (RNFL) and ganglion cell layer (GCL). In this work, we investigate the potential of using changes across all retinal layer thickness as a biomarker for MS detection. To accomplish this, we propose a fully automatic system consisting of an MS classification model and a pathological thickness visualization model. First, our system employs a fully convolutional neural network to segment retinal layers and choroidal vessels and to calculate the extraction of layer thickness at varying granularities. Global and local layer thickness are used as inputs for the MS classification model. A genetic multi objective algorithm is used for effective feature selection. Concurrently, voxel-level layer thickness serves as input for the visualization model that generates a 2D probability map where the pathological regions are highlighted. This map contributes to an interactive 3D reconstruction that provides a swift overview of MS-associated thickness changes. Extensive experimentation on real clinical MS cases validates the significant potential of the proposed system for practical clinical applications and showcases its efficacy in enhancing diagnostic precision and efficiency., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Choroid segmentation in non-EDI OCT images of multiple sclerosis patients

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • García Ben, Emma
  • Rubio Cid, Sara
  • Penedo, Manuel
[Abstract]: Optical coherence tomography (OCT) is a non-invasive diagnostic technique that can image ocular structures. Recently, this imaging technique has been used to diagnose and monitor patients with multiple sclerosis (MS), as several clinical studies have linked the development of MS to various changes in the eye. Among the different structures, one of the relevant biomarkers for MS analysis is the choroid. Systems such as Enhanced Depth Imaging (EDI) provide detailed images of the choroid region. However, OCT images are not routinely captured using this technology unless the study is specifically focused on choroidal analysis. In this work we propose a robust approach, based on convolutional neural networks to segment the choroid in non-EDI OCT images. The results obtained show that the proposed network manages to delimit the inferior contour of the choroid in a similar way to the experts., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovaciónn, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publication Artículo científico (JournalArticle)

End-To-End Multi-Task Learning Approaches for the Joint Epiretinal Membrane Segmentation and Screening in OCT Images

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Background and objectives The Epiretinal Membrane (ERM) is an ocular disease that can cause visual distortions and irreversible vision loss. Patient sight preservation relies on an early diagnosis and on determining the location of the ERM in order to be treated and potentially removed. In this context, the visual inspection of the images in order to screen for ERM signs is a costly and subjective process. Methods In this work, we propose and study three end-to-end fully-automatic approaches for the simultaneous segmentation and screening of ERM signs in Optical Coherence Tomography images. These convolutional approaches exploit a multi-task learning context to leverage inter-task complementarity in order to guide the training process. The proposed architectures are combined with three different state of the art encoder architectures of reference in order to provide an exhaustive study of the suitability of each of the approaches for these tasks. Furthermore, these architectures work in an end-to-end manner, entailing a significant simplification of the development process since they are able to be trained directly from annotated images without the need for a series of purpose-specific steps. Results In terms of segmentation, the proposed models obtained a precision of 0.760 ± 0.050, a sensitivity of 0.768 ± 0.210 and a specificity of 0.945 ± 0.011. For the screening task, these models achieved a precision of 0.963 ± 0.068, a sensitivity of 0.816 ± 0.162 and a specificity of 0.983 ± 0.068. The obtained results show that these multi-task approaches are able to perform competitively with or even outperform single-task methods tailored for either the segmentation or the screening of the ERM. Conclusions These results highlight the advantages of using complementary knowledge related to the segmentation and screening tasks in the diagnosis of this relevant pathology, constituting the first proposal to address the diagnosis of the ERM from a multi-task perspective., This research was funded by Instituto de Salud Carlos III, Government of Spain, [grant number DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [grant number RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant number PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], Predoctoral grant [grant number ED481A 2021/161] and Postdoctoral grant [grant number ED481B 2021/059]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant number IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding sources had no role in the development of this work. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Deep Learning-Based Approaches for Ciliary Muscle Segmentation and Biomarker Extraction

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presentado en: XX Conferencia de la Asociación Española para la Inteligencia Artificial, A Coruña, 19 - 21 de Junio de 2024 (CAEPIA 2024), [Abstract]: This paper highlights our recently published work that involves the application of deep learning techniques to perform the segmentation of the ciliary muscle in Anterior Segment Optical Coherence Tomography (AS-OCT) images. The ciliary muscle is vital for various anterior segment of the eye functions, including intraocular pressure regulation and lens shape maintenance. To advance research, we propose a fully automatic method for segmenting and measuring ciliary muscle biomarkers in 6 mm and 16 mm scan depths, commonly used in clinical analysis. Our approach ensures repeatable and immediate results through thorough exploration of artificial intelligence approaches combining different network architectures, encoders, data augmentation and transfer learning strategies. Additionally, we extract relevant biomarkers, aiding in diagnoses and monitoring of ocular diseases such as glaucoma, myopia, and presbyopia, and facilitating the development of new therapeutic strategies. With high accuracy values (0.9665 ± 0.1280 and 0.9772 ± 0.0873 for the best 6 mm and 16 mm combinations, respectively), our system provides clinicians and researchers with a valuable, automatic tool for ciliary muscle segmentation and analysis in AS-OCT images., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educacioó, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A-2023-152]., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publication Artículo científico (JournalArticle)

Automatic segmentation of retinal layers in multiple neurodegenerative disorder scenarios

  • Gende, Mateo
  • Mallen, Víctor
  • de Moura, Joaquim
  • Cordón, Beatriz
  • Garcia-Martin, Elena
  • Sánchez, Clara I.
  • Novo, Jorge
  • Ortega, Marcos
Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND.