Pasar al contenido principal

CUANTIFICACION Y CARACTERIZACION COMPUTACIONAL DE IMAGEN MULTIMODAL OFTALMOLOGICA: ESTUDIOS EN ESCLEROSIS MULTIPLE

PID2019-108435RB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 36
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Data Augmentation Approaches Using Cycle-Consistent Adversarial Networks for Improving COVID-19 Screening in Portable Chest X-Ray Images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The current COVID-19 pandemic, that has caused more than 100 million cases as well as more than two million deaths worldwide, demands the development of fast and accurate diagnostic methods despite the lack of available samples. This disease mainly affects the respiratory system of the patients and can lead to pneumonia and to severe cases of acute respiratory syndrome that result in the formation of several pathological structures in the lungs. These pathological structures can be explored taking advantage of chest X-ray imaging. As a recommendation for the health services, portable chest X-ray devices should be used instead of conventional fixed machinery, in order to prevent the spread of the pathogen. However, portable devices present several problems (specially those related with capture quality). Moreover, the subjectivity and the fatigue of the clinicians lead to a very difficult diagnostic process. To overcome that, computer-aided methodologies can be very useful even taking into account the lack of available samples that the COVID-19 affectation shows. In this work, we propose an improvement in the performance of COVID-19 screening, taking advantage of several cycle generative adversarial networks to generate useful and relevant synthetic images to solve the lack of COVID-19 samples, in the context of poor quality and low detail datasets obtained from portable devices. For validating this proposal for improved COVID-19 screening, several experiments were conducted. The results demonstrate that this data augmentation strategy improves the performance of a previous COVID-19 screening proposal, achieving an accuracy of 98.61% when distinguishing among NON-COVID-19 (i.e. normal control samples and samples with pathologies others than COVID-19) and genuine COVID-19 samples. It is remarkable that this methodology can be extrapolated to other pulmonary pathologies and even other medical imaging domains to overcome the data scarcity., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multi-Stage Transfer Learning for Lung Segmentation Using Portable X-Ray Devices for Patients With COVID-19

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] One of the main challenges in times of sanitary emergency is to quickly develop computer aided diagnosis systems with a limited number of available samples due to the novelty, complexity of the case and the urgency of its implementation. This is the case during the current pandemic of COVID-19. This pathogen primarily infects the respiratory system of the afflicted, resulting in pneumonia and in a severe case of acute respiratory distress syndrome. This results in the formation of different pathological structures in the lungs that can be detected by the use of chest X-rays. Due to the overload of the health services, portable X-ray devices are recommended during the pandemic, preventing the spread of the disease. However, these devices entail different complications (such as capture quality) that, together with the subjectivity of the clinician, make the diagnostic process more difficult and suggest the necessity for computer-aided diagnosis methodologies despite the scarcity of samples available to do so. To solve this problem, we propose a methodology that allows to adapt the knowledge from a well-known domain with a high number of samples to a new domain with a significantly reduced number and greater complexity. We took advantage of a pre-trained segmentation model from brain magnetic resonance imaging of a unrelated pathology and performed two stages of knowledge transfer to obtain a robust system able to segment lung regions from portable X-ray devices despite the scarcity of samples and lesser quality. This way, our methodology obtained a satisfactory accuracy of 0.9761 ± 0.0100 for patients with COVID-19, 0.9801 ± 0.0104 for normal patients and 0.9769 ± 0.0111 for patients with pulmonary diseases with similar characteristics as COVID-19 (such as pneumonia) but not genuine COVID-19., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant Ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant Ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant Ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01).
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Adapted generative latent diffusion models for accurate pathological analysis in chest X-ray images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Funding for open access charge: Universidade da Coruña/CISUG, [Absctract]: Respiratory diseases have a significant global impact, and assessing these conditions is crucial for improving patient outcomes. Chest X-ray is widely used for diagnosis, but expert evaluation can be challenging. Automatic computer-aided diagnosis methods can provide support for clinicians in these tasks. Deep learning has emerged as a set of algorithms with exceptional potential in such tasks. However, these algorithms require a vast amount of data, often scarce in medical imaging domains. In this work, a new data augmentation methodology based on adapted generative latent diffusion models is proposed to improve the performance of an automatic pathological screening in two high-impact scenarios: tuberculosis and lung nodules. The methodology is evaluated using three publicly available datasets, representative of real-world settings. An ablation study obtained the highest-performing image generation model configuration regarding the number of training steps. The results demonstrate that the novel set of generated images can improve the performance of the screening of these two highly relevant pathologies, obtaining an accuracy of 97.09%, 92.14% in each dataset of tuberculosis screening, respectively, and 82.19% in lung nodules. The proposal notably improves on previous image generation methods for data augmentation, highlighting the importance of the contribution in these critical public health challenges., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Intra- and Inter-expert Validation of an Automatic Segmentation Method for Fluid Regions Associated with Central Serous Chorioretinopathy in OCT Images

  • Gende, M.
  • Castelo Martínez, Lúa
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Central Serous Chorioretinopathy (CSC) is a retinal disorder caused by the accumulation of fluid, resulting in vision distortion. The diagnosis of this disease is typically performed through Optical Coherence Tomography (OCT) imaging, which displays any fluid buildup between the retinal layers. Currently, these fluid regions are manually detected by visual inspection a time-consuming and subjective process that can be prone to errors. A series of six deep learning-based automatic segmentation architectural configurations of different levels of complexity were trained and compared in order to determine the best model intended for the automatic segmentation of CSC-related lesions in OCT images. The best performing models were then evaluated in an external validation study. Furthermore, an intra- and inter-expert analysis was conducted in order to compare the manual segmentation performed by expert ophthalmologists with the automatic segmentation provided by the models. Test results of the best performing configuration achieved a mean Dice of in the internal dataset. In the external validation set, these models achieved a level of agreement with human experts of up to 0.960 in terms of Kappa coefficient, contrasting with a value of 0.951 for agreement between human experts. Overall, the models reached a better agreement with either of the human experts than these experts with each other, suggesting that automatic segmentation models for the detection of CSC-related lesions in OCT imaging can be useful tools for assessing this disease, reducing the workload of manual inspection and leading to a more robust and objective diagnosis method., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research was funded by Instituto de Salud Carlos III, Government of Spain (research project DTS18/00136); Ministerio de Ciencia e Innovación, Government of Spain (research projects PID2019-108435RB-I00, TED2021-131201B-I00, PDC2022-133132-I00); Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva (grant number ED431C 2020/24) and predoctoral grant (grant number ED481A 2021/161); and CITIC, Centro de Investigación de Galicia (grant number ED431G 2019/01), and receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding sources had no role in the development of this work., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Generation of Synthetic Intermediate Slices in 3D OCT Cubes for Improving Pathology Detection and Monitoring

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Arroyo Castillo, María Rosa
  • Penedo, Manuel
Funding for open access charge: Universidade da Coruña/CISUG, [Absctract]: OCT is a non-invasive imaging technique commonly used to obtain 3D volumes of the ocular structure. These volumes allow the monitoring of ocular and systemic diseases through the observation of subtle changes in the different structures present in the eye. In order to observe these changes it is essential that the OCT volumes have a high resolution in all axes, but unfortunately there is an inverse relationship between the quality of the OCT images and the number of slices of the cube. This results in routine clinical examinations using cubes that generally contain high-resolution images with few slices. This lack of slices complicates the monitoring of changes in the retina hindering the diagnostic process and reducing the effectiveness of 3D visualizations. Therefore, increasing the cross-sectional resolution of OCT cubes would improve the visualization of these changes aiding the clinician in the diagnostic process. In this work we present a novel fully automatic methodology to perform the synthesis of intermediate slices of OCT image volumes in an unsupervised manner. To perform this synthesis, we propose a fully convolutional neural network architecture that uses information from two adjacent slices to generate the intermediate synthetic slice. We also propose a training methodology, where we use three adjacent slices to train the network by contrastive learning and image reconstruction. We test our methodology with three different types of OCT volumes commonly used in the clinical setting and validate the quality of the synthetic slices created with several medical experts and using an expert system., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG ., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

End-To-End Multi-Task Learning for Simultaneous Optic Disc and Cup Segmentation and Glaucoma Classification in Eye Fundus Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The automated analysis of eye fundus images is crucial towards facilitating the screening and early diagnosis of glaucoma. Nowadays, there are two common alternatives for the diagnosis of this disease using deep neural networks. One is the segmentation of the optic disc and cup followed by the morphological analysis of these structures. The other is to directly address the diagnosis as an image classification task. The segmentation approach presents the advantage of using pixel-level labels with precise morphological information for training. However, while this detailed training feedback is not available for the classification approach, in this case the image-level labels may allow the discovery of additional non-morphological cues that are also relevant for the diagnosis. In this work, we propose a novel multi-task approach for the simultaneous classification of glaucoma and segmentation of the optic disc and cup. This approach can improve the overall performance by taking advantage of both pixel-level and image-level labels during the network training. Additionally, the segmentation maps that are predicted together with the diagnosis allow the extraction of relevant biomarkers such as the cup-to-disc ratio. The proposed methodology presents two relevant technical novelties. First, a network architecture for simultaneous segmentation and classification that increases the number of shared parameters between both tasks. Second, a multi-adaptive optimization strategy that ensures that both tasks contribute similarly to the parameter updates during training, avoiding the use of loss weighting hyperparameters. To validate our proposal, an exhaustive experimentation was performed on the public REFUGE and DRISHTI-GS datasets. The results show that our proposal outperforms comparable multi-task baselines and is highly competitive with existing state-of-the-art approaches. Additionally, the provided ablation study shows that both the network architecture and the optimization approach are independently advantageous for multi-task learning., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, through grant ref. IN845D 2020/38; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Spain . Funding for open access charge: Universidade da Coruña/CISUG, Spain., Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multimodal Image Encoding Pre-training for Diabetic Retinopathy Grading

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Diabetic retinopathy is an increasingly prevalent eye disorder that can lead to severe vision impairment. The severity grading of the disease using retinal images is key to provide an adequate treatment. However, in order to learn the diverse patterns and complex relations that are required for the grading, deep neural networks require very large annotated datasets that are not always available. This has been typically addressed by reusing networks that were pre-trained for natural image classification, hence relying on additional annotated data from a different domain. In contrast, we propose a novel pre-training approach that takes advantage of unlabeled multimodal visual data commonly available in ophthalmology. The use of multimodal visual data for pre-training purposes has been previously explored by training a network in the prediction of one image modality from another. However, that approach does not ensure a broad understanding of the retinal images, given that the network may exclusively focus on the similarities between modalities while ignoring the differences. Thus, we propose a novel self-supervised pre-training that explicitly teaches the networks to learn the common characteristics between modalities as well as the characteristics that are exclusive to the input modality. This provides a complete comprehension of the input domain and facilitates the training of downstream tasks that require a broad understanding of the retinal images, such as the grading of diabetic retinopathy. To validate and analyze the proposed approach, we performed an exhaustive experimentation on different public datasets. The transfer learning performance for the grading of diabetic retinopathy is evaluated under different settings while also comparing against previous state-of-the-art pre-training approaches. Additionally, a comparison against relevant state-of-the-art works for the detection and grading of diabetic retinopathy is also provided. The results show a satisfactory performance of the proposed approach, which outperforms previous pre-training alternatives in the grading of diabetic retinopathy., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully-Automatic 3D Intuitive Visualization of Age-Related Macular Degeneration Fluid Accumulations in OCT Cubes

  • López-Varela, Emilio
  • Vidal, Plácido
  • Olivier Pascual, Nuria
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Age-related macular degeneration is the leading cause of vision loss in developed countries, and wet-type AMD requires urgent treatment and rapid diagnosis because it causes rapid irreversible vision loss. Currently, AMD diagnosis is mainly carried out using images obtained by optical coherence tomography. This diagnostic process is performed by human clinicians, so human error may occur in some cases. Therefore, fully automatic methodologies are highly desirable adding a layer of robustness to the diagnosis. In this work, a novel computer-aided diagnosis and visualization methodology is proposed for the rapid identification and visualization of wet AMD. We adapted a convolutional neural network for segmentation of a similar domain of medical images to the problem of wet AMD segmentation, taking advantage of transfer learning, which allows us to work with and exploit a reduced number of samples. We generate a 3D intuitive visualization where the existence, position and severity of the fluid were represented in a clear and intuitive way to facilitate the analysis of the clinicians. The 3D visualization is robust and accurate, obtaining satisfactory 0.949 and 0.960 Dice coefficients in the different evaluated OCT cube configurations, allowing to quickly assess the presence and extension of the fluid associated to wet AMD., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG. The research was funded by Instituto de Salud Carlos III, Government of Spain through the PI17/00940 and DTS18/00136 research projects, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, unta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). Emilio López Varela acknowledges its support under FPI Grant Program through the PID2019-108435RB-I00 project., Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Phytoplankton detection and recognition in freshwater digital microscopy images using deep learning object detectors

  • Figueroa, Jorge
  • Rivas-Villar, David
  • Rouco, José
  • Novo Buján, Jorge
[Absctract]: Water quality can be negatively affected by the presence of some toxic phytoplankton species, whose toxins are difficult to remove by conventional purification systems. This creates the need for periodic analyses, which are nowadays manually performed by experts. These labor-intensive processes are affected by subjectivity and expertise, causing unreliability. Some automatic systems have been proposed to address these limitations. However, most of them are based on classical image processing pipelines with not easily scalable designs. In this context, deep learning techniques are more adequate for the detection and recognition of phytoplankton specimens in multi-specimen microscopy images, as they integrate both tasks in a single end-to-end trainable module that is able to automatize the adaption to such a complex domain. In this work, we explore the use of two different object detectors: Faster R-CNN and RetinaNet, from the one-stage and two-stage paradigms respectively. We use a dataset composed of multi-specimen microscopy images captured using a systematic protocol. This allows the use of widely available optical microscopes, also avoiding manual adjustments on a per-specimen basis, which would require expert knowledge. We have made our dataset publicly available to improve the reproducibility and to foment the development of new alternatives in the field. The selected Faster R-CNN methodology reaches maximum recall levels of 95.35%, 84.69%, and 79.81%, and precisions of 94.68%, 89.30% and 82.61%, for W. naegeliana, A. spiroides, and D. sociale, respectively. The system is able to adapt to the dataset problems and improves the results overall with respect to the reference state-of-the-art work. In addition, the proposed system improves the automation and abstraction from the domain and simplifies the workflow and adjustment., This research was funded by Ministerio de Innovación, Government of Spain [research projects PDC2022-133132-I00, PID2019-108435RB-I00 and TED2021-131201B-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts ref. ED481A 2021/147 and ED481A 2023/059, and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481A 2023/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multi-task localization of the hemidiaphragms and lung segmentation in portable chest X-ray images of COVID-19 patients

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Aslani, Shahab
  • Jacob, Joseph
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Background: The COVID-19 can cause long-term symptoms in the patients after they overcome the disease. Given that this disease mainly damages the respiratory system, these symptoms are often related with breathing problems that can be caused by an affected diaphragm. The diaphragmatic function can be assessed with imaging modalities like computerized tomography or chest X-ray. However, this process must be performed by expert clinicians with manual visual inspection. Moreover, during the pandemic, the clinicians were asked to prioritize the use of portable devices, preventing the risk of cross-contamination. Nevertheless, the captures of these devices are of a lower quality. Objectives: The automatic quantification of the diaphragmatic function can determine the damage of COVID-19 on each patient and assess their evolution during the recovery period, a task that could also be complemented with the lung segmentation. Methods: We propose a novel multi-task fully automatic methodology to simultaneously localize the position of the hemidiaphragms and to segment the lung boundaries with a convolutional architecture using portable chest X-ray images of COVID-19 patients. For that aim, the hemidiaphragms’ landmarks are located adapting the paradigm of heatmap regression. Results: The methodology is exhaustively validated with four analyses, achieving an 82.31% +- 2.78% of accuracy when localizing the hemidiaphragms’ landmarks and a Dice score of 0.9688 +- 0.0012 in lung segmentation. Conclusions: The results demonstrate that the model is able to perform both tasks simultaneously, being a helpful tool for clinicians despite the lower quality of the portable chest X-ray images., The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). This research was funded in whole or in part by the Wellcome Trust [209553/Z/17/Z]. For the purpose of open access, the author has applied a CC-BY public copyright licence to any author accepted manuscript version arising from this submission., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A 2021/196, Wellcome Trust; 209553/Z/17/Z
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Context encoder transfer learning approaches for retinal image analysis

  • Iglesias Morís, Daniel
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: During the last years, deep learning techniques have emerged as powerful alternatives to solve biomedical image analysis problems. However, the training of deep neural networks usually needs great amounts of labeled data to be done effectively. This is even more critical in the case of biomedical imaging due to the added difficulty of obtaining data labeled by experienced clinicians. To mitigate the impact of data scarcity, one of the most commonly used strategies is transfer learning. Nevertheless, the success of this approach depends on the effectiveness of the available pre-training techniques for learning from little or no labeled data. In this work, we explore the application of the Context Encoder paradigm for transfer learning in the domain of retinal image analysis. To this aim, we propose several approaches that allow to work with full resolution images and improve the recognition of the retinal structures. In order to validate the proposals, the Context Encoder pre-trained models are fine-tuned to perform two relevant tasks in the domain: vessels segmentation and fovea localization. The experiments performed on different public datasets demonstrate that the proposed Context Encoder approaches allow mitigating the impact of data scarcity, being superior to previous alternatives in this domain., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Gov- ernment of Spain, DTS18/00136 research project; Ministerio de Cien- cia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Univer- sidade, Xunta de Galicia, Spain through the predoctoral grant contract ref. ED481A 2021/196 and postdoctoral grant contract ref. ED481B- 2022-025; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

ConKeD: multiview contrastive descriptor learning for keypoint-based retinal image registration

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Retinal image registration is of utmost importance due to its wide applications in medical practice. In this context, we propose ConKeD, a novel deep learning approach to learn descriptors for retinal image registration. In contrast to current registration methods, our approach employs a novel multi-positive multi-negative contrastive learning strategy that enables the utilization of additional information from the available training samples. This makes it possible to learn high-quality descriptors from limited training data. To train and evaluate ConKeD, we combine these descriptors with domain-specific keypoints, particularly blood vessel bifurcations and crossovers, that are detected using a deep neural network. Our experimental results demonstrate the benefits of the novel multi-positive multi-negative strategy, as it outperforms the widely used triplet loss technique (single-positive and single-negative) as well as the single-positive multi-negative alternative. Additionally, the combination of ConKeD with the domain-specific keypoints produces comparable results to the state-of-the-art methods for retinal image registration, while offering important advantages such as avoiding pre-processing, utilizing fewer training samples, and requiring fewer detected keypoints, among others. Therefore, ConKeD shows a promising potential towards facilitating the development and application of deep learning-based methods for retinal image registration., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24, predoctoral fellowship ref. ED481A 2021/147 and the postdoctoral fellowship ref. ED481B-2022-025; and Instituto de Salud Carlos III (ISCIII) under the grant FORT23/00010 as part of the Programa FORTALECE of Ministerio de Ciencia e Innovación. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481B-2022-025
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Comprehensive fully-automatic multi-depth grading of the clinical types of macular neovascularization in OCTA images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Almuina Varela, Pablo
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
  • Novo Buján, Jorge
[Abstract]: Optical Coherence Tomography Angiography or OCTA represents one of the main means of diagnosis of Age-related Macular Degeneration (AMD), the leading cause of blindness in developed countries. This eye disease is characterized by Macular Neovascularization (MNV), the formation of vessels that tear through the retinal tissues. Four types of MNV can be distinguished, each representing different levels of severity. Both the aggressiveness of the treatment and the recovery of the patient rely on an early detection and correct diagnosis of the stage of the disease. In this work, we propose the first fully-automatic grading methodology that considers all the four clinical types of MNV at the three most relevant OCTA scanning depths for the diagnosis of AMD. We perform both a comprehensive ablation study on the contribution of said depths and an analysis of the attention maps of the network in collaboration with experts of the domain. Our proposal aims to ease the diagnosis burden and decrease the influence of subjectivity on it, offering a explainable grading through the visualization of the attention of the expert models. Our grading proposal achieved satisfactory results with an AUC of 0.9224 ± 0.0381. Additionally, the qualitative analysis performed in collaboration with experts revealed the relevance of the avascular plexus in the grading of all three types of MNV (despite not being directly involved in some of them). Thus, our proposal is not only able to robustly detect MNV in complex scenarios, but also aided to discover previously unconsidered relationships between plexuses., Funding for open access charge: Universidade da Coruña/CISUG. This research was funded by Instituto de Salud Carlos III, Government of Spain, PI17/00940 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271 and Ayudas complementarias de movilidad destinadas a beneficiarios del programa de Formación del Profesorado Universitario (FPU) EST22/00696; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38;CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Self-Supervised Multimodal Reconstruction Pre-training for Retinal Computer-Aided Diagnosis

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Computer-aided diagnosis using retinal fundus images is crucial for the early detection of many ocular and systemic diseases. Nowadays, deep learning-based approaches are commonly used for this purpose. However, training deep neural networks usually requires a large amount of annotated data, which is not always available. In practice, this issue is commonly mitigated with different techniques, such as data augmentation or transfer learning. Nevertheless, the latter is typically faced using networks that were pre-trained on additional annotated data. An emerging alternative to the traditional transfer learning source tasks is the use of self-supervised tasks that do not require manually annotated data for training. In that regard, we propose a novel self-supervised visual learning strategy for improving the retinal computer-aided diagnosis systems using unlabeled multimodal data. In particular, we explore the use of a multimodal reconstruction task between complementary retinal imaging modalities. This allows to take advantage of existent unlabeled multimodal data in the medical domain, improving the diagnosis of different ocular diseases with additional domain-specific knowledge that does not rely on manual annotation. To validate and analyze the proposed approach, we performed several experiments aiming at the diagnosis of different diseases, including two of the most prevalent impairing ocular disorders: glaucoma and age-related macular degeneration. Additionally, the advantages of the proposed approach are clearly demonstrated in the comparisons that we perform against both the common fully-supervised approaches in the literature as well as current self-supervised alternatives for retinal computer-aided diagnosis. In general, the results show a satisfactory performance of our proposal, which improves existing alternatives by leveraging the unlabeled multimodal visual data that is commonly available in the medical field., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully Automatic Deep Convolutional Approaches for the Analysis of COVID-19 Using Chest X-Ray Images

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Covid-19 is a new infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the seriousness of the situation, the World Health Organization declared a global pandemic as the Covid-19 rapidly around the world. Among its applications, chest X-ray images are frequently used for an early diagnostic/screening of Covid-19 disease, given the frequent pulmonary impact in the patients, critical issue to prevent further complications caused by this highly infectious disease. In this work, we propose 4 fully automatic approaches for the classification of chest X-ray images under the analysis of 3 different categories: Covid-19, pneumonia and healthy cases. Given the similarity between the pathological impact in the lungs between Covid-19 and pneumonia, mainly during the initial stages of both lung diseases, we performed an exhaustive study of differentiation considering different pathological scenarios. To address these classification tasks, we evaluated 6 representative state-of-the-art deep network architectures on 3 different public datasets: (I) Chest X-ray dataset of the Radiological Society of North America (RSNA); (II) Covid-19 Image Data Collection; (III) SIRM dataset of the Italian Society of Medical Radiology. To validate the designed approaches, several representative experiments were performed using 6,070 chest X-ray radiographs. In general, satisfactory results were obtained from the designed approaches, reaching a global accuracy values of 0.9706 ± 0.0044, 0.9839 ± 0.0102, 0.9744 ± 0.0104 and 0.9744 ± 0.0104, respectively, thus helping the work of clinicians in the diagnosis and consequently in the early treatment of this relevant pandemic pathology., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the postdoctoral grant contract ref. ED481B-2021-059; and Grupos de Referencia Competitiva, Spain, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, Spain, and the remaining 20% by “Secretaría Xeral de Universidades, Spain ” (Grant ED431G 2019/01). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Evolutionary mosaicking for high-resolution wide-field optical coherence tomography angiography

  • Martínez-Río, Javier
  • Carmona, Enrique J.
  • Cancelas, Daniel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a noninvasive imaging modality that produces retinal blood flow images. However, the limited field of view (FOV) of typical high-resolution scan poses challenges for comprehensive analysis. This work presents a fully automatic method for generating high-resolution wide-field OCTA mosaics from overlapping scans, addressing the need for wider FOVs without requiring advanced OCTA equipment or manual mosaicking. The proposed approach consists of a three-stage pipeline: an initial mosaic is constructed using correlation-based template matching, refined with an evolutionary algorithm to optimize vascular continuity at seams, and finalized with a blending stage to improve overall quality. Unlike existing methods, our approach avoids keypoint extraction or input image preprocessing, making it robust against noise and artifacts typically present in clinical OCTA images. Using a correlation-based metric that measures the degree of vascular continuity at the seams in each mosaic, we obtained a mean and standard deviation equal to (before blending) for all the mosaics analyzed. The proposed method presented robust results, producing high-resolution wide-field OCTA mosaics., This work was supported by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894- B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 and PDC2022- 133132-I00 research projects; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24. Two of the authors of this work also receive financial support from the European Social Fund, through the predoctoral contract ref. PEJD-2019-PRE/TIC-17030 and research assistant contract ref. PEJ-2019-AI/TIC-13771., Xunta de Galicia; ED431C 2020/24, Comunidad de Madrid; PEJD-2019-PRE/TIC-17030, Comunidad de Madrid; PEJ-2019-AI/TIC-13771
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully automatic segmentation and monitoring of choriocapillaris flow voids in OCTA images

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive ophthalmic imaging modality that is widely used in clinical practice. Recent technological advances in OCTA allow imaging of blood flow deeper than the retinal layers, at the level of the choriocapillaris (CC), where a granular image is obtained showing a pattern of bright areas, representing blood flow, and a pattern of small dark regions, called flow voids (FVs). Several clinical studies have reported a close correlation between abnormal FVs distribution and multiple diseases, so quantifying changes in FVs distribution in CC has become an area of interest for many clinicians. However, CC OCTA images present very complex features that make it difficult to correctly compare FVs during the monitoring of a patient. In this work, we propose fully automatic approaches for the segmentation and monitoring of FVs in CC OCTA images. First, a baseline approach, in which a fully automatic segmentation methodology based on local contrast enhancement and global thresholding is proposed to segment FVs and measure changes in their distribution in a straightforward manner. Second, a robust approach in which, prior to the use of our segmentation methodology, an unsupervised trained neural network is used to perform a deformable registration that aligns inconsistencies between images acquired at different time instants. The proposed approaches were tested with CC OCTA images collected during a clinical study on the response to photodynamic therapy in patients affected by chronic central serous chorioretinopathy (CSC), demonstrating their clinical utility. The results showed that both approaches are accurate and robust, surpassing the state of the art, therefore improving the efficacy of FVs as a biomarker to monitor the patient treatments. This gives great potential for the clinical use of our methods, with the possibility of extending their use to other pathologies or treatments associated with this type of imaging., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with references PID2019-108435RB-I00; TED2021-131201B-I00 and PDC2022-133132-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80 % through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20 % by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Joint keypoint detection and description network for color fundus image registration

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
[Absctract]: Background: Retinal imaging is widely used to diagnose many diseases, both systemic and eye-specific. In these cases, image registration, which is the process of aligning images taken from different viewpoints or moments in time, is fundamental to compare different images and to assess changes in their appearance, commonly caused by disease progression. Currently, the field of color fundus registration is dominated by classical methods, as deep learning alternatives have not shown sufficient improvement over classic methods to justify the added computational cost. However, deep learning registration methods are still considered beneficial as they can be easily adapted to different modalities and devices following a data-driven learning approach. Methods: In this work, we propose a novel methodology to register color fundus images using deep learning for the joint detection and description of keypoints. In particular, we use an unsupervised neural network trained to obtain repeatable keypoints and reliable descriptors. These keypoints and descriptors allow to produce an accurate registration using RANdom SAmple Consensus (RANSAC). We train the method using the Messidor dataset and test it with the Fundus Image Registration Dataset (FIRE) dataset, both of which are publicly accessible. Results: Our work demonstrates a color fundus registration method that is robust to changes in imaging devices and capture conditions. Moreover, we conduct multiple experiments exploring several of the method’s parameters to assess their impact on the registration performance. The method obtained an overall Registration Score of 0.695 for the whole FIRE dataset (0.925 for category S, 0.352 for P, and 0.726 for A). Conclusions: Our proposal improves the results of previous deep learning methods in every category and surpasses the performance of classical approaches in category A which has disease progression and thus represents the most relevant scenario for clinical practice as registration is commonly used in patients with diseases for disease monitoring purposes., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade Xunta de Galicia through the Grupos de Referencia Competitiva grant (Ref. ED431C 2020/24), the predoctoral fellowship (Ref. ED481A 2021/147) and the postdoctoral fellowship (Ref. ED481B-2022-025); CITIC, Centro de Investigación de Galicia (Ref. ED431G 2019/01), itself received financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic simultaneous ciliary muscle segmentation and biomarker extraction in AS-OCT images using deep learning-based approaches

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Recent clinical studies have emphasized the importance of understanding the morphology and mechanics of the ciliary muscle. The ciliary muscle plays a vital role in various functions related to the anterior segment of the eye, including the regulation of intraocular pressure and the maintenance of the shape of the crystalline lens. To advance research in this area, we propose a fully automated methodology for the segmentation and biomarker measurement of the ciliary muscle in two different scan depths (6 mm and 16 mm), which are commonly used by clinicians to analyze biomarkers. Our methodology aims to provide repeatable, and immediate results through an exhaustive analysis of different network architectures, encoders, and transfer learning strategies. We also extracted a comprehensive set of relevant biomarkers, including parameters that provide essential information about its behavior during the accommodation process, overall dimensions, and biomechanical properties. These biomarkers can help clinicians and researchers in the diagnoses and monitor of different ocular diseases such as glaucoma, myopia, and presbyopia and develop new therapeutic strategies, potentially leading to more effective treatments and improved patient outcomes. Our methodology achieved accurate qualitative and quantitative results, with high accuracy values of 0.9665 ± 0.1280 and 0.9772 ± 0.0873 for the best combinations for 6 mm and 16 mm, respectively. Our proposed system provides a valuable and automatic tool for clinicians and researchers in the segmentation and analysis of the ciliary muscle in AS-OCT images., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B–I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24]; predoctoral grant [grant number ED481A-2023-152]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Evolutionary multi-target neural network architectures for flow void analysis in optical coherence tomography angiography

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • García-Feijóo, Julián
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive imaging modality used to evaluate the retinal microvasculature. Recent advances in OCTA allows to visualize the blood flow within the choriocapillaris region, where a granular image is obtained showing a pattern of small dark regions, called flow voids (FVs). Given its relevance, numerous clinical studies have linked the changes in FVs distribution to multiple diseases. The granular structure of these images makes accurate labeling and segmentation difficult, which can be overcome by using a multi-target perspective. However, manually designing a neural architecture that can accurately predict all targets in a balanced way is a major challenge. In this work, we propose a novel methodology based on evolutionary multi-target optimized networks that, through a set of evolutionary operators, traverses a search space of architectures in a deep but efficient way. This methodology allows us to discover efficient and accurate multi-target architectures tailored to our problem, but which are also adaptable to other tasks due to their robustness. To validate and analyze our methodology and the discovered network model, we performed extensive experimentation with cases from a real clinical study, achieving better results than the state of the art and manually designed architectures., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021- 131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Robust multi-view approaches for retinal layer segmentation in glaucoma patients via transfer learning

  • Gende, M.
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Martínez-de-la-Casa, José María
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Background: Glaucoma is the leading global cause of irreversible blindness. Glaucoma patients experience a progressive deterioration of the retinal nervous tissues that begins with a loss of peripheral vision. An early diagnosis is essential in order to prevent blindness. Ophthalmologists measure the deterioration caused by this disease by assessing the retinal layers in different regions of the eye, using different optical coherence tomography (OCT) scanning patterns to extract images, generating different views from multiple parts of the retina. These images are used to measure the thickness of the retinal layers in different regions. Methods: We present two approaches for the multi-region segmentation of the retinal layers in OCT images of glaucoma patients. These approaches can extract the relevant anatomical structures for glaucoma assessment from three different OCT scan patterns: circumpapillary circle scans, macular cube scans and optic disc (OD) radial scans. By employing transfer learning to take advantage of the visual patterns present in a related domain, these approaches use state-of-the-art segmentation modules to achieve a robust, fully automatic segmentation of the retinal layers. The first approach exploits inter-view similarities by using a single module to segment all of the scan patterns, considering them as a single domain. The second approach uses view-specific modules for the segmentation of each scan pattern, automatically detecting the suitable module to analyse each image. Results: The proposed approaches produced satisfactory results with the first approach achieving a dice coefficient of 0.85±0.06 and the second one 0.87±0.08 for all segmented layers. The first approach produced the best results for the radial scans. Concurrently, the view-specific second approach achieved the best results for the better represented circle and cube scan patterns. Conclusions: To the extent of our knowledge, this is the first proposal in the literature for the multi-view segmentation of the retinal layers of glaucoma patients, demonstrating the applicability of machine learning-based systems for aiding in the diagnosis of this relevant pathology., This work was supported by Ministerio de Ciencia e Innovación y Universidades, Government of Spain (grant number RTI2018-095894-B-I00); Ministerio de Ciencia e Innovación, Government of Spain through the research project with (grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00); Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, Grupos de Referencia Competitiva (grant number ED431C 2020/24), predoctoral grant (grant number ED481A 2021/161); CITIC, Centro de Investigación de Galicia (grant number ED431G 2019/01), and receives financial support from Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Enhanced multiple sclerosis diagnosis using high-resolution 3D OCT volumes with synthetic slices

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Santos Bueso, Enrique
  • Barreira, Noelia
[Abstract]: Optical Coherence Tomography (OCT), known for its micron-level resolution and non-invasive nature, is essential in diagnosing Multiple Sclerosis (MS). Accurate MS diagnosis through OCT is facilitated by identifying changes in retinal layer thickness, which serve as biomarkers, such as the retinal nerve fiber layer and the macular ganglion cell layer. To adequately diagnose MS, it is crucial to detect thickness changes in specific small regions of the retina, necessitating extensive retinal coverage with minimal granularity. However, a significant challenge in using OCT for MS diagnosis is the inverse relationship between the number of slices and the image quality of OCT volumes. High-resolution images require longer acquisition times, which limits the number of slices that can be obtained and results in covering a smaller area of the retina. Conversely, increasing the number of slices reduces individual image quality, impairing the detection of retinal layer structures. To address this issue, we propose a novel approach for the automatic detection of MS using high-resolution synthetic 3D OCT volumes. Our methodology involves using a generative network to synthesize intermediate slices, thereby enhancing retinal coverage without degrading image quality. This synthetic augmentation improves cross-sectional resolution, providing more comprehensive retinal details. Then we use a segmentation network to extract biomarkers and multiple 3D classification models to directly detect MS automatically. Our results demonstrate significant improvements in accuracy and reliability. Integrating synthetic slices into OCT volumes enhances the detection of MS, underscoring the potential of generative models for better clinical outcomes in MS diagnosis., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universi- dade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014– 2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Segmentation of Retinal Layers in Multiple Neurodegenerative Disorder Scenarios

  • Gende, M.
  • Mallén Gracia, Victor
  • Moura, Joaquim de
  • Cordón Ciordia, Beatriz
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Open Access provided by ‘Universidade da Coruña/CISUG’ within the CRUI-CARE Agreement, [Absctract]: Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND., This work was supported in part by Instituto de Salud Carlos III, Government of Spain, under Grants PI17/01726 and PI20/00437, in part by Inflammatory Disease Network (RICORS) under Grant RD21/0002/0050, in part by the Ministerio de Ciencia e Innovación, Government of Spain under Grants PDC2022-133132-I00, RTI2018-095894-B-I00, PID2019- 108435RB-I00, and TED2021-131201B-I00, in part by the Consellería de Cultura, Educación e Universidade, Xunta de Galicia through Grupos de Referencia Competitiva under Grant ED431C 2020/24 and predoctoral under Grant ED481A 2021/161, in part by CITIC, Centro de Investigación de Galicia under Grant ED431G 2019/01, and in part by Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Retinal Microaneurysms Detection Using Adversarial Pre-training With Unlabeled Multimodal Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The detection of retinal microaneurysms is crucial for the early detection of important diseases such as diabetic retinopathy. However, the detection of these lesions in retinography, the most widely available retinal imaging modality, remains a very challenging task. This is mainly due to the tiny size and low contrast of the microaneurysms in the images. Consequently, the automated detection of microaneurysms usually relies on extensive ad-hoc processing. In this regard, although microaneurysms can be more easily detected using fluorescein angiography, this alternative imaging modality is invasive and not adequate for regular preventive screening. In this work, we propose a novel deep learning methodology that takes advantage of unlabeled multimodal image pairs for improving the detection of microaneurysms in retinography. In particular, we propose a novel adversarial multimodal pre-training consisting in the prediction of fluorescein angiography from retinography using generative adversarial networks. This pre-training allows learning about the retina and the microaneurysms without any manually annotated data. Additionally, we also propose to approach the microaneurysms detection as a heatmap regression, which allows an efficient detection and precise localization of multiple microaneurysms. To validate and analyze the proposed methodology, we perform an exhaustive experimentation on different public datasets. Additionally, we provide relevant comparisons against different state-of-the-art approaches. The results show a satisfactory performance of the proposal, achieving an Average Precision of 64.90%, 31.36%, and 33.55% in the E-Ophtha, ROC, and DDR public datasets. Overall, the proposed approach outperforms existing deep learning alternatives while providing a more straightforward detection method that can be effectively applied to raw unprocessed retinal images., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia, Spain and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Segmentation and Intuitive Visualisation of the Epiretinal Membrane in 3D OCT Images Using Deep Convolutional Approaches

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Epiretinal Membrane (ERM) is a disease caused by a thin layer of scar tissue that is formed on the surface of the retina. When this membrane appears over the macula, it can cause distorted or blurred vision. Although normally idiopathic, its presence can also be indicative of other pathologies such as diabetic macular edema or vitreous haemorrhage. ERM removal surgery can preserve more visual acuity the earlier it is performed. For this purpose, we present a fully automatic segmentation system that can help the clinicians to determine the ERM presence and location over the eye fundus using 3D Optical Coherence Tomography (OCT) volumes. The proposed system uses a convolutional neural network architecture to classify patches of the retina surface. All the 2D OCT slices of the 3D OCT volume of a patient are combined to produce an intuitive colour map over the 2D fundus reconstruction, providing a visual representation of the presence of ERM which therefore facilitates the diagnosis and treatment of this relevant eye disease. A total of 2.428 2D OCT slices obtained from 20 OCT 3D volumes was used in this work. To validate the designed methodology, several representative experiments were performed. We obtained satisfactory results with a Dice Coefficient of 0.826 ± 0.112 and a Jaccard Index of 0.714 ± 0.155, proving its applicability for diagnosis purposes. The proposed system also demonstrated its simplicity and competitive performance with respect to other state-of-the-art approaches., 10.13039/501100004587-Instituto de Salud Carlos III, Government of Spain, research project (Grant Number: DTS18/00136), 10.13039/501100004837-Ministerio de Ciencia e Innovación y Universidades, Government of Spain, research project (Grant Number: RTI2018-095894-B-I00), 10.13039/501100004837-Ministerio de Ciencia e Innovación, Government of Spain through the research project (Grant Number: PID2019-108435RB-I00), 10.13039/501100008425-Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva (Grant Number: ED431C 2020/24), 10.13039/501100010769-Axencia Galega de Innovación (GAIN), Xunta de Galicia (Grant Number: IN845D 2020/38), 10.13039/501100008425-CITIC, Centro de Investigación de Galicia, receives financial support from the Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%) (Grant Number: ED431G 2019/01), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multi-Adaptive Optimization for multi-task learning with deep neural networks

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Multi-task learning is a promising paradigm to leverage task interrelations during the training of deep neural networks. A key challenge in the training of multi-task networks is to adequately balance the complementary supervisory signals of multiple tasks. In that regard, although several task-balancing approaches have been proposed, they are usually limited by the use of per-task weighting schemes and do not completely address the uneven contribution of the different tasks to the network training. In contrast to classical approaches, we propose a novel Multi-Adaptive Optimization (MAO) strategy that dynamically adjusts the contribution of each task to the training of each individual parameter in the network. This automatically produces a balanced learning across tasks and across parameters, throughout the whole training and for any number of tasks. To validate our proposal, we perform comparative experiments on real-world datasets for computer vision, considering different experimental settings. These experiments allow us to analyze the performance obtained in several multi-task scenarios along with the learning balance across tasks, network layers and training steps. The results demonstrate that MAO outperforms previous task-balancing alternatives. Additionally, the performed analyses provide insights that allow us to comprehend the advantages of this novel approach for multi-task learning., This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24 and the postdoctoral fellowship ref. ED481B-2022-025. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Efficient semi-supervised hierarchical training for segmenting choroidal vessels and other structures on OCT images of multiple sclerosis patients

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Barreira, Noelia
[Abstract]: Optical coherence tomography (OCT) is a non-invasive imaging technique used to diagnose ocular and systemic diseases. Recently, several clinical studies have linked changes in different ocular layers to the development of multiple sclerosis (MS), so accurate segmentation of these structures has become an essential task. Unfortunately, segmenting the entire set of structures involved is a very difficult task, due to their large number and variability. These two factors hinder the labeling of images and therefore severely restrict the ability to achieve a large dataset with all structures manually annotated, limiting the use of a standard supervised approach. In this paper, we propose a semi-supervised learning methodology to robustly segment ocular structures in OCT images using a limited number of partially labeled images. Our methodology maximizes the information we can extract from labeled images through hierarchical learning, where multiple decoders are used to extract segmented structures progressively. We use a reconstruction loss function to provide structural coherence to the segmentation and a teacher–student strategy to effectively leverage the information present in the set of unlabeled images. In addition to the segmentation of labeled structures, this hierarchical approach allows segmenting structures that are not labeled in the dataset such as the choroidal vessels. To validate the proposed methodology, we have carried out extensive experimentation using two datasets with different characteristics. These experiments have demonstrated a great potential of this methodology to train networks efficiently with partially labeled images, which allows to accurately extract the main biomarkers linked to the development of MS., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, PDC2022-133132-I00 and TED2021-1312 01B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades, Spain’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI, Spain Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Feature Definition and Comprehensive Analysis on the Robust Identification of Intraretinal Cystoid Regions Using Optical Coherence Tomography Images

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Rouco, José
  • Penedo, Manuel
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Currently, optical coherence tomography is one of the most used medical imaging modalities, offering cross-sectional representations of the studied tissues. This image modality is specially relevant for the analysis of the retina, since it is the internal part of the human body that allows an almost direct examination without invasive techniques. One of the most representative cases of use of this medical imaging modality is for the identification and characterization of intraretinal fluid accumulations, critical for the diagnosis of one of the main causes of blindness in developed countries: the Diabetic Macular Edema. The study of these fluid accumulations is particularly interesting, both from the point of view of pattern recognition and from the different branches of health sciences. As these fluid accumulations are intermingled with retinal tissues, they present numerous variants according to their severity, and change their appearance depending on the configuration of the device; they are a perfect subject for an in-depth research, as they are considered to be a problem without a strict solution. In this work, we propose a comprehensive and detailed analysis of the patterns that characterize them. We employed a pool of 11 different texture and intensity feature families (giving a total of 510 markers) which we have analyzed using three different feature selection strategies and seven complementary classification algorithms. By doing so, we have been able to narrow down and explain the factors affecting this kind of accumulations and tissue lesions by means of machine learning techniques with a pipeline specially designed for this purpose., Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Comprehensive analysis of clinical data for COVID-19 outcome estimation with machine learning models

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Funding for open access charge: Universidade da Coruña/CISUG., [Abstract]: COVID-19 is a global threat for the healthcare systems due to the rapid spread of the pathogen that causes it. In such situation, the clinicians must take important decisions, in an environment where medical resources can be insufficient. In this task, the computer-aided diagnosis systems can be very useful not only in the task of supporting the clinical decisions but also to perform relevant analyses, allowing them to understand better the disease and the factors that can identify the high risk patients. For those purposes, in this work, we use several machine learning algorithms to estimate the outcome of COVID-19 patients given their clinical information. Particularly, we perform 2 different studies: the first one estimates whether the patient is at low or at high risk of death whereas the second estimates if the patient needs hospitalization or not. The results of the analyses of this work show the most relevant features for each studied scenario, as well as the classification performance of the considered machine learning models. In particular, the XGBoost algorithm is able to estimate the need for hospitalization of a patient with an AUC-ROC of 0.8415± 0.0217 while it can also estimate the risk of death with an AUC-ROC of 0.7992±0.0104. Results have demonstrated the great potential of the proposal to determine those patients that need a greater amount of medical resources for being at a higher risk. This provides the healthcare services with a tool to better manage their resources., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/196; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning

  • Morano, José
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Ortega Hortas, Marcos
[Abstract]: Background and Objectives: Age-related macular degeneration (AMD) is a degenerative disorder affecting the macula, a key area of the retina for visual acuity. Nowadays, AMD is the most frequent cause of blindness in developed countries. Although some promising treatments have been proposed that effectively slow down its development, their effectiveness significantly diminishes in the advanced stages. This emphasizes the importance of large-scale screening programs for early detection. Nevertheless, implementing such programs for a disease like AMD is usually unfeasible, since the population at risk is large and the diagnosis is challenging. For the characterization of the disease, clinicians have to identify and localize certain retinal lesions. All this motivates the development of automatic diagnostic methods. In this sense, several works have achieved highly positive results for AMD detection using convolutional neural networks (CNNs). However, none of them incorporates explainability mechanisms linking the diagnosis to its related lesions to help clinicians to better understand the decisions of the models. This is specially relevant, since the absence of such mechanisms limits the application of automatic methods in the clinical practice. In that regard, we propose an explainable deep learning approach for the diagnosis of AMD via the joint identification of its associated retinal lesions. Methods: In our proposal, a CNN with a custom architectural setting is trained end-to-end for the joint identification of AMD and its associated retinal lesions. With the proposed setting, the lesion identification is directly derived from independent lesion activation maps; then, the diagnosis is obtained from the identified lesions. The training is performed end-to-end using image-level labels. Thus, lesion-specific activation maps are learned in a weakly-supervised manner. The provided lesion information is of high clinical interest, as it allows clinicians to assess the developmental stage of the disease. Additionally, the proposed approach allows to explain the diagnosis obtained by the models directly from the identified lesions and their corresponding activation maps. The training data necessary for the approach can be obtained without much extra work on the part of clinicians, since the lesion information is habitually present in medical records. This is an important advantage over other methods, including fully-supervised lesion segmentation methods, which require pixel-level labels whose acquisition is arduous. Results: The experiments conducted in 4 different datasets demonstrate that the proposed approach is able to identify AMD and its associated lesions with satisfactory performance. Moreover, the evaluation of the lesion activation maps shows that the models trained using the proposed approach are able to identify the pathological areas within the image and, in most cases, to correctly determine to which lesion they correspond. Conclusions: The proposed approach provides meaningful information—lesion identification and lesion activation maps—that conveniently explains and complements the diagnosis, and is of particular interest to clinicians for the diagnostic process. Moreover, the data needed to train the networks using the proposed approach is commonly easy to obtain, what represents an important advantage in fields with particularly scarce data, such as medical imaging., Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A 2021/140, Xunta de Galicia; ED431G 2019/01, This work was funded by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Conselleria de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, ref. ED431C 2020/24, the predoctoral grant ref. ED481A 2021/140, and the postdoctoral grant ref. ED481B-2022-025; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, is funded by Conselleria de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaria Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Explainable artificial intelligence for the automated assessment of the retinal vascular tortuosity

  • Hervella, Álvaro S.
  • Ramos, Lucía
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Retinal vascular tortuosity is an excessive bending and twisting of the blood vessels in the retina that is associated with numerous health conditions. We propose a novel methodology for the automated assessment of the retinal vascular tortuosity from color fundus images. Our methodology takes into consideration several anatomical factors to weigh the importance of each individual blood vessel. First, we use deep neural networks to produce a robust extraction of the different anatomical structures. Then, the weighting coefficients that are required for the integration of the different anatomical factors are adjusted using evolutionary computation. Finally, the proposed methodology also provides visual representations that explain the contribution of each individual blood vessel to the predicted tortuosity, hence allowing us to understand the decisions of the model. We validate our proposal in a dataset of color fundus images providing a consensus ground truth as well as the annotations of five clinical experts. Our proposal outperforms previous automated methods and offers a performance that is comparable to that of the clinical experts. Therefore, our methodology demonstrates to be a viable alternative for the assessment of the retinal vascular tortuosity. This could facilitate the use of this biomarker in clinical practice and medical research., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work is supported by Ministerio de Ciencia e Innovación, Government of Spain (RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects); Consellería de Cultura, Educación e Universidade, Xunta de Galicia (Grupos de Referencia Competitiva ref. ED431C 2020/24 and postdoctoral fellowship ref. ED481B-2022-025). CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Simultaneous Segmentation and Classification of the Retinal Arteries and Veins From Color Fundus Images

  • Morano, José
  • Hervella, Álvaro S.
  • Novo Buján, Jorge
  • Rouco, José
[Abstract] Background and objectives: The study of the retinal vasculature represents a fundamental stage in the screening and diagnosis of many high-incidence diseases, both systemic and ophthalmic. A complete retinal vascular analysis requires the segmentation of the vascular tree along with the classification of the blood vessels into arteries and veins. Early automatic methods approach these complementary segmentation and classification tasks in two sequential stages. However, currently, these two tasks are approached as a joint semantic segmentation, because the classification results highly depend on the effectiveness of the vessel segmentation. In that regard, we propose a novel approach for the simultaneous segmentation and classification of the retinal arteries and veins from eye fundus images. Methods: We propose a novel method that, unlike previous approaches, and thanks to the proposal of a novel loss, decomposes the joint task into three segmentation problems targeting arteries, veins and the whole vascular tree. This configuration allows to handle vessel crossings intuitively and directly provides accurate segmentation masks of the different target vascular trees. Results: The provided ablation study on the public Retinal Images vessel Tree Extraction (RITE) dataset demonstrates that the proposed method provides a satisfactory performance, particularly in the segmentation of the different structures. Furthermore, the comparison with the state of the art shows that our method achieves highly competitive results in the artery/vein classification, while significantly improving the vascular segmentation. Conclusions: The proposed multi-segmentation method allows to detect more vessels and better segment the different structures, while achieving a competitive classification performance. Also, in these terms, our approach outperforms the approaches of various reference works. Moreover, in contrast with previous approaches, the proposed method allows to directly detect the vessel crossings, as well as preserving the continuity of both arteries and veins at these complex locations., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

3D Features Fusion for Automated Segmentation of Fluid Regions in CSCR Patients: An OCT-based Photodynamic Therapy Response Analysis

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Central Serous Chorioretinopathy (CSCR) is a significant cause of vision impairment worldwide, with Photodynamic Therapy (PDT) emerging as a promising treatment strategy. The capability to precisely segment fluid regions in Optical Coherence Tomography (OCT) scans and predict the response to PDT treatment can substantially augment patient outcomes. This paper introduces a novel deep learning (DL) methodology for automated 3D segmentation of fluid regions in OCT scans, followed by a subsequent PDT response analysis for CSCR patients. Our approach utilizes the rich 3D contextual information from OCT scans to train a model that accurately delineates fluid regions. This model not only substantially reduces the time and effort required for segmentation but also offers a standardized technique, fostering further large-scale research studies. Additionally, by incorporating pre- and post-treatment OCT scans, our model is capable of predicting PDT response, hence enabling the formulation of personalized treatment strategies and optimized patient management. To validate our approach, we employed a robust dataset comprising 2,769 OCT scans (124 3D volumes), and the results obtained were significantly satisfactory, outperforming the current state-of-the-art methods. This research signifies an important milestone in the integration of DL advancements with practical clinical applications, propelling us a step closer towards improved management of CSCR. Furthermore, the methodologies and systems developed can be adapted and extrapolated to tackle similar challenges in the diagnosis and treatment of other retinal pathologies, favoring more comprehensive and personalized patient care., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A-2023-152]. Furthermore, this work was supported by the Instituto de Salud Carlos III (ISCIII) under the grant [FORT23/00010] as part of the Programa FORTALECE del Ministerio de Ciencia e Innovación. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Detecting, Characterizing and Visualizing Multiple Sclerosis in Optical Coherence Tomography Through Biomarker Selection

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Rouco, José
[Abstract]: Multiple sclerosis (MS) is a chronic neurodegenerative disease affecting the central nervous system, which is the primary cause of non-traumatic neurological disability among young adults. Diagnosing MS is challenging yet crucial for effective patient treatment. Optical Coherence Tomography (OCT) has emerged as a non-invasive and efficient tool for analysing optic nerv alterations and assessing neurodegeneration in MS, particularly through changes in retinal thickness of layers such as the retinal nerve fiber layer (RNFL) and ganglion cell layer (GCL). In this work, we investigate the potential of using changes across all retinal layer thickness as a biomarker for MS detection. To accomplish this, we propose a fully automatic system consisting of an MS classification model and a pathological thickness visualization model. First, our system employs a fully convolutional neural network to segment retinal layers and choroidal vessels and to calculate the extraction of layer thickness at varying granularities. Global and local layer thickness are used as inputs for the MS classification model. A genetic multi objective algorithm is used for effective feature selection. Concurrently, voxel-level layer thickness serves as input for the visualization model that generates a 2D probability map where the pathological regions are highlighted. This map contributes to an interactive 3D reconstruction that provides a swift overview of MS-associated thickness changes. Extensive experimentation on real clinical MS cases validates the significant potential of the proposed system for practical clinical applications and showcases its efficacy in enhancing diagnostic precision and efficiency., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

End-To-End Multi-Task Learning Approaches for the Joint Epiretinal Membrane Segmentation and Screening in OCT Images

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Background and objectives The Epiretinal Membrane (ERM) is an ocular disease that can cause visual distortions and irreversible vision loss. Patient sight preservation relies on an early diagnosis and on determining the location of the ERM in order to be treated and potentially removed. In this context, the visual inspection of the images in order to screen for ERM signs is a costly and subjective process. Methods In this work, we propose and study three end-to-end fully-automatic approaches for the simultaneous segmentation and screening of ERM signs in Optical Coherence Tomography images. These convolutional approaches exploit a multi-task learning context to leverage inter-task complementarity in order to guide the training process. The proposed architectures are combined with three different state of the art encoder architectures of reference in order to provide an exhaustive study of the suitability of each of the approaches for these tasks. Furthermore, these architectures work in an end-to-end manner, entailing a significant simplification of the development process since they are able to be trained directly from annotated images without the need for a series of purpose-specific steps. Results In terms of segmentation, the proposed models obtained a precision of 0.760 ± 0.050, a sensitivity of 0.768 ± 0.210 and a specificity of 0.945 ± 0.011. For the screening task, these models achieved a precision of 0.963 ± 0.068, a sensitivity of 0.816 ± 0.162 and a specificity of 0.983 ± 0.068. The obtained results show that these multi-task approaches are able to perform competitively with or even outperform single-task methods tailored for either the segmentation or the screening of the ERM. Conclusions These results highlight the advantages of using complementary knowledge related to the segmentation and screening tasks in the diagnosis of this relevant pathology, constituting the first proposal to address the diagnosis of the ERM from a multi-task perspective., This research was funded by Instituto de Salud Carlos III, Government of Spain, [grant number DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [grant number RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant number PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], Predoctoral grant [grant number ED481A 2021/161] and Postdoctoral grant [grant number ED481B 2021/059]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant number IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding sources had no role in the development of this work. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Automatic segmentation of retinal layers in multiple neurodegenerative disorder scenarios

  • Gende, Mateo
  • Mallen, Víctor
  • de Moura, Joaquim
  • Cordón, Beatriz
  • Garcia-Martin, Elena
  • Sánchez, Clara I.
  • Novo, Jorge
  • Ortega, Marcos
Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND.