Pasar al contenido principal

DESARROLLO DE TECNOLOGIAS INTELIGENTES PARA DIAGNOSTICO DE LA DMAE BASADAS EN EL ANALISIS AUTOMATICO DE NUEVAS MODALIDADES HETEROGENEAS DE ADQUISICION DE IMAGEN OFTALMOLOGICA

RTI2018-095894-B-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2018
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 84
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Data Augmentation Approaches Using Cycle-Consistent Adversarial Networks for Improving COVID-19 Screening in Portable Chest X-Ray Images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The current COVID-19 pandemic, that has caused more than 100 million cases as well as more than two million deaths worldwide, demands the development of fast and accurate diagnostic methods despite the lack of available samples. This disease mainly affects the respiratory system of the patients and can lead to pneumonia and to severe cases of acute respiratory syndrome that result in the formation of several pathological structures in the lungs. These pathological structures can be explored taking advantage of chest X-ray imaging. As a recommendation for the health services, portable chest X-ray devices should be used instead of conventional fixed machinery, in order to prevent the spread of the pathogen. However, portable devices present several problems (specially those related with capture quality). Moreover, the subjectivity and the fatigue of the clinicians lead to a very difficult diagnostic process. To overcome that, computer-aided methodologies can be very useful even taking into account the lack of available samples that the COVID-19 affectation shows. In this work, we propose an improvement in the performance of COVID-19 screening, taking advantage of several cycle generative adversarial networks to generate useful and relevant synthetic images to solve the lack of COVID-19 samples, in the context of poor quality and low detail datasets obtained from portable devices. For validating this proposal for improved COVID-19 screening, several experiments were conducted. The results demonstrate that this data augmentation strategy improves the performance of a previous COVID-19 screening proposal, achieving an accuracy of 98.61% when distinguishing among NON-COVID-19 (i.e. normal control samples and samples with pathologies others than COVID-19) and genuine COVID-19 samples. It is remarkable that this methodology can be extrapolated to other pulmonary pathologies and even other medical imaging domains to overcome the data scarcity., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Study on Relevant Features in COVID-19 PCR Tests

  • Vidal, Plácido
  • Moura, Joaquim de
  • Ramos, Lucía
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] In the year 2020, the world suffered the effects of a global pandemic. COVID-19 is a disease that mainly affects the respiratory system of patients, even causing a disproportionate response of the immune system and further spreading the damage to other vital organs. The main means by which health care services detected this viral disease was through the use of Polymerase Chain Reactions (PCRs). These PCRs allow the detection of known chains of the genetic code of the virus in samples of sputum. In this work, we study PCR signal features that allow to automatize the analysis of hundreds of PCRs. The findings obtained from the study have shown these features to be capable of obtaining successful results in the detection of COVID-19 in PCR samples, with only a small fraction of the information extracted by the clinicians for that purpose., Xunta de Galicia; ED431G 2019/01, Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia, Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multi-Stage Transfer Learning for Lung Segmentation Using Portable X-Ray Devices for Patients With COVID-19

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] One of the main challenges in times of sanitary emergency is to quickly develop computer aided diagnosis systems with a limited number of available samples due to the novelty, complexity of the case and the urgency of its implementation. This is the case during the current pandemic of COVID-19. This pathogen primarily infects the respiratory system of the afflicted, resulting in pneumonia and in a severe case of acute respiratory distress syndrome. This results in the formation of different pathological structures in the lungs that can be detected by the use of chest X-rays. Due to the overload of the health services, portable X-ray devices are recommended during the pandemic, preventing the spread of the disease. However, these devices entail different complications (such as capture quality) that, together with the subjectivity of the clinician, make the diagnostic process more difficult and suggest the necessity for computer-aided diagnosis methodologies despite the scarcity of samples available to do so. To solve this problem, we propose a methodology that allows to adapt the knowledge from a well-known domain with a high number of samples to a new domain with a significantly reduced number and greater complexity. We took advantage of a pre-trained segmentation model from brain magnetic resonance imaging of a unrelated pathology and performed two stages of knowledge transfer to obtain a robust system able to segment lung regions from portable X-ray devices despite the scarcity of samples and lesser quality. This way, our methodology obtained a satisfactory accuracy of 0.9761 ± 0.0100 for patients with COVID-19, 0.9801 ± 0.0104 for normal patients and 0.9769 ± 0.0111 for patients with pulmonary diseases with similar characteristics as COVID-19 (such as pneumonia) but not genuine COVID-19., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant Ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant Ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant Ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01).
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Impact of the Region of Analysis on the Performance of the Automatic Epiretinal Membrane Segmentation in OCT Images

  • Gende, M.
  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Eurocast 2022, 18th International Conference on Computer Aided Systems Theory. Museo Elder de la Ciencia y la Tecnología, Las Palmas de Gran Canaria, Spain, 20-25 February 2022., [Absctract]: The Epiretinal Membrane (ERM) is an ocular pathology that can cause permanent visual loss if left untreated for long. Despite its transparency, it is possible to visualise the ERM in Optical Coherence Tomography (OCT) images. In this work, we present a study on the impact of the analysis region on the performance of an automatic ERM segmentation methodology using OCT images. For this purpose, we tested 5 different sliding windows sizes ranging from to pixels to calibrate the impact of the field of view under analysis. Furthermore, 3 different approaches are proposed to enable the analysis of the regions close to the edges of the images. The proposed approaches provided satisfactory results, with each of them interacting differently with the variations in window size., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019- 108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24] and predoctoral grants [ED481A 2021/161] and [ED481A 2021/196]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia ref. [ED431G 2019/01] receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Deep learning for segmentation of optic disc and retinal layers in peripapillary optical coherence tomography images

  • Rivas Vázquez, Estefanía
  • Barreira, Noelia
  • López-Varela, Emilio
  • Penedo, Manuel
This version of the conference paper has been accepted for publication, after peer review in Proceedings SPIE 12701, Fifteenth International Conference on Machine Vision (ICMV 2022), 127011A, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1117/12.2680545., [Abstract]: Optical coherence tomography (OCT) is a non-invasive technique that allows the retina to be studied with precision, the analysis of the features of its layers and other structures such as the macula or the optic nerve. This is why it is used in the diagnosis and monitoring of eye diseases such as glaucoma and optic neuritis. A crucial step in this process is the segmentation of the different layers, which is a great challenge due to its complexity. In this work, a methodology based on deep learning and transfer learning will be developed to automatically segment nine retinal layers in OCT images centred on the optic disc. In addition, the thickness of each retinal layer will be measured along each B-scan. For this purpose, OCT images from a public dataset and a dataset collected from depth-enhanced images will be used. The proposed method achieves a Dice score of 83.6%, similar to that obtained in the state of the art, segmenting the nine retinal layers and the optic disc in both sets of images. In addition, the different layers are represented in three different graphical formats., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Fully-automatic segmentation of the ciliary muscle using anterior segment optical coherence tomography images

  • Goyanes, Elena
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Ortega Hortas, Marcos
This version of the paper has been accepted for publication. The final published paper is available online at: https://doi.org/10.1109/IJCNN55064.2022.9892316, [Abstract]: The study of the ciliary muscle represents a fundamental step in the diagnosis and treatment of many high-incidence diseases, such as glaucoma or myopia. Currently, Anterior Segment Optical Coherence Tomography (AS-OCT) is widely used by clinicians to analyse the morphological changes that affect this important ocular structure. AS-OCT is a non-invasive imaging technique that produces high-resolution cross-sectional images, allowing a precise visualization of the main ocular tissues of the anterior segment of the eye. In this work, we propose a novel methodology for the ciliary muscle segmentation using AS-OCT images, an emerging ophthalmic imaging technology with great potential to support early diagnosis of relevant ocular conditions. For this purpose, we have analysed the performance of the U-Net architecture with two different encoders (ResNet-18 and ResNet-34) combined with a transfer learning-based approach. The validation of the proposed system was performed through different and representative experiments, using an AS-OCT dataset that was specifically designed for this work. The results demonstrated that the proposed system is robust and reliable, achieving an average Precision of 0.8902 ± 0.0815, an average Recall of 0.8237 ± 0.1239, an average Accuracy of 0.9961 ± 0.0021, an average Jaccard of 0.7431 ± 0.1116 and an average Dice of 0.8445 ± 0.0870. These results demonstrate that the proposed method has a satisfactory performance that can help the clinicians to make a more accurate diagnosis and proceed with appropriate treatments of different diseases of interest., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Analysis of Separability of COVID-19 and Pneumonia in Chest X-ray Images by Means of Convolutional Neural Networks

  • Moura, Joaquim de
  • Ramos, Lucía
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] The new coronavirus (COVID-19) is a disease that is caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). On 11 March 2020, the coronavirus outbreak has been labelled a global pandemic by the World Health Organization. In this context, chest X-ray imaging has become a remarkably powerful tool for the identification of patients with COVID-19 infections at an early stage when clinical symptoms may be unspecific or sparse. In this work, we propose a complete analysis of separability of COVID-19 and pneumonia in chest X-ray images by means of Convolutional Neural Networks. Satisfactory results were obtained that demonstrated the suitability of the proposed system, improving the efficiency of the medical screening process in the healthcare systems., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the RTI2018-095894-B-I00 research projects, as well as through Ayudas para la formación de profesorado universitario (FPU), Ref. FPU18/02271. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Centro de Investigación del Sistema Universitario de Galicia, Ref. ED431G 2019/01., Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Generation of Synthetic Intermediate Slices in 3D OCT Cubes for Improving Pathology Detection and Monitoring

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Arroyo Castillo, María Rosa
  • Penedo, Manuel
Funding for open access charge: Universidade da Coruña/CISUG, [Absctract]: OCT is a non-invasive imaging technique commonly used to obtain 3D volumes of the ocular structure. These volumes allow the monitoring of ocular and systemic diseases through the observation of subtle changes in the different structures present in the eye. In order to observe these changes it is essential that the OCT volumes have a high resolution in all axes, but unfortunately there is an inverse relationship between the quality of the OCT images and the number of slices of the cube. This results in routine clinical examinations using cubes that generally contain high-resolution images with few slices. This lack of slices complicates the monitoring of changes in the retina hindering the diagnostic process and reducing the effectiveness of 3D visualizations. Therefore, increasing the cross-sectional resolution of OCT cubes would improve the visualization of these changes aiding the clinician in the diagnostic process. In this work we present a novel fully automatic methodology to perform the synthesis of intermediate slices of OCT image volumes in an unsupervised manner. To perform this synthesis, we propose a fully convolutional neural network architecture that uses information from two adjacent slices to generate the intermediate synthetic slice. We also propose a training methodology, where we use three adjacent slices to train the network by contrastive learning and image reconstruction. We test our methodology with three different types of OCT volumes commonly used in the clinical setting and validate the quality of the synthetic slices created with several medical experts and using an expert system., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG ., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Automatic Segmentation and Visualisation of the Epirretinal Membrane in OCT Scans Using Densely Connected Convolutional Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The Epiretinal Membrane (ERM) is an ocular disease that appears as a fibro-cellular layer of tissue over the retina, specifically, over the Inner Limiting Membrane (ILM). It causes vision blurring and distortion, and its presence can be indicative of other ocular pathologies, such as diabetic macular edema. The ERM diagnosis is usually performed by visually inspecting Optical Coherence Tomography (OCT) images, a manual process which is tiresome and prone to subjectivity. In this work, we present a methodology for the automatic segmentation and visualisation of the ERM in OCT volumes using deep learning. By employing a Densely Connected Convolutional Network, every pixel in the ILM can be classified into either healthy or pathological. Thus, a segmentation of the region susceptible to ERM appearance can be produced. This methodology also produces an intuitive colour map representation of the ERM presence over a visualisation of the eye fundus created from the OCT volume. In a series of representative experiments conducted to evaluate this methodology, it achieved a Dice score of 0.826±0.112 and a Jaccard index of 0.714±0.155. The results that were obtained demonstrate the competitive performance of the proposed methodology when compared to other works in the state of the art., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/161 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

End-To-End Multi-Task Learning for Simultaneous Optic Disc and Cup Segmentation and Glaucoma Classification in Eye Fundus Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The automated analysis of eye fundus images is crucial towards facilitating the screening and early diagnosis of glaucoma. Nowadays, there are two common alternatives for the diagnosis of this disease using deep neural networks. One is the segmentation of the optic disc and cup followed by the morphological analysis of these structures. The other is to directly address the diagnosis as an image classification task. The segmentation approach presents the advantage of using pixel-level labels with precise morphological information for training. However, while this detailed training feedback is not available for the classification approach, in this case the image-level labels may allow the discovery of additional non-morphological cues that are also relevant for the diagnosis. In this work, we propose a novel multi-task approach for the simultaneous classification of glaucoma and segmentation of the optic disc and cup. This approach can improve the overall performance by taking advantage of both pixel-level and image-level labels during the network training. Additionally, the segmentation maps that are predicted together with the diagnosis allow the extraction of relevant biomarkers such as the cup-to-disc ratio. The proposed methodology presents two relevant technical novelties. First, a network architecture for simultaneous segmentation and classification that increases the number of shared parameters between both tasks. Second, a multi-adaptive optimization strategy that ensures that both tasks contribute similarly to the parameter updates during training, avoiding the use of loss weighting hyperparameters. To validate our proposal, an exhaustive experimentation was performed on the public REFUGE and DRISHTI-GS datasets. The results show that our proposal outperforms comparable multi-task baselines and is highly competitive with existing state-of-the-art approaches. Additionally, the provided ablation study shows that both the network architecture and the optimization approach are independently advantageous for multi-task learning., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, through grant ref. IN845D 2020/38; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Spain . Funding for open access charge: Universidade da Coruña/CISUG, Spain., Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

High/Low Quality Style Transfer for Mutual Conversion of OCT Images Using Contrastive Unpaired Translation Generative Adversarial Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
21st International Conference, Lecce, Italy, May 23–27, 2022, [Absctract]: Recent advances in artificial intelligence and deep learning models are contributing to the development of advanced computer-aided diagnosis (CAD) systems. In the context of medical imaging, Optical Coherence Tomography (OCT) is a valuable technique that is able to provide cross-sectional visualisations of the ocular tissue. However, OCT is constrained by a limitation between the quality of the visualisations that it can produce and the overall amount of tissue that can be analysed at once. This limitation leads to a scarcity of high quality data, a problem that is very prevalent when developing machine learning-based CAD systems intended for medical imaging. To mitigate this problem, we present a novel methodology for the unpaired conversion of OCT images acquired with a low quality extensive scanning preset into the visual style of those taken with a high quality intensive scan and vice versa. This is achieved by employing contrastive unpaired translation generative adversarial networks to convert between the visual styles of the different acquisition presets. The results we obtained in the validation experiments show that these synthetic generated images can mirror the visual features of the original ones while preserving the natural tissue texture, effectively increasing the total number of available samples that can be used to train robust machine learning-based CAD systems., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24], predoctoral grant [ED481A 2021/161]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Color Fundus Image Registration Using a Learning-Based Domain-Specific Landmark Detection Methodology

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Medical imaging, and particularly retinal imaging, allows to accurately diagnose many eye pathologies as well as some systemic diseases such as hypertension or diabetes. Registering these images is crucial to correctly compare key structures, not only within patients, but also to contrast data with a model or among a population. Currently, this field is dominated by complex classical methods because the novel deep learning methods cannot compete yet in terms of results and commonly used methods are difficult to adapt to the retinal domain. In this work, we propose a novel method to register color fundus images based on previous works which employed classical approaches to detect domain-specific landmarks. Instead, we propose to use deep learning methods for the detection of these highly-specific domain-related landmarks. Our method uses a neural network to detect the bifurcations and crossovers of the retinal blood vessels, whose arrangement and location are unique to each eye and person. This proposal is the first deep learning feature-based registration method in fundus imaging. These keypoints are matched using a method based on RANSAC (Random Sample Consensus) without the requirement to calculate complex descriptors. Our method was tested using the public FIRE dataset, although the landmark detection network was trained using the DRIVE dataset. Our method provides accurate results, a registration score of 0.657 for the whole FIRE dataset (0.908 for category S, 0.293 for category P and 0.660 for category A). Therefore, our proposal can compete with complex classical methods and beat the deep learning methods in the state of the art., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00 136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095 894-B-I00 research project; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/147 and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding institutions had no involvement in the study design, in the collection, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Portable Chest X-ray Synthetic Image Generation for the COVID-19 Screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The global pandemic of COVID-19 raises the importance of having fast and reliable methods to perform an early detection and to visualize the evolution of the disease in every patient, which can be assessed with chest X-ray imaging. Moreover, in order to reduce the risk of cross contamination, radiologists are asked to prioritize the use of portable chest X-ray devices that provide a lower quality and lower level of detail in comparison with the fixed machinery. In this context, computer-aided diagnosis systems are very useful. During the last years, for the case of medical imaging, they are widely developed using deep learning strategies. However, there is a lack of sufficient representative datasets of the COVID-19 affectation, which are critical for supervised learning when training deep models. In this work, we propose a fully automatic method to artificially increase the size of an original portable chest X-ray imaging dataset that was specifically designed for the COVID-19 diagnosis, which can be developed in a non-supervised manner and without requiring paired data. The results demonstrate that the method is able to perform a reliable screening despite all the problems associated with images provided by portable devices, providing an overall accuracy of 92.50%., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multimodal Image Encoding Pre-training for Diabetic Retinopathy Grading

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Diabetic retinopathy is an increasingly prevalent eye disorder that can lead to severe vision impairment. The severity grading of the disease using retinal images is key to provide an adequate treatment. However, in order to learn the diverse patterns and complex relations that are required for the grading, deep neural networks require very large annotated datasets that are not always available. This has been typically addressed by reusing networks that were pre-trained for natural image classification, hence relying on additional annotated data from a different domain. In contrast, we propose a novel pre-training approach that takes advantage of unlabeled multimodal visual data commonly available in ophthalmology. The use of multimodal visual data for pre-training purposes has been previously explored by training a network in the prediction of one image modality from another. However, that approach does not ensure a broad understanding of the retinal images, given that the network may exclusively focus on the similarities between modalities while ignoring the differences. Thus, we propose a novel self-supervised pre-training that explicitly teaches the networks to learn the common characteristics between modalities as well as the characteristics that are exclusive to the input modality. This provides a complete comprehension of the input domain and facilitates the training of downstream tasks that require a broad understanding of the retinal images, such as the grading of diabetic retinopathy. To validate and analyze the proposed approach, we performed an exhaustive experimentation on different public datasets. The transfer learning performance for the grading of diabetic retinopathy is evaluated under different settings while also comparing against previous state-of-the-art pre-training approaches. Additionally, a comparison against relevant state-of-the-art works for the detection and grading of diabetic retinopathy is also provided. The results show a satisfactory performance of the proposed approach, which outperforms previous pre-training alternatives in the grading of diabetic retinopathy., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Automatic Tool for the Detection, Characterization and Intuitive Visualization of Macular Edema Regions in OCT Images

  • Otero, Iago
  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] The methodology presented in this paper aims to detect pathological regions affected by one or more of the three clinically defined types of Diabetic Macular Edema (DME). Using representative samples extracted from Optical Coherence Tomography (OCT) images, three representative classifiers are trained to analyze new input images and create an intuitive visualization of the detection results. The trained models provided a satisfactory performance for all three defined types of DME, and the visual feedback can effectively assists clinical experts in the diagnosis of this representative and extended disease., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Ministerio de Educación y Formación Profesional; 18CO1/006199., This research was funded by Instituto de Salud Carlos III grant number DTS18/00136, Ministerio de Ciencia, Innovación y Universidades grant numbers DPI 2015-69948-R and RTI2018-095894-B-I00, Xunta de Galicia through the accreditation of Centro Singular de Investigación 2016–2019, Ref. ED431G/01, Xunta de Galicia through Grupos de Referencia Competitiva, Ref. ED431C 2016-047 and Ministerio de Educación y Formación Profesional grant number 18CO1/006199.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Automatic Deep Learning-based Models for Retinal Layer Thickness Analysis as a Biomarker for Neurodegenerative Diseases

  • Gende, M.
  • Moura, Joaquim de
  • Cordón Ciordia, Beatriz
  • Viladés, Elisa
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
The ARVO Annual Meeting is the premiere gathering for eye and vision scientists at all career stages, students, and those in affiliated fields to share the latest research findings and collaborate on innovative solutions. For 2023, the Meeting will be hosted April 23 – 27 in New Orleans, La., Purpose : The retina is the most accessible part of the central nervous system, allowing its non-invasive exploration and measurement. Optical Coherence Tomography (OCT) offers an objective monitoring method of progression in Neurodegenerative Disease (NDD), enabling the extraction of biomarkers such as retinal layer thickness. Machine learning models allow the automatic and repeatable measurement of the retinal layers and enable an early diagnosis of NDD. These need to be trained on annotated images representative of the visual patterns that characterise these diseases. We present a study in the automatic measurement of retinal layer thickness in patients of different NDDs and an assessment of the mutual compatibility of models trained in representative images of these diseases. Methods : Five independent samples of multiple sclerosis, Alzheimer's disease, Parkinson's disease and essential tremor patients, along with healthy controls were prospectively recruited (N=50). Macula centred OCT volumes from these patients were annotated with the area of the Retinal Nerve Fibre Layer (RNFL) and between the Ganglion Cell Layer and Bruch's Membrane (GCL-BM), for 1250 B-scans in total. In a first experiment, a series of deep learning models were trained on every NDD but one and evaluated in terms of their ability to segment the retinal layers of the unseen NDD. In a second experiment, the models were trained on images from a specific NDD and then evaluated on each of the other ones. Results : The average thickness for each layer was measured and separately compared for each NDD using a one-way ANOVA test. This test found no significant differences between the thickness of either RNFL or GCL-BM (p>0.05). The results show that the models are able to accurately segment the retinal layers, with an overall Dice coefficient of 0.96±0.02 for Experiment 1 and 0.95±0.03 for Experiment 2. However, these results do not translate equally for every NDD. The models trained in diseases such as Alzheimer's and essential tremor can better generalise to other NDDs, while healthy control images achieved the second worst results. Conclusions : Patients of different NDDs may present visual differences in their retinal OCTs, which affect the performance of automatic retinal layer segmentation models., This research was funded by Instituto de Salud Carlos III, Government of Spain, [research projects PI17/01726 and PI20/00437]; Inflammatory Disease Network (RICORS) [research project RD21/0002/0050]; Ministerio de Ciencia e Innovación, Government of Spain [research projects RTI2018-095894-B-I00, PID2019-108435RB-I00 and TED2021-131201B-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/161]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding organisations had no role in the design or conduct of this research., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Capítulo o parte de un libro (BookPart)

Fully Automatic Epiretinal Membrane Segmentation in OCT Scans Using Convolutional Networks

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: The epiretinal membrane (ERM) is an ocular pathology that can cause visual distortions. To prevent a loss of vision, symptomatic ERM needs to be removed before it can cause irreversible damage. In order to do this, the ERM needs to be located early, so that it can be peeled from the retina. This chapter explores an automatic methodology for ERM segmentation, as well as its intuitive visualization in the form of colour maps. To do this, visual features that are compatible with ERM presence are extracted from ophthalmologic images by using computer vision algorithms and deep learning models. This methodology achieved satisfactory results, reaching a dice coefficient of 0.826 and a Jaccard index of 0.714, contributing to highlight the applicability of deep learning models for the detection of pathological signs in medical images., This research was funded by Instituto de Salud Carlos III, Government of Spain, [research project DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [research project RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain [research project PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [grant ref. ED431C 2020/24], predoctoral [grant ref. ED481A 2021/161] and postdoctoral [grant ref. ED481B 113 Fully Automatic Epiretinal Membrane Segmentation 2021/059]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant ref. IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant ref. ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Capítulo o parte de un libro (BookPart)

Generation of Novel Synthetic Portable Chest X-Ray Images for Automatic COVID-19 Screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
in: Rajae El Ouazzani, Mohammed Fattah, Nabil Benamar (eds.) AI Applications for Disease Diagnosis and Treatment, IGI Global, 2022, [Abstract]: The diagnosis and the study of the evolution of COVID-19 is crucial to tackle the challenge that this disease represents for healthcare services. Chest x-ray imaging allows us to visualize the pulmonary regions, where COVID-19 causes its main affectation. In order to reduce the risk of cross-contamination, a crucial aspect in the pandemic, portable chest x-ray devices are advantageous being easier to decontaminate in comparison with the fixed machinery, despite offering a lower image quality. Furthermore, the recent emergence of COVID-19 implies a data scarcity that must be tackled. In this chapter, the authors present the analysis of a strategy that generates novel synthetic portable chest x-ray images using the CycleGAN, an architecture for image translation that is trained with unpaired data. The novel set of images is then added to the original dataset, improving the performance of the classification model., This research was funded by Instituto de Salud Carlos III, Government of Spain, [grant number DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [grant number RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant number PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral and postdoctoral grant contracts [grant number ED481A 2021/196] and [grant number ED481B 2021/059], respectively; and Grupos de Referencia Competitiva, [grant number ED431C 2020/24]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant number IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481B 2021/059
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully-Automatic 3D Intuitive Visualization of Age-Related Macular Degeneration Fluid Accumulations in OCT Cubes

  • López-Varela, Emilio
  • Vidal, Plácido
  • Olivier Pascual, Nuria
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Age-related macular degeneration is the leading cause of vision loss in developed countries, and wet-type AMD requires urgent treatment and rapid diagnosis because it causes rapid irreversible vision loss. Currently, AMD diagnosis is mainly carried out using images obtained by optical coherence tomography. This diagnostic process is performed by human clinicians, so human error may occur in some cases. Therefore, fully automatic methodologies are highly desirable adding a layer of robustness to the diagnosis. In this work, a novel computer-aided diagnosis and visualization methodology is proposed for the rapid identification and visualization of wet AMD. We adapted a convolutional neural network for segmentation of a similar domain of medical images to the problem of wet AMD segmentation, taking advantage of transfer learning, which allows us to work with and exploit a reduced number of samples. We generate a 3D intuitive visualization where the existence, position and severity of the fluid were represented in a clear and intuitive way to facilitate the analysis of the clinicians. The 3D visualization is robust and accurate, obtaining satisfactory 0.949 and 0.960 Dice coefficients in the different evaluated OCT cube configurations, allowing to quickly assess the presence and extension of the fluid associated to wet AMD., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG. The research was funded by Instituto de Salud Carlos III, Government of Spain through the PI17/00940 and DTS18/00136 research projects, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, unta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). Emilio López Varela acknowledges its support under FPI Grant Program through the PID2019-108435RB-I00 project., Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Portable chest X-ray image generation for the improvement of the automatic COVID-19 screening

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
V XoveTIC Conference. XoveTIC 2022, A Coruña, 5 y 6 de octubre de 2022., [Abstract]: COVID-19 is a disease whose gold standard diagnosis tool, RT-PCR, is unable to provide accurate quantification of its severity in a given patient. Currently, this assessment can be performed with the help of chest X-ray imaging visualization that, however, is a manual, tedious and time-consuming task. In this context, Computer-Aided Diagnosis (CAD) systems are very useful to facilitate the work of clinical specialists in these complex diagnostic tasks, especially in view of recent advances in deep learning techniques in the field of medical image analysis. Despite their great potential, deep learning strategies require a large amount of labelled data, which is often scarce in the context of COVID-19 pandemic. To mitigate these problems, in this work we propose the use of a image translation paradigm, the Cycle-Consistent Adversarial Networks (CycleGAN) to generate a novel set of synthetic images with the aim to improve an automatic COVID-19 screening system using portable chest X-ray images., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/196; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Visualization of pathological changes in retinal layer thickness using optical coherence tomography

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
[Abstract]: Optical Coherence Tomography (OCT) is a non-invasive imaging technique that provides high-resolution cross-sectional images of biological tissues. Biomarkers such as the thickness of retinal layers can be used for the evaluation of several diseases such as glaucoma or multiple sclerosis. In this work, we create the thickness profiles of healthy and pathological eyes using a statistical model and developed a methodology to compare the thickness profiles of OCT images with the models and visually inspect the abnormal areas. This approach allows for a quick assessment of the retinal layers health, assisting clinicians and easing the diagnostic burden., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Emilio López Varela acknowledges its support under FPI PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

COVID-19 Lung Radiography Segmentation by Means of Multiphase Transfer Learning

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] COVID-19 is characterized by its impact on the respiratory system and, during the global outbreak of 2020, specific protocols had to be designed to contain its spread within hospitals. This required the use of portable X-ray devices that allow for a greater flexibility in terms of their arrangement in rooms not specifically designed for such purpose. However, their poor image quality, together with the subjectivity of the expert, can hinder the diagnosis process. Therefore, the use of automatic methodologies is advised. Even so, their development is challenging due to the scarcity of available samples. For this reason, we present a COVID-19-specific methodology able to segment these portable chest radiographs with a reduced number of samples via multiple transfer learning phases. This allows us to extract knowledge from two related fields and obtain a robust methodology with limited data from the target domain. Our proposal aims to help both experts and other computer-aided diagnosis systems to focus their attention on the region of interest, ignoring unrelated information., Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Penedo, Manuel
  • Ortega Hortas, Marcos
©2020. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Hervella, Á. S., Rouco, J., Novo, J., Penedo, M. G., & Ortega, M. (2020). “Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images” has been accepted for publication in Computer Methods and Programs in Biomedicine, 186(105201), 105201. The Version of Record is available online at: https://doi.org/10.1016/j.cmpb.2019.105201., [Abstract]: Background and objectives:The analysis of the retinal vasculature plays an important role in the diagnosis of many ocular and systemic diseases. In this context, the accurate detection of the vessel crossings and bifurcations is an important requirement for the automated extraction of relevant biomarkers. In that regard, we propose a novel approach that addresses the simultaneous detection of vessel crossings and bifurcations in eye fundus images. Method: We propose to formulate the detection of vessel crossings and bifurcations in eye fundus images as a multi-instance heatmap regression. In particular, a deep neural network is trained in the prediction of multi-instance heatmaps that model the likelihood of a pixel being a landmark location. This novel approach allows to make predictions using full images and integrates into a single step the detection and distinction of the vascular landmarks. Results: The proposed method is validated on two public datasets of reference that include detailed annotations for vessel crossings and bifurcations in eye fundus images. The conducted experiments evidence that the proposed method offers a satisfactory performance. In particular, the proposed method achieves 74.23% and 70.90% F-score for the detection of crossings and bifurcations, respectively, in color fundus images. Furthermore, the proposed method outperforms previous works by a significant margin. Conclusions: The proposed multi-instance heatmap regression allows to successfully exploit the potential of modern deep learning algorithms for the simultaneous detection of retinal vessel crossings and bifurcations. Consequently, this results in a significant improvement over previous methods, which will further facilitate the automated analysis of the retinal vasculature in many pathological conditions., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. The authors of this work also receive financial support from the ERDF and European Social Fund (ESF) of the EU, and Xunta de Galicia through Centro Singular de Investigación de Galicia, accreditation 2016–2019, ref. ED431G/01, Grupo de Referencia Competitiva, ref. ED431C 2016-047, and the predoctoral grant contract ref. ED481A-2017/328., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Context encoder self-supervised approaches for eye fundus analysis

  • Iglesias Morís, Daniel
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
© 2021 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/IJCNN52387.2021.9533567, Proceedings of the International Joint Conference on Neural NetworksVolume 2021-July18 July 2021 2021 International Joint Conference on Neural Networks, IJCNN 2021Virtual, Shenzhen, 18 July 2021 through 22 July 2021, Code 171891, [Abstract]: The broad availability of medical images in current clinical practice provides a source of large image datasets. In order to use these datasets for training deep neural networks in detection and segmentation tools, it is necessary to provide pixel-wise annotations associated to each image. However, the image annotation is a tedious, time consuming and error prone process that requires the participation of experienced specialists. In this work, we propose different complementary context encoder self-supervised approaches to learn relevant characteristics for the restricted medical imaging domain of retinographies. In particular, we propose a patch-wise approach, inspired in the previous proposal of broad domain context encoders, and complementary fully convolutional approaches. These approaches take advantage of the restricted application domain to learn the relevant features of the eye fundus, situation that can be extrapolated to many medical imaging issues. Different representative experiments were conducted in order to evaluate the performance of the trained models, demonstrating the suitability of the proposed approaches in the understanding of the eye fundus characteristics. The proposed self-supervised models can serve as reference to support other domain-related issues through transfer or multi-task learning paradigms, like the detection and evaluation of the retinal structures or anomaly detections in the context of pathological analysis., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, the predoctoral grant contract ref. ED481A-2017/328; Ministe-rio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Análisis de datos multimodales para la toma de decisiones clínicas utilizando Inteligencia Artificial en el contexto de la COVID-19

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Míguez-Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
BIOINTEGRASAÚDE 2023, celebrada en A Coruña o día 14 de Decembro de 2023, organizada polo Instituto de Investigación Biomédica da Coruña (INIBIC), o Instituto de Investigación Sanitaria de Santiago de Compostela (IDIS) e o Instituto de Investigación Sanitaria Galicia Sur (IISGS), [Abstract]: La COVID-19 es una enfermedad pulmonar infecciosa causante de la pandemia mundial del año 2020. En los momentos críticos de las emergencias sanitarias, el equipo médico debe tomar decisiones importantes en un contexto de recursos limitados. En este contexto, los métodos de diagnóstico asistido por ordenador pueden ayudar en esa toma de decisiones, permitiendo identificar a los pacientes de alto riesgo. Esto se puede realizar utilizando información extraída de historiales clínicos electrónicos, tests de laboratorio o estudios de imagen. En este trabajo, presentamos un nuevo método eficiente y totalmente automático para estimar el riesgo de pacientes COVID-19, utilizando la fusión de datos multimodales con características clínicas y características profundas extraídas a partir de imágenes de radiografía torácica. Esta estimación se efectúa en 2 escenarios críticos: riesgo de hospitalización y riesgo de fallecimiento. Los resultados demuestran un gran desempeño por parte de los clasificadores, estimando ambos riesgos con una gran precisión y utilizando únicamente un subconjunto muy reducido de un conjunto de características originales notablemente más extenso. Esta reducción de la dimensionalidad en el conjunto de datos es muy ventajosa en escenarios donde los recursos computacionales son limitados. Este método totalmente automático presenta un potencial prometedor para mejorar el proceso de toma de decisiones clínicas y una mejor gestión de los recursos médicos, no solo en el contexto de la COVID-19 sino también en otros escenarios clínicos., Este trabajo está financiado por el Ministerio de Ciencia e Innovación, Gobierno de España por medio del proyecto de investigación con los códigos [RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 y PDC2022-133132-I00]; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [código ED431C 2020/24], ayuda predoctoral [código ED481A 2021/196]., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Context encoder transfer learning approaches for retinal image analysis

  • Iglesias Morís, Daniel
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: During the last years, deep learning techniques have emerged as powerful alternatives to solve biomedical image analysis problems. However, the training of deep neural networks usually needs great amounts of labeled data to be done effectively. This is even more critical in the case of biomedical imaging due to the added difficulty of obtaining data labeled by experienced clinicians. To mitigate the impact of data scarcity, one of the most commonly used strategies is transfer learning. Nevertheless, the success of this approach depends on the effectiveness of the available pre-training techniques for learning from little or no labeled data. In this work, we explore the application of the Context Encoder paradigm for transfer learning in the domain of retinal image analysis. To this aim, we propose several approaches that allow to work with full resolution images and improve the recognition of the retinal structures. In order to validate the proposals, the Context Encoder pre-trained models are fine-tuned to perform two relevant tasks in the domain: vessels segmentation and fovea localization. The experiments performed on different public datasets demonstrate that the proposed Context Encoder approaches allow mitigating the impact of data scarcity, being superior to previous alternatives in this domain., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Gov- ernment of Spain, DTS18/00136 research project; Ministerio de Cien- cia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Univer- sidade, Xunta de Galicia, Spain through the predoctoral grant contract ref. ED481A 2021/196 and postdoctoral grant contract ref. ED481B- 2022-025; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Spain, Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia, Spain ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Comprehensive fully-automatic multi-depth grading of the clinical types of macular neovascularization in OCTA images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Almuina Varela, Pablo
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
  • Novo Buján, Jorge
[Abstract]: Optical Coherence Tomography Angiography or OCTA represents one of the main means of diagnosis of Age-related Macular Degeneration (AMD), the leading cause of blindness in developed countries. This eye disease is characterized by Macular Neovascularization (MNV), the formation of vessels that tear through the retinal tissues. Four types of MNV can be distinguished, each representing different levels of severity. Both the aggressiveness of the treatment and the recovery of the patient rely on an early detection and correct diagnosis of the stage of the disease. In this work, we propose the first fully-automatic grading methodology that considers all the four clinical types of MNV at the three most relevant OCTA scanning depths for the diagnosis of AMD. We perform both a comprehensive ablation study on the contribution of said depths and an analysis of the attention maps of the network in collaboration with experts of the domain. Our proposal aims to ease the diagnosis burden and decrease the influence of subjectivity on it, offering a explainable grading through the visualization of the attention of the expert models. Our grading proposal achieved satisfactory results with an AUC of 0.9224 ± 0.0381. Additionally, the qualitative analysis performed in collaboration with experts revealed the relevance of the avascular plexus in the grading of all three types of MNV (despite not being directly involved in some of them). Thus, our proposal is not only able to robustly detect MNV in complex scenarios, but also aided to discover previously unconsidered relationships between plexuses., Funding for open access charge: Universidade da Coruña/CISUG. This research was funded by Instituto de Salud Carlos III, Government of Spain, PI17/00940 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271 and Ayudas complementarias de movilidad destinadas a beneficiarios del programa de Formación del Profesorado Universitario (FPU) EST22/00696; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38;CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Xunta de Galicia; IN845D 2020/38
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Clinical Decision Support Tool for the Identification of Pathological Structures Associated with Age-Related Macular Degeneration

  • Barrientos Lema, Iván
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Penedo, Manuel
18th International Conference on Computer Aided Systems Theory, EUROCAST 2022, Las Palmas de Gran Canaria, 20 - 25 February 2022, This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature's AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-25312-6_48, [Abstract]: In the field of ophthalmology, different imaging modalities are commonly used to carry out different clinical diagnostic procedures. Currently, both optical coherence tomography (OCT) and optical coherence tomography angiography (OCT-A) have made great advances in the study of the posterior pole of the eye and are essential for the diagnosis and monitoring of the treatment of different ocular and systemic diseases. On the other hand, the development of clinical decision support systems is an emerging field, in which clinical and technological advances are allowing clinical specialists to diagnose various pathologies with greater precision, which translates into more appropriate treatment and, consequently, an improvement in the quality of life of patients. This paper presents a clinical decision support tool for the identification of different pathological structures associated with age-related macular degeneration using OCT and OCT-A images. The system provides a useful tool that facilitates clinical decision-making in the diagnosis and treatment of this relevant disease., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 and PI17/00940 research projects; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and postdoctoral grant ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Con-sellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Robust deep learning-based approach for retinal layer segmentation in optical coherence tomography images

  • Budiño, Alejandro
  • Ramos, Lucía
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Penedo, Manuel
  • Ortega Hortas, Marcos
18th International Conference on Computer Aided Systems Theory, EUROCAST 2022,Las Palmas de Gran Canaria,20 February 2022 through 25 February 2022, This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-25312-6_50, [Abstract]: In recent years, the medical image analysis field has experienced remarkable growth. Advances in computational power have made it possible to create increasingly complex diagnostic support systems based on deep learning. In ophthalmology, optical coherence tomography (OCT) enables the capture of highly detailed images of the retinal morphology, being the reference technology for the analysis of relevant ocular structures. This paper proposes a new methodology for the automatic segmentation of the main retinal layers using OCT images. The system provides a useful tool that facilitates the clinical evaluation of key ocular structures, such as the choroid, vitreous humour or inner retinal layers, as potential computational biomarkers for the analysis of different neurodegenerative disorders, including multiple sclerosis and Alzheimer’s disease., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and postdoctoral grant ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Instituto de Salud Carlos III; DTS18/00136, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Transformer-Based Multi-Prototype Approach for Diabetic Macular Edema Analysis in OCT Images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Cardoso, Jaime S.
© 2023 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/ICASSP49357.2023.10095039, Presentado en: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 04-10 June 2023, [Abstract]: Optical Coherence Tomography (OCT) is the major diagnostic tool for the leading cause of blindness in developed countries: Diabetic Macular Edema (DME). Depending on the type of fluid accumulations, different treatments are needed. In particular, Cystoid Macular Edemas (CMEs) represent the most severe scenario, while Diffuse Retinal Thickening (DRT) is an early indicator of the disease but a challenging scenario to detect. While methodologies exist, their explanatory power is limited to the input sample itself. However, due to the complexity of these accumulations, this may not be enough for a clinician to assess the validity of the classification. Thus, in this work, we propose a novel approach based on multi-prototype networks with vision transformers to obtain an example-based explainable classification. Our proposal achieved robust results in two representative OCT devices, with a mean accuracy of 0.9099 ± 0.0083 and 0.8582 ± 0.0126 for CME and DRT-type fluid accumulations, respectively., This research was funded by Instituto de Salud Carlos III, Government of Spain, PI17/00940 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271 and Ayudas complementarias de movilidad destinadas a beneficiarios del programa de Formación del Profesorado Universitario (FPU) EST22/00696; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38;CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Enhancing Retinal Blood Vessel Segmentation through Self-Supervised Pre-Training

  • Morano, José
  • Hervella, Álvaro S.
  • Barreira, Noelia
  • Novo Buján, Jorge
  • Rouco, José
[Abstract] The segmentation of the retinal vasculature is fundamental in the study of many diseases. However, its manual completion is problematic, which motivates the research on automatic methods. Nowadays, these methods usually employ Fully Convolutional Networks (FCNs), whose success is highly conditioned by the network architecture and the availability of many annotated data, something infrequent in medicine. In this work, we present a novel application of self-supervised multimodal pre-training to enhance the retinal vasculature segmentation. The experiments with diverse FCN architectures demonstrate that, independently of the architecture, this pre-training allows one to overcome annotated data scarcity and leads to significantly better results with less training on the target task., This work is supported by the Instituto de Salud Carlos III, Government of Spain, and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the RTI2018-095894-B-I00 research projects. In addition, this work has received financial support from the Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), CITIC, Centro de Investigación del Sistema Universitario de Galicia, Ref. ED431G 2019/01, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Self-Supervised Multimodal Reconstruction Pre-training for Retinal Computer-Aided Diagnosis

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Computer-aided diagnosis using retinal fundus images is crucial for the early detection of many ocular and systemic diseases. Nowadays, deep learning-based approaches are commonly used for this purpose. However, training deep neural networks usually requires a large amount of annotated data, which is not always available. In practice, this issue is commonly mitigated with different techniques, such as data augmentation or transfer learning. Nevertheless, the latter is typically faced using networks that were pre-trained on additional annotated data. An emerging alternative to the traditional transfer learning source tasks is the use of self-supervised tasks that do not require manually annotated data for training. In that regard, we propose a novel self-supervised visual learning strategy for improving the retinal computer-aided diagnosis systems using unlabeled multimodal data. In particular, we explore the use of a multimodal reconstruction task between complementary retinal imaging modalities. This allows to take advantage of existent unlabeled multimodal data in the medical domain, improving the diagnosis of different ocular diseases with additional domain-specific knowledge that does not rely on manual annotation. To validate and analyze the proposed approach, we performed several experiments aiming at the diagnosis of different diseases, including two of the most prevalent impairing ocular disorders: glaucoma and age-related macular degeneration. Additionally, the advantages of the proposed approach are clearly demonstrated in the comparisons that we perform against both the common fully-supervised approaches in the literature as well as current self-supervised alternatives for retinal computer-aided diagnosis. In general, the results show a satisfactory performance of our proposal, which improves existing alternatives by leveraging the unlabeled multimodal visual data that is commonly available in the medical field., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening

  • Iglesias Morís, Daniel
  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Versión aceptada de: D. I. Morís, M. Gende, J. de Moura, J. Novo, M. Ortega, "Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening", 18th International Conference on Computer Aided Systems Theory - EUROCAST'22, 108-109, Las Palmas de Gran Canaria, Spain, 2022, Extended abstracts, [Abstract]: This manuscript presents a performance analysis of chest Xray synthetic image generation for COVID-19 screening. The proposed system translates chest X-ray images from Normal to COVID-19 and vice versa, without needing paired data, representing a powerful data augmentation approach. To this end, we analyze the performance of 3 representative state of the art architectures for image translation, assessing the impact of oversampling on improving the performance of automatic COVID-19 screening., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts refs. ED481A 2021/196, ED481A 2021/161 and postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully Automatic Deep Convolutional Approaches for the Analysis of COVID-19 Using Chest X-Ray Images

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Covid-19 is a new infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the seriousness of the situation, the World Health Organization declared a global pandemic as the Covid-19 rapidly around the world. Among its applications, chest X-ray images are frequently used for an early diagnostic/screening of Covid-19 disease, given the frequent pulmonary impact in the patients, critical issue to prevent further complications caused by this highly infectious disease. In this work, we propose 4 fully automatic approaches for the classification of chest X-ray images under the analysis of 3 different categories: Covid-19, pneumonia and healthy cases. Given the similarity between the pathological impact in the lungs between Covid-19 and pneumonia, mainly during the initial stages of both lung diseases, we performed an exhaustive study of differentiation considering different pathological scenarios. To address these classification tasks, we evaluated 6 representative state-of-the-art deep network architectures on 3 different public datasets: (I) Chest X-ray dataset of the Radiological Society of North America (RSNA); (II) Covid-19 Image Data Collection; (III) SIRM dataset of the Italian Society of Medical Radiology. To validate the designed approaches, several representative experiments were performed using 6,070 chest X-ray radiographs. In general, satisfactory results were obtained from the designed approaches, reaching a global accuracy values of 0.9706 ± 0.0044, 0.9839 ± 0.0102, 0.9744 ± 0.0104 and 0.9744 ± 0.0104, respectively, thus helping the work of clinicians in the diagnosis and consequently in the early treatment of this relevant pandemic pathology., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Spain through the postdoctoral grant contract ref. ED481B-2021-059; and Grupos de Referencia Competitiva, Spain, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, Spain, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, Spain, and the remaining 20% by “Secretaría Xeral de Universidades, Spain ” (Grant ED431G 2019/01). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Evolutionary mosaicking for high-resolution wide-field optical coherence tomography angiography

  • Martínez-Río, Javier
  • Carmona, Enrique J.
  • Cancelas, Daniel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a noninvasive imaging modality that produces retinal blood flow images. However, the limited field of view (FOV) of typical high-resolution scan poses challenges for comprehensive analysis. This work presents a fully automatic method for generating high-resolution wide-field OCTA mosaics from overlapping scans, addressing the need for wider FOVs without requiring advanced OCTA equipment or manual mosaicking. The proposed approach consists of a three-stage pipeline: an initial mosaic is constructed using correlation-based template matching, refined with an evolutionary algorithm to optimize vascular continuity at seams, and finalized with a blending stage to improve overall quality. Unlike existing methods, our approach avoids keypoint extraction or input image preprocessing, making it robust against noise and artifacts typically present in clinical OCTA images. Using a correlation-based metric that measures the degree of vascular continuity at the seams in each mosaic, we obtained a mean and standard deviation equal to (before blending) for all the mosaics analyzed. The proposed method presented robust results, producing high-resolution wide-field OCTA mosaics., This work was supported by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894- B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 and PDC2022- 133132-I00 research projects; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24. Two of the authors of this work also receive financial support from the European Social Fund, through the predoctoral contract ref. PEJD-2019-PRE/TIC-17030 and research assistant contract ref. PEJ-2019-AI/TIC-13771., Xunta de Galicia; ED431C 2020/24, Comunidad de Madrid; PEJD-2019-PRE/TIC-17030, Comunidad de Madrid; PEJ-2019-AI/TIC-13771
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fully automatic segmentation and monitoring of choriocapillaris flow voids in OCTA images

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG., [Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive ophthalmic imaging modality that is widely used in clinical practice. Recent technological advances in OCTA allow imaging of blood flow deeper than the retinal layers, at the level of the choriocapillaris (CC), where a granular image is obtained showing a pattern of bright areas, representing blood flow, and a pattern of small dark regions, called flow voids (FVs). Several clinical studies have reported a close correlation between abnormal FVs distribution and multiple diseases, so quantifying changes in FVs distribution in CC has become an area of interest for many clinicians. However, CC OCTA images present very complex features that make it difficult to correctly compare FVs during the monitoring of a patient. In this work, we propose fully automatic approaches for the segmentation and monitoring of FVs in CC OCTA images. First, a baseline approach, in which a fully automatic segmentation methodology based on local contrast enhancement and global thresholding is proposed to segment FVs and measure changes in their distribution in a straightforward manner. Second, a robust approach in which, prior to the use of our segmentation methodology, an unsupervised trained neural network is used to perform a deformable registration that aligns inconsistencies between images acquired at different time instants. The proposed approaches were tested with CC OCTA images collected during a clinical study on the response to photodynamic therapy in patients affected by chronic central serous chorioretinopathy (CSC), demonstrating their clinical utility. The results showed that both approaches are accurate and robust, surpassing the state of the art, therefore improving the efficacy of FVs as a biomarker to monitor the patient treatments. This gives great potential for the clinical use of our methods, with the possibility of extending their use to other pathologies or treatments associated with this type of imaging., Xunta de Galicia; ED481B-2021-059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with references PID2019-108435RB-I00; TED2021-131201B-I00 and PDC2022-133132-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the postdoctoral, grant ref. ED481B-2021-059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80 % through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20 % by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Joint keypoint detection and description network for color fundus image registration

  • Rivas-Villar, David
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
[Absctract]: Background: Retinal imaging is widely used to diagnose many diseases, both systemic and eye-specific. In these cases, image registration, which is the process of aligning images taken from different viewpoints or moments in time, is fundamental to compare different images and to assess changes in their appearance, commonly caused by disease progression. Currently, the field of color fundus registration is dominated by classical methods, as deep learning alternatives have not shown sufficient improvement over classic methods to justify the added computational cost. However, deep learning registration methods are still considered beneficial as they can be easily adapted to different modalities and devices following a data-driven learning approach. Methods: In this work, we propose a novel methodology to register color fundus images using deep learning for the joint detection and description of keypoints. In particular, we use an unsupervised neural network trained to obtain repeatable keypoints and reliable descriptors. These keypoints and descriptors allow to produce an accurate registration using RANdom SAmple Consensus (RANSAC). We train the method using the Messidor dataset and test it with the Fundus Image Registration Dataset (FIRE) dataset, both of which are publicly accessible. Results: Our work demonstrates a color fundus registration method that is robust to changes in imaging devices and capture conditions. Moreover, we conduct multiple experiments exploring several of the method’s parameters to assess their impact on the registration performance. The method obtained an overall Registration Score of 0.695 for the whole FIRE dataset (0.925 for category S, 0.352 for P, and 0.726 for A). Conclusions: Our proposal improves the results of previous deep learning methods in every category and surpasses the performance of classical approaches in category A which has disease progression and thus represents the most relevant scenario for clinical practice as registration is commonly used in patients with diseases for disease monitoring purposes., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade Xunta de Galicia through the Grupos de Referencia Competitiva grant (Ref. ED431C 2020/24), the predoctoral fellowship (Ref. ED481A 2021/147) and the postdoctoral fellowship (Ref. ED481B-2022-025); CITIC, Centro de Investigación de Galicia (Ref. ED431G 2019/01), itself received financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/147, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Cycle generative adversarial network approaches to produce novel portable chest X-rays images for covid-19 diagnosis

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
© 2021 IEEE. This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/ICASSP39728.2021.9414031, Presentado en: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada, 2021, [Abstract]: Coronavirus Disease 2019 (COVID-19), declared a global pandemic by the World Health Organization, mainly affects the pulmonary tissues, playing chest X-ray images an important role for its screening and early detection. In this context, portable X-ray devices are widely used, representing an alternative to fixed devices in order to reduce risks of cross-contamination. However, they provide lower quality and detailed images in terms of spatial resolution and contrast. In this work, given the low availability of images of this recent disease, we present new approaches to artificially increase the dimensionality of portable chest X-ray datasets for COVID-19 diagnosis. Hence, we combined 3 complementary CycleGAN architectures to perform a simultaneous oversampling using an unsupervised strategy and without the necessity of paired data. Despite the poor quality of the portable X-ray images, we provide an overall accuracy of 92.50% in a COVID-19 screening context, proving their suitability for COVID-19 diagnostic tasks., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic simultaneous ciliary muscle segmentation and biomarker extraction in AS-OCT images using deep learning-based approaches

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Recent clinical studies have emphasized the importance of understanding the morphology and mechanics of the ciliary muscle. The ciliary muscle plays a vital role in various functions related to the anterior segment of the eye, including the regulation of intraocular pressure and the maintenance of the shape of the crystalline lens. To advance research in this area, we propose a fully automated methodology for the segmentation and biomarker measurement of the ciliary muscle in two different scan depths (6 mm and 16 mm), which are commonly used by clinicians to analyze biomarkers. Our methodology aims to provide repeatable, and immediate results through an exhaustive analysis of different network architectures, encoders, and transfer learning strategies. We also extracted a comprehensive set of relevant biomarkers, including parameters that provide essential information about its behavior during the accommodation process, overall dimensions, and biomechanical properties. These biomarkers can help clinicians and researchers in the diagnoses and monitor of different ocular diseases such as glaucoma, myopia, and presbyopia and develop new therapeutic strategies, potentially leading to more effective treatments and improved patient outcomes. Our methodology achieved accurate qualitative and quantitative results, with high accuracy values of 0.9665 ± 0.1280 and 0.9772 ± 0.0873 for the best combinations for 6 mm and 16 mm, respectively. Our proposed system provides a valuable and automatic tool for clinicians and researchers in the segmentation and analysis of the ciliary muscle in AS-OCT images., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B–I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24]; predoctoral grant [grant number ED481A-2023-152]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Capítulo o parte de un libro (BookPart)

Computerized tool for the automatic segmentation of DRT edemas using OCT scans

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Part of Photo Acoustic and Optical Coherence Tomography Imaging, Volume 1: Diabetic retinopathy (pp. 1-1). Bristol, UK: IOP Publishing. https://doi.org/10.1088/978-0-7503-2052-8, [Abstract]: This chapter presents a software tool for the automated segmentation of diffuse retinal thickening regions from optical coherence tomography (OCT) images. For this purpose, two retinal regions were defined and extracted: the inner retina and the outer retina. Then, a learning process was used to analyze a comprehensive and heterogeneous subset of relevant patterns in the OCT scans. Finally, two complementary post-processing stages were applied to improve the obtained performance and the overall efficiency of the presented tool. The presented tool achieved satisfactory performance, which demonstrates the suitability of the adopted solution., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018–095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant reference FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant reference ED431C 2020/24 and through the postdoctoral grant contract reference ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant reference IN845D 2020/38; CITIC, Centro de Investigación de Galicia reference ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Deep feature analysis in a transfer learning approach for the automatic COVID-19 screening using chest X-ray images

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: COVID-19 is a challenging disease that was declared as global pandemic in March 2020. As the main impact of this disease is located in the pulmonary regions, chest X-ray devices are very useful to understand the severity of the disease on each patient. In order to reduce the risk of cross-contamination, the radiologists are recommended to use portable devices instead of fixed machinery, as these devices are easier to decontaminate. Moreover, the development of reliable and robust methodologies of computer-aided diagnosis systems is very relevant to reduce the workload that expert clinicians are experiencing in the current moment. In this work, we propose a comprehensive analysis of the deep features extracted from portable chest X-ray captures to perform a COVID-19 screening. We also study the optimal characterization of the problem with a lower dimensionality, contrasting the results of the feature selection methods that were chosen. Results demonstrated that the proposed approach is robust and reliable, obtaining a 90.43% of accuracy for the test set, using only 46.85% of the deep features in the context of poor quality and low detail X-ray images obtained from portable devices., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secre-taría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Explainable learning to analyze the outcome of COVID-19 patients using clinical data

  • Olañeta Fariña, Daniel
  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Míguez-Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract]: Patients at high risk of contracting COVID-19 require specialized monitoring throughout their illness to ensure optimal treatment at each stage. To support this monitoring, Computer-Aided Diagnosis (CAD) methods analyze clinical data to estimate the most likely outcome for each patient, using various clinical variables such as symptoms, medical history, and laboratory results to predict outcomes. Despite the numerous proposals for COVID-19 diagnosis using CAD methods, the lack of explainability in many machine learning models poses a challenge in incorporating these methods into clinical practice. Additionally, other crucial tasks such as estimating the risk of death or severe forms of the disease must be considered to identify cases that require greater monitoring. To overcome these challenges, we propose an explainable methodology for estimating the risk of hospitalization and death in COVID-19 patients using clinical data. Our methodology employs four machine learning algorithms, three feature selection methods, and a decision tree to provide explainability. Our approach achieves an accuracy of 86.16% ± 0.74% for the estimation of hospitalization risk with 29 features, and an accuracy of 86.40% ± 1.80% for the estimation of the risk of death with 26 features. Moreover, our methodology provides valuable insights into the relationship between clinical variables and patient outcomes, which can inform more robust and informed clinical decision-making and improve our understanding of the disease. We demonstrate the potential of our transparent and effective CAD methods to support clinical decision-making in COVID-19 patient care and further research, offering a promising solution to overcome the challenges in incorporating CAD methods into clinical practice., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educación, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A 2021/196]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Con-sellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secre-taría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Evolutionary multi-target neural network architectures for flow void analysis in optical coherence tomography angiography

  • López-Varela, Emilio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • García-Feijóo, Julián
  • Ortega Hortas, Marcos
[Abstract]: Optical coherence tomography angiography (OCTA) is a non-invasive imaging modality used to evaluate the retinal microvasculature. Recent advances in OCTA allows to visualize the blood flow within the choriocapillaris region, where a granular image is obtained showing a pattern of small dark regions, called flow voids (FVs). Given its relevance, numerous clinical studies have linked the changes in FVs distribution to multiple diseases. The granular structure of these images makes accurate labeling and segmentation difficult, which can be overcome by using a multi-target perspective. However, manually designing a neural architecture that can accurately predict all targets in a balanced way is a major challenge. In this work, we propose a novel methodology based on evolutionary multi-target optimized networks that, through a set of evolutionary operators, traverses a search space of architectures in a deep but efficient way. This methodology allows us to discover efficient and accurate multi-target architectures tailored to our problem, but which are also adaptable to other tasks due to their robustness. To validate and analyze our methodology and the discovered network model, we performed extensive experimentation with cases from a real clinical study, achieving better results than the state of the art and manually designed architectures., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021- 131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Pulmonary-Restricted COVID-19 Informative Visual Screening Using Chest X-ray Images from Portable Devices

  • Vidal, Plácido
  • Moura, Joaquim de
  • Ortega Hortas, Marcos
This version of the conference paper has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-06427-2_6., The conference was held during May 23-27, 2022, in Lecce, Italy., [Abstract]: In the recent COVID-19 outbreak, chest X-rays were the main tool for diagnosing and monitoring the pathology. To prevent further spread of this disease, special circuits had to be implemented in the healthcare services. For this reason, these chest X-rays were captured with portable X-ray devices that compensate its lower quality and limitations with more deployment flexibility. However, most of the proposed computer-aided diagnosis methodologies were designed to work with traditional fixed X-ray machines and their performance is diminished when faced with these portable images. Additionally, given that the equipment needed to properly treat the disease (such as for life support and monitoring of vital signs) most of these systems learnt to identify these artifacts in the images instead of real clinically-significant variables. In this work, we present the first methodology forced to extract features exclusively from the pulmonary region of interest that is specially designed to work with these difficult portable images. Additionally, we generate a class activation map so the methodology also provides explainability to the results returned to the clinician. To ensure the robustness of our proposal, we tested the methodology with chest radiographs from patients diagnosed with COVID-19, pathologies similar to COVID-19 (such as other types of viral pneumonias) and healthy patients in different combinations with three convolutional networks from the state of the art (for a total of 9 studied scenarios). The experimentation confirms that our proposal is able to separate COVID-19 cases, reaching a 94.7% ± 1.34% of accuracy., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Robust multi-view approaches for retinal layer segmentation in glaucoma patients via transfer learning

  • Gende, M.
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Martínez-de-la-Casa, José María
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: Background: Glaucoma is the leading global cause of irreversible blindness. Glaucoma patients experience a progressive deterioration of the retinal nervous tissues that begins with a loss of peripheral vision. An early diagnosis is essential in order to prevent blindness. Ophthalmologists measure the deterioration caused by this disease by assessing the retinal layers in different regions of the eye, using different optical coherence tomography (OCT) scanning patterns to extract images, generating different views from multiple parts of the retina. These images are used to measure the thickness of the retinal layers in different regions. Methods: We present two approaches for the multi-region segmentation of the retinal layers in OCT images of glaucoma patients. These approaches can extract the relevant anatomical structures for glaucoma assessment from three different OCT scan patterns: circumpapillary circle scans, macular cube scans and optic disc (OD) radial scans. By employing transfer learning to take advantage of the visual patterns present in a related domain, these approaches use state-of-the-art segmentation modules to achieve a robust, fully automatic segmentation of the retinal layers. The first approach exploits inter-view similarities by using a single module to segment all of the scan patterns, considering them as a single domain. The second approach uses view-specific modules for the segmentation of each scan pattern, automatically detecting the suitable module to analyse each image. Results: The proposed approaches produced satisfactory results with the first approach achieving a dice coefficient of 0.85±0.06 and the second one 0.87±0.08 for all segmented layers. The first approach produced the best results for the radial scans. Concurrently, the view-specific second approach achieved the best results for the better represented circle and cube scan patterns. Conclusions: To the extent of our knowledge, this is the first proposal in the literature for the multi-view segmentation of the retinal layers of glaucoma patients, demonstrating the applicability of machine learning-based systems for aiding in the diagnosis of this relevant pathology., This work was supported by Ministerio de Ciencia e Innovación y Universidades, Government of Spain (grant number RTI2018-095894-B-I00); Ministerio de Ciencia e Innovación, Government of Spain through the research project with (grant numbers PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00); Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, Grupos de Referencia Competitiva (grant number ED431C 2020/24), predoctoral grant (grant number ED481A 2021/161); CITIC, Centro de Investigación de Galicia (grant number ED431G 2019/01), and receives financial support from Consellería de Cultura, Educación, Formación Profesional e Universidades, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Deep Convolutional Approaches for the Analysis of COVID-19 Using Chest X-Ray Images From Portable Devices

  • Moura, Joaquim de
  • Ramos, Lucía
  • Vidal, Plácido
  • Cruz, Nilfa Milena
  • Abelairas López, Laura
  • Castro López, Eva
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] The recent human coronavirus disease (COVID-19) is a respiratory infection caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the effects of COVID-19 in pulmonary tissues, chest radiography imaging plays an important role in the screening, early detection, and monitoring of the suspected individuals. Hence, as the pandemic of COVID-19 progresses, there will be a greater reliance on the use of portable equipment for the acquisition of chest X-ray images due to its accessibility, widespread availability, and benefits regarding to infection control issues, minimizing the risk of cross-contamination. This work presents novel fully automatic approaches specifically tailored for the classification of chest X-ray images acquired by portable equipment into 3 different clinical categories: normal, pathological, and COVID-19. For this purpose, 3 complementary deep learning approaches based on a densely convolutional network architecture are herein presented. The joint response of all the approaches allows to enhance the differentiation between patients infected with COVID-19, patients with other diseases that manifest characteristics similar to COVID-19 and normal cases. The proposed approaches were validated over a dataset specifically retrieved for this research. Despite the poor quality of the chest X-ray images that is inherent to the nature of the portable equipment, the proposed approaches provided global accuracy values of 79.62%, 90.27% and 79.86%, respectively, allowing a reliable analysis of portable radiographs to facilitate the clinical decision-making process., Xunta de Galicia; ED431G 2019/01, 10.13039/100014440-Instituto de Salud Carlos III, Government of Spain, and European Regional Development Fund (ERDF) funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894-B-I00 research projects, as well as through the Ayudas para la formación de profesorado universitario (FPU) (Grant Number: FPU18/02271) 10.13039/501100010801-European Union (ERDF) and the Xunta de Galicia, Centro de Investigación del Sistema Universitario de Galicia (Grant Number: ED431G 2019/01)
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Performance analysis of GAN approaches in the portable chest X-ray synthetic image generation for COVID-19 screening

  • Iglesias Morís, Daniel
  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Versión aceptada de: Morís, D.I., Gende, M., de Moura, J., Novo, J., Ortega, M. (2022). Performance Analysis of GAN Approaches in the Portable Chest X-Ray Synthetic Image Generation for COVID-19 Screening. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2022. EUROCAST 2022. Lecture Notes in Computer Science, vol 13789. Springer, Cham. https://doi.org/10.1007/978-3-031-25312-6_47, [Abstract]: COVID-19 mainly affects lung tissues, aspect that makes chest X-ray imaging useful to visualize this damage. In the context of the global pandemic, portable devices are advantageous for the daily practice. Furthermore, Computer-aided Diagnosis systems developed with Deep Learning algorithms can support the clinicians while making decisions. However, data scarcity is an issue that hinders this process. Thus, in this work, we propose the performance analysis of 3 different stateof-the-art Generative Adversarial Networks (GAN) approaches that are used for synthetic image generation to improve the task of automatic COVID-19 screening using chest X-ray images provided by portable devices. Particularly, the results demonstrate a significant improvement in terms of accuracy, that raises 5.28% using the images generated by the best image translation model., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contracts refs. ED481A 2021/196, ED481A 2021/161 and postdoctoral grant contract ref. ED481B 2021/059; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Enhanced multiple sclerosis diagnosis using high-resolution 3D OCT volumes with synthetic slices

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Santos Bueso, Enrique
  • Barreira, Noelia
[Abstract]: Optical Coherence Tomography (OCT), known for its micron-level resolution and non-invasive nature, is essential in diagnosing Multiple Sclerosis (MS). Accurate MS diagnosis through OCT is facilitated by identifying changes in retinal layer thickness, which serve as biomarkers, such as the retinal nerve fiber layer and the macular ganglion cell layer. To adequately diagnose MS, it is crucial to detect thickness changes in specific small regions of the retina, necessitating extensive retinal coverage with minimal granularity. However, a significant challenge in using OCT for MS diagnosis is the inverse relationship between the number of slices and the image quality of OCT volumes. High-resolution images require longer acquisition times, which limits the number of slices that can be obtained and results in covering a smaller area of the retina. Conversely, increasing the number of slices reduces individual image quality, impairing the detection of retinal layer structures. To address this issue, we propose a novel approach for the automatic detection of MS using high-resolution synthetic 3D OCT volumes. Our methodology involves using a generative network to synthesize intermediate slices, thereby enhancing retinal coverage without degrading image quality. This synthetic augmentation improves cross-sectional resolution, providing more comprehensive retinal details. Then we use a segmentation network to extract biomarkers and multiple 3D classification models to directly detect MS automatically. Our results demonstrate significant improvements in accuracy and reliability. Integrating synthetic slices into OCT volumes enhances the detection of MS, underscoring the potential of generative models for better clinical outcomes in MS diagnosis., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018- 095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universi- dade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014– 2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Enhancing Pathological Detection and Monitoring in OCT Volumes with Limited Slices using Convolutional Neural Networks and 3D Visualization Techniques

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Penedo, Manuel
Cursos e Congresos, C-155, [Abstract] Optical Coherence Tomography (OCT) is a non-invasive imaging technique with a crucial role in the monitoring of a wide range of diseases. In order to make a good diagnosis it is essential that clinicians can observe any subtle changes that appear in the multiple ocular structures, so it is imperative that the 3D OCT volumes have good resolution in each axis. Unfortunately, there is a trade-off between image quality and the number of volume slices. In this work, we use a convolutional neural network to generate the intermediate synthetic slices of the OTC volumes and we propose a few variants of a 3D reconstruction algorithm to create visualizations that emphasize the changes present in multiple retinal structures to aid clinicians in the diagnostic process, Xunta de Galicia; ED431C 2020/24, This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ”Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by ”Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Segmentation of Retinal Layers in Multiple Neurodegenerative Disorder Scenarios

  • Gende, M.
  • Mallén Gracia, Victor
  • Moura, Joaquim de
  • Cordón Ciordia, Beatriz
  • García-Martín, Elena
  • Sánchez, Clara I.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Open Access provided by ‘Universidade da Coruña/CISUG’ within the CRUI-CARE Agreement, [Absctract]: Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND., This work was supported in part by Instituto de Salud Carlos III, Government of Spain, under Grants PI17/01726 and PI20/00437, in part by Inflammatory Disease Network (RICORS) under Grant RD21/0002/0050, in part by the Ministerio de Ciencia e Innovación, Government of Spain under Grants PDC2022-133132-I00, RTI2018-095894-B-I00, PID2019- 108435RB-I00, and TED2021-131201B-I00, in part by the Consellería de Cultura, Educación e Universidade, Xunta de Galicia through Grupos de Referencia Competitiva under Grant ED431C 2020/24 and predoctoral under Grant ED481A 2021/161, in part by CITIC, Centro de Investigación de Galicia under Grant ED431G 2019/01, and in part by Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Comparative and Behavioural Analysis of a Diffuse Paradigm for the Evaluation of Diabetic Macular Edema in OCT images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Díaz, Macarena
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
The conference was held during June 7 to 9, 2021 Aveiro, Portugal., This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The final published paper is available online at: https://doi.org/10.1109/CBMS52027.2021.00010, [Abstract]: Nowadays, Diabetic Macular Edema (DME) is one of the leading causes of blindness in developed countries, and its characterized by the presence of pathological fluid accumulations inside the retinal layers. Currently, the main way to detect these fluid accumulations (as well as their severity) is through the use of Optical Coherence Tomography (OCT) imaging. In particular, this ophthalmological image modality allows a precise non-invasive analysis of the morphology of the retina and its structures. Due to the complexity of attempting to successfully segment these fluid accumulations, an alternative paradigm for their detection has been recently proposed. This paradigm, based on a diffuse representation of the pathological regions, creates an intuitive representation of the pathological regions based on a confidence map. Currently, there are only two approaches for this paradigm: one based on a predefined library of texture and intensity features with established machine learning algorithms and other based on deep learning methods. Both approaches have proven to offer satisfactory results, but each one of them performs better in different scenarios. In this work, we perform a complete analysis and comparison on the behaviour and performance of both strategies in a clinical screening scenario to evaluate the suitability of both approaches for the clinical practice as well as their performance as computer vision strategies., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00 ; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 ; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38 ; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Retinal Microaneurysms Detection Using Adversarial Pre-training With Unlabeled Multimodal Images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The detection of retinal microaneurysms is crucial for the early detection of important diseases such as diabetic retinopathy. However, the detection of these lesions in retinography, the most widely available retinal imaging modality, remains a very challenging task. This is mainly due to the tiny size and low contrast of the microaneurysms in the images. Consequently, the automated detection of microaneurysms usually relies on extensive ad-hoc processing. In this regard, although microaneurysms can be more easily detected using fluorescein angiography, this alternative imaging modality is invasive and not adequate for regular preventive screening. In this work, we propose a novel deep learning methodology that takes advantage of unlabeled multimodal image pairs for improving the detection of microaneurysms in retinography. In particular, we propose a novel adversarial multimodal pre-training consisting in the prediction of fluorescein angiography from retinography using generative adversarial networks. This pre-training allows learning about the retina and the microaneurysms without any manually annotated data. Additionally, we also propose to approach the microaneurysms detection as a heatmap regression, which allows an efficient detection and precise localization of multiple microaneurysms. To validate and analyze the proposed methodology, we perform an exhaustive experimentation on different public datasets. Additionally, we provide relevant comparisons against different state-of-the-art approaches. The results show a satisfactory performance of the proposal, achieving an Average Precision of 64.90%, 31.36%, and 33.55% in the E-Ophtha, ROC, and DDR public datasets. Overall, the proposed approach outperforms existing deep learning alternatives while providing a more straightforward detection method that can be effectively applied to raw unprocessed retinal images., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia, Spain and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Segmentation and Intuitive Visualisation of the Epiretinal Membrane in 3D OCT Images Using Deep Convolutional Approaches

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Epiretinal Membrane (ERM) is a disease caused by a thin layer of scar tissue that is formed on the surface of the retina. When this membrane appears over the macula, it can cause distorted or blurred vision. Although normally idiopathic, its presence can also be indicative of other pathologies such as diabetic macular edema or vitreous haemorrhage. ERM removal surgery can preserve more visual acuity the earlier it is performed. For this purpose, we present a fully automatic segmentation system that can help the clinicians to determine the ERM presence and location over the eye fundus using 3D Optical Coherence Tomography (OCT) volumes. The proposed system uses a convolutional neural network architecture to classify patches of the retina surface. All the 2D OCT slices of the 3D OCT volume of a patient are combined to produce an intuitive colour map over the 2D fundus reconstruction, providing a visual representation of the presence of ERM which therefore facilitates the diagnosis and treatment of this relevant eye disease. A total of 2.428 2D OCT slices obtained from 20 OCT 3D volumes was used in this work. To validate the designed methodology, several representative experiments were performed. We obtained satisfactory results with a Dice Coefficient of 0.826 ± 0.112 and a Jaccard Index of 0.714 ± 0.155, proving its applicability for diagnosis purposes. The proposed system also demonstrated its simplicity and competitive performance with respect to other state-of-the-art approaches., 10.13039/501100004587-Instituto de Salud Carlos III, Government of Spain, research project (Grant Number: DTS18/00136), 10.13039/501100004837-Ministerio de Ciencia e Innovación y Universidades, Government of Spain, research project (Grant Number: RTI2018-095894-B-I00), 10.13039/501100004837-Ministerio de Ciencia e Innovación, Government of Spain through the research project (Grant Number: PID2019-108435RB-I00), 10.13039/501100008425-Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva (Grant Number: ED431C 2020/24), 10.13039/501100010769-Axencia Galega de Innovación (GAIN), Xunta de Galicia (Grant Number: IN845D 2020/38), 10.13039/501100008425-CITIC, Centro de Investigación de Galicia, receives financial support from the Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%) (Grant Number: ED431G 2019/01), Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multi-Adaptive Optimization for multi-task learning with deep neural networks

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Multi-task learning is a promising paradigm to leverage task interrelations during the training of deep neural networks. A key challenge in the training of multi-task networks is to adequately balance the complementary supervisory signals of multiple tasks. In that regard, although several task-balancing approaches have been proposed, they are usually limited by the use of per-task weighting schemes and do not completely address the uneven contribution of the different tasks to the network training. In contrast to classical approaches, we propose a novel Multi-Adaptive Optimization (MAO) strategy that dynamically adjusts the contribution of each task to the training of each individual parameter in the network. This automatically produces a balanced learning across tasks and across parameters, throughout the whole training and for any number of tasks. To validate our proposal, we perform comparative experiments on real-world datasets for computer vision, considering different experimental settings. These experiments allow us to analyze the performance obtained in several multi-task scenarios along with the learning balance across tasks, network layers and training steps. The results demonstrate that MAO outperforms previous task-balancing alternatives. Additionally, the performed analyses provide insights that allow us to comprehend the advantages of this novel approach for multi-task learning., This work is supported by Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva ref. ED431C 2020/24 and the postdoctoral fellowship ref. ED481B-2022-025. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Efficient semi-supervised hierarchical training for segmenting choroidal vessels and other structures on OCT images of multiple sclerosis patients

  • López-Varela, Emilio
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Barreira, Noelia
[Abstract]: Optical coherence tomography (OCT) is a non-invasive imaging technique used to diagnose ocular and systemic diseases. Recently, several clinical studies have linked changes in different ocular layers to the development of multiple sclerosis (MS), so accurate segmentation of these structures has become an essential task. Unfortunately, segmenting the entire set of structures involved is a very difficult task, due to their large number and variability. These two factors hinder the labeling of images and therefore severely restrict the ability to achieve a large dataset with all structures manually annotated, limiting the use of a standard supervised approach. In this paper, we propose a semi-supervised learning methodology to robustly segment ocular structures in OCT images using a limited number of partially labeled images. Our methodology maximizes the information we can extract from labeled images through hierarchical learning, where multiple decoders are used to extract segmented structures progressively. We use a reconstruction loss function to provide structural coherence to the segmentation and a teacher–student strategy to effectively leverage the information present in the set of unlabeled images. In addition to the segmentation of labeled structures, this hierarchical approach allows segmenting structures that are not labeled in the dataset such as the choroidal vessels. To validate the proposed methodology, we have carried out extensive experimentation using two datasets with different characteristics. These experiments have demonstrated a great potential of this methodology to train networks efficiently with partially labeled images, which allows to accurately extract the main biomarkers linked to the development of MS., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, PDC2022-133132-I00 and TED2021-1312 01B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by ‘‘Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain’’, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by ‘‘Secretaría Xeral de Universidades, Spain’’, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI, Spain Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Multi-task Convolutional Neural Networks for the End-to-end Simultaneous Segmentation and Screening of the Epiretinal Membrane in OCT Images

  • Gende, M.
  • Moura, Joaquim de
  • Penedo, Manuel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), 5 y 6 de octubre de 2022, A Coruña., [Absctract]: The Epiretinal Membrane (ERM) is an ocular pathology that causes visual distortion. In order to detect and treat the ERM, ophthalmologists visually inspect Optical Coherence Tomography (OCT) images.This is a costly and subjective process. In this work, we present three different fully automatic, end-to-end approaches that make use of multi-task learning to simultaneously screen for and segment ERM symptoms in OCT images. These approaches were implemented into three architectures that capitalise on the way the models share a single architecture for the two complementary tasks., This research was funded by Instituto de Salud Carlos III, Government of Spain, [DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project [PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [ED431C 2020/24], predoctoral grant [ED481A 2021/161]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Identification and Intuitive Map Representation of the Epiretinal Membrane Presence in 3D OCT Volumes

  • Baamonde, Sergio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Optical Coherence Tomography (OCT) is a medical image modality providing high-resolution cross-sectional visualizations of the retinal tissues without any invasive procedure, commonly used in the analysis of retinal diseases such as diabetic retinopathy or retinal detachment. Early identification of the epiretinal membrane (ERM) facilitates ERM surgical removal operations. Moreover, presence of the ERM is linked to other retinal pathologies, such as macular edemas, being among the main causes of vision loss. In this work, we propose an automatic method for the characterization and visualization of the ERM’s presence using 3D OCT volumes. A set of 452 features is refined using the Spatial Uniform ReliefF (SURF) selection strategy to identify the most relevant ones. Afterwards, a set of representative classifiers is trained, selecting the most proficient model, generating a 2D reconstruction of the ERM’s presence. Finally, a post-processing stage using a set of morphological operators is performed to improve the quality of the generated maps. To verify the proposed methodology, we used 20 3D OCT volumes, both with and without the ERM’s presence, totalling 2428 OCT images manually labeled by a specialist. The most optimal classifier in the training stage achieved a mean accuracy of 91.9%. Regarding the post-processing stage, mean specificity values of 91.9% and 99.0% were obtained from volumes with and without the ERM’s presence, respectively., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Moreover, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Deep Multi-Segmentation Approach for the Joint Classification and Segmentation of the Retinal Arterial and Venous Trees in Color Fundus Images

  • Morano, José
  • Hervella, Álvaro S.
  • Novo Buján, Jorge
  • Rouco, José
Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021., [Abstract] The analysis of the retinal vasculature represents a crucial stage in the diagnosis of several diseases. An exhaustive analysis involves segmenting the retinal vessels and classifying them into veins and arteries. In this work, we present an accurate approach, based on deep neural networks, for the joint segmentation and classification of the retinal veins and arteries from color fundus images. The presented approach decomposes this joint task into three related subtasks: the segmentation of arteries, veins and the whole vascular tree. The experiments performed show that our method achieves competitive results in the discrimination of arteries and veins, while clearly enhancing the segmentation of the different structures. Moreover, unlike other approaches, our method allows for the straightforward detection of vessel crossings, and preserves the continuity of the arterial and venous vascular trees at these locations., This work was funded by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Xunta de Galicia and European Social Fund (ESF) of the EU through the predoctoral grant contracts ED481A-2017/328 and ED481A 2021/140; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, is funded by Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED481A 2021/140, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Feature Definition and Comprehensive Analysis on the Robust Identification of Intraretinal Cystoid Regions Using Optical Coherence Tomography Images

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Rouco, José
  • Penedo, Manuel
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Currently, optical coherence tomography is one of the most used medical imaging modalities, offering cross-sectional representations of the studied tissues. This image modality is specially relevant for the analysis of the retina, since it is the internal part of the human body that allows an almost direct examination without invasive techniques. One of the most representative cases of use of this medical imaging modality is for the identification and characterization of intraretinal fluid accumulations, critical for the diagnosis of one of the main causes of blindness in developed countries: the Diabetic Macular Edema. The study of these fluid accumulations is particularly interesting, both from the point of view of pattern recognition and from the different branches of health sciences. As these fluid accumulations are intermingled with retinal tissues, they present numerous variants according to their severity, and change their appearance depending on the configuration of the device; they are a perfect subject for an in-depth research, as they are considered to be a problem without a strict solution. In this work, we propose a comprehensive and detailed analysis of the patterns that characterize them. We employed a pool of 11 different texture and intensity feature families (giving a total of 510 markers) which we have analyzed using three different feature selection strategies and seven complementary classification algorithms. By doing so, we have been able to narrow down and explain the factors affecting this kind of accumulations and tissue lesions by means of machine learning techniques with a pipeline specially designed for this purpose., Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24 and through the postdoctoral grant contract ref. ED481B 2021/059; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Identification and Representation of the Cornea–Contact Lens Relationship Using AS-OCT Images

  • Cabaleiro, Pablo
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] The clinical study of the cornea–contact lens relationship is widely used in the process of adaptation of the scleral contact lens (SCL) to the ocular morphology of patients. In that sense, the measurement of the adjustment between the SCL and the cornea can be used to study the comfort or potential damage that the lens may produce in the eye. The current analysis procedure implies the manual inspection of optical coherence tomography of the anterior segment images (AS-OCT) by the clinical experts. This process presents several limitations such as the inability to obtain complex metrics, the inaccuracies of the manual measurements or the requirement of a time-consuming process by the expert in a tedious process, among others. This work proposes a fully-automatic methodology for the extraction of the areas of interest in the study of the cornea–contact lens relationship and the measurement of representative metrics that allow the clinicians to measure quantitatively the adjustment between the lens and the eye. In particular, three distance metrics are herein proposed: Vertical, normal to the tangent of the region of interest and by the nearest point. Moreover, the images are classified to characterize the analysis as belonging to the central cornea, peripheral cornea, limbus or sclera (regions where the inner layer of the lens has already joined the cornea). Finally, the methodology graphically presents the results of the identified segmentations using an intuitive visualization that facilitates the analysis and diagnosis of the patients by the clinical experts., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Moreover, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431C 2016-047.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Analysis of Imbalanced Datasets in the Performance of Deep Learning Approaches for COVID-19 Screening from Chest X-ray Imaging: Impact of Sex and Age Factors

  • Álvarez-Rodríguez, Lorena
  • Moura, Joaquim de
  • Ramos, Lucía
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Comunicación presentada al V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), tendrá lugar los días 5 y 6 de octubre de 2022, [Absctract]: In this work, we analysed 11 imbalance scenarios with female and male COVID-19 patients present in different proportions for the sex analysis, and 6 scenarios where only one specific age range was used for training for the age factor. In each study, 3 different approaches for automatic COVID-19 screening were used: (I) Normal vs COVID-19, (II) Pneumonia vs COVID-19 and (III) Non-COVID-19 vs COVID-19. The present study was validated using two representative public chest X-ray datasets, allowing a reliable analysis to support the clinical decision-making process. The results for the sex-related analysis indicate this factor slightly affects the COVID- 19 deep learning-based systems, although the identified differences are not relevant enough to considerably worsen the system. Regarding the age-related analysis, this factor was observed to be influencing the system in a more consistent way than the sex factor, as it was present in all considered scenarios., This research was funded by: Instituto de Salud Carlos III - DTS18/00136; Ministerio de Ciencia e Innovación y Universidades, Gov. of Spain - RTI2018-095894-B-I00; Ministerio de Ciencia e Innovación, Gov. of Spain - PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva - ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia - N845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; N845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Comprehensive Analysis of the Screening of COVID-19 Approaches in Chest X-ray Images from Portable Devices

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
ESANN 2021 Proceedings - 29th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine LearningOpen AccessPages 165 - 1702021 29th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2021Virtual, Online 6 October 2021 through 8 October 2021 Code 178821, [Abstract]: Computer-aided diagnosis plays an important role in the COVID-19 pandemic. Currently, it is recommended to use X-ray imaging to diagnose and assess the evolution in patients. Particularly, radiologists are asked to use portable acquisition devices to minimize the risk of cross-infection, facilitating an effective separation of suspected patients with other low-risk cases. In this work, we present an automatic COVID-19 screening, considering 6 representative state-of-the-art deep network architectures on a portable chest X-ray dataset that was specifically designed for this proposal. Exhaustive experimentation demonstrates that the models can separate COVID-19 cases from NON-COVID-19 cases, achieving a 97.68% of global accuracy., This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral and postdoctoral grant contracts ref. ED481A 2021/196 and ED481B 2021/059, respectively; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Comprehensive analysis of clinical data for COVID-19 outcome estimation with machine learning models

  • Iglesias Morís, Daniel
  • Moura, Joaquim de
  • Marcos, Pedro J.
  • Rey, Enrique
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Funding for open access charge: Universidade da Coruña/CISUG., [Abstract]: COVID-19 is a global threat for the healthcare systems due to the rapid spread of the pathogen that causes it. In such situation, the clinicians must take important decisions, in an environment where medical resources can be insufficient. In this task, the computer-aided diagnosis systems can be very useful not only in the task of supporting the clinical decisions but also to perform relevant analyses, allowing them to understand better the disease and the factors that can identify the high risk patients. For those purposes, in this work, we use several machine learning algorithms to estimate the outcome of COVID-19 patients given their clinical information. Particularly, we perform 2 different studies: the first one estimates whether the patient is at low or at high risk of death whereas the second estimates if the patient needs hospitalization or not. The results of the analyses of this work show the most relevant features for each studied scenario, as well as the classification performance of the considered machine learning models. In particular, the XGBoost algorithm is able to estimate the need for hospitalization of a patient with an AUC-ROC of 0.8415± 0.0217 while it can also estimate the risk of death with an AUC-ROC of 0.7992±0.0104. Results have demonstrated the great potential of the proposal to determine those patients that need a greater amount of medical resources for being at a higher risk. This provides the healthcare services with a tool to better manage their resources., Xunta de Galicia; ED481A 2021/196, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by ISCIII, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; CCEU, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/196; and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from CCEU, Xunta de Galicia , through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Deformable registration of multimodal retinal images using a weakly supervised deep learning approach

  • Martínez-Río, Javier
  • Carmona, Enrique J.
  • Cancelas, Daniel
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: There are different retinal vascular imaging modalities widely used in clinical practice to diagnose different retinal pathologies. The joint analysis of these multimodal images is of increasing interest since each of them provides common and complementary visual information. However, if we want to facilitate the comparison of two images, obtained with different techniques and containing the same retinal region of interest, it will be necessary to make a previous registration of both images. Here, we present a weakly supervised deep learning methodology for robust deformable registration of multimodal retinal images, which is applied to implement a method for the registration of fluorescein angiography (FA) and optical coherence tomography angiography (OCTA) images. This methodology is strongly inspired by VoxelMorph, a general unsupervised deep learning framework of the state of the art for deformable registration of unimodal medical images. The method was evaluated in a public dataset with 172 pairs of FA and superficial plexus OCTA images. The degree of alignment of the common information (blood vessels) and preservation of the non-common information (image background) in the transformed image were measured using the Dice coefficient (DC) and zero-normalized cross-correlation (ZNCC), respectively. The average values of the mentioned metrics, including the standard deviations, were DC = 0.72 ± 0.10 and ZNCC = 0.82 ± 0.04. The time required to obtain each pair of registered images was 0.12 s. These results outperform rigid and deformable registration methods with which our method was compared., This work was supported by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894-B-I00 research project. Some of the authors of this work also receive financial support from the European Social Fund through the predoctoral contract ref. PEJD-2019-PRE/TIC17030 and research assistant contract ref. PEJ-2019-AI/TIC-13771.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Unsupervised Deformable Image Registration in a Landmark Scarcity Scenario: Choroid OCTA

  • López-Varela, Emilio
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Moreno-Morillo, Francisco Javier
  • Ortega Hortas, Marcos
This version of the conference paper has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-06427-2_8., [Abstract]: Recent advances in OCTA allow the imaging of blood flow deeper than the retinal layers at the level of the choriocapillaris (CC), where a pattern of small dark areas represents the absence of flow, called flow voids. The distribution of flow voids can be used as a biomarker to diagnose and monitor the progression of relevant pathologies or the efficacy of applied treatments. A pixel-to-pixel comparison can help to carry out this monitoring effectively, although in order to carry out this comparison, the used images must be perfectly aligned. CC images are characterized by their granularity, presenting numerous and complex local deformations, so a deformable registration is necessary to carry out a reliable comparison. However, CC OCTA images also present a characteristic absence of visually significant anatomical structures. This landmark scarcity hardens drastically the identification of points of interest to achieve an accurate registration. Based on this context, we designed a methodology to accurately perform this deformable registration in this challenging scenario. Hence, we propose a convolutional neural network model trained by unsupervised learning to register images in a real clinical scenario, being obtained at different time instants from patients with central serous chorioretinopathy (CSC) treated with photodynamic therapy. Our methodology produces superior alignment to those achieved with other proven methods, helping to improve the monitoring of the efficacy of photodynamic therapy applied to patients with CSC. Our robust and adaptable methodology can also be exploited in other similar scenarios of complex registrations with anatomical landmark scarcity., This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning

  • Morano, José
  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Fernández-Vigo, José Ignacio
  • Ortega Hortas, Marcos
[Abstract]: Background and Objectives: Age-related macular degeneration (AMD) is a degenerative disorder affecting the macula, a key area of the retina for visual acuity. Nowadays, AMD is the most frequent cause of blindness in developed countries. Although some promising treatments have been proposed that effectively slow down its development, their effectiveness significantly diminishes in the advanced stages. This emphasizes the importance of large-scale screening programs for early detection. Nevertheless, implementing such programs for a disease like AMD is usually unfeasible, since the population at risk is large and the diagnosis is challenging. For the characterization of the disease, clinicians have to identify and localize certain retinal lesions. All this motivates the development of automatic diagnostic methods. In this sense, several works have achieved highly positive results for AMD detection using convolutional neural networks (CNNs). However, none of them incorporates explainability mechanisms linking the diagnosis to its related lesions to help clinicians to better understand the decisions of the models. This is specially relevant, since the absence of such mechanisms limits the application of automatic methods in the clinical practice. In that regard, we propose an explainable deep learning approach for the diagnosis of AMD via the joint identification of its associated retinal lesions. Methods: In our proposal, a CNN with a custom architectural setting is trained end-to-end for the joint identification of AMD and its associated retinal lesions. With the proposed setting, the lesion identification is directly derived from independent lesion activation maps; then, the diagnosis is obtained from the identified lesions. The training is performed end-to-end using image-level labels. Thus, lesion-specific activation maps are learned in a weakly-supervised manner. The provided lesion information is of high clinical interest, as it allows clinicians to assess the developmental stage of the disease. Additionally, the proposed approach allows to explain the diagnosis obtained by the models directly from the identified lesions and their corresponding activation maps. The training data necessary for the approach can be obtained without much extra work on the part of clinicians, since the lesion information is habitually present in medical records. This is an important advantage over other methods, including fully-supervised lesion segmentation methods, which require pixel-level labels whose acquisition is arduous. Results: The experiments conducted in 4 different datasets demonstrate that the proposed approach is able to identify AMD and its associated lesions with satisfactory performance. Moreover, the evaluation of the lesion activation maps shows that the models trained using the proposed approach are able to identify the pathological areas within the image and, in most cases, to correctly determine to which lesion they correspond. Conclusions: The proposed approach provides meaningful information—lesion identification and lesion activation maps—that conveniently explains and complements the diagnosis, and is of particular interest to clinicians for the diagnostic process. Moreover, the data needed to train the networks using the proposed approach is commonly easy to obtain, what represents an important advantage in fields with particularly scarce data, such as medical imaging., Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED481A 2021/140, Xunta de Galicia; ED431G 2019/01, This work was funded by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Axencia Galega de Innovación (GAIN), Xunta de Galicia, ref. IN845D 2020/38; Conselleria de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, ref. ED431C 2020/24, the predoctoral grant ref. ED481A 2021/140, and the postdoctoral grant ref. ED481B-2022-025; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, is funded by Conselleria de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaria Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Sistema automático para la predicción de la respuesta a la terapia fotodinámica en la coriorretinopatía serosa central

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • García-Feijóo, Julián
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Resumen] Se presenta un innovador método de deep learning para la segmentación automatizada en 3D de las regiones de fluido en imágenes de Tomografía de Coherencia ´Óptica (OCT) de pacientes con coriorretinopatía serosa central (CSCR), seguida de un análisis de respuesta a la Terapia Fotodinámica (PDT) en pacientes con CSCR. Este método no solo reduce sustancialmente el tiempo y esfuerzo requeridos para la segmentación, sino que también ofrece una técnica estandarizada, fomentando estudios de investigación a gran escala. Para llevar a cabo el trabajo utilizamos un conjunto de datos robusto compuesto por 2,769 imágenes OCT, logrando resultados altamente satisfactorios que superan a las demás propuestas del estado del arte. Esta investigación impulsa la integración del deep learning en la práctica clínica, mejorando la gestión de la CSCR al permitir la formulación de estrategias de tratamiento personalizadas y una atención optimizada al paciente., Este trabajo está financiado por el Ministerio de Ciencia e Innovación, Gobierno de España por medio del proyecto de investigación con los códigos [RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00 y PDC2022-133132-I00]; Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [código ED431C 2020/24], ayuda predoctoral [ED481A-2023-152]., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Region of interest-bounded COVID-19 lung screening using images from portable X-ray devices

  • Vidal, Plácido
  • Moura, Joaquim de
  • Ramos, Lucía
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Comunicación presentada al V Congreso XoveTIC, organizado por el Centro de Investigación en TIC da Universidade da Coruña (CITIC), os días 5 y 6 de octubre de 2022, [Abstract]: X-ray analysis of the lungs was the main method to assess the degree of affliction of SARS-COV-2. Due to the high contagiousness of this pathology, this assessment was conducted using portable X-ray devices. Automatic methodologies were proposed to compensate the image quality of said portable X-ray devices. However, these methodologies were shown to be exploiting external information (such as pacemakers or ventilators present in the images) to determine the severity. For this reason, we present a methodology specially designed to reduce the effect on an automatic methodology of these extraneous artifacts. We extract the lung region and we perform a screening of the presence of the pathology using only the pulmonary region. Finally, to ascertain the performance of the system (and provide explainability to the clinical experts), we generate the corresponding activation maps. The presented methodology has achieved a more than satisfactory performance in all the scenarios and the activation maps clearly indicate that the system is successfully using information from the lung region while excluding elements unrelated to the disease., This research was funded by: Instituto de Salud Carlos III - DTS18/00136; Ministerio de Ciencia e Innovación y Universidades, Gov. of Spain - RTI2018-095894-B-I00, Ayudas para la formación de prof. universitario (FPU)- FPU18/02271; Ministerio de Ciencia e Innovación, Gov. of Spain - PID2019-108435RB-I00; Conselleria de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva - ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia - IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; IN845D 2020/38
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Explainable artificial intelligence for the automated assessment of the retinal vascular tortuosity

  • Hervella, Álvaro S.
  • Ramos, Lucía
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Retinal vascular tortuosity is an excessive bending and twisting of the blood vessels in the retina that is associated with numerous health conditions. We propose a novel methodology for the automated assessment of the retinal vascular tortuosity from color fundus images. Our methodology takes into consideration several anatomical factors to weigh the importance of each individual blood vessel. First, we use deep neural networks to produce a robust extraction of the different anatomical structures. Then, the weighting coefficients that are required for the integration of the different anatomical factors are adjusted using evolutionary computation. Finally, the proposed methodology also provides visual representations that explain the contribution of each individual blood vessel to the predicted tortuosity, hence allowing us to understand the decisions of the model. We validate our proposal in a dataset of color fundus images providing a consensus ground truth as well as the annotations of five clinical experts. Our proposal outperforms previous automated methods and offers a performance that is comparable to that of the clinical experts. Therefore, our methodology demonstrates to be a viable alternative for the assessment of the retinal vascular tortuosity. This could facilitate the use of this biomarker in clinical practice and medical research., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work is supported by Ministerio de Ciencia e Innovación, Government of Spain (RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00 research projects); Consellería de Cultura, Educación e Universidade, Xunta de Galicia (Grupos de Referencia Competitiva ref. ED431C 2020/24 and postdoctoral fellowship ref. ED481B-2022-025). CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through the ERDF of the European Union (80%) and Secretaría Xeral de Universidades (20%). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481B-2022-025, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Intraretinal Fluid Pattern Characterization in Optical Coherence Tomography Images

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Rouco, José
  • Penedo, Manuel
  • Ortega Hortas, Marcos
[Abstract] Optical Coherence Tomography (OCT) has become a relevant image modality in the ophthalmological clinical practice, as it offers a detailed representation of the eye fundus. This medical imaging modality is currently one of the main means of identification and characterization of intraretinal cystoid regions, a crucial task in the diagnosis of exudative macular disease or macular edema, among the main causes of blindness in developed countries. This work presents an exhaustive analysis of intensity and texture-based descriptors for its identification and classification, using a complete set of 510 texture features, three state-of-the-art feature selection strategies, and seven representative classifier strategies. The methodology validation and the analysis were performed using an image dataset of 83 OCT scans. From these images, 1609 samples were extracted from both cystoid and non-cystoid regions. The different tested configurations provided satisfactory results, reaching a mean cross-validation test accuracy of 92.69%. The most promising feature categories identified for the issue were the Gabor filters, the Histogram of Oriented Gradients (HOG), the Gray-Level Run-Length matrix (GLRL), and the Laws’ texture filters (LAWS), being consistently and considerably selected along all feature selector algorithms in the top positions of different relevance rankings., Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2019/196, This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047 and the Xunta de Galicia predoctoral grant contract ref. ED481A-2019/196.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Automated segmentation of the central serous chorioretinopathy fluid regions using optical coherence tomography scans

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Barreira, Noelia
  • Charlón, Pablo
2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), Aveiro, Portugal, 2021, This version of the article has been accepted for publication, after peer review. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The Version of Record is available online at: https://doi.org/10.1109/CBMS52027.2021.00008, [Abstract]: Central serous chorioretinopathy is one of the most frequent causes of vision impairment among middle-aged adults. Optical Coherence Tomography (OCT) is a non-invasive diagnostic technique that is commonly used for the monitoring of this relevant eye disease. In this context, this paper proposes a fully automatic system for the characterization of intraretinal pathological fluid regions associated with central serous chori-oretinopathy using OCT scans. To achieve this, we adapted an end-to-end fully convolutional architecture for semantic pixel-wise segmentation. The proposed methodology was tested using a heterogeneous set of 100 OCT scans of different patients. Satisfactory results were obtained, reaching values of 0.9954pm 0.0007, 0.8792 \pm 0.0079 and 0.9651 \pm 0.0041 for the mean Accuracy, mean Jaccard index and mean Dice coefficient, respectively. The proposed system also demonstrated its competitive performance with respect to other state-of-the-art approaches., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovacion´ y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovacion, Government of Spain through ´ the research project with reference PID2019-108435RB-I00; Conseller´ıa de Cultura, Educacion e Universidade, Xunta de Galicia, Grupos de Referencia ´ Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovacion´ (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigacion de Galicia ref. ED431G 2019/01, receives financial support from ´ Consellería de Educacion, Universidade e Formación Profesional, Xunta de ´ Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Automatic Identification of Diabetic Macular Edema Using a Transfer Learning-Based Approach

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] This paper presents a complete system for the automatic identification of pathological Diabetic Macular Edema (DME) cases using Optical Coherence Tomography (OCT) images as source of information. To do so, the system extracts a set of deep features using a transfer learning-based approach from different fully-connected layers and different pre-trained Convolutional Neural Network (CNN) models. Next, the most relevant subset of deep features is identified using representative feature selection methods. Finally, a machine learning strategy is applied to train and test the potential of the identified deep features in the pathological classification process. Satisfactory results were obtained, demonstrating the suitability of the presented system to filter those pathological DME cases, helping the specialist to optimize their diagnostic procedures., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds through the DTS18/00136 research project and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Simultaneous Segmentation and Classification of the Retinal Arteries and Veins From Color Fundus Images

  • Morano, José
  • Hervella, Álvaro S.
  • Novo Buján, Jorge
  • Rouco, José
[Abstract] Background and objectives: The study of the retinal vasculature represents a fundamental stage in the screening and diagnosis of many high-incidence diseases, both systemic and ophthalmic. A complete retinal vascular analysis requires the segmentation of the vascular tree along with the classification of the blood vessels into arteries and veins. Early automatic methods approach these complementary segmentation and classification tasks in two sequential stages. However, currently, these two tasks are approached as a joint semantic segmentation, because the classification results highly depend on the effectiveness of the vessel segmentation. In that regard, we propose a novel approach for the simultaneous segmentation and classification of the retinal arteries and veins from eye fundus images. Methods: We propose a novel method that, unlike previous approaches, and thanks to the proposal of a novel loss, decomposes the joint task into three segmentation problems targeting arteries, veins and the whole vascular tree. This configuration allows to handle vessel crossings intuitively and directly provides accurate segmentation masks of the different target vascular trees. Results: The provided ablation study on the public Retinal Images vessel Tree Extraction (RITE) dataset demonstrates that the proposed method provides a satisfactory performance, particularly in the segmentation of the different structures. Furthermore, the comparison with the state of the art shows that our method achieves highly competitive results in the artery/vein classification, while significantly improving the vascular segmentation. Conclusions: The proposed multi-segmentation method allows to detect more vessels and better segment the different structures, while achieving a competitive classification performance. Also, in these terms, our approach outperforms the approaches of various reference works. Moreover, in contrast with previous approaches, the proposed method allows to directly detect the vessel crossings, as well as preserving the continuity of both arteries and veins at these complex locations., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project; Ministerio de Ciencia e Innovación, Government of Spain, through the RTI2018-095894-B-I00 and PID2019-108435RB-I00 research projects; Xunta de Galicia and the European Social Fund (ESF) of the EU through the predoctoral grant contract ref. ED481A-2017/328; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, through Grupos de Referencia Competitiva, grant ref. ED431C 2020/24. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Diabetic Macular Edema Characterization and Visualization Using Optical Coherence Tomography Images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Díaz González, Macarena
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] Diabetic Retinopathy and Diabetic Macular Edema (DME) represent one of the main causes of blindness in developed countries. They are characterized by fluid deposits in the retinal layers, causing a progressive vision loss over the time. The clinical literature defines three DME types according to the texture and disposition of the fluid accumulations: Cystoid Macular Edema (CME), Diffuse Retinal Thickening (DRT) and Serous Retinal Detachment (SRD). Detecting each one is essential as, depending on their presence, the expert will decide on the adequate treatment of the pathology. In this work, we propose a robust detection and visualization methodology based on the analysis of independent image regions. We study a complete and heterogeneous library of 375 texture and intensity features in a dataset of 356 labeled images from two of the most used capture devices in the clinical domain: a CIRRUSTM HD-OCT 500 Carl Zeiss Meditec and 179 OCT images from a modular HRA + OCT SPECTRALIS® from Heidelberg Engineering, Inc. We extracted 33,810 samples for each type of DME for the feature analysis and incremental training of four different classifier paradigms. This way, we achieved an 84.04% average accuracy for CME, 78.44% average accuracy for DRT and 95.40% average accuracy for SRD. These models are used to generate an intuitive visualization of the fluid regions. We use an image sampling and voting strategy, resulting in a system capable of detecting and characterizing the three types of DME presenting them in an intuitive and repeatable way., Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia, Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project, Ayudas para la formación de profesorado universitario (FPU), grant ref. FPU18/02271; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%).
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Detecting, Characterizing and Visualizing Multiple Sclerosis in Optical Coherence Tomography Through Biomarker Selection

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • Quezada-Sánchez, Johnny
  • Oreja-Guevara, Celia
  • Rouco, José
[Abstract]: Multiple sclerosis (MS) is a chronic neurodegenerative disease affecting the central nervous system, which is the primary cause of non-traumatic neurological disability among young adults. Diagnosing MS is challenging yet crucial for effective patient treatment. Optical Coherence Tomography (OCT) has emerged as a non-invasive and efficient tool for analysing optic nerv alterations and assessing neurodegeneration in MS, particularly through changes in retinal thickness of layers such as the retinal nerve fiber layer (RNFL) and ganglion cell layer (GCL). In this work, we investigate the potential of using changes across all retinal layer thickness as a biomarker for MS detection. To accomplish this, we propose a fully automatic system consisting of an MS classification model and a pathological thickness visualization model. First, our system employs a fully convolutional neural network to segment retinal layers and choroidal vessels and to calculate the extraction of layer thickness at varying granularities. Global and local layer thickness are used as inputs for the MS classification model. A genetic multi objective algorithm is used for effective feature selection. Concurrently, voxel-level layer thickness serves as input for the visualization model that generates a 2D probability map where the pathological regions are highlighted. This map contributes to an interactive 3D reconstruction that provides a swift overview of MS-associated thickness changes. Extensive experimentation on real clinical MS cases validates the significant potential of the proposed system for practical clinical applications and showcases its efficacy in enhancing diagnostic precision and efficiency., This research was funded by Government of Spain, Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovación, Government of Spain through the research projects with reference PID2019-108435RB-I00, reference PDC2022-133132-I00 and TED2021-131201B-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades”, grant ref. ED431G 2019/01. Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2020/24
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Joint Diabetic Macular Edema Segmentation and Characterization in OCT Images

  • Moura, Joaquim de
  • Samagaio, Gabriela
  • Novo Buján, Jorge
  • Almuina Varela, Pablo
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10278-020-00360-y, [Abstract]: The automatic identification and segmentation of edemas associated with diabetic macular edema (DME) constitutes a crucial ophthalmological issue as they provide useful information for the evaluation of the disease severity. According to clinical knowledge, the DME disorder can be categorized into three main pathological types: serous retinal detachment (SRD), cystoid macular edema (CME), and diffuse retinal thickening (DRT). The implementation of computational systems for their automatic extraction and characterization may help the clinicians in their daily clinical practice, adjusting the diagnosis and therapies and consequently the life quality of the patients. In this context, this paper proposes a fully automatic system for the identification, segmentation and characterization of the three ME types using optical coherence tomography (OCT) images. In the case of SRD and CME edemas, different approaches were implemented adapting graph cuts and active contours for their identification and precise delimitation. In the case of the DRT edemas, given their fuzzy regional appearance that requires a complex extraction process, an exhaustive analysis using a learning strategy was designed, exploiting intensity, texture, and clinical-based information. The different steps of this methodology were validated with a heterogeneous set of 262 OCT images, using the manual labeling provided by an expert clinician. In general terms, the system provided satisfactory results, reaching Dice coefficient scores of 0.8768, 0.7475, and 0.8913 for the segmentation of SRD, CME, and DRT edemas, respectively., This work is supported by the Instituto de Salud Carlos III, Government of Spain, and FEDER funds through the DTS18/00136 research project and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro de Investigación del Sistema Universitário de Galicia, Ref. ED431G 2019/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Modeling, Localization, and Segmentation of the Foveal Avascular Zone on Retinal OCT-Angiography Images

  • Carmona, Enrique J.
  • Díaz González, Macarena
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: The Foveal Avascular Zone (FAZ) is a capillary-free area that is placed inside the macula and its morphology and size represent important biomarkers to detect different ocular pathologies such as diabetic retinopathy, impaired vision or retinal vein occlusion. Therefore, an adequate and precise segmentation of the FAZ presents a high clinical interest. About to this, Angiography by Optical Coherence Tomography (OCT-A) is a non-invasive imaging technique that allows the expert to visualize the vascular and avascular foveal zone. In this work, we present a robust methodology composed of three stages to model, localize, and segment the FAZ in OCT-A images. The first stage is addressed to generate two FAZ normality models: superficial and deep plexus. The second one uses the FAZ model as a template to localize the FAZ center. Finally, in the third stage, an adaptive binarization is proposed to segment the entire FAZ region. A method based on this methodology was implemented and validated in two OCT-A image subsets, presenting the second subset more challenging pathological conditions than the first. We obtained localization success rates of 100% and 96% in the first and second subsets, respectively, considering a success if the obtained FAZ center is inside the FAZ area segmented by an expert clinician. Complementary, the Dice score and other indexes (Jaccard index and Hausdorff distance) are used to measure the segmentation quality, obtaining competitive average values in the first subset: 0.84± 0.01 (expert 1) and 0.85± 0.01 (expert 2). The average Dice score obtained in the second subset was also acceptable (0.70± 0.17), even though the segmentation process is more complex in this case., This work was supported by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894-B-I00 research project.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Choroid segmentation in non-EDI OCT images of multiple sclerosis patients

  • López-Varela, Emilio
  • Barreira, Noelia
  • Olivier Pascual, Nuria
  • García Ben, Emma
  • Rubio Cid, Sara
  • Penedo, Manuel
[Abstract]: Optical coherence tomography (OCT) is a non-invasive diagnostic technique that can image ocular structures. Recently, this imaging technique has been used to diagnose and monitor patients with multiple sclerosis (MS), as several clinical studies have linked the development of MS to various changes in the eye. Among the different structures, one of the relevant biomarkers for MS analysis is the choroid. Systems such as Enhanced Depth Imaging (EDI) provide detailed images of the choroid region. However, OCT images are not routinely captured using this technology unless the study is specifically focused on choroidal analysis. In this work we propose a robust approach, based on convolutional neural networks to segment the choroid in non-EDI OCT images. The results obtained show that the proposed network manages to delimit the inferior contour of the choroid in a similar way to the experts., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01, This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095894-B-I00 research project; Ministerio de Ciencia e Innovaciónn, Government of Spain through the research project with reference PID2019-108435RB-I00; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; Axencia Galega de Innovación (GAIN), Xunta de Galicia, grant ref. IN845D 2020/38; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). Emilio López Varela acknowledges its support under FPI Grant Program through PID2019-108435RB-I00 project.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

End-To-End Multi-Task Learning Approaches for the Joint Epiretinal Membrane Segmentation and Screening in OCT Images

  • Gende, M.
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Background and objectives The Epiretinal Membrane (ERM) is an ocular disease that can cause visual distortions and irreversible vision loss. Patient sight preservation relies on an early diagnosis and on determining the location of the ERM in order to be treated and potentially removed. In this context, the visual inspection of the images in order to screen for ERM signs is a costly and subjective process. Methods In this work, we propose and study three end-to-end fully-automatic approaches for the simultaneous segmentation and screening of ERM signs in Optical Coherence Tomography images. These convolutional approaches exploit a multi-task learning context to leverage inter-task complementarity in order to guide the training process. The proposed architectures are combined with three different state of the art encoder architectures of reference in order to provide an exhaustive study of the suitability of each of the approaches for these tasks. Furthermore, these architectures work in an end-to-end manner, entailing a significant simplification of the development process since they are able to be trained directly from annotated images without the need for a series of purpose-specific steps. Results In terms of segmentation, the proposed models obtained a precision of 0.760 ± 0.050, a sensitivity of 0.768 ± 0.210 and a specificity of 0.945 ± 0.011. For the screening task, these models achieved a precision of 0.963 ± 0.068, a sensitivity of 0.816 ± 0.162 and a specificity of 0.983 ± 0.068. The obtained results show that these multi-task approaches are able to perform competitively with or even outperform single-task methods tailored for either the segmentation or the screening of the ERM. Conclusions These results highlight the advantages of using complementary knowledge related to the segmentation and screening tasks in the diagnosis of this relevant pathology, constituting the first proposal to address the diagnosis of the ERM from a multi-task perspective., This research was funded by Instituto de Salud Carlos III, Government of Spain, [grant number DTS18/00136]; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, [grant number RTI2018-095894-B-I00]; Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant number PID2019-108435RB-I00]; Consellería de Cultura, Educación e Universidade, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], Predoctoral grant [grant number ED481A 2021/161] and Postdoctoral grant [grant number ED481B 2021/059]; Axencia Galega de Innovación (GAIN), Xunta de Galicia, [grant number IN845D 2020/38]; CITIC, Centro de Investigación de Galicia [grant number ED431G 2019/01], receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding sources had no role in the development of this work. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A 2021/161, Xunta de Galicia; ED481B 2021/059, Xunta de Galicia; IN845D 2020/38, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Deep Learning-Based Approaches for Ciliary Muscle Segmentation and Biomarker Extraction

  • Goyanes, Elena
  • Moura, Joaquim de
  • Fernández-Vigo, José Ignacio
  • Fernández-Vigo, José A.
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presentado en: XX Conferencia de la Asociación Española para la Inteligencia Artificial, A Coruña, 19 - 21 de Junio de 2024 (CAEPIA 2024), [Abstract]: This paper highlights our recently published work that involves the application of deep learning techniques to perform the segmentation of the ciliary muscle in Anterior Segment Optical Coherence Tomography (AS-OCT) images. The ciliary muscle is vital for various anterior segment of the eye functions, including intraocular pressure regulation and lens shape maintenance. To advance research, we propose a fully automatic method for segmenting and measuring ciliary muscle biomarkers in 6 mm and 16 mm scan depths, commonly used in clinical analysis. Our approach ensures repeatable and immediate results through thorough exploration of artificial intelligence approaches combining different network architectures, encoders, data augmentation and transfer learning strategies. Additionally, we extract relevant biomarkers, aiding in diagnoses and monitoring of ocular diseases such as glaucoma, myopia, and presbyopia, and facilitating the development of new therapeutic strategies. With high accuracy values (0.9665 ± 0.1280 and 0.9772 ± 0.0873 for the best 6 mm and 16 mm combinations, respectively), our system provides clinicians and researchers with a valuable, automatic tool for ciliary muscle segmentation and analysis in AS-OCT images., This work was supported by Ministerio de Ciencia e Innovación, Government of Spain through the research project with [grant numbers RTI2018-095894-B-I00, PID2019-108435RB-I00, TED2021-131201B-I00, and PDC2022-133132-I00]; Consellería de Educacioó, Universidade, e Formación Profesional, Xunta de Galicia, Grupos de Referencia Competitiva, [grant number ED431C 2020/24], predoctoral grant [grant number ED481A-2023-152]., Xunta de Galicia; ED431C 2020/24, Xunta de Galicia; ED481A-2023-152
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Fully Automatic Retinal Vascular Tortuosity Assessment Integrating Domain-Related Information

  • Ramos, Lucía
  • Novo Buján, Jorge
  • Rouco, José
  • Romeo Villadóniga, Stephanie
  • Álvarez Días, María Dolores
  • Ortega Hortas, Marcos
[Abstract] The fundus of the eye is the only part of the human body that allows a direct non-invasive observation of the circulatory system. Retinal vascular tortuosity presents a valuable potential for diagnostic and treatment purposes of relevant vascular and systemic diseases. This work presents a computational metric for the tortuosity characterization that combines mathematical representations of the vessel segments with anatomical properties of the fundus image such as the vessel caliber, the distance to the optic disc, the distance to the fovea and the distinction between arteries and veins. The evaluation of the prognostic performance shows that the incorporation of the domain-related information allows a reliable characterization of the retinal vascular tortuosity that provides a better representation of the expert perception., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the RTI2018-095894-B-I00 research projects; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Joint Optic Disc and Cup Segmentation Using Self-Supervised Multimodal Reconstruction Pre-Training

  • Hervella, Álvaro S.
  • Ramos, Lucía
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] The analysis of the optic disc and cup in retinal images is important for the early diagnosis of glaucoma. In order to improve the joint segmentation of these relevant retinal structures, we propose a novel approach applying the self-supervised multimodal reconstruction of retinal images as pre-training for deep neural networks. The proposed approach is evaluated on different public datasets. The obtained results indicate that the self-supervised multimodal reconstruction pre-training improves the performance of the segmentation. Thus, the proposed approach presents a great potential for also improving the interpretable diagnosis of glaucoma., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the RTI2018-095894-B-I00 research project. The authors of this work also receive financial support from the ERDF, the European Social Fund (ESF) of the EU, and Xunta de Galicia through Centro de Investigación de Galicia ref. ED431G 2019/01 and the predoctoral grant contract ref. ED481A-2017/328, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED481A-2017/328.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Multi-Modal Self-Supervised Pre-Training for Joint Optic Disc and Cup Segmentation in Eye Fundus Images

  • S. Hervella, Álvaro
  • Ramos, Lucía
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
Presented at: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4-8 May 2020, Virtual Barcelona, Spain. This version of the paper has been accepted for publication. The final published paper is available online at: https://doi.org/10.1109/ICASSP40776.2020.9053551, [Abstract]: This paper presents a novel approach for the segmentation of the optic disc and cup in eye fundus images using deep learning. The accurate segmentation of these anatomical structures in the eye is important towards the early detection of glaucoma and, therefore, potentially avoiding severe vision loss. In order to improve the segmentation of the optic disc and cup, we propose a novel self-supervised pretraining consisting in the multi-modal reconstruction of eye fundus images. This novel approach aims at facilitating the segmentation task and avoiding the necessity of excessively large annotated datasets.To validate the proposal, we perform several experiments on different public datasets. The results show that the proposed multi-modal self-supervised pre-training leads to a significant improvement in the performance of the segmentation task. Consequently, the presented approach shows remarkable potential towards further improving the interpretable and early diagnosis of a relevant disease as is glaucoma., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Ciencia, Innovaci´on y Universidades, Government of Spain, through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. The authors of this work also receive financial support from the ERDF and European Social Fund (ESF) of the EU, and Xunta de Galicia through Centro Singular de Investigaci´on de Galicia, accreditation 2016-2019, ref. ED431G/01, Grupo de Referencia Competitiva, ref. ED431C 2016-047, and the predoctoral grant contract ref. ED481A-2017/328., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED431C 2016-047
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Automatic segmentation of retinal layers in multiple neurodegenerative disorder scenarios

  • Gende, Mateo
  • Mallen, Víctor
  • de Moura, Joaquim
  • Cordón, Beatriz
  • Garcia-Martin, Elena
  • Sánchez, Clara I.
  • Novo, Jorge
  • Ortega, Marcos
Retinal Optical Coherence Tomography (OCT) allows the non-invasive direct observation of the central nervous system, enabling the measurement and extraction of biomarkers from neural tissue that can be helpful in the assessment of ocular, systemic and Neurological Disorders (ND). Deep learning models can be trained to segment the retinal layers for biomarker extraction. However, the onset of ND can have an impact on the neural tissue, which can lead to the degraded performance of models not exposed to images displaying signs of disease during training. We present a fully automatic approach for the retinal layer segmentation in multiple neurodegenerative disorder scenarios, using an annotated dataset of patients of the most prevalent NDs: Alzheimer's disease, Parkinson's disease, multiple sclerosis and essential tremor, along with healthy control patients. Furthermore, we present a two-part, comprehensive study on the effects of ND on the performance of these models. The results show that images of healthy patients may not be sufficient for the robust training of automated segmentation models intended for the analysis of ND patients, and that using images representative of different NDs can increase the model performance. These results indicate that the presence or absence of patients of ND in datasets should be taken into account when training deep learning models for retinal layer segmentation, and that the proposed approach can provide a valuable tool for the robust and reliable diagnosis in multiple scenarios of ND.