Pasar al contenido principal

IDENTIFICACION Y CARACTERIZACION DEL EDEMA MACULAR DIABETICO MEDIANTE ANALISIS AUTOMATICO DE TOMOGRAFIAS DE COHERENCIA OPTICA Y TECNICAS DE APRENDIZAJE MAQUINA

DPI2015-69948-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2015
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Dirección General de Investigación Científica y Técnica
Centro beneficiario UNIVERSIDADE DA CORUÑA
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 18
Encontrada(s) 1 página(s)

Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

Defining the Optimal Region of Interest for Hyperemia Grading in the Bulbar Conjunctiva

  • Sánchez Brea, Luisa
  • Barreira, Noelia
  • Mosquera González, Antonio
  • Evans, Katharine
  • Pena Verdeal, Hugo
Conjunctival hyperemia or conjunctival redness is a symptom that can be associated with a broad group of ocular diseases. Its levels of severity are represented by standard photographic charts that are visually compared with the patient’s eye. This way, the hyperemia diagnosis becomes a nonrepeatable task that depends on the experience of the grader. To solve this problem, we have proposed a computer-aided methodology that comprises three main stages: the segmentation of the conjunctiva, the extraction of features in this region based on colour and the presence of blood vessels, and, finally, the transformation of these features into grading scale values by means of regression techniques. However, the conjunctival segmentation can be slightly inaccurate mainly due to illumination issues. In this work, we analyse the relevance of different features with respect to their location within the conjunctiva in order to delimit a reliable region of interest for the grading. The results show that the automatic procedure behaves like an expert using only a limited region of interest within the conjunctiva
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Intraretinal fluid identification via enhanced maps using optical coherence tomography images

  • Vidal, Plácido
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Penedo, Manuel
  • Ortega Hortas, Marcos
[Abstract]: Nowadays, among the main causes of blindness in developed countries are age-related macular degeneration (AMD) and the diabetic macular edema (DME). Both diseases present, as a common symptom, the appearance of cystoid fluid regions inside the retinal layers. Optical coherence tomography (OCT) image modality was one of the main medical imaging techniques for the early diagnosis and monitoring of AMD and DME via this intraretinal fluid detection and characterization. We present a novel methodology to identify these fluid accumulations by means of generating binary maps (offering a direct representation of these areas) and heat maps (containing the region confidence). To achieve this, a set of 312 intensity and texture-based features were studied. The most relevant features were selected using the sequential forward selection (SFS) strategy and tested with three archetypal classifiers: LDC, SVM and Parzen window. Finally, the most proficient classifier is used to create the proposed maps. All of the tested classifiers returned satisfactory results, the best classifier achieving a mean test accuracy higher than 94% in all of the experiments. The suitability of the maps was evaluated in a context of a screening issue with three different datasets obtained with two different devices, testing the capabilities of the system to work independently of the used OCT device. The experiments with the map creation were performed using 323 OCT images. Using only the binary maps, more than 91.33% of the images were correctly classified. With only the heat maps, the proposed methodology correctly separated 93.50% of the images., Instituto de Salud Carlos III (ISCIII) (PI14/02161, DTS15/00153); Ministerio de Economía, Industria y Competitividad, Gobierno de España (DPI2015-69948-R); Consellería de Cultura, Educación e Ordenación Universitaria, Xunta de Galicia (ED431C 2016-047, ED431G/01). The authors take this opportunity to gratefully acknowledge the assistance and contributions of the opthalmologic services from the Complejo Hospitalario Universitario de Santiago (CHUS) and the Complejo Hospitalario Universitario de Ferrol (CHUF)., Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED431G/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Retinal vascular tortuosity assessment: Inter-intra expert analysis and correlation with computational measurements

  • Ramos, Lucía
  • Novo Buján, Jorge
  • Rouco, José
  • Romeo Villadóniga, Stephanie
  • Álvarez Días, María Dolores
  • Ortega Hortas, Marcos
The datasets used and/or analysed during the current study are not publicly available given they are part of private data from a clinical service but are available from the corresponding author on reasonable request., [Abstract]: Background: The retinal vascular tortuosity can be a potential indicator of relevant vascular and non-vascular diseases. However, the lack of a precise and standard guide for the tortuosity evaluation hinders its use for diagnostic and treatment purposes. This work aims to advance in the standardization of the retinal vascular tortuosity as a clinical biomarker with diagnostic potential, allowing, thereby, the validation of objective computational measurements on the basis of the entire spectrum of the expert knowledge. Methods: This paper describes a multi-expert validation process of the computational vascular tortuosity measurements of reference. A group of five experts, covering the different clinical profiles of an ophthalmological service, and a four-grade scale from non-tortuous to severe tortuosity as well as non-tortuous / tortuous and asymptomatic / symptomatic binary classifications are considered for the analysis of the the multi-expert validation procedure. The specialists rating process comprises two rounds involving all the experts and a joint round to establish consensual rates. The expert agreement is analyzed throughout the rating procedure and, then, the consensual rates are set as the reference to validate the prognostic performance of four computational tortuosity metrics of reference. Results: The Kappa indexes for the intra-rater agreement analysis were obtained between 0.35 and 0.83 whereas for the inter-rater agreement in the asymptomatic / symptomatic classification were between 0.22 and 0.76. The Area Under the Curve (AUC) for each expert against the consensual rates were placed between 0.61 and 0.83 whereas the prognostic performance of the best objective tortuosity metric was 0.80. Conclusions: There is a high inter and intra-rater variability, especially for the case of the four grade scale. The prognostic performance of the tortuosity measurements is close to the experts' performance, especially for Grisan measurement. However, there is a gap between the automatic effectiveness and the expert perception given the lack of clinical criteria in the computational measurements., This research has been economically supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the PI14/02161 and the DTS15/00153 research projects and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016-2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Penedo, Manuel
  • Ortega Hortas, Marcos
©2020. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Hervella, Á. S., Rouco, J., Novo, J., Penedo, M. G., & Ortega, M. (2020). “Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images” has been accepted for publication in Computer Methods and Programs in Biomedicine, 186(105201), 105201. The Version of Record is available online at: https://doi.org/10.1016/j.cmpb.2019.105201., [Abstract]: Background and objectives:The analysis of the retinal vasculature plays an important role in the diagnosis of many ocular and systemic diseases. In this context, the accurate detection of the vessel crossings and bifurcations is an important requirement for the automated extraction of relevant biomarkers. In that regard, we propose a novel approach that addresses the simultaneous detection of vessel crossings and bifurcations in eye fundus images. Method: We propose to formulate the detection of vessel crossings and bifurcations in eye fundus images as a multi-instance heatmap regression. In particular, a deep neural network is trained in the prediction of multi-instance heatmaps that model the likelihood of a pixel being a landmark location. This novel approach allows to make predictions using full images and integrates into a single step the detection and distinction of the vascular landmarks. Results: The proposed method is validated on two public datasets of reference that include detailed annotations for vessel crossings and bifurcations in eye fundus images. The conducted experiments evidence that the proposed method offers a satisfactory performance. In particular, the proposed method achieves 74.23% and 70.90% F-score for the detection of crossings and bifurcations, respectively, in color fundus images. Furthermore, the proposed method outperforms previous works by a significant margin. Conclusions: The proposed multi-instance heatmap regression allows to successfully exploit the potential of modern deep learning algorithms for the simultaneous detection of retinal vessel crossings and bifurcations. Consequently, this results in a significant improvement over previous methods, which will further facilitate the automated analysis of the retinal vasculature in many pathological conditions., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. The authors of this work also receive financial support from the ERDF and European Social Fund (ESF) of the EU, and Xunta de Galicia through Centro Singular de Investigación de Galicia, accreditation 2016–2019, ref. ED431G/01, Grupo de Referencia Competitiva, ref. ED431C 2016-047, and the predoctoral grant contract ref. ED481A-2017/328., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Multimodal registration of retinal images using domain-specific landmarks and vessel enhancement

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Absctract]: The analysis of different image modalities is frequently performed in ophthalmology as it provides complementary information for the diagnosis and follow-up of relevant diseases, like hypertension or diabetes. This work presents a hybrid method for the multimodal registration of color fundus retinography and fluorescein angiography. The proposed method combines a feature-based approach, using domain-specific landmarks, with an intensity-based approach that employs a domain-adapted similarity metric. The methodology is tested on a dataset of 59 image pairs containing both healthy and pathological cases. The results show a satisfactory performance of the proposed combined approach in this multimodal scenario, improving the registration accuracy achieved by the feature-based and the intensity-based approaches., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS15/00153 research project, and by the Ministerio de Economa, Industria y Competitividad, Government of Spain, through the DPI2015-69948-R research project. The authors of this work also receive financial support from the European Regional Development Fund (ERDF) and European Social Fund (ESF) of the EU, and the Xunta de Galicia through Centro Singular de Investigacin de Galicia, accreditation 2016-2019, ref. ED431G/01 and Grupo de Referencia Competitiva, ref. ED431C 2016-047 research projects, and the predoctoral grant contract ref. ED481A-2017/328., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2017/328
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Self-Supervised Multimodal Reconstruction of Retinal Images Over Paired Datasets

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] Data scarcity represents an important constraint for the training of deep neural networks in medical imaging. Medical image labeling, especially if pixel-level annotations are required, is an expensive task that needs expert intervention and usually results in a reduced number of annotated samples. In contrast, extensive amounts of unlabeled data are produced in the daily clinical practice, including paired multimodal images from patients that were subjected to multiple imaging tests. This work proposes a novel self-supervised multimodal reconstruction task that takes advantage of this unlabeled multimodal data for learning about the domain without human supervision. Paired multimodal data is a rich source of clinical information that can be naturally exploited by trying to estimate one image modality from others. This multimodal reconstruction requires the recognition of domain-specific patterns that can be used to complement the training of image analysis tasks in the same domain for which annotated data is scarce. In this work, a set of experiments is performed using a multimodal setting of retinography and fluorescein angiography pairs that offer complementary information about the eye fundus. The evaluations performed on different public datasets, which include pathological and healthy data samples, demonstrate that a network trained for self-supervised multimodal reconstruction of angiography from retinography achieves unsupervised recognition of important retinal structures. These results indicate that the proposed self-supervised task provides relevant cues for image analysis tasks in the same domain., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Economía, Industria y Competitividad, Government of Spain, through the DPI2015-69948-R research project. The authors of this work also receive financial support from the ERDF and Xunta de Galicia through Grupo de Referencia Competitiva, Ref. ED431C 2016-047, and from the European Social Fund (ESF) of the EU and Xunta de Galicia through the predoctoral grant contract Ref. ED481A-2017/328. CITIC, Centro de Investigación de Galicia Ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2017/328, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic segmentation of the foveal avascular zone in ophthalmological OCT-A images

  • Díaz González, Macarena
  • Novo Buján, Jorge
  • Cutrín, Paula
  • Gómez-Ulla, Francisco
  • Penedo, Manuel
  • Ortega Hortas, Marcos
Data Availability: All images OCT-A files are available from the OCTAGON database (http://www.varpa.org/research/ophtalmology.html) All code files are available in https://github.com/macarenadiaz/FAZ_Extraction., [Abstract]: Angiography by Optical Coherence Tomography (OCT-A) is a non-invasive retinal imaging modality of recent appearance that allows the visualization of the vascular structure at predefined depths based on the detection of the blood movement through the retinal vasculature. In this way, OCT-A images constitute a suitable scenario to analyze the retinal vascular properties of regions of interest as is the case of the macular area, measuring the characteristics of the foveal vascular and avascular zones. Extracted parameters of this region can be used as prognostic factors that determine if the patient suffers from certain pathologies (such as diabetic retinopathy or retinal vein occlusion, among others), indicating the associated pathological degree. The manual extraction of these biomedical parameters is a long, tedious and subjective process, introducing a significant intra and inter-expert variability, which penalizes the utility of the measurements. In addition, the absence of tools that automatically facilitate these calculations encourages the creation of computer-aided diagnosis frameworks that ease the doctor’s work, increasing their productivity and making viable the use of this type of vascular biomarkers. In this work we propose a fully automatic system that identifies and precisely segments the region of the foveal avascular zone (FAZ) using a novel ophthalmological image modality as is OCT-A. The system combines different image processing techniques to firstly identify the region where the FAZ is contained and, secondly, proceed with the extraction of its precise contour. The system was validated using a representative set of 213 healthy and diabetic OCT-A images, providing accurate results with the best correlation with the manual measurements of two experts clinician of 0.93 as well as a Jaccard’s index of 0.82 of the best experimental case in the experiments with healthy OCT-A images. The method also provided satisfactory results in diabetic OCT-A images, with a best correlation coefficient with the manual labeling of an expert clinician of 0.93 and a Jaccard’s index of 0.83. This tool provides an accurate FAZ measurement with the desired objectivity and reproducibility, being very useful for the analysis of relevant vascular diseases through the study of the retinal micro-circulation. © 2019 Díaz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited., This work is supported by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016-2019, Ref. ED431G/01; Grupos de Referencia Competitiva, Ref. ED431C 2016-047 and Instituto de salud Carlos III, Ref. PI-00940. Also, this work has received partial financial support from the Fundación Mutua Madrileña project, Ref. 2017/365., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047, Fundación Mutua Madrileña; 2017/365
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic macular edema identification and characterization using OCT images

  • Samagaio, Gabriela
  • Estévez, Aída
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
© 2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Samagaio, G., Estévez, A., Moura, J. de, Novo, J., Fernández, M. I., & Ortega, M. (2018). “Automatic macular edema identification and characterization using OCT images” has been accepted for publication in Computer Methods and Programs in Biomedicine, 163, 47–63. The Version of Record is available online at: https://doi.org/10.1016/j.cmpb.2018.05.033., [Abstract]: Background and objective: The detection and characterization of the intraretinal fluid accumulation constitutes a crucial ophthalmological issue as it provides useful information for the identification and diagnosis of the different types of Macular Edema (ME). These types are clinically defined, according to the clinical guidelines, as: Serous Retinal Detachment (SRD), Diffuse Retinal Thickening (DRT) and Cystoid Macular Edema (CME). Their accurate identification and characterization facilitate the diagnostic process, determining the disease severity and, therefore, allowing the clinicians to achieve more precise analysis and suitable treatments. Methods: This paper proposes a new fully automatic system for the identification and characterization of the three types of ME using Optical Coherence Tomography (OCT) images. In the case of SRD and CME edemas, multilevel image thresholding approaches were designed and combined with the application of ad-hoc clinical restrictions. The case of DRT edemas, given their complexity and fuzzy regional appearance, was approached by a learning strategy that exploits intensity, texture and clinical-based information to identify their presence. Results: The system provided satisfactory results with F-Measures of 87.54% and 91.99% for the DRT and CME detections, respectively. In the case of SRD edemas, the system correctly detected all the cases that were included in the designed dataset. Conclusions: The proposed methodology offered an accurate performance for the individual identification and characterization of the three different types of ME in OCT images. In fact, the method is capable to handle the ME analysis even in cases of significant severity with the simultaneous existence of the three ME types that appear merged inside the retinal layers., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the PI14/02161 and the DTS15/00153 research projects and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic evaluation of eye gestural reactions to sound in video sequences

  • Fernández Arias, Alba
  • Ortega Hortas, Marcos
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Penedo, Manuel
© 2019. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Fernández, A., Ortega, M., de Moura, J., Novo, J., & Penedo, M. G. (2019). “Automatic evaluation of eye gestural reactions to sound in video sequences”, has been accepted for publication in Engineering Applications of Artificial Intelligence, 85, 164–174. The Version of Record is available online at: https://doi.org/10.1016/j.engappai.2019.06.009., [Abstract]: Hearing loss is a common disorder that often intensifies with age. In some cases, especially in the elderly population, the hearing loss may decrease in physical, mental and social well-being capacities. In particular, patients with signs of cognitive impairment typically present specific clinical–pathological conditions, which complicates the analysis and diagnosis of the type and severity of hearing loss by clinical specialists. In these patients, unconscious changes in gaze direction may indicate a certain perception of sound through their auditory system. In this context, this work presents a new system that supports clinical experts in the identification and classification of eye gestures that are associated with reactions to auditory stimuli by patients with different levels of cognitive impairment. The proposed system was validated using the public Video Audiometry Sequence Test (VAST) dataset, providing a global accuracy of 97.12% for the classification of eye gestures and a 100% for gestural reactions to auditory stimuli. The proposed system offers a complete analysis of audiometric video sequences, being applicable in daily clinical practice, improving the well-being and quality of life of the patients., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union, Spain through the DTS18/00136 research projects and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund — ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019 , Ref. ED431G/01; and Grupos de Referencia Competitiva , Ref. ED431C 2016-047., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Artery/Vein Vessel Tree Identification in Near-Infrared Reflectance Retinographies

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Rouco, José
  • Charlón, Pablo
  • Ortega Hortas, Marcos
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10278-019-00235-x, [Abstract]: An accurate identification of the retinal arteries and veins is a relevant issue in the development of automatic computer-aided diagnosis systems that facilitate the analysis of different relevant diseases that affect the vascular system as diabetes or hypertension, among others. The proposed method offers a complete analysis of the retinal vascular tree structure by its identification and posterior classification into arteries and veins using optical coherence tomography (OCT) scans. These scans include the near-infrared reflectance retinography images, the ones we used in this work, in combination with the corresponding histological sections. The method, firstly, segments the vessel tree and identifies its characteristic points. Then, Global Intensity-Based Features (GIBS) are used to measure the differences in the intensity profiles between arteries and veins. A k-means clustering classifier employs these features to evaluate the potential of artery/vein identification of the proposed method. Finally, a post-processing stage is applied to correct misclassifications using context information and maximize the performance of the classification process. The methodology was validated using an OCT image dataset retrieved from 46 different patients, where 2,392 vessel segments and 97,294 vessel points were manually labeled by an expert clinician. The method achieved satisfactory results, reaching a best accuracy of 93.35% in the identification of arteries and veins, being the first proposal that faces this issue in this image modality., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research project and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF); the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Identification and Intuitive Map Representation of the Epiretinal Membrane Presence in 3D OCT Volumes

  • Baamonde, Sergio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Optical Coherence Tomography (OCT) is a medical image modality providing high-resolution cross-sectional visualizations of the retinal tissues without any invasive procedure, commonly used in the analysis of retinal diseases such as diabetic retinopathy or retinal detachment. Early identification of the epiretinal membrane (ERM) facilitates ERM surgical removal operations. Moreover, presence of the ERM is linked to other retinal pathologies, such as macular edemas, being among the main causes of vision loss. In this work, we propose an automatic method for the characterization and visualization of the ERM’s presence using 3D OCT volumes. A set of 452 features is refined using the Spatial Uniform ReliefF (SURF) selection strategy to identify the most relevant ones. Afterwards, a set of representative classifiers is trained, selecting the most proficient model, generating a 2D reconstruction of the ERM’s presence. Finally, a post-processing stage using a set of morphological operators is performed to improve the quality of the generated maps. To verify the proposed methodology, we used 20 3D OCT volumes, both with and without the ERM’s presence, totalling 2428 OCT images manually labeled by a specialist. The most optimal classifier in the training stage achieved a mean accuracy of 91.9%. Regarding the post-processing stage, mean specificity values of 91.9% and 99.0% were obtained from volumes with and without the ERM’s presence, respectively., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Moreover, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Identification and Representation of the Cornea–Contact Lens Relationship Using AS-OCT Images

  • Cabaleiro, Pablo
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] The clinical study of the cornea–contact lens relationship is widely used in the process of adaptation of the scleral contact lens (SCL) to the ocular morphology of patients. In that sense, the measurement of the adjustment between the SCL and the cornea can be used to study the comfort or potential damage that the lens may produce in the eye. The current analysis procedure implies the manual inspection of optical coherence tomography of the anterior segment images (AS-OCT) by the clinical experts. This process presents several limitations such as the inability to obtain complex metrics, the inaccuracies of the manual measurements or the requirement of a time-consuming process by the expert in a tedious process, among others. This work proposes a fully-automatic methodology for the extraction of the areas of interest in the study of the cornea–contact lens relationship and the measurement of representative metrics that allow the clinicians to measure quantitatively the adjustment between the lens and the eye. In particular, three distance metrics are herein proposed: Vertical, normal to the tangent of the region of interest and by the nearest point. Moreover, the images are classified to characterize the analysis as belonging to the central cornea, peripheral cornea, limbus or sclera (regions where the inner layer of the lens has already joined the cornea). Finally, the methodology graphically presents the results of the identified segmentations using an intuitive visualization that facilitates the analysis and diagnosis of the patients by the clinical experts., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Moreover, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431C 2016-047.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Automatic Identification and Characterization of the Epiretinal Membrane in OCT Images

  • Baamonde, Sergio
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Ortega Hortas, Marcos
[Abstract] Optical coherence tomography (OCT) is a medical image modality that is used to capture, non-invasively, high-resolution cross-sectional images of the retinal tissue. These images constitute a suitable scenario for the diagnosis of relevant eye diseases like the vitreomacular traction or the diabetic retinopathy. The identification of the epiretinal membrane (ERM) is a relevant issue as its presence constitutes a symptom of diseases like the macular edema, deteriorating the vision quality of the patients. This work presents an automatic methodology for the identification of the ERM presence in OCT scans. Initially, a complete and heterogeneous set of features was defined to capture the properties of the ERM in the OCT scans. Selected features went through a feature selection process to further improve the method efficiency. Additionally, representative classifiers were trained and tested to measure the suitability of the proposed approach. The method was tested with a dataset of 285 OCT scans labeled by a specialist. In particular, 3,600 samples were equally extracted from the dataset, representing zones with and without ERM presence. Different experiments were conducted to reach the most suitable approach. Finally, selected classifiers were trained and compared using different metrics, providing in the best configuration an accuracy of 89.35%., Ministerio de Economía, Industria y Competitividad, Gobierno de España (DPI2015-69948-R); Consellería de Cultura, Educación e Ordenación Universitaria, Xunta de Galicia (ED431C 2016-047, ED431G/01); Instituto de Salud Carlos III (ISCIII) (DTS18/00136)., Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED431G/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Enhanced visualization of the retinal vasculature using depth information in OCT

  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Charlón, Pablo
  • Barreira, Noelia
  • Ortega Hortas, Marcos
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s11517-017-1660-8, [Abstract]: Retinal vessel tree extraction is a crucial step for analyzing the microcirculation, a frequently needed process in the study of relevant diseases. To date, this has normally been done by using 2D image capture paradigms, offering a restricted visualization of the real layout of the retinal vasculature. In this work, we propose a new approach that automatically segments and reconstructs the 3D retinal vessel tree by combining near-infrared reflectance retinography information with Optical Coherence Tomography (OCT) sections. Our proposal identifies the vessels, estimates their calibers, and obtains the depth at all the positions of the entire vessel tree, thereby enabling the reconstruction of the 3D layout of the complete arteriovenous tree for subsequent analysis. The method was tested using 991 OCT images combined with their corresponding near-infrared reflectance retinography. The different stages of the methodology were validated using the opinion of an expert as a reference. The tests offered accurate results, showing coherent reconstructions of the 3D vasculature that can be analyzed in the diagnosis of relevant diseases affecting the retinal microcirculation, such as hypertension or diabetes, among others., This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the PI14/02161 and the DTS15/00153 research projects and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016-2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Intraretinal Fluid Pattern Characterization in Optical Coherence Tomography Images

  • Moura, Joaquim de
  • Vidal, Plácido
  • Novo Buján, Jorge
  • Rouco, José
  • Penedo, Manuel
  • Ortega Hortas, Marcos
[Abstract] Optical Coherence Tomography (OCT) has become a relevant image modality in the ophthalmological clinical practice, as it offers a detailed representation of the eye fundus. This medical imaging modality is currently one of the main means of identification and characterization of intraretinal cystoid regions, a crucial task in the diagnosis of exudative macular disease or macular edema, among the main causes of blindness in developed countries. This work presents an exhaustive analysis of intensity and texture-based descriptors for its identification and classification, using a complete set of 510 texture features, three state-of-the-art feature selection strategies, and seven representative classifier strategies. The methodology validation and the analysis were performed using an image dataset of 83 OCT scans. From these images, 1609 samples were extracted from both cystoid and non-cystoid regions. The different tested configurations provided satisfactory results, reaching a mean cross-validation test accuracy of 92.69%. The most promising feature categories identified for the issue were the Gabor filters, the Histogram of Oriented Gradients (HOG), the Gray-Level Run-Length matrix (GLRL), and the Laws’ texture filters (LAWS), being consistently and considerably selected along all feature selector algorithms in the top positions of different relevance rankings., Xunta de Galicia; ED431C 2016-047, Xunta de Galicia; ED481A-2019/196, This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research projects and by the Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF) and the Xunta de Galicia, Grupos de Referencia Competitiva, Ref. ED431C 2016-047 and the Xunta de Galicia predoctoral grant contract ref. ED481A-2019/196.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Robust segmentation of retinal layers in optical coherence tomography images based on a multistage active contour model

  • González-López, Ana
  • Moura, Joaquim de
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
  • Penedo, Manuel
[Abstract]: Optical Coherence Tomography (OCT) constitutes an imaging technique that is increasing its popularity in the ophthalmology field, since it offers a more complete set of information about the main retinal structures. Hence, it offers detailed information about the eye fundus morphology, allowing the identification of many intraretinal pathological signs. For that reason, over the recent years, Computer-Aided Diagnosis (CAD) systems have spread to work with this image modality and analyze its information. A crucial step for the analysis of the retinal tissues implies the identification and delimitation of the different retinal layers. In this context, we present in this work a fully automatic method for the identification of the main retinal layers that delimits the retinal region. Thus, an active contour-based model was completely adapted and optimized to segment these main retinal boundaries. This fully automatic method uses the information of the horizontal placement of these retinal layers and their relative location over the analyzed images to restrict the search space, considering the presence of shadows that are normally generated by pathological or non-pathological artifacts. The validation process was done using the groundtruth of an expert ophthalmologist analyzing healthy as well as unhealthy patients with different degrees of diabetic retinopathy (without macular edema, with macular edema and with lesions in the photoreceptor layers). Quantitative results are in line with the state of the art of this domain, providing accurate segmentations of the retinal layers even when significative pathological alterations are present in the eye fundus. Therefore, the proposed method is robust enough to be used in complex environments, making it feasible for the ophthalmologists in their routine clinical practice., This work was supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union (PI14/02161 and DTS15/00153), the Ministerio de Economía y Competitividad, Government of Spain (DPI2015-69948-R), the Xunta de Galicia, Centro singular de investigacíon de Galicia accreditation 2016–2019 (ED431G/01), and Grupos de Referencia Competitiva (ED431C 2016-047)., Xunta de Galicia; ED431G/01, Xunta de Galicia; ED431C 2016-047
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Learning the Retinal Anatomy From Scarce Annotated Data Using Self-Supervised Multimodal Reconstruction

  • Hervella, Álvaro S.
  • Rouco, José
  • Novo Buján, Jorge
  • Ortega Hortas, Marcos
[Abstract] Deep learning is becoming the reference paradigm for approaching many computer vision problems. Nevertheless, the training of deep neural networks typically requires a significantly large amount of annotated data, which is not always available. A proven approach to alleviate the scarcity of annotated data is transfer learning. However, in practice, the use of this technique typically relies on the availability of additional annotations, either from the same or natural domain. We propose a novel alternative that allows to apply transfer learning from unlabelled data of the same domain, which consists in the use of a multimodal reconstruction task. A neural network trained to generate one image modality from another must learn relevant patterns from the images to successfully solve the task. These learned patterns can then be used to solve additional tasks in the same domain, reducing the necessity of a large amount of annotated data. In this work, we apply the described idea to the localization and segmentation of the most important anatomical structures of the eye fundus in retinography. The objective is to reduce the amount of annotated data that is required to solve the different tasks using deep neural networks. For that purpose, a neural network is pre-trained using the self-supervised multimodal reconstruction of fluorescein angiography from retinography. Then, the network is fine-tuned on the different target tasks performed on the retinography. The obtained results demonstrate that the proposed self-supervised transfer learning strategy leads to state-of-the-art performance in all the studied tasks with a significant reduction of the required annotations., This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Economía, Industria y Competitividad, Government of Spain, through the DPI2015-69948-R research project. The authors of this work also receive financial support from the ERDF and Xunta de Galicia (Spain) through Grupo de Referencia Competitiva, ref. ED431C 2016-047, and from the European Social Fund (ESF) of the EU and Xunta de Galicia (Spain) through the predoctoral grant contract ref. ED481A-2017/328. CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia (Spain) , through the ERDF (80%) and Secretaría Xeral de Universidades (20%), Xunta de Galicia; ED431C 2016-047, Xunta de Galicia ; ED481A-2017/328, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Joint Diabetic Macular Edema Segmentation and Characterization in OCT Images

  • Moura, Joaquim de
  • Samagaio, Gabriela
  • Novo Buján, Jorge
  • Almuina Varela, Pablo
  • Fernández, María Isabel
  • Ortega Hortas, Marcos
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10278-020-00360-y, [Abstract]: The automatic identification and segmentation of edemas associated with diabetic macular edema (DME) constitutes a crucial ophthalmological issue as they provide useful information for the evaluation of the disease severity. According to clinical knowledge, the DME disorder can be categorized into three main pathological types: serous retinal detachment (SRD), cystoid macular edema (CME), and diffuse retinal thickening (DRT). The implementation of computational systems for their automatic extraction and characterization may help the clinicians in their daily clinical practice, adjusting the diagnosis and therapies and consequently the life quality of the patients. In this context, this paper proposes a fully automatic system for the identification, segmentation and characterization of the three ME types using optical coherence tomography (OCT) images. In the case of SRD and CME edemas, different approaches were implemented adapting graph cuts and active contours for their identification and precise delimitation. In the case of the DRT edemas, given their fuzzy regional appearance that requires a complex extraction process, an exhaustive analysis using a learning strategy was designed, exploiting intensity, texture, and clinical-based information. The different steps of this methodology were validated with a heterogeneous set of 262 OCT images, using the manual labeling provided by an expert clinician. In general terms, the system provided satisfactory results, reaching Dice coefficient scores of 0.8768, 0.7475, and 0.8913 for the segmentation of SRD, CME, and DRT edemas, respectively., This work is supported by the Instituto de Salud Carlos III, Government of Spain, and FEDER funds through the DTS18/00136 research project and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro de Investigación del Sistema Universitário de Galicia, Ref. ED431G 2019/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2016-047