Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Cálculo de flujo óptico denso en colonoscopia mediante aprendizaje no supervisado, Dense optical flow estimation in colonoscopy images using an unsupervised learning approach

  • Gonzalo, Iván
  • Morlana, Javier
  • Martínez Montiel, José María
[Resumen] La colonoscopia es la técnica de referencia en la detección del cáncer colorrectal. Sin embargo, los métodos asistidos por ordenador no se usan mucho en estos procedimientos. Este trabajo se enmarca dentro del proyecto EndoMapper, que tiene como objetivo crear reconstrucciones del colon que puedan ser utilizadas para ayudar a los médicos o para llevar a cabo cirugía robotizada. La asociación de datos es un elemento clave en estos sistemas, realizando la asociación entre píxeles de la imagen para permitir posteriores reconstrucciones 3D. En este trabajo, evaluamos un método de estimación de flujo óptico denso sobre imágenes de colonoscopia, adaptándolo al dominio del colon mediante aprendizaje no supervisado. Diseñamos un conjunto de datos para training, validation y test a partir de las secuencias reales de colonoscopia del conjunto de datos de Endomapper. El modelo se ha re-entrenado obteniendo una versión adaptada al dominio del colon. La validación experimental muestra cómo el modelo entrenado puede estimar el flujo de manera robusta bajo cambios de iluminación. También muestra una capacidad excepcional para estimar el flujo entre imágenes de colonoscopia muy separadas con grandes rotaciones., [Abstract] Colonoscopy is the gold standard in colorectal cancer screening. However, computer-assisted interventional methods are not widely used in these procedures. The Endomapper project, in which this work is embedded, aims to create reconstructions of the colon that can be used to assist doctors or for robotic surgery. Data association is a key element in these systems, performing the association between image pixels to enable subsequent 3D reconstructions. In this work, we evaluated a dense optical flow method on colonoscopy images, adapting it to the colon domain by using unsupervised learning. We built a dataset for training, validation and test from the real colonoscopy sequences of the Endomapper dataset. The model has been re-trained obtaining a version adapted to the colon domain. Experimental validation shows how the trained model is able to estimate flow robustly under illumination changes. It also shows an exceptional ability to estimate flow between widely separated colonoscopy images with large rotations., Ministerio de Educación y Formación Profesional; 22CO1/006926, Ministerio de Ciencia e Innovación; PID2021-127685NB-I00, Gobierno de Aragón; DGA_T45-17R
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

DefSLAM: Tracking and Mapping of Deforming Scenes from Monocular Sequences

  • Lamarca, J.
  • Parashar, S.
  • Bartoli, A.
  • Martínez Montiel, J.M.
Monocular simultaneous localization and mapping (SLAM) algorithms perform robustly when observing rigid scenes; however, they fail when the observed scene deforms, for example, in medical endoscopy applications. In this article, we present DefSLAM, the first monocular SLAM capable of operating in deforming scenes in real time. Our approach intertwines Shape-from-Template (SfT) and Non-Rigid Structure-from-Motion (NRSfM) techniques to deal with the exploratory sequences typical of SLAM. A deformation tracking thread recovers the pose of the camera and the deformation of the observed map, at frame rate, by means of SfT processing a template that models the scene shape-at-rest. A deformation mapping thread runs in parallel with the tracking to update the template, at keyframe rate, by means of an isometric NRSfM processing a batch of full perspective keyframes. In our experiments, DefSLAM processes close-up sequences of deforming scenes, both in a laboratory-controlled experiment and in medical endoscopy sequences, producing accurate 3-D models of the scene with respect to the moving camera.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Contribución de congreso (ConferenceOutput)

Photometric single-view dense 3D reconstruction in endoscopy

  • Martínez Batlle, V.
  • Martínez Montiel, J. M.
  • Tardos, J. D.
Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we exploit the controlled lighting in colonoscopy to achieve the first in-vivo 3D reconstruction of the human colon using photometric stereo on a calibrated monocular endoscope. Our method works in a real medical environment, providing both a suitable in-place calibration procedure and a depth estimation technique adapted to the colon's tubular geometry. We validate our method on simulated colonoscopies, obtaining a mean error of 7% on depth estimation, which is below 3 mm on average. Our qualitative results on the EndoMapper dataset show that the method is able to correctly estimate the colon shape in real human colonoscopies, paving the ground for truescale monocular SLAM in endoscopy.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Endomapper dataset of complete calibrated endoscopy procedures

  • Azagra, Pablo
  • Sostres, Carlos
  • Ferrández, Ángel
  • Riazuelo, Luis
  • Tomasini, Clara
  • Barbed, O. León
  • Morlana, Javier
  • Recasens, David
  • Batlle Martínez, Víctor
  • Gómez-Rodríguez, Juan J.
  • Elvira, Richard
  • López, Julia
  • Oriol, Cristina
  • Civera, Javier
  • Tardós, Juan D.
  • Murillo, Ana C.
  • Lanas, Angel
  • Montiel, José M. M.
Computer-assisted systems are becoming broadly used in medicine. In endoscopy, most research focuses on the automatic detection of polyps or other pathologies, but localization and navigation of the endoscope are completely performed manually by physicians. To broaden this research and bring spatial Artificial Intelligence to endoscopies, data from complete procedures is needed. This paper introduces the Endomapper dataset, the first collection of complete endoscopy sequences acquired during regular medical practice, making secondary use of medical data. Its main purpose is to facilitate the development and evaluation of Visual Simultaneous Localization and Mapping (VSLAM) methods in real endoscopy data. The dataset contains more than 24 hours of video. It is the first endoscopic dataset that includes endoscope calibration as well as the original calibration videos. Meta-data and annotations associated with the dataset vary from the anatomical landmarks, procedure labeling, segmentations, reconstructions, simulated sequences with ground truth and same patient procedures. The software used in this paper is publicly available.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Contribución de congreso (ConferenceOutput)

LightDepth: Single-view depth self-supervision from illumination decline

  • Rodríguez-Puigvert, Javier
  • Batlle, Víctor M.
  • Martínez Montiel, J.M.
  • Martinez-Cantin, Ruben
  • Fua, Pascal
  • Tardós, Juan D.
  • Civera, Javier
Single-view depth estimation can be remarkably effective if there is enough ground-truth depth data for supervised training. However, there are scenarios, especially in medicine in the case of endoscopies, where such data cannot be obtained. In such cases, multi-view self-supervision and synthetic-to-real transfer serve as alternative approaches, however, with a considerable performance reduction in comparison to supervised case. Instead, we propose a single-view self-supervised method that achieves a performance similar to the supervised case. In some medical devices, such as endoscopes, the camera and light sources are co-located at a small distance from the target surfaces. Thus, we can exploit that, for any given albedo and surface orientation, pixel brightness is inversely proportional to the square of the distance to the surface, providing a strong single-view self-supervisory signal. In our experiments, our self-supervised models deliver accuracies comparable to those of fully supervised ones, while being applicable without depth ground-truth data.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

SimCol3D — 3D reconstruction during colonoscopy challenge

  • Rau, Anita
  • Bano, Sophia
  • Jin, Yueming
  • Azagra, Pablo
  • Morlana, Javier
  • Kader, Rawen
  • Sanderson, Edward
  • Matuszewski, Bogdan J.
  • Lee, Jae Young
  • Lee, Dong-Jae
  • Posner, Erez
  • Frank, Netanel
  • Elangovan, Varshini
  • Raviteja, Sista
  • Li, Zhengwen
  • Liu, Jiquan
  • Lalithkumar, Seenivasan
  • Islam, Mobarakol
  • Ren, Hongliang
  • Lovat, Laurence B.
  • Montiel, José M. M.
  • Stoyanov, Danail
Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could enhance the identification of unscreened colon tissue and serve as a training platform. However, reconstructing the colon from video footage remains difficult. Learning-based approaches hold promise as robust alternatives, but necessitate extensive datasets. Establishing a benchmark dataset, the 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. The challenge was hosted as part of MICCAI 2022 in Singapore. Six teams from around the world and representatives from academia and industry participated in the three sub-challenges: synthetic depth prediction, synthetic pose prediction, and real pose prediction. This paper describes the challenge, the submitted methods, and their results. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

NR-SLAM: Non-Rigid Monocular SLAM

  • Gómez Rodríguez, Juan J.
  • Martínez Montiel, José M.
  • Tardós, Juan D.
In this paper we present NR-SLAM, a novel non-rigid monocular SLAM system founded on the combination of a Dynamic Deformation Graph with a Visco-Elastic deformation model. The former enables our system to represent the dynamics of the deforming environment as the camera explores, while the later allows us to model general deformations in a simple way. The presented system is able to automatically initialize and extend a map modeled by a sparse point cloud in deforming environments, that is refined with a sliding-window Deformable Bundle Adjustment. This map serves as base for the estimation of the camera motion and deformation and enables us to represent arbitrary surface topologies, overcoming the limitations of previous methods. To assess the performance of our system in challenging deforming scenarios, we evaluate it in several representative medical datasets. In our experiments, NR-SLAM outperforms previous deformable SLAM systems, achieving millimeter reconstruction accuracy and bringing automated medical intervention closer. For the benefit of the community, we make the source code public.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Automated vision-based assistance tools in bronchoscopy: stenosis severity estimation

  • Tomasini, Clara
  • Rodriguez-Puigvert, Javier
  • Polanco, Dinora
  • Viñuales, Manuel
  • Riazuelo, Luis
  • Murillo, Ana C.
Purpose Subglottic stenosis refers to the narrowing of the subglottis, the airway between the vocal cords and the trachea. Its severity is typically evaluated by estimating the percentage of obstructed airway. This estimation can be obtained from CT data or through visual inspection by experts exploring the region. However, visual inspections are inherently subjective, leading to less consistent and robust diagnoses. No public methods or datasets are currently available for automated evaluation of this condition from bronchoscopy video. Methods We propose a pipeline for automated subglottic stenosis severity estimation during the bronchoscopy exploration, without requiring the physician to traverse the stenosed region. Our approach exploits the physical effect of illumination decline in endoscopy to segment and track the lumen and obtain a 3D model of the airway. This 3D model is obtained from a single frame and is used to measure the airway narrowing. Results Our pipeline is the first to enable automated and robust subglottic stenosis severity measurement using bronchoscopy images. The results show consistency with ground-truth estimations from CT scans and expert estimations and reliable repeatability across multiple estimations on the same patient. Our evaluation is performed on our new Subglottic Stenosis Dataset of real bronchoscopy procedures data. Conclusion We demonstrate how to automate evaluation of subglottic stenosis severity using only bronchoscopy. Our approach can assist with and shorten diagnosis and monitoring procedures, with automated and repeatable estimations and less exploration time, and save radiation exposure to patients as no CT is required. Additionally, we release the first public benchmark for subglottic stenosis severity assessment.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Automated overview of complete endoscopies with unsupervised learned descriptors

  • Barbed, O. León
  • Azagra, Pablo
  • Plo, Juan
  • Murillo, Ana C.
Purpose We aim to automate the initial analysis of complete endoscopy videos, identifying the sparse relevant content. This facilitates long procedure recording understanding, reduces the clinicians’ review time, and facilitates downstream tasks such as video summarization, event detection, and 3D reconstruction. Methods Our approach extracts endoscopic video frame representations with a learned embedding model. These descriptors are clustered to find visual patterns in the procedure, identifying key scene types (surgery, clear visibility frames, etc.) and enabling segmentation into informative and non-informative video parts. Results Evaluation on complete colonoscopy videos presents good performance identifying surgery segments and different visibility conditions. The method produces structured overviews that separate useful segments from irrelevant ones. We illustrate its suitability and benefits as preprocessing for other downstream tasks, such as 3D reconstruction or video summarization. Conclusion Our approach enables automated endoscopy overview generation, helping the clinicians focus on the relevant video content such as good visibility sections and surgery actions. The presented work facilitates faster recording reviewing for clinicians and effective video preprocessing for downstream tasks.