Pasar al contenido principal

TECNICAS DE APRENDIZAJE PARA RESOLVER LA RECONSTRUCCION Y REGISTRO DEFORMABLES APLICADOS A IMAGENES DE LAPAROSCOPIA

PID2020-115995RB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE ALCALA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 11
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A hybrid cascade-parallel discriminative-generative model for pipeline integrity threat detection in a smart fiber optic surveillance system

  • Tejedor, Javier
  • Macias-Guarasa, Javier
  • Martins, Hugo F.
  • Martín-López, Sonia
  • González-Herráez, Miguel
25 pags., 10 figs., 8 tabs., This paper presents an advanced system for the continuous monitoring of potential threats in a long gas pipeline. For signal acquisition, phase-sensitive optical time domain reflectometry (ϕ-OTDR) technology is employed. Then, pattern recognition strategies are incorporated, which are aimed at identifying threats. To do so, the system integrates a random forest-based approach on top of a multiple-layer perceptron (MLP)-based discriminative approach for feature extraction within a parallel Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM) for pattern classification in a hybrid approach. Subsequently, a system combination strategy, which makes use of the decisions carried out by this hybrid approach, is also presented. This strategy is based on the so-called majority voting technique, which makes use of the output of the classification step from the different feature extraction strategies and the different number of states in the GMM-HMM-based classification. The system is tested on two tasks: (1) Identification of machine and activity, and (2) detection of threats for the pipeline. Compared with our previous system, the results of this advanced system show that the hybrid feature extraction and pattern classification achieve statistically significant improvements for both tasks (i.e., 5% of relative improvement for the machine and activity identification task, 1% of relative improvement in the threat detection rate, and 15% of relative improvement in the false alarm rate for the threat detection task)., This work was partially supported by the Ministry of Science, Innovation and Universities of Spain (grant number RTI2018-095324-B-I00).This work was also funded by the Spanish Ministry of Economy and Competitiveness with projects ARTEMISA (TIN2016-80939-R) and HEIMDAL-UAH (TIN201675982-C2-1-R), by the Spanish Ministry of Science and Innovation MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR program, with projects PSI (PLEC2021-007875),ATHENA (PID2020-115995RB-I00) and EYEFUL (PID2020-113118RB-C31), and by CAM and UAH under projects ARGOS+ (PIUAH21/IA-016) and CONDORDIA (CM/JIN/2021-015). The authors gratefully acknowledge the computer resources at Artemisa, funded by the European Union ERDF and Comunitat Valenciana as well as the technical support provided by the Instituto de Fisica Corpuscular, IFIC (CSIC-UV). The authors thank Sira E. Palazuelos-Cagigas for her participation in the writing and technical editing of the manuscript., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Revealing the structural complexity of ETS-10 using 4D-STEM & electron ptychography

  • Li, Daiyuan
  • Kayani, Sara
  • Sara
  • Dong, Zhuoya
  • Zhang, Qing
  • Cobreces, Santiago
  • Pizarro, Daniel
  • Mayoral, Álvaro
Data will be made available on request., Atomic-level structural elucidation of zeolites remains challenging, particularly due to their sensitivity to the electron beam, as in the case of ETS-10, which features a unique 12-membered ring titanosilicate framework with linear Ti–O–Ti chains. In this study, we demonstrate the use of four-dimensional scanning transmission electron microscopy (4D-STEM) combined with electron ptychography to image Eu-exchanged ETS-10 (Eu-ETS-10) at sub-angstrom resolution. A homemade ptychographic reconstruction algorithm based on the extended ptychographical iterative engine (ePIE) was developed, enabling recovery of high-fidelity phase contrast images. The reconstructed images reveal not only all T-sites, including Si and Ti atoms, but also light elements such as oxygen and extraframework Eu3+ cations. Surface terminations and stacking faults were clearly resolved, allowing identification of the ABA and ABC polymorphs and their local transformations along the three dimensions through multislice reconstruction. These results validate ptychography as a powerful technique for atomic-scale analysis of fragile zeolitic materials offering unique insights into the structural complexity of ETS-10., Authors acknowledge the Spanish Ministry of Science, Innovation and Universities. MICIU/AEI/10.13039/501100011033 (RYC2018-024561-I; PID2022-138481NB-I00, Grant CEX2023-001286-S, ATHENA PID2020-115995RB-I00, METAMORPH PID2023-151295OB-I00 and The EU NextGenerationEU/PRTR: CNS2023-144346). Authors also acknowledge the CℏEM, School of Physical Science and Technology, ShanghaiTech University (#EM02161943); Shanghai Science and Technology Plan (21DZ2260400), the Spanish National Research Council (CSIC) through the i-COOP program (COOPA20470) and the regional government of Aragon (E13_23R). This research work was also funded through Momentum CSIC Programme: Develop Your Digital Talent (MMT24-INMA-01)., With funding from the Spanish government through the "Severo Ochoa Centre of Excellence" accreditation (CEX2023-001286-S)., Peer reviewed
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Revealing the structural complexity of ETS-10 using 4D-STEM & electron ptychography

  • Daiyuan, Li
  • Kayani, Sara
  • Dong, Zhuoya
  • Zhang, Qing
  • Cobreces, Santiago
  • Pizarro, Daniel
  • Mayoral, Alvaro
Atomic-level structural elucidation of zeolites remains challenging, particularly due to their sensitivity to the electron beam, as in the case of ETS-10, which features a unique 12-membered ring titanosilicate framework with linear Ti–O–Ti chains. In this study, we demonstrate the use of four-dimensional scanning transmission electron microscopy (4D-STEM) combined with electron ptychography to image Eu-exchanged ETS-10 (Eu-ETS-10) at sub-angstrom resolution. A homemade ptychographic reconstruction algorithm based on the extended ptychographical iterative engine (ePIE) was developed, enabling recovery of high-fidelity phase contrast images. The reconstructed images reveal not only all T-sites, including Si and Ti atoms, but also light elements such as oxygen and extraframework Eu3+ cations. Surface terminations and stacking faults were clearly resolved, allowing identification of the ABA and ABC polymorphs and their local transformations along the three dimensions through multislice reconstruction. These results validate ptychography as a powerful technique for atomic-scale analysis of fragile zeolitic materials offering unique insights into the structural complexity of ETS-10.
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

A proposal for automatic evaluation of human functional limitations in activities of daily living

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Melino Carrero, Alessandro
  • Murillo Teruel, Marina
  • Calvo Del Castillo, Pablo
  • Fuente Lasa, Santiago de la
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Obeso Benítez, Paula
  • Martínez Piédrola, Rosa María
  • Pérez de Heredia Torres, Marta
This work presents a novel proposal aimed at automating the assessment of human functional limitations. It represents an interdisciplinary effort to develop and clinically evaluate an automated system for objective functional assessment, and is being carried out within the EYEFUL research project. Functional evaluation is a complex task that requires a holistic approach, considering various components like cognition, motor skills, and executive functions. The EYEFUL project has created an intelligent space within a fully equipped apartment, which includes the deployment of advanced technology (cameras, microphones, and wearable devices), to capture data from subjects undergoing assessment. In this paper, we provide an extensive overview of the project's architecture, including the selection of Activities of Daily Living (ADLs), the recruitment of subjects, the validation methodology, and the experimental setup. We describe the specialized apartment and sensor hardware deployed for data collection, along with the initial machine learning systems for data analysis. Additionally, we analyze the existing state-of-the-art research in automatic functional performance evaluation and present our proposal. This encompasses ADL selection, database design, recording considerations, and an overview of technological modules to be implemented. We also discuss the current status of select modules, including quantitative and qualitative results and references to ongoing work. In conclusion, the EYEFUL project is pioneering automated functional assessment, integrating advanced technology and interdisciplinary collaboration. It aims to provide healthcare professionals with accurate, comprehensive, and clinically validated evaluations of human functionality during ADLs, addressing the complex nature of functional limitations., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Towards dense people detection with deep learning and depth images

  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Martín López, Roberto|||0000-0002-5172-9403
  • Luna Vázquez, Carlos Andrés
This paper describes a novel DNN-based system, named PD3net, that detects multiple people from a single depth image, in real time. The proposed neural network processes a depth image and outputs a likelihood map in image coordinates, where each detection corresponds to a Gaussian-shaped local distribution, centered at each person?s head. This likelihood map encodes both the number of detected people as well as their position in the image, from which the 3D position can be computed. The proposed DNN includes spatially separated convolutions to increase performance, and runs in real-time with low budget GPUs. We use synthetic data for initially training the network, followed by fine tuning with a small amount of real data. This allows adapting the network to different scenarios without needing large and manually labeled image datasets. Due to that, the people detection system presented in this paper has numerous potential applications in different fields, such as capacity control, automatic video-surveillance, people or groups behavior analysis, healthcare or monitoring and assistance of elderly people in ambient assisted living environments. In addition, the use of depth information does not allow recognizing the identity of people in the scene, thus enabling their detection while preserving their privacy. The proposed DNN has been experimentally evaluated and compared with other state-of-the-art approaches, including both classical and DNN-based solutions, under a wide range of experimental conditions. The achieved results allows concluding that the proposed architecture and the training strategy are effective, and the network generalize to work with scenes different from those used during training. We also demonstrate that our proposal outperforms existing methods and can accurately detect people in scenes with significant occlusions., Ministerio de Economía y Competitividad, Universidad de Alcalá, Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Audiovisual tracking of multiple speakers in smart spaces

  • Sanabria Macías, Frank
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
This paper presents GAVT, a highly accurate audiovisual 3D tracking system based on particle filters and a probabilistic framework, employing a single camera and a microphone array. Our first contribution is a complex visual appearance model that accurately locates the speaker?s mouth. It transforms a Viola & Jones face detector classifier kernel into a likelihood estimator, leveraging knowledge from multiple classifiers trained for different face poses. Additionally, we propose a mechanism to handle occlusions based on the new likelihood?s dispersion. The audio localization proposal utilizes a probabilistic steered response power, representing cross-correlation functions as Gaussian mixture models. Moreover, to prevent tracker interference, we introduce a novel mechanism for associating Gaussians with speakers. The evaluation is carried out using the AV16.3 and CAV3D databases for Single- and Multiple-Object Tracking tasks (SOT and MOT, respectively). GAVT significantly improves the localization performance over audio-only and video- only modalities, with up to 50.3% average relative improvement in 3D when compared with the video-only modality. When compared to the state of the art, our audiovisual system achieves up to 69.7% average relative improvement for the SOT and MOT tasks in the AV16.3 dataset (2D comparison), and up to 18.1% average relative improvement in the MOT task for the CAV3D dataset (3D comparison)., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Using Perspective-n-Point Algorithms for a Local Positioning System Based on LEDs and a QADA Receiver

  • Aparicio Esteve, Elena|||0000-0001-7886-312X
  • Ureña Ureña, Jesús|||0000-0003-1408-6039
  • Hernández Alonso, Álvaro|||0000-0001-9308-8133
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Moltó Orozco, David|||0000-0002-2790-3758
The research interest on location-based services has increased during the last years ever since 3D centimetre accuracy inside intelligent environments could be confronted with. This work proposes an indoor local positioning system based on LED lighting, transmitted from a set of beacons to a receiver. The receiver is based on a quadrant photodiode angular diversity aperture (QADA) plus an aperture placed over it. This configuration can be modelled as a perspective camera, where the image position of the transmitters can be used to recover the receiver?s 3D pose. This process is known as the perspective-n-point (PnP) problem, which is well known in computer vision and photogrammetry. This work investigates the use of different state-of-the-art PnP algorithms to localize the receiver in a large space of 2 2m2 based on four co-planar transmitters and with a distance from transmitters to receiver up to 3.4 m. Encoding techniques are used to permit the simultaneous emission of all the transmitted signals and their processing in the receiver. In addition, correlation techniques (match filtering) are used to determine the image points projected from each emitter on the QADA. This work uses Monte Carlo simulations to characterize the absolute errors for a grid of test points under noisy measurements, as well as the robustness of the system when varying the 3D location of one transmitter. The IPPE algorithm obtained the best performance in this configuration. The proposal has also been experimentally evaluated in a real setup. The estimation of the receiver's position at three particular points for roll angles of the receiver of g ={0º, 120º, 210º and 300º} using the IPPE algorithm achieves average absolute errors and standard deviations of 4.33 cm, 3.51cm and 28.90 cm; and 1.84 cm, 1.17cm and 19.80cm in the coordinates x, y and z, respectively. These positioning results are in line with those obtained in previous work using triangulation techniques but with the addition that the complete pose of the receiver (x, y, z, a, b, g) is obtained in this proposal., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Label augmentation to improve generalization of deep learning semantic segmentation of laparoscopic images

  • Monasterio Expósito, Leticia
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
Training Deep Neural Networks to solve semantic segmentation is a challenging problem with small-size labeled datasets, leading to overfitting. This is especially problematic in medical images, and in particular, in laparoscopic surgery images. In this context, ground-truth segmentation labels are available only for a small set of images with few patients. Besides, inter-patient variability is very high in practice. Models trained for a specific setup and a set of patients usually performs poorly when deployed in a new environment. This work proposes a new training strategy that improves the generalization accuracy of current state-of-the-art semantic segmentation methods applied to laparoscopic images. Our approach is based on training a discriminator network, which learns to detect segmentation errors, producing a dense segmentation error map. Unlike in adversarial networks, we train the discriminator offline by synthetically altering ground- truth segmentation labels with simple morphological and geometric operations. We then use the discriminator to train a segmentation neural network, by minimizing the discriminator predicted error jointly with a standard segmentation loss. This strategy results in segmentation models that are significantly more accurate when tested in unseen images than those only relying on data augmentation. This technique is very suitable to boost the performance of any state-of-the-art segmentation network and can be combined with other data augmentation strategies. This paper evaluates and validates our proposal by training and testing common state-of-the-art segmentation models in publicly available semantic segmentation datasets, specialized in laparoscopic and endoscopic surgery. The results show that our methods are effective, obtaining a significant improvement in terms of segmentation accuracy, especially in challenging small-size datasets., Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Deep Shape-from-Template: Single-image quasi-isometric deformable registration and reconstruction

  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Collins, Toby
  • Bartoli, Adrien
Shape-from-Template (SfT) solves 3D vision from a single image and a deformable 3D object model, called a template. Concretely, SfT computes registration (the correspondence between the template and the image) and reconstruction (the depth in camera frame). It constrains the object deformation to quasi-isometry. Real-time and automatic SfT represents an open problem for complex objects and imaging conditions. We present four contributions to address core unmet challenges to realise SfT with a Deep Neural Network (DNN). First, we propose a novel DNN called DeepSfT, which encodes the template in its weights and hence copes with highly complex templates. Second, we propose a semi-supervised training procedure to exploit real data. This is a practical solution to overcome the render gap that occurs when training only with simulated data. Third, we propose a geometry adaptation module to deal with different cameras at training and inference. Fourth, we combine statistical learning with physics-based reasoning. DeepSfT runs automatically and in real-time and we show with numerous experiments and an ablation study that it consistently achieves a lower 3D error than previous work. It outperforms in generalisation and achieves great performance in terms of reconstruction and registration error with wide-baseline, occlusions, illumination changes, weak texture and blur., Agencia Estatal de Investigación, Ministerio de Universidades
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

A hybrid cascade-parallel discriminative-generative model for pipeline integrity threat detection in a smart fiber optic surveillance system

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents an advanced system for the continuous monitoring of potential threats in a long gas pipeline. For signal acquisition, phase-sensitive optical time domain reflectometry (phi-OTDR) technology is employed. Then, pattern recognition strategies are incorporated, which are aimed at identifying threats. To do so, the system integrates a random forest-based approach on top of a multiple-layer perceptron (MLP)-based discriminative approach for feature extraction within a parallel Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM) for pattern classification in a hybrid approach. Subsequently, a system combination strategy, which makes use of the decisions carried out by this hybrid approach, is also presented. This strategy is based on the so-called majority voting technique, which makes use of the output of the classification step from the different feature extraction strategies and the different number of states in the GMM-HMM-based classification. The system is tested on two tasks: (1) Identification of machine and activity, and (2) detection of threats for the pipeline. Compared with our previous system, the results of this advanced system show that the hybrid feature extraction and pattern classification achieve statistically significant improvements for both tasks (i.e., 5% of relative improvement for the machine and activity identification task, 1% of relative improvement in the threat detection rate, and 15% of relative improvement in the false alarm rate for the threat detection task)., Ministerio de Ciencia e Innovación, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Weakly-Supervised Deep Shape-from-Template

  • Luengo Sánchez, Sara|||0000-0003-3942-3804
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Bartoli, Adrien
We propose WS-DeepSfT, a novel deep learning-based approach to the Shape-from-Template (SfT) problem, which aims at reconstructing the 3D shape of a deformable object from a single RGB image and a template. WS-DeepSfT addresses the limitations of existing SfT techniques by combining a weakly-supervised deep neural network (DNN) for registration and a classical As-Rigid-As-Possible (ARAP) algorithm for 3D reconstruction. Unlike previous deep learning-based SfT methods, which require extensive synthetic data and depth sensors for training, WS-DeepSfT only requires regular RGB video of the deforming object and a segmentation mask to discriminate the object from the background. The registration model is trained without synthetic data, using videos where the object undergoes deformations, while ARAP does not require training and infers the 3D shape in real-time with minimal overhead. We show that WSDeepSfT outperforms the state-of-the-art, in both accuracy and robustness, without requiring depth sensors or synthetic data generation. WS-DeepSfT thus offers a robust, efficient, and scalable approach to SfT, bringing it closer to applications such as augmented reality., Ministerio de Ciencia e Innovación, Ministerio de Universidades