Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 20
Encontrada(s) 1 página(s)

Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Capítulo o parte de un libro (BookPart)

Single-Shot Transient Imaging Via Compressed Time-Of-Flight Imaging And Dictionary Learning

  • Fayyaz Shahandashti, Peyman
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
  • García-Lesta, Manuel
  • Heredia Conde, Miguel
In this work, we propose a single-shot transient imaging framework that combines sparsity-based signal modeling with compressive frequency-domain sampling. The temporal response function of a scene encodes rich information about depth and light transport, and its accurate reconstruction is critical for various imaging applications. To enable transient recovery from a limited number of measurements, we exploit learned sparse representations in an optimized dictionary basis. We compare multiple sampling strategies in the frequency domain and show that both transient profiles and depth maps can be reconstructed under highly compressed acquisition. Notably, we achieve full transient reconstruction using only 16 modulation frequencies, based on real correlation functions, enabling practical singleshot acquisition through spatial frequency multiplexing
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

Pseudo-Passive Time-of-Flight Imaging: Simultaneous Illumination, Communication, and 3D Sensing

  • Ahmed, Faisal
  • López Martínez, Paula
  • Kerstein, Thomas
  • Heredia Conde, Miguel
  • Buxbaum, Bernd
The 3D time-of-flight (ToF) cameras have recently received a lot of attention due to their wide range of applications. Despite remarkable advancements in ToF imaging, state-of-the-art ToF cameras are still afflicted by the power hungriness of their illumination sources. To tackle this problem, we exploited existing lighting infrastructure, which ensures the ubiquitous presence of modulated light sources in indoor spaces that serve as opportunity illuminators. We explored the bistatic geometry for passive imaging using the pulse-based ToF approach. Our work is inspired by the recently introduced visible light communication (VLC) or light-fidelity (Li-Fi) infrastructure. VLC allows the infrastructure to provide indoor simultaneous illumination, communication, and sensing (SICS). To this end, we designed a bistatic geometry for the purpose of attaining passive 3D imaging. Such capabilities are achieved by exploiting the pulse shape of the autocorrelation function of real optical signals generated by VLC/Li-Fi modules (e.g., OpenVLC and LiFiMAX). We demonstrated passive imaging by means of matched filtering. In this work, we also studied different sampling strategies in the time-shift domain, including uniform, random, and sparse rulers, which is another step forward toward preserving high depth accuracy with a minimal number of measurements. The proposed methodology achieved successful depth reconstruction with negligible root-mean-square error (RMSE) for the low signal-to-noise ratio (SNR) of the measurements. Parametric models, such as Gaussian and sum of sines, are used to characterize the cross correlation functions and allow for robust parametric depth retrieval from a few measurements. Moreover, we attained a 20-mm worst case error for a target at 25 cm. The experiment proved that the bistatic passive depth reconstruction is feasible.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

Global shutter CMOS vision sensors and event cameras for on‐chip dynamic information

  • Jaklin, Marko
  • García Lesta, Daniel
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
The on-chip extraction of dynamic information from a scene can be addressed with either frame-based CMOS vision, also called smart image sensors, or dynamic vision sensors, also known as event cameras. When implemented with a pinned photodiode (PPD) as a 4-transistor active pixel sensor (4T-APS), the former brings about the benefits of low temporal noise and dark current but without high dynamic range (HDR). The latter comes with the benefits of HDR and a fast event detection rate with low power consumption. The drawback is the background activity noise, which leads to additional hardware or algorithms to keep it low. This paperanalyses the mismatch and noise of a global shutter 4T-APS implementation with local HDR through an overflow capacitor and correlated double sampling (CDS) to provide low noise events through frame differencing. The aim is to narrow the gap with dynamic vision sensors in terms of event rate and dynamic range. We show that our solution would be competitive with event cameras in scenarios with slow moving objects and a relatively wide dynamic range (85 dB).
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

Low-cost mobile mapping system solution for traffic sign segmentation using Azure Kinect

  • Qiu, Zhouyan
  • Martínez Sánchez, Joaquín
  • Brea Sánchez, Víctor Manuel
  • López Martínez, Paula
  • Arias, Pedro
The mobile mapping system (MMS) could become the foundation of digital twins and 3D modeling, and is widely applicable in a variety of fields, such as infrastructure management, intelligent transportation systems, and smart cities. However, data collected by MMS is extensive and complex, making data processing difficult. We present a novel method for segmenting urban assets (specifically in this case study traffic signs) with a lower-cost Azure Kinect and automatic data processing workflows. First, it was necessary to verify the reliability of this approach using the Time of Flight (ToF) camera from Azure Kinect to detect road signs outdoors. Using the data generated by the ToF camera, we then extracted the Region of Interest (ROI) quickly and efficiently. After transforming the ROI to the RGB image, we obtained the traffic sign area through a hybrid color-shape based method. In addition, we calculated the distance between the traffic sign and Azure Kinect based on the depth image. The Coefficient of Variation cv averaged 1.1%. It is thus evident that Azure Kinect is reliable for outdoor traffic sign segmentation. Our algorithm has been compared with deep learning algorithms. According to our analysis, our algorithm has an accuracy of 0.8216, while the accuracy of deep learning is 0.7466, which indicates that our solution is more flexible and cost-effective.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Contribución de congreso (ConferenceOutput)

Early vision on the focal-plane with high dynamic range pixels

  • Jaklin, Marko
  • García Lesta, Daniel
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
This paper introduces a high dynamic range pixel for early vision processing. Early vision is the first stage to subsequently extract semantic information for image processing or video analytics. This paper proposes to bring said processing to the focal plane, next to a high dynamic range image sensor working on the principle of lateral overflow capacitor. This brings the benefits of processing scenes with a wide dynamic range in a power efficient manner. Circuit simulations for edge detection, as an example of early vision processing conveyed in this paper, show that our proposal meets the accuracy typically found in applications like machine vision. Simulations are in XFAB’s XS018 technology
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Capítulo o parte de un libro (BookPart)

Recent Advances in Computational Time-of-Flight Imaging

  • Heredia Conde, Miguel
  • López Paredes, Álvaro
  • Ahmed, Faisal
  • Fayyaz Shahandashti, Peyman
  • López Martínez, Paula
Las cámaras de tiempo de vuelo (ToF) son dispositivos de imagen 3D que capturan la geometría de una escena, aprovechando que el tiempo de viaje de los fotones está directamente relacionado con la distancia recorrida. Este tipo de sensor es muy prometedor en áreas de aplicación emergentes, pero varias deficiencias dificultan su uso. En concreto, nos centramos en el consumo de energía relativamente alto en comparación con las cámaras convencionales, el rango limitado en el que se puede estimar la profundidad con precisión y las distorsiones de medición producidas por el contenido armónico de las formas de onda de modulación/demodulación y la interferencia multitrayecto. En este trabajo, presentamos avances recientes en la computación de imágenes ToF con el objetivo de superar estas limitaciones, permitiendo el funcionamiento pasivo en interiores, el funcionamiento a largo plazo en exteriores y la realización de operaciones de onda continua multifrecuencia de un solo disparo con mínima distorsión armónica. El funcionamiento pasivo se logra aprovechando fuentes de luz modulada, como los módulos LiFi o de Comunicaciones por Luz Visible (VLC). De forma independiente, se pueden obtener ganancias en el rango operativo mediante la conformación de pulsos ultracortos combinada con demodulación codificada de baja densidad. Se logra un muestreo de Fourier preciso con mínima distorsión armónica mediante la inducción de efectos de resonancia personalizados en los píxeles del tiempo de vuelo. Los resultados iniciales de la evaluación demuestran el potencial de estos enfoques computacionales de imágenes 3D para superar las limitaciones mencionadas.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Capítulo o parte de un libro (BookPart)

CDS Free Frame Differencing Event Vision Pixel with Lateral Overflow Capacitor for Dynamic Range Extension

  • Jaklin, Marko
  • García Lesta, Daniel
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
This paper reports on a redesign of an event pixel by frame differencing with a lateral overflow capacitor for dynamic range extension. In the first prototype, the inclusion of an inpixel correlated double sampling (CDS) and an algorithm for dynamic range extension resulted in a large pixel area, with a 32μm pitch in 180 nm CMOS technology. This paper studies a CDS free version of our former pixel through post-layout simulations. The pixel pitch is shrinked to 22μm, power consumption is lowered and speed is preserved.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Capítulo o parte de un libro (BookPart)

Live demonstration: a frame-based CMOS vision sensor with high dynamic range for events generation

  • Jaklin, Marko
  • García Lesta, Daniel
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
This live demonstration shows a frame-based CMOS vision sensor with high dynamic range for event generation. Our CMOS vision sensor features 64 × 64 processing elements that comprise one 4T-APS and local circuitry to provide events and high dynamic range extension. The event generation is performed synchronously through the threshold of the frame difference between consecutive frames. The dynamic range extension is carried out per-pixel with the overflow capacitance method. The sensor can reach up to thousands of event frames per second. Electrical simulations indicate a dynamic range of 85 dB, which narrows the gap with dynamic vision sensors
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

2HDED:NET for joint depth estimation and image deblurring from a single out-of-focus image

  • Nazir, Saqib
  • Vaquero Otal, Lorenzo
  • Mucientes Molina, Manuel
  • Brea Sánchez, Víctor Manuel
  • Coltuc, Daniela
Depth estimation and all-in-focus image restoration from defocused RGB images are related problems, although most of the existing methods address them separately. The few approaches that solve both problems use a pipeline processing to derive a depth or defocus map as an intermediary product that serves as a support for image deblurring, which remains the primary goal. In this paper, we propose a new Deep Neural Network (DNN) architecture that performs in parallel the tasks of depth estimation and image deblurring, by attaching them the same importance. Our Two-headed Depth Estimation and Deblurring Network (2HDED:NET) is an encoderdecoder network for Depth from Defocus (DFD) that is extended with a deblurring branch, sharing the same encoder. The network is tested on NYU-Depth V2 dataset and compared with several state-of-the-art methods for depth estimation and image deblurring.
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Artículo científico (JournalArticle)

Scanning technologies to building information modelling: a review

  • Rashdi , Rabia
  • Martínez Sánchez, Joaquín
  • Arias Sánchez, Pedro
  • Qiu , Zhouyan
Building information modelling (BIM) is evolving significantly in the architecture, engineering and construction industries. BIM involves various remote-sensing tools, procedures and standards that are useful for collating the semantic information required to produce 3D models. This is thanks to LiDAR technology, which has become one of the key elements in BIM, useful to capture a semantically rich geometric representation of 3D models in terms of 3D point clouds. This review paper explains the ‘Scan to BIM’ methodology in detail. The paper starts by summarising the 3D point clouds of LiDAR and photogrammetry. LiDAR systems based on different platforms, such as mobile, terrestrial, spaceborne and airborne, are outlined and compared. In addition, the importance of integrating multisource data is briefly discussed. Various methodologies involved in point-cloud processing such as sampling, registration and semantic segmentation are explained in detail. Furthermore, different open BIM standards are summarised and compared. Finally, current limitations and future directions are highlighted to provide useful solutions for efficient BIM models., European Union's Horizon 2020 research and innovation programme | Ref. 860370, Ministerio de Ciencia e Innovación | Ref. PID2019-108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Artículo científico (JournalArticle)

External multi-modal imaging sensor calibration for sensor fusion: A review

  • Qiu , Zhouyan
  • Martínez Sánchez, Joaquín
  • Arias Sánchez, Pedro
  • Rashdi , Rabia
Multi-modal data fusion has gained popularity due to its diverse applications, leading to an increased demand for external sensor calibration. Despite several proven calibration solutions, they fail to fully satisfy all the evaluation criteria, including accuracy, automation, and robustness. Thus, this review aims to contribute to this growing field by examining recent research on multi-modal imaging sensor calibration and proposing future research directions. The literature review comprehensively explains the various characteristics and conditions of different multi-modal external calibration methods, including traditional motion-based calibration and feature-based calibration. Target-based calibration and targetless calibration are two types of feature-based calibration, which are discussed in detail. Furthermore, the paper highlights systematic calibration as an emerging research direction. Finally, this review concludes crucial factors for evaluating calibration methods and provides a comprehensive discussion on their applications, with the aim of providing valuable insights to guide future research directions. Future research should focus primarily on the capability of online targetless calibration and systematic multi-modal sensor calibration., Ministerio de Ciencia, Innovación y Universidades | Ref. PID2019-108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Tesis doctoral (DoctoralThesis)

Civil works, operation and maintenance of urban infrastructure, Obra civil, operaciones y mantenimiento de infraestructuras urbanas, Obra civil, operacións e mantemento de infraestruturas urbanas

  • Rashdi , Rabia
Intelligent Infrastructure is based on digitalization and Big Data solutions for smart mobility. The key factor for smart infrastructures is the predictive maintenance based on connected and digitalized infrastructures. Recently, the concept of building information modelling (BIM) has gained a lot of attention in civil engineering and asset management industries. One of the main challenges faced in Scan to BIM is lack of interoperability. IFC, the final standard, is still limited to major transportation structures (tunnels, rail, roads, and bridges). Therefore, information exchange and standard management protocols is important for the successful implementation of BIM in transport infrastructure. The main aim of this project is to make to make compatible 3D LiDAR point clouds of different nature independently of the capture device used. Automatic compressed data processing and data mining techniques will be developed for the monitoring and extraction of relevant semantic information existing in the transport infrastructure, which will be used as base to build BIM for infrastructure. In the end of the project, the automatic IFC for infrastructure model should allow to analyze the performance, carry out a predictive analysis, test scenarios and review the planned maintenance of the linear structures. So, this should arise as key component of any Intelligent Infrastructure systems mainly for Smart Mobility and Smart Logistics, Las infraestructras inteligentes del transporte se basan en la digitalización y el empleo de Big Data para avanzar en la movilidad inteligente. El factor clave para las infraestructuras inteligentes es el mantenimiento predictivo basado en infraestructuras conectadas y digitalizadas. Recientemente, el concepto de modelado de información de edificios (BIM) ha ganado mucha atención en las industrias de ingeniería civil y gestión de activos. Uno de los principales desafíos a los que se enfrenta “Scan to BIM” es la falta de interoperabilidad. IFC, el estándar final, está aún limitado a las principales estructuras de transporte (túneles, ferrocarriles, carreteras y puentes). Por lo tanto, el intercambio de información y los protocolos de gestión estándar resultan un factor clave para la implementación exitosa de los BIM en las infraestructuras de transporte. El objetivo principal de este proyecto es avanzar en la compatibilidad entre nubes de puntos 3D LiDAR independientemente del dispositivo de captura utilizado. Se desarrollarán técnicas de procesamiento mediante compresión automática y minería de datos para el seguimiento y extracción de información semántica relevante existente en la infraestructura de transporte, que se utilizará como base para construir el BIM de la infraestructura. Al final del proyecto, la IFC automática para el modelo de infraestructura permitirá analizar su rendimiento, realizar un análisis predictivo, probar escenarios y revisar el mantenimiento de las estructuras lineales. Como consecuencia, se traducirá en un aspecto clave en la gestión de cualquier infraestructura inteligente y su orientación a la movilidad y la logística inteligentes., As infraestruturas intelixentes do transporte baséanse na dixitalización e no uso do Big Data para avanzar na mobilidade intelixente. O factor clave para as infraestruturas intelixentes é o mantemento predictivo baseado en infraestruturas conectadas e dixitalizadas. Recentemente, o concepto de Modelado de Información de Edificios (BIM) gañou moita atención nas industrias de enxeñería civil e xestión de activos. Un dos principais retos aos que se enfronta "Scan a BIM" é a falta de interoperabilidade. O IFC, o estándar final, aínda está limitado ás principais estruturas de transporte (túneles, ferrocarrís, estradas e pontes). Polo tanto, o intercambio de información e os protocolos de xestión estándar son un factor clave para a implementación exitosa de BIM en infraestruturas de transporte. O principal obxectivo deste proxecto é avanzar na compatibilidade entre nubes de puntos LiDAR 3D independentemente do dispositivo de captura empregado. As técnicas de procesamento desenvolveranse mediante a compresión automática e a minería de datos para o seguimento e extracción de información semántica relevante existente na infraestrutura de transporte, que se utilizará como base para a construción do BIM da infraestrutura. Ao final do proxecto, o IFC automático para o modelo de infraestrutura permitirá analizar o seu rendemento, realizar análises predictivas, probar escenarios e revisar o mantemento das estruturas lineais. Como consecuencia, converterase nun aspecto clave na xestión de calquera infraestrutura intelixente e na súa orientación cara a mobilidade e loxística intelixentes.
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Contribución de congreso (ConferenceOutput)

Comparative study of road and urban object classification based on mobile laser scanners

  • Rashdi , Rabia
  • Balado Frías, Jesús
  • Martínez Sánchez, Joaquín
  • Arias Sánchez, Pedro
Recently, the rapid development of new laser technologies has led to the continuous evolution of mobile laser systems, resulting in even greater capabilities for transport infrastructure. However, the market offers numerous MLS systems with varying specifications for global navigation satellite systems (GNSS), inertial measurement units (IMU), and laser scanners, which can result in different accuracies, resolutions, and densities. In this regard, this paper aims to compare two different MLS system, integrated with different GNSS and IMU for mapping in road and urban environments. The study evaluates the performance of these sensors using different classifiers and neighborhood sizes to determine which sensor produces better results. Random forest was found to be the most suitable classifier with an overall accuracy of (91.81% for Optech and 94.38% for Riegl) in road environment and (86.39% for Optech and 84.21% for Riegl) in urban environment. In terms of MLS, Optech achieved the highest accuracy in the road environment, while Riegl obtained the highest accuracy in the urban environment. This study provides valuable insights into the most effective MLS systems and approaches for accurate mapping in road and urban infrastructure., Xunta de Galicia | Ref. ED481B-2019-061, Agencia Estatal de Investigación | Ref. PID2019-108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Artículo científico (JournalArticle)

Comparative Evaluation of LiDAR systems for transport infrastructure: case studies and performance analysis

  • Rashdi , Rabia
  • Garrido González, Iván
  • Balado Frías, Jesús
  • Del Rio Barral, Pablo
  • Rodríguez Somoza, Juan Luis
  • Martínez Sánchez, Joaquín
Mobile laser scanners are vital for intelligent transport infrastructure, capturing detailed 3D road representations, but their accuracy depends on factors like sensor positioning and environment. This study compares two van-mounted Mobile Laser Scanners (MLS): the dual head Lynx Mobile Mapper and the single head VUX-1 HA, along with the terrestrial laser scanner Faro Focus XX30. Using point cloud reference data from Faro Focus XX30 and GNSS data from Trimble R8, performance is assessed in road, urban, and semi-urban environments. Accuracy is measured by the difference between Trimble GNSS and MLS coordinates. Geometric features of each LiDAR are compared, and mapping tasks in road and urban areas are performed using a machine learning classifier. Results show the MLS-single head scanner achieves satisfactory accuracy in roads and semi-urban areas, while Faro performs better in urban settings for classification. MLS-single head excels in road environments, while Faro is superior in urban ones. This analysis aids researchers and professionals in selecting the appropriate mobile laser scanner for mapping transport infrastructure, providing valuable insights into MLS systems’ comparative performance across different environments., Agencia Estatal de Investigación | Ref. RYC2022-038100-I, Agencia Estatal de Investigación | Ref. PID2019- 108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Tesis doctoral (DoctoralThesis)

Mobile mapping applications of compressive sensing techniques, Aplicaciones cartográficas móviles de técnicas de detección por compresión, Aplicacións de cartografía móbil de técnicas de detección por compresión

  • Qiu , Zhouyan
Urban mobility is playing an increasingly important role in urban development. Smart mobility provides an innovative and sustainable way for urban residents to travel. (Aletà et al., 2017) Intelligent Infrastructure is based on digitalization and Big Data solutions for smart mobility. The key factor for smart infrastructures is predictive maintenance based on connected and digitalized infrastructures. This project will focus on using low-cost mobile devices for continuous monitoring and digitalizing for different transport infrastructures, inside and outside urban areas. The mobile devices will integrate sensors of various natures for the acquisition of georeferenced data. Several sensor technologies will be applied here: i) Photogrammetry provides high-quality, high-definition images and measurements of the surveyed areas. ii) Lidar technology provides accurate and precise Point Clouds in real-time. iii) ToF cameras can generate 2D grayscale photos and 2.5D depth maps simultaneously. iv) Thermal cameras can convert thermal energy into visible light to analyze specific objects or scenes. Compressive sensing (CS) acquires a signal of interest indirectly by correcting a small number of its “projections” rather than evenly sampling it at the Nyquist rate, which can be prohibitively high for broadband signals encountered in many applications. (Wu-Sheng Lu, 2010) Compressed sensing strategies will be applied to the selected sensors, such as image, ToF (Time of flight) cameras, LiDAR sensors. So, the specific objective of this project will be the automatic and real-time data processing for the extraction of relevant information existing in the transport infrastructure. The challenge of this project focuses on efficiently fusing and processing the compressive sampled data from several sensors for Mobile Mapping applications based on devices mounted on non-dedicated vehicles. The goal of this real-time processing consists of detecting relevant assets and components of the transport infrastructure., La movilidad urbana juega cada vez un papel más importante en el desarrollo urbano. La movilidad inteligente proporciona una forma innovadora y sostenible para que los ciudadanos se desplacen (Aletà et al., 2017). Las Infraestructuras Inteligentes se basan en soluciones de digitalización y Big Data para la movilidad inteligente. El factor clave para las infraestructuras inteligentes es el mantenimiento predictivo basado en infraestructuras conectadas y digitalizadas. Este proyecto se centra en el uso de dispositivos móviles de bajo coste para la monitorización continua y la digitalización de diferentes infraestructuras de transporte, dentro y fuera de las zonas urbanas. Los dispositivos móviles integrarán sensores de diversa naturaleza para la adquisición de datos georreferenciados. Para ello se realizará una adquisición de datos mediante distintos sensores y técnicas: i) la fotogrametría proporciona imágenes y mediciones de alta calidad y alta definición de las zonas de estudio, ii) la tecnología Lidar proporciona nubes de puntos en tiempo real de forma rápida y precisa, iii) las cámaras ToF (time-of-flight) pueden generar fotos en escala de grises 2D y mapas de profundidad 2.5D simultáneamente, iv) las cámaras térmicas generan imágenes visibles a partir de información térmica para analizar objetos o escenas específicas. Por otra parte, las técnicas de Compressive Sensing (CS) permiten adquirir una señal de interés de forma indirecta al corregir un pequeño número de sus ´proyecciones´ en lugar de muestrearla uniformemente según la fecuencia de Nyquist, que puede resultar excesivamente alta para las señales de banda ancha que se encuentran en muchas aplicaciones (Wu-Sheng Lu, 2010). Estas técnicas de Compressive Sensing se aplicarán a los sensores seleccionados mencionados anteriormente. El objetivo principal de este proyecto se centra en el procesamiento automático de datos en tiempo real para obtener información relevante presente en las infraestructuras de transporte. El mayor reto consistirá en fusionar y procesar de manera eficiente los datos muestreados por compresión de varios sensores para aplicaciones de mapeo móvil basadas en dispositivos montados en vehículos no tripulados. El resultado de este procesamiento permitirá la detección de activos y otros componentes relevantes en las infraestructuras de transporte estudiadas., A mobilidade urbana xoga un papel cada vez máis importante no desenvolvemento urbano. A mobilidade intelixente proporciona aos cidadáns un xeito innovador e sostible de desprazarse (Aletà et al., 2017). As infraestruturas intelixentes baséanse en dixitalización e solucións de Big Data para a mobilidade intelixente. O factor clave para as infraestruturas intelixentes é o mantemento predictivo baseado en infraestruturas conectadas e dixitalizadas. Este proxecto céntrase no uso de dispositivos móbiles de baixo custo para a vixilancia e dixitalización continua de diferentes infraestruturas de transporte, dentro e fóra das áreas urbanas. Os dispositivos móbiles integrarán sensores de varios tipos para a adquisición de datos xeorreferenciados. Para iso, os datos adquiriranse utilizando diferentes sensores e técnicas: i) a fotogrametría proporciona imaxes de alta calidade e alta definición e medicións das áreas de estudo, ii) a tecnoloxía LiDAR proporciona nubes de puntos en tempo real de xeito rápido e preciso, iii) as cámaras ToF (tempo de voo) poden xerar fotos en escala de grises 2D e mapas de profundidade 2.5D simultaneamente, iv) as cámaras térmicas xeran imaxes visibles a partir de información térmica para analizar obxectos ou escenas específicas. Por outra banda, as técnicas de Compressive Sensing (CS) permiten adquirir un sinal de interese de xeito indirecto corrixindo un pequeno número das súas "proxeccións" en lugar de mostralo uniformemente segundo a frecuencia de Nyquist, que pode ser excesivamente alta para os sinais de banda ancha atopados en moitas aplicacións (Wu-Sheng Lu, 2010). Estas técnicas de Compressive Sensing aplicaranse aos sensores seleccionados mencionados anteriormente. O principal obxectivo deste proxecto céntrase no procesamento automático de datos en tempo real para obter información relevante presente nas infraestruturas de transporte. O maior desafío será combinar e procesar de xeito eficiente datos de mostraxe de compresión de varios sensores para aplicacións de cartografía móbil baseadas en dispositivos montados no vehículo. O resultado deste procesamento permitirá a detección de activos e outros compoñentes relevantes nas infraestruturas de transporte estudadas.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Contribución de congreso (ConferenceOutput)

Impact of diffraction on terahertz compressed sensing single-pixel imaging

  • Ndagijimana, Adolphe
  • Ederra Urzainqui, Íñigo
  • Heredia Conde, Miguel
Terahertz (THz) single-pixel imaging, through compressive sensing, enables sampling below Nyquist rates and bypasses the need for mechanical scanning and the limitation of availability of high-resolution cost-effective THz imaging array detectors off-the-shelf. This research investigates how diffraction phenomena affect THz single-pixel imaging and properties of sensing matrices, along with the sparse signal reconstruction process. We introduce a variety of strategies designed to mitigate the effects of diffraction, along with novel methods to counteract the disruptions caused by THz physics, thereby preserving the integrity of the original sensing matrix and improving signal recoverability. A comprehensive simulation study sheds light on the effects of diffraction on the sensing matrices and their impact on signal reconstruction. Our results highlight the importance of accurate diffraction minimization techniques and sophisticated modelling in enhancing THz imaging systems., This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 860370.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Contribución de congreso (ConferenceOutput)

Towards optimal binary patterns for compressive terahertz single-pixel imaging

  • Ndagijimana, Adolphe
  • Ederra Urzainqui, Íñigo
  • Heredia Conde, Miguel
Terahertz (THz) radiation's properties make it ideal for various imaging applications. However, creating simple, cost-effective, and high-resolution THz array detectors is challenging. Mechanical scanning is commonly used but creates a trade-off between frame rate and resolution. Fortunately, Compressive Sensing (CS) offers a solution by reducing the required number of measurements needed compared to Shannon-Nyquist's sampling theory. CS-THz imaging is usually implemented using a single-pixel camera with spatial modulation patterns, mostly binary patterns. However, the non-uniform and diffraction propagation present in the THz range affects the mutual coherence of the resulting sensing matrices resulting in image reconstruction degradation. In this paper, we introduce an optimization procedure for generating binary patterns that consider THz diffraction and non-uniform illumination of the mask. The produced sensing matrices exhibit low coherence compared to other typical binary sensing matrices, resulting in a higher reconstruction performance than all others., This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 860370
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Artículo científico (JournalArticle)

Single-pixel compressive terahertz 3D imaging

  • Ndagijimana, Adolphe
  • Ederra Urzainqui, Íñigo
  • Heredia Conde, Miguel
Terahertz (THz) imaging contends with the lack of cost-effective, off-the-shelf high-resolution array detectors and the slow acquisition speeds associated with pixel-by-pixel raster scanning. Single-pixel imaging with Compressive Sensing (CS) represents a potential solution for resolution and acquisition speed in a cost-efficient manner. Our paper introduces a novel approach for extending 2D single-pixel THz imaging systems to 3D using a single frequency. By leveraging the single-pixel approach, we achieve 3D resolution while avoiding mechanical scanning, and the use of a single frequency eliminates the need for bandwidth, a significant limitation of conventional techniques, where design of THz sources and detectors with large bandwidth remains challenging and typically complex. The Order Recursive Matching Pursuit (ORMP) algorithm is used as the sparse recovery method to exploit the sparsity/compressibility of the 3D THz signal and enable sampling at a rate far lower than that required by the Nyquist Theorem. The 2D sensing matrix is obtained by analyzing the diffracted propagation of THz imaging systems on a 2D surface perpendicular to the optical axis. Moreover, the 3D sensing matrix is based on the diffracted propagation of 2D surfaces at different sampling depth positions. Our system can quickly capture the reflective properties of every point in a 3D space using a single-pixel camera setup that leverages CS, making it a simple and efficient method for creating a fast 3D THz imaging system, particularly suited to high-frequency THz sources that operate efficiently at a single frequency or at small bandwidth., This work was supported by European Union's Horizon 2020 Research and Innovation Program through Marie Sklodowska-Curie under Grant 860370 and Spanish State Research Agency, under Project PID2023-146064OB-C31.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Contribución de congreso (ConferenceOutput)

Characterizing modulation depth of optically induced THz patterns for single-pixel imaging

  • Ndagijimana, Adolphe
  • Ederra Urzainqui, Íñigo
  • Heredia Conde, Miguel
  • Pérez Escudero, José Manuel
Terahertz (THz) single-pixel imaging (SPI) is a cost-effective alternative to detector arrays, enabling faster acquisition than traditional mechanical scanning. However, its performance depends heavily on the precise implementation and modeling of modulation patterns. This study examines discrepancies between ideal and measured modulation depths in optically induced THz SPI using a phase-only patterned Liquid Crystal Near-Infrared Spatial Light Modulator (NIR SLM). Under 50 mW/cm2 NIR illumination and with antireflection-coated silicon wafers, we generated THz patterns with an expected ideal modulation depth of 46%. Experimentally, we observed a reduced depth of 25.95% using pixel-to-pixel patterned mask analysis, mainly due to NIR pattern imperfections and carrier diffusion. Accurate modulation depth estimation is crucial for selecting optical power and, more importantly, for modeling the sensing matrix used in signal reconstruction. Inaccurate modelling can result in noisy or failed reconstructions. We also observed frequency-dependent modulation depth, varying from 19% to 36% for the 25.95% case for WR 2.2 band. This highlights the potential to enhance SPI performance by selecting an optimal operating frequency., This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 860370 and by the Spanish State Research Agency, project PID2023-146064OB-C31.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publicación Contribución de congreso (ConferenceOutput)

Performance evaluation of spatial modulation patterns in compressive sensing terahertz imaging

  • Ndagijimana, Adolphe
  • Heredia Conde, Miguel
  • Ederra Urzainqui, Íñigo
Terahertz (THz) imaging traditionally uses pixel-to-pixel mechanical raster scanning, which is slow and limits the resolution and potential applications. Compressive Sensing Terahertz (CS-THz) imaging has the potential to solve these challenges by reducing the number of required measurements. However, there is an existing research gap between the current CS-THz implementations, which often use random binary masks without further consideration, and specialized Compressive Sensing works, which focus on RIP and coherence reduction but ignore the physics underlying THz wave propagation such as the effect of diffraction on masks patterns. This paper discusses and evaluates the use of low-coherence sensing matrices as mask patterns for CS-THz imaging. Although not previously used in THz imaging, Best Antipodal Spherical Code masks show the best image reconstruction performance among the considered alternatives. We also demonstrate the feasibility of phase-only modulation., This project has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No 860370.