Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 8
Encontrada(s) 1 página(s)

Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Artículo científico (JournalArticle)

Pseudo-Passive Time-of-Flight Imaging: Simultaneous Illumination, Communication, and 3D Sensing

  • Ahmed, Faisal
  • López Martínez, Paula
  • Kerstein, Thomas
  • Heredia Conde, Miguel
  • Buxbaum, Bernd
The 3D time-of-flight (ToF) cameras have recently received a lot of attention due to their wide range of applications. Despite remarkable advancements in ToF imaging, state-of-the-art ToF cameras are still afflicted by the power hungriness of their illumination sources. To tackle this problem, we exploited existing lighting infrastructure, which ensures the ubiquitous presence of modulated light sources in indoor spaces that serve as opportunity illuminators. We explored the bistatic geometry for passive imaging using the pulse-based ToF approach. Our work is inspired by the recently introduced visible light communication (VLC) or light-fidelity (Li-Fi) infrastructure. VLC allows the infrastructure to provide indoor simultaneous illumination, communication, and sensing (SICS). To this end, we designed a bistatic geometry for the purpose of attaining passive 3D imaging. Such capabilities are achieved by exploiting the pulse shape of the autocorrelation function of real optical signals generated by VLC/Li-Fi modules (e.g., OpenVLC and LiFiMAX). We demonstrated passive imaging by means of matched filtering. In this work, we also studied different sampling strategies in the time-shift domain, including uniform, random, and sparse rulers, which is another step forward toward preserving high depth accuracy with a minimal number of measurements. The proposed methodology achieved successful depth reconstruction with negligible root-mean-square error (RMSE) for the low signal-to-noise ratio (SNR) of the measurements. Parametric models, such as Gaussian and sum of sines, are used to characterize the cross correlation functions and allow for robust parametric depth retrieval from a few measurements. Moreover, we attained a 20-mm worst case error for a target at 25 cm. The experiment proved that the bistatic passive depth reconstruction is feasible.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Artículo científico (JournalArticle)

Global shutter CMOS vision sensors and event cameras for on‐chip dynamic information

  • Jaklin, Marko
  • García Lesta, Daniel
  • López Martínez, Paula
  • Brea Sánchez, Víctor Manuel
The on-chip extraction of dynamic information from a scene can be addressed with either frame-based CMOS vision, also called smart image sensors, or dynamic vision sensors, also known as event cameras. When implemented with a pinned photodiode (PPD) as a 4-transistor active pixel sensor (4T-APS), the former brings about the benefits of low temporal noise and dark current but without high dynamic range (HDR). The latter comes with the benefits of HDR and a fast event detection rate with low power consumption. The drawback is the background activity noise, which leads to additional hardware or algorithms to keep it low. This paperanalyses the mismatch and noise of a global shutter 4T-APS implementation with local HDR through an overflow capacitor and correlated double sampling (CDS) to provide low noise events through frame differencing. The aim is to narrow the gap with dynamic vision sensors in terms of event rate and dynamic range. We show that our solution would be competitive with event cameras in scenarios with slow moving objects and a relatively wide dynamic range (85 dB).
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Artículo científico (JournalArticle)

Low-cost mobile mapping system solution for traffic sign segmentation using Azure Kinect

  • Qiu, Zhouyan
  • Martínez Sánchez, Joaquín
  • Brea Sánchez, Víctor Manuel
  • López Martínez, Paula
  • Arias, Pedro
The mobile mapping system (MMS) could become the foundation of digital twins and 3D modeling, and is widely applicable in a variety of fields, such as infrastructure management, intelligent transportation systems, and smart cities. However, data collected by MMS is extensive and complex, making data processing difficult. We present a novel method for segmenting urban assets (specifically in this case study traffic signs) with a lower-cost Azure Kinect and automatic data processing workflows. First, it was necessary to verify the reliability of this approach using the Time of Flight (ToF) camera from Azure Kinect to detect road signs outdoors. Using the data generated by the ToF camera, we then extracted the Region of Interest (ROI) quickly and efficiently. After transforming the ROI to the RGB image, we obtained the traffic sign area through a hybrid color-shape based method. In addition, we calculated the distance between the traffic sign and Azure Kinect based on the depth image. The Coefficient of Variation cv averaged 1.1%. It is thus evident that Azure Kinect is reliable for outdoor traffic sign segmentation. Our algorithm has been compared with deep learning algorithms. According to our analysis, our algorithm has an accuracy of 0.8216, while the accuracy of deep learning is 0.7466, which indicates that our solution is more flexible and cost-effective.
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publication Artículo científico (JournalArticle)

2HDED:NET for joint depth estimation and image deblurring from a single out-of-focus image

  • Nazir, Saqib
  • Vaquero Otal, Lorenzo
  • Mucientes Molina, Manuel
  • Brea Sánchez, Víctor Manuel
  • Coltuc, Daniela
Depth estimation and all-in-focus image restoration from defocused RGB images are related problems, although most of the existing methods address them separately. The few approaches that solve both problems use a pipeline processing to derive a depth or defocus map as an intermediary product that serves as a support for image deblurring, which remains the primary goal. In this paper, we propose a new Deep Neural Network (DNN) architecture that performs in parallel the tasks of depth estimation and image deblurring, by attaching them the same importance. Our Two-headed Depth Estimation and Deblurring Network (2HDED:NET) is an encoderdecoder network for Depth from Defocus (DFD) that is extended with a deblurring branch, sharing the same encoder. The network is tested on NYU-Depth V2 dataset and compared with several state-of-the-art methods for depth estimation and image deblurring.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Single-pixel compressive terahertz 3D imaging

  • Ndagijimana, Adolphe
  • Ederra Urzainqui, Íñigo
  • Heredia Conde, Miguel
Terahertz (THz) imaging contends with the lack of cost-effective, off-the-shelf high-resolution array detectors and the slow acquisition speeds associated with pixel-by-pixel raster scanning. Single-pixel imaging with Compressive Sensing (CS) represents a potential solution for resolution and acquisition speed in a cost-efficient manner. Our paper introduces a novel approach for extending 2D single-pixel THz imaging systems to 3D using a single frequency. By leveraging the single-pixel approach, we achieve 3D resolution while avoiding mechanical scanning, and the use of a single frequency eliminates the need for bandwidth, a significant limitation of conventional techniques, where design of THz sources and detectors with large bandwidth remains challenging and typically complex. The Order Recursive Matching Pursuit (ORMP) algorithm is used as the sparse recovery method to exploit the sparsity/compressibility of the 3D THz signal and enable sampling at a rate far lower than that required by the Nyquist Theorem. The 2D sensing matrix is obtained by analyzing the diffracted propagation of THz imaging systems on a 2D surface perpendicular to the optical axis. Moreover, the 3D sensing matrix is based on the diffracted propagation of 2D surfaces at different sampling depth positions. Our system can quickly capture the reflective properties of every point in a 3D space using a single-pixel camera setup that leverages CS, making it a simple and efficient method for creating a fast 3D THz imaging system, particularly suited to high-frequency THz sources that operate efficiently at a single frequency or at small bandwidth., This work was supported by European Union's Horizon 2020 Research and Innovation Program through Marie Sklodowska-Curie under Grant 860370 and Spanish State Research Agency, under Project PID2023-146064OB-C31.
Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

Scanning technologies to building information modelling: a review

  • Rashdi , Rabia
  • Martínez Sánchez, Joaquín
  • Arias Sánchez, Pedro
  • Qiu , Zhouyan
Building information modelling (BIM) is evolving significantly in the architecture, engineering and construction industries. BIM involves various remote-sensing tools, procedures and standards that are useful for collating the semantic information required to produce 3D models. This is thanks to LiDAR technology, which has become one of the key elements in BIM, useful to capture a semantically rich geometric representation of 3D models in terms of 3D point clouds. This review paper explains the ‘Scan to BIM’ methodology in detail. The paper starts by summarising the 3D point clouds of LiDAR and photogrammetry. LiDAR systems based on different platforms, such as mobile, terrestrial, spaceborne and airborne, are outlined and compared. In addition, the importance of integrating multisource data is briefly discussed. Various methodologies involved in point-cloud processing such as sampling, registration and semantic segmentation are explained in detail. Furthermore, different open BIM standards are summarised and compared. Finally, current limitations and future directions are highlighted to provide useful solutions for efficient BIM models., European Union's Horizon 2020 research and innovation programme | Ref. 860370, Ministerio de Ciencia e Innovación | Ref. PID2019-108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

External multi-modal imaging sensor calibration for sensor fusion: A review

  • Qiu , Zhouyan
  • Martínez Sánchez, Joaquín
  • Arias Sánchez, Pedro
  • Rashdi , Rabia
Multi-modal data fusion has gained popularity due to its diverse applications, leading to an increased demand for external sensor calibration. Despite several proven calibration solutions, they fail to fully satisfy all the evaluation criteria, including accuracy, automation, and robustness. Thus, this review aims to contribute to this growing field by examining recent research on multi-modal imaging sensor calibration and proposing future research directions. The literature review comprehensively explains the various characteristics and conditions of different multi-modal external calibration methods, including traditional motion-based calibration and feature-based calibration. Target-based calibration and targetless calibration are two types of feature-based calibration, which are discussed in detail. Furthermore, the paper highlights systematic calibration as an emerging research direction. Finally, this review concludes crucial factors for evaluating calibration methods and provides a comprehensive discussion on their applications, with the aim of providing valuable insights to guide future research directions. Future research should focus primarily on the capability of online targetless calibration and systematic multi-modal sensor calibration., Ministerio de Ciencia, Innovación y Universidades | Ref. PID2019-108816RB-I00
Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

Comparative Evaluation of LiDAR systems for transport infrastructure: case studies and performance analysis

  • Rashdi , Rabia
  • Garrido González, Iván
  • Balado Frías, Jesús
  • Del Rio Barral, Pablo
  • Rodríguez Somoza, Juan Luis
  • Martínez Sánchez, Joaquín
Mobile laser scanners are vital for intelligent transport infrastructure, capturing detailed 3D road representations, but their accuracy depends on factors like sensor positioning and environment. This study compares two van-mounted Mobile Laser Scanners (MLS): the dual head Lynx Mobile Mapper and the single head VUX-1 HA, along with the terrestrial laser scanner Faro Focus XX30. Using point cloud reference data from Faro Focus XX30 and GNSS data from Trimble R8, performance is assessed in road, urban, and semi-urban environments. Accuracy is measured by the difference between Trimble GNSS and MLS coordinates. Geometric features of each LiDAR are compared, and mapping tasks in road and urban areas are performed using a machine learning classifier. Results show the MLS-single head scanner achieves satisfactory accuracy in roads and semi-urban areas, while Faro performs better in urban settings for classification. MLS-single head excels in road environments, while Faro is superior in urban ones. This analysis aids researchers and professionals in selecting the appropriate mobile laser scanner for mapping transport infrastructure, providing valuable insights into MLS systems’ comparative performance across different environments., Agencia Estatal de Investigación | Ref. RYC2022-038100-I, Agencia Estatal de Investigación | Ref. PID2019- 108816RB-I00