Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 6
Encontrada(s) 1 página(s)

Archivo Digital UPM
Publication Artículo científico (JournalArticle)

Pose-guided token selection for the recognition of activities of daily living

  • Pizarro Carreño, Ricardo|||0000-0001-7894-0236
  • Valle Fernández, Roberto|||0000-0003-1423-1478
  • Buenaposada Biencinto, José Miguel
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
  • Baumela Molina, Luis|||0000-0001-6910-4359
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Efficient Baselines for Motion Prediction in Autonomous Driving

  • Gómez Huélamo, Carlos
  • Conde, Marcos V.
  • Barea Navarro, Rafael|||0000-0002-4179-6100
  • Ocaña Miguel, Manuel|||0000-0002-8875-1866
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
Motion Prediction (MP) of multiple surroundings agents is a crucial task in arbitrarily complex environments, from simple robots to Autonomous Driving Stacks (ADS). Current techniques tackle this problem using end-to-end pipelines, where the input data is usually a rendered top-view of the physical information and the past trajectories of the most relevant agents; leveraging this information is a must to obtain optimal performance. In that sense, a reliable ADS must produce reasonable predictions on time. However, despite many approaches use simple ConvNets and LSTMs to obtain the social latent features, State-of-the-Art (SOTA) models might be too complex for real-time applications when using both sources of information (map and past trajectories) as well as little interpretable, specifically considering the physical information. Moreover, the performance of such models highly depends on the number of available inputs for each particular traffic scenario, which are expensive to obtain, particularly, annotated High-Definition (HD) maps. In this work, we propose several efficient baselines for the well-known Argoverse 1 Motion Forecasting Benchmark. We aim to develop compact models using SOTA techniques for MP, including attention mechanisms and GNNs. Our lightweight models use standard social information and interpretable map information such as points from the driveable area and plausible centerlines by means of a novel physics-based heuristic step based on kinematic constraints, in opposition to black-box CNN-based or too-complex graphs methods for map encoding, to generate plausible multi-modal trajectories achieving up-to-pair accuracy with less operations and parameters than other SOTA methods. Our code is publicly available at https://github.com/Cram3r95/mapfe4mp ., Agencia Estatal de Investigación, Comunidad de Madrid
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Point Cloud Painting for 3D Object Detection with Camera and Automotive 3+1D RADAR Fusion

  • Montiel Marín, Santiago|||0009-0000-5492-0839
  • Llamazares Llamazares, Ángel|||0000-0001-8273-5163
  • Antunes García, Miguel|||0009-0008-5627-5325
  • Revenga de Toro, Pedro Alfonso|||0000-0003-2550-5972
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
RADARs and cameras have been present in automotives since the advent of ADAS, as they possess complementary strengths and weaknesses but have been underlooked in the context of learning-based methods. In this work, we propose a method to perform object detection in autonomous driving based on a geometrical and sequential sensor fusion of 3+1D RADAR and semantics extracted from camera data through point cloud painting from the perspective view. To achieve this objective, we adapt PointPainting from the LiDAR and camera domains to the sensors mentioned above. We first apply YOLOv8-seg to obtain instance segmentation masks and project their results to the point cloud. As a refinement stage, we design a set of heuristic rules to minimize the propagation of errors from the segmentation to the detection stage. Our pipeline concludes by applying PointPillars as an object detection network to the painted RADAR point cloud. We validate our approach in the novel View of Delft dataset, which includes 3+1D RADAR data sequences in urban environments. Experimental results show that this fusion is also suitable for RADAR and cameras as we obtain a significant improvement over the RADAR-only baseline, increasing mAP from 41.18 to 52.67 (+27.9%)., Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

SalsaNext+: a multimodal-based point cloud semantic segmentation with range and RGB images

  • Sánchez García, Fabio
  • Montiel Marín, Santiago|||0009-0000-5492-0839
  • Antunes García, Miguel|||0009-0008-5627-5325
  • Gutiérrez Moreno, Rodrigo
  • Llamazares Llamazares, Ángel|||0000-0001-8273-5163
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
Advances in sensor fusion techniques are redefining the landscape of 3D point cloud semantic segmentation, particularly for autonomous driving applications. We propose an enhanced approach that leverages the complementary strengths of LiDAR and multi-camera systems. This study introduces two extensions to the state-of-the-art SalsaNext model based only in LiDAR: SalsaNext+RGB, which integrates RGB data into range-view (RV) images, and SalsaNext+PANO, incorporating panoramic images built from multi-camera setups. The proposed methods are evaluated using the SemanticKITTI and Panoptic nuScenes datasets, showing notable improvements in segmentation accuracy. Results indicate that RGB fusion boosts performance with minimal latency, while panoramic integration offers additional gains at the expense of higher computational load. Comparative analyses highlight significant mIoU gains, demonstrating the potential of multimodal sensor fusion for intricate driving scene understanding., Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Enhancing autonomous driving in urban scenarios: a hybrid approach with reinforcement learning and classical control

  • Gutiérrez Moreno, Rodrigo
  • Barea Navarro, Rafael|||0000-0002-4179-6100
  • López Guillén, María Elena
  • Arango Vargas, Juan Felipe|||0000-0003-4989-9443
  • Sánchez García, Fabio
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
The use of Deep Learning algorithms in the domain of Decision Making for Autonomous Vehicles has garnered significant attention in the literature in recent years, showcasing considerable potential. Nevertheless, most of the solutions proposed by the scientific community encounter difficulties in real-world applications. This paper aims to provide a realistic implementation of a hybrid Decision Making module in an Autonomous Driving stack, integrating the learning capabilities from the experience of Deep Reinforcement Learning algorithms and the reliability of classical methodologies. Our Decision Making system is in charge of generating steering and velocity signals using the HD map information and sensors pre-processed data. This work encompasses the implementation of concatenated scenarios in simulated environments, and the integration of Autonomous Driving modules. Specifically, the authors address the Decision Making problem by employing a Partially Observable Markov Decision Process formulation and offer a solution through the use of Deep Reinforcement Learning algorithms. Furthermore, an additional control module to execute the decisions in a safe and comfortable way through a hybrid architecture is presented. The proposed architecture is validated in the CARLA simulator by navigating through multiple concatenated scenarios, outperforming the CARLA Autopilot in terms of completion time, while ensuring both safety and comfort., Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Leveraging Driver Attention for an End-to-End Explainable Decision-Making from Frontal Images

  • Araluce Ruiz, Javier
  • Bergasa Pascual, Luis Miguel|||0000-0002-0087-3077
  • Ocaña Miguel, Manuel|||0000-0002-8875-1866
  • Llamazares Llamazares, Ángel|||0000-0001-8273-5163
  • López Guillén, María Elena
Explaining the decision made by end-to-end autonomous driving is a difficult task. These approaches take raw sensor data and compute the decision as a black box with large deep learning models. Understanding the output of deep learning is a complex challenge due to the complicated nature of explainability; as data passes through the network, it becomes untraceable, making it difficult to understand. Explainability increases confidence in the decision by making the black box that drives the vehicle transparent to the user inside. Achieving a Level 5 autonomous vehicle necessitates the resolution of that challenging task. In this work, we propose a model that leverages the driver’s attention to obtain explainable decisions based on an attention map and the scene context. Our novel architecture addresses the task of obtaining a decision and its explanation from a single RGB sequence of the driving scene ahead. We base this architecture on the Transformer architecture with some efficiency tricks in order to use it at a reasonable frame rate. Moreover, we integrate in this proposal our previous ARAGAN model, which obtains SOTA attention maps, to improve the performance of the model thanks to understand the sequence as a human does. We train and validate our proposal on the BDD-OIA dataset, achieving on-pair results or even better than other state-of-the-art methods. Additionally, we present a simulation-based proof of concept demonstrating the model’s performance as a copilot in a close-loop vehicle to driver interaction., Agencia Estatal de Investigación