Pasar al contenido principal

SLAM CON CAMARA DE EVENTOS

DPI2017-89564-P

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D (Excelencia / Generación de Conocimiento)
Año convocatoria 2017
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 19
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

LOGIMATIC Autonomous Navigation

  • Rizzo, Carlos
  • Andrade-Cetto, Juan
  • Solà, Joan
  • Vallvé, Joan
  • Serrano López, Daniel
  • González Villodres, Jesús Pablo
  • Tsitsamis, Dimitris
  • Rodríguez, Hugo
Advanced autonomous navigation solution based on the integration of Global Navigation Satellite Systems (GNSS) and sensors onboard straddle carrier vehicles for port automation., We acknowledge financial support from the Spanish Science Ministry (MINECO) through projects EB-SLAM (DPI2017-89564-P) and María de Maeztu Seal of Excellence (MDM-2016-0656); and from the European GNSS Agency Grant LOGIMATIC (H2020-Galileo-2015-1-687534)., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Active SLAM for autonomous underwater exploration

  • Palomeras, Narcís
  • Carreras, Marc
  • Andrade-Cetto, Juan
Exploration of a complex underwater environment without an a priori map is beyond the state of the art for autonomous underwater vehicles (AUVs). Despite several efforts regarding simultaneous localization and mapping (SLAM) and view planning, there is no exploration framework, tailored to underwater vehicles, that faces exploration combining mapping, active localization, and view planning in a unified way. We propose an exploration framework, based on an active SLAM strategy, that combines three main elements: a view planner, an iterative closest point algorithm (ICP)-based pose-graph SLAM algorithm, and an action selection mechanism that makes use of the joint map and state entropy reduction. To demonstrate the benefits of the active SLAM strategy, several tests were conducted with the Girona 500 AUV, both in simulation and in the real world. The article shows how the proposed framework makes it possible to plan exploratory trajectories that keep the vehicle's uncertainty bounded; thus, creating more consistent maps., This research was funded by the Spanish State Research Agency through grants DPI2015-73978-JIN and DPI2017-89564-P, and the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Pose-graph SLAM sparsification using factor descent

  • Vallvé, Joan
  • Solà, Joan
  • Andrade-Cetto, Juan
Since state of the art simultaneous localization and mapping (SLAM) algorithms are not constant time, it is often necessary to reduce the problem size while keeping as much of the original graph's information content. In graph SLAM, the problem is reduced by removing nodes and rearranging factors. This is normally faced locally: after selecting a node to be removed, its Markov blanket sub-graph is isolated, the node is marginalized and its dense result is sparsified. The aim of sparsification is to compute an approximation of the dense and non-relinearizable result of node marginalization with a new set of factors. Sparsification consists on two processes: building the topology of new factors, and finding the optimal parameters that best approximate the original dense distribution. This best approximation can be obtained through minimization of the Kullback–Liebler divergence between the two distributions. Using simple topologies such as Chow–Liu trees, there is a closed form for the optimal solution. However, a tree is oftentimes too sparse and produces bad distribution approximations. On the contrary, more populated topologies require nonlinear iterative optimization. In the present paper, the particularities of pose-graph SLAM are exploited for designing new informative topologies and for applying the novel factor descent iterative optimization method for sparsification. Several experiments are provided comparing the proposed topology methods and factor descent optimization with state-of-the-art methods in synthetic and real datasets with regards to approximation accuracy and computational cost., This work has been supported by the Spanish Ministry of Economy and Competitiveness Project EB-SLAM [DPI2017-89564-P]; by the EU H2020 Project LOGIMATIC [H2020-Galileo-2015-1-687534]; and by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI [MDM-2016-0656].
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Absolute humanoid localization and mapping based on IMU Lie group and fiducial markers

  • Fourmy, Mederic
  • Atchuthan, Dinesh
  • Mansard, Nicolas
  • Solà, Joan
  • Flayols, Thomas
Trabajo presentado en el 19th International Conference on Humanoid Robots (Humanoids), celebrado en Toronto (Canadá) del 15 al 17 de octubre de 2019, Current locomotion algorithms in structured (in-door) 3D environments require an accurate localization. The several and diverse sensors typically embedded on legged robots (IMU, coders, vision and/or LIDARS) should make it possible if properly fused. Yet this is a difficult task due to the hetero-geneity of these sensors and the real-time requirement of the control. While previous works were using staggered approaches (odometry at high frequency, sparsely corrected from vision and LIDAR localization), the recent progress in optimal estimation, in particular in visual-inertial localization, is paving the way to a holistic fusion. This paper is a contribution in this direction. We propose to quantify how a visual-inertial navigation system can accurately localize a humanoid robot in a 3D indoor environment tagged with fiducial markers. We introduce a theoretical contribution strengthening the formulation of Forster's IMU pre-integration, a practical contribution to avoid possible ambiguity raised by pose estimation of fiducial markers, and an experimental contribution on a humanoid dataset with ground truth. Our system is able to localize the robot with less than 2 cm errors once the environment is properly mapped. This would naturally extend to additional measurements corresponding to leg odometry (kinematic factors) thanks to the genericity of the proposed pre-integration algebra., This work has been supported by the MEMMO European Union project within the H2020 Program under Grant Agreement No. 780684, the Spanish Ministry of Science, Innovation, and Universities project EB-SLAM (DPI2017-89564-P), by the EU H2020 project GAUSS (DPI2017-89564-P) and by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI MDM-2016-0656.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Timed-elastic smooth curve optimization for mobile-base planning

  • Deray, Jeremie
  • Magyar, Bence
  • Solà, Joan
  • Andrade-Cetto, Juan
Trabajo presentado en la IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), celebrada en Macao (China), del 3 al 8 de noviembre de 2019, This paper proposes the use of piecewise Cn smooth curve for mobile-base motion planning and control, coined Timed-Elastic Smooth Curve (TESC) planner. Based on a Timed-Elastic Band, the problem is defined so that the trajectory lies on a spline in SE(2) with non-vanishing n-th derivatives at every point. Formulated as a multi-objective nonlinear optimization problem, it allows imposing soft constraints such as collision-avoidance, velocity, acceleration and jerk limits, and more. The planning process is realtime-capable allowing the robot to navigate in dynamic complex scenarios. The proposed method is compared against the state-of-the-art in various scenarios. Results show that trajectories generated by the TESC planner have smaller average acceleration and are more efcient in terms of total curvature and pseudo-kinetic energy while being produced with more consistency than state-of-the-art planners do., This work was partially supported by the EU H2020 project LOGIMATIC (H2020-Galileo-2015-1-687534), and by the Spanish State Research Agency through projects EB-SLAM (DPI2017-89564-P) and the Mar´ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Joint on-manifold self-calibration of odometry model and sensor extrinsics using pre-integration

  • Deray, Jeremie
  • Solà, Joan
  • Andrade-Cetto, Juan
Trabajo presentado en la European Conference on Mobile Robots (ECMR), celebrada en Praga (República Checa), del 4 al 6 de septiembre de 2019, This paper describes a self-calibration procedure that jointly estimates the extrinsic parameters of an exteroceptive sensor able to observe ego-motion, and the intrinsic parameters of an odometry motion model, consisting of wheel radii and wheel separation. We use iterative nonlinear onmanifold optimization with a graphical representation of the state, and resort to an adaptation of the pre-integration theory, initially developed for the IMU motion sensor, to be applied to the differential drive motion model. For this, we describe the construction of a pre-integrated factor for the differential drive motion model, which includes the motion increment, its covariance, and a first-order approximation of its dependence with the calibration parameters. As the calibration parameters change at each solver iteration, this allows a posteriori factor correction without the need of re-integrating the motion data. We validate our proposal in simulations and on a real robot and show the convergence of the calibration towards the true values of the parameters. It is then tested online in simulation and is shown to accommodate to variations in the calibration parameters when the vehicle is subject to physical changes such as loading and unloading a freight., This work has been supported by the Spanish Ministry of Science, Innovation, and Universities project EB-SLAM (DPI2017-89564-P), by the EU H2020 project LOGIMATIC (H2020-Galileo-2015-1-687534) and by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI MDM-2016-0656. J. Deray acknowledges support from the Industrial Doctorate Program of the Catalan Agency for Management of University and Research Grants.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

High-speed event camera tracking

  • Chamorro Hernández, William Oswaldo
  • Andrade-Cetto, Juan
  • Solà, Joan
Trabajo presentado en la 31st British Machine Vision Conference, celebrada online del 7 al 10 de septiembre de 2020, Event cameras are bioinspired sensors with reaction times in the order of microseconds. This property makes them appealing for use in highly-dynamic computer vision applications. In this work, we explore the limits of this sensing technology and present an ultra-fast tracking algorithm able to estimate six-degree-of-freedom motion with dynamics over 25.8g, at a throughput of 10kHz, processing over a million events per second. Our method is capable of tracking either camera motion or the motion of an object in front of it, using an error-state Kalman filter formulated in a Lie-theoretic sense. The method includes a robust mechanism for the matching of events with projected line segments with very fast outlier rejection. Meticulous treatment of sparse matrices is applied to achieve real-time performance. Different motion models of varying complexity are considered for the sake of comparison and performance analysis., This work was partially supported by the EU H2020 project GAUSS (H2020-Galileo-2017- 1-776293), by the Spanish State Research Agency through projects EB-SLAM (DPI2017- 89564-P) and the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656, and by a scholarship from SENESCYT, Republic of Ecuador to William Chamorro.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Dual-Branch CNNs for Vehicle Detection and Tracking on LiDAR Data

  • Vaquero, Victor
  • Pino, Iván del
  • Moreno-Noguer, Francesc
  • Solà, Joan
  • Sanfeliu, Alberto
  • Andrade-Cetto, Juan
We present a novel vehicle detection and tracking system that works solely on 3D LiDAR information. Our approach segments vehicles using a dual-view representation of the 3D LiDAR point cloud on two independently trained convolutional neural networks, one for each view. A bounding box growing algorithm is applied to the fused output of the networks to properly enclose the segmented vehicles. Bounding boxes are grown using a probabilistic method that takes into account also occluded areas. The final vehicle bounding boxes act as observations for a multi-hypothesis tracking system which allows to estimate the position and velocity of the observed vehicles. We thoroughly evaluate our system on the KITTI benchmarks both for detection and tracking separately and show that our dual-branch classifier consistently outperforms previous single-branch approaches, improving or directly competing to other state of the art LiDAR-based methods., This work is supported by the EU project LOGIMATIC (H2020-Galileo2015-1-687534), the Spanish State Research Agency through the Mar´ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656), the ColRobTransp project (DPI2016-78957-R AEI/FEDER EU), the EB-SLAM project (DPI2017-89564-P), and the FPU grant FPU15/04446.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Wolf: A Modular Estimation Framework for Robotics Based on Factor Graphs

  • Solà, Joan
  • Vallvé, Joan
  • Casalsm Joaquim
  • Deray, Jeremie
  • Fourmy, Mederic
  • Atchuthan, Dinesh
  • Corominas Murtra, Andreu
  • Andrade-Cetto, Juan
This letter introduces Wolf, a C++ estimation framework based on factor graphs and targeted at mobile robotics. Wolf can be used beyond SLAM to handle self-calibration, model identification, or the observation of dynamic quantities other than localization. The architecture of Wolf allows for a modular yet tightly-coupled estimator. Modularity is enhanced via reusable plugins that are loaded at runtime depending on application setup. This setup is achieved conveniently through YAML files, allowing users to configure a wide range of applications without the need of writing or compiling code. Most procedures are coded as abstract algorithms in base classes with varying levels of specialization. Overall, all these assets allow for coherent processing and favor code re-usability and scalability. Wolf can be used with ROS, and is made publicly available and open to collaboration., This work was partially supported by the EU H2020 projects LOGIMATIC (Galileo- 2015-1-687534), GAUSS (Galileo-2017-1-776293), TERRINET (INFRAIA- 2017-1-730994), and MEMMO (ICT-25-2017-1-780684); and by the Spanish State Research Agency through projects EB-SLAM (DPI2017-89564- P), EBCON (PID2020-119244GB-I00), and the Mar´ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Event transformer FlowNet for optical flow estimation

  • Tian, Yi
  • Andrade-Cetto, Juan
Trabajo presentado en la 33rd British Machine Vision Conference, celebrada en Londres (Gran Bretaña), del 21 al 24 de noviembre de 2022. Vídeo de la presentación disponible en: https://bmvc2022.mpi-inf.mpg.de/577/, Event cameras are bioinspired sensors that produce asynchronous and sparse streams of events at image locations where intensity change is detected. They can detect fast motion with low latency, high dynamic range, and low power consumption. Over the past decade, efforts have been conducted in developing solutions with event cameras for robotics applications. In this work, we address their use for fast and robust computation of optical flow. We present ET-FlowNet, a hybrid RNN-ViT architecture for optical flow estimation. Visual transformers (ViTs) are ideal candidates for the learning of global context in visual tasks, and we argue that rigid body motion is a prime case for the use of ViTs since long-range dependencies in the image hold during rigid body motion. We perform end-to-end training with self-supervised learning method. Our results show comparable and in some cases exceeding performance with state-of-the-art coarse-to-fine event-based optical flow estimation., This work was supported by projects EBSLAM DPI2017-89564-P and EBCON PID2020- 119244GB-I00 funded by MCIN/AEI/10.13039/501100011033 and by an FI AGAUR PhD grant to Yi Tian
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Spiking neural network for event camera ego-motion estimation

  • Tian, Yi
  • Andrade-Cetto, Juan
Resumen del trabajo presentado en el Materials for Sustainable Development Conference (MAT-SUS) (NFM22), celebrado en Barcelona (España), del 24 al 28 de octubre de 2022, Event cameras mimic the workings of the human bio visual pathway by sending image intensity change pulses to the neural system. They are a promising alternative to conventional frame-based cameras for detecting ultra fast motion with low latency, robustness to changes in illumination conditions, and low power consumption. These characteristics make them ideal for mobile robotic tasks. However, exploiting to its full capacity their unconventional sparse and asynchronous spatio-temporal data flow efficiently still challenges the computer vision community. Deep Artificial Neural Networks (ANN), especially, the recent architecture of visual transformers (ViT) have achieved state-of-the-art performance for various visual tasks. However, the straight-forward use of ANNs on event input data needs a preprocessing step that constraints its sparse and asynchronous nature. Inspired by computational neuroscience, Spiking Neural Networks (SNNs) turn out to be a natural match for event cameras due to their sparse event-driven and temporal processing characteristics. SNNs have been applied mostly for classification tasks. Some other works involve regression tasks for optical flow estimation, depth estimation angular velocity estimation, and video reconstruction. However, limited work has been done to incorporate SNNs for full 3D ego-motion estimation. We first present an optimization-based ego-motion estimation framework that exploits the event-based optical flow outputs of a trained SNN model. Our method successfully estimates pure rotation and pure translation motion from input events only and shows the potential of using SNNs for continuous ego-motion estimation tasks. Secondly, we show our Hybrid RNN-ViT architecture for optical flow estimation which uses ViT to learn global context yielding better results than SoA. We further present its SNN counterpart which combines SNNs to directly process the event data., This work was supported by projects EBSLAM DPI2017-89564-P and EBCON PID2020-119244GB-I00 funded by MCIN/AEI/10.13039/501100011033 and by an FI AGAUR PhD grant to Yi Tian.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

High-speed event camera tracking

  • Chamorro Hernández, William Oswaldo
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Solà Ortega, Joan|||0000-0002-2933-3381
Event cameras are bioinspired sensors with reaction times in the order of microseconds. This property makes them appealing for use in highly-dynamic computer vision applications. In this work, we explore the limits of this sensing technology and present an ultra-fast tracking algorithm able to estimate six-degree-of-freedom motion with dynamics over 25.8 g, at a throughput of 10 kHz, processing over a million events per second. Our method is capable of tracking either camera motion or the motion of an object in front of it, using an error-state Kalman filter formulated in a Lie-theoretic sense. The method includes a robust mechanism for the matching of events with projected line segments with very fast outlier rejection. Meticulous treatment of sparse matrices is applied to achieve real-time performance. Different motion models of varying complexity are considered for the sake of comparison and performance analysis., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Event transformer FlowNet for optical flow estimation

  • Tian, Yi|||0000-0002-8673-6363
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
Event cameras are bioinspired sensors that produce asynchronous and sparse streams of events at image locations where intensity change is detected. They can detect fast motion with low latency, high dynamic range, and low power consumption. Over the past decade, efforts have been conducted in developing solutions with event cameras for robotics applications. In this work, we address their use for fast and robust computation of optical flow. We present ET-FlowNet, a hybrid RNN-ViT architecture for optical flow estimation. Visual transformers (ViTs) are ideal candidates for the learning of global context in visual tasks, and we argue that rigid body motion is a prime case for the use of ViTs since long-range dependencies in the image hold during rigid body motion. We perform end-to-end training with self-supervised learning method. Our results show comparable and in some cases exceeding performance with state-of-the-art coarse-to-fine event-based optical flow estimation., This work was supported by projects EBSLAM DPI2017-89564-P and EBCON PID2020-119244GB-I00 funded by CIN/AEI/10.13039/501100011033 and by an FI AGAUR PhD grant to Yi Tian.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Squash-box feasibility driven differential dynamic programming

  • Martí Saumell, Josep|||0000-0001-7981-7942
  • Solà Ortega, Joan|||0000-0002-2933-3381
  • Mastalli, Carlos
  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Recently, Differential Dynamic Programming (DDP) and other similar algorithms have become the solvers of choice when performing non-linear Model Predictive Control (nMPC) with modern robotic devices. The reason is that they have a lower computational cost per iteration when compared with off-the-shelf Non-Linear Programming (NLP) solvers, which enables its online operation. However, they cannot handle constraints, and are known to have poor convergence capabilities. In this paper, we propose a method to solve the optimal control problem with control bounds through a squashing function (i.e. a sigmoid, which is bounded by construction). It has been shown that a naive use of squashing functions damage the convergence rate. To tackle this, we first propose to add a quadratic barrier that avoids the difficulty of the plateau produced by the sigmoid. Second, we add an outer loop that adapts both the sigmoid and the barrier; it makes the optimal control problem with the squashing function converge to the original control-bounded problem. To validate our method, we present simulation results for different types of platforms including a multi-rotor, a biped, a quadruped and a humanoid robot., This work was partially supported by the EU H2020 project GAUSS(H2020-Galileo-2017-1-776293), project EB-SLAM (DPI2017-89564-P),by the Spanish State Research Agency through the Mar ́ıa de Maeztu Sealof Excellence to IRI (MDM-2016-0656) and by the European Commissionunder the Horizon 2020 project Memory of Motion (MEMMO, projectID: 780684). Part of this research was carried out at the Jet PropulsionLaboratory, California Institute of Technology, under a contract with theNational Aeronautics and Space Administration (NASA, US, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Multi-task closed-loop inverse kinematics stability through semidefinite programming

  • Martí Saumell, Josep|||0000-0001-7981-7942
  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Ocampo-Martínez, Carlos|||0000-0001-9251-6044
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Today’s complex robotic designs comprise in some cases a large number of degrees of freedom, enabling for multi-objective task resolution (e.g., humanoid robots or aerial manipulators). This paper tackles the stability problem of a hierarchical closed-loop inverse kinematics algorithm for such highly redundant robots. We present a method to guarantee system stability by performing an online tuning of the closedloop control gains. We define a semi-definite programming problem (SDP) with these gains as decision variables and a discrete-time Lyapunov stability condition as a linear matrix inequality, constraining the SDP optimization problem and guaranteeing the stability of the prioritized tasks. To the best of authors’ knowledge, this work represents the first mathematical development of an SDP formulation that introduces stability conditions for a multi-objective closed-loop inverse kinematic problem for highly redundant robots. The validity of the proposed approach is demonstrated through simulation case studies, including didactic examples and a Matlab toolbox for the benefit of the community., This work was partially supported by the EU H2020 project GAUSS (H2020-Galileo-2017-1-776293), project EB-SLAM (DPI2017-89564-P) and by the Spanish State Research Agency through the Mar ́ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656). Part of this research was car-ried out at the Jet Propulsion Laboratory, California Institute of Technology,under a contract with the National Aeronautics and Space Administration(NASA, USA), Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Event transformer FlowNet for optical flow estimation

  • Tian, Yi
  • Andrade-Cetto, Juan
Event cameras are bioinspired sensors that produce asynchronous and sparse streams of events at image locations where intensity change is detected. They can detect fast motion with low latency, high dynamic range, and low power consumption. Over the past decade, efforts have been conducted in developing solutions with event cameras for robotics applications. In this work, we address their use for fast and robust computation of optical flow. We present ET-FlowNet, a hybrid RNN-ViT architecture for optical flow estimation. Visual transformers (ViTs) are ideal candidates for the learning of global context in visual tasks, and we argue that rigid body motion is a prime case for the use of ViTs since long-range dependencies in the image hold during rigid body motion. We perform end-to-end training with self-supervised learning method. Our results show comparable and in some cases exceeding performance with state-of-the-art coarse-to-fine event-based optical flow estimation., This work was supported by projects EBSLAM DPI2017-89564-P and EBCON PID2020-119244GB-I00 funded by CIN/AEI/10.13039/501100011033 and by an FI AGAUR PhD grant to Yi Tian., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multi-task closed-loop inverse kinematics stability through semidefinite programming

  • Martí Saumell, Josep
  • Santamaria Navarro, Àngel
  • Ocampo-Martínez, Carlos
  • Andrade-Cetto, Juan
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Today’s complex robotic designs comprise in some cases a large number of degrees of freedom, enabling for multi-objective task resolution (e.g., humanoid robots or aerial manipulators). This paper tackles the stability problem of a hierarchical closed-loop inverse kinematics algorithm for such highly redundant robots. We present a method to guarantee system stability by performing an online tuning of the closedloop control gains. We define a semi-definite programming problem (SDP) with these gains as decision variables and a discrete-time Lyapunov stability condition as a linear matrix inequality, constraining the SDP optimization problem and guaranteeing the stability of the prioritized tasks. To the best of authors’ knowledge, this work represents the first mathematical development of an SDP formulation that introduces stability conditions for a multi-objective closed-loop inverse kinematic problem for highly redundant robots. The validity of the proposed approach is demonstrated through simulation case studies, including didactic examples and a Matlab toolbox for the benefit of the community., This work was partially supported by the EU H2020 project GAUSS (H2020-Galileo-2017-1-776293), project EB-SLAM (DPI2017-89564-P) and by the Spanish State Research Agency through the Mar ́ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656). Part of this research was car-ried out at the Jet Propulsion Laboratory, California Institute of Technology,under a contract with the National Aeronautics and Space Administration(NASA, USA), Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

High-speed event camera tracking

  • Chamorro Hernández, William Oswaldo
  • Andrade-Cetto, Juan
  • Solà Ortega, Joan
Event cameras are bioinspired sensors with reaction times in the order of microseconds. This property makes them appealing for use in highly-dynamic computer vision applications. In this work, we explore the limits of this sensing technology and present an ultra-fast tracking algorithm able to estimate six-degree-of-freedom motion with dynamics over 25.8 g, at a throughput of 10 kHz, processing over a million events per second. Our method is capable of tracking either camera motion or the motion of an object in front of it, using an error-state Kalman filter formulated in a Lie-theoretic sense. The method includes a robust mechanism for the matching of events with projected line segments with very fast outlier rejection. Meticulous treatment of sparse matrices is applied to achieve real-time performance. Different motion models of varying complexity are considered for the sake of comparison and performance analysis., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Squash-box feasibility driven differential dynamic programming

  • Martí Saumell, Josep
  • Solà Ortega, Joan
  • Mastalli, Carlos
  • Santamaria Navarro, Àngel
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Recently, Differential Dynamic Programming (DDP) and other similar algorithms have become the solvers of choice when performing non-linear Model Predictive Control (nMPC) with modern robotic devices. The reason is that they have a lower computational cost per iteration when compared with off-the-shelf Non-Linear Programming (NLP) solvers, which enables its online operation. However, they cannot handle constraints, and are known to have poor convergence capabilities. In this paper, we propose a method to solve the optimal control problem with control bounds through a squashing function (i.e. a sigmoid, which is bounded by construction). It has been shown that a naive use of squashing functions damage the convergence rate. To tackle this, we first propose to add a quadratic barrier that avoids the difficulty of the plateau produced by the sigmoid. Second, we add an outer loop that adapts both the sigmoid and the barrier; it makes the optimal control problem with the squashing function converge to the original control-bounded problem. To validate our method, we present simulation results for different types of platforms including a multi-rotor, a biped, a quadruped and a humanoid robot., This work was partially supported by the EU H2020 project GAUSS(H2020-Galileo-2017-1-776293), project EB-SLAM (DPI2017-89564-P),by the Spanish State Research Agency through the Mar ́ıa de Maeztu Sealof Excellence to IRI (MDM-2016-0656) and by the European Commissionunder the Horizon 2020 project Memory of Motion (MEMMO, projectID: 780684). Part of this research was carried out at the Jet PropulsionLaboratory, California Institute of Technology, under a contract with theNational Aeronautics and Space Administration (NASA, US, Peer Reviewed, Postprint (author's final draft)