DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Contribución de congreso (ConferenceOutput)
Event transformer FlowNet for optical flow estimation
Trabajo presentado en la 33rd British Machine Vision Conference, celebrada en Londres (Gran Bretaña), del 21 al 24 de noviembre de 2022. Vídeo de la presentación disponible en: https://bmvc2022.mpi-inf.mpg.de/577/, Event cameras are bioinspired sensors that produce asynchronous and sparse streams of events at image locations where intensity change is detected. They can detect fast motion with low latency, high dynamic range, and low power consumption. Over the past decade, efforts have been conducted in developing solutions with event cameras for robotics applications. In this work, we address their use for fast and robust computation of optical flow. We present ET-FlowNet, a hybrid RNN-ViT architecture for optical flow estimation. Visual transformers (ViTs) are ideal candidates for the learning of global context in visual tasks, and we argue that rigid body motion is a prime case for the use of ViTs since long-range dependencies in the image hold during rigid body motion. We perform end-to-end training with self-supervised learning method. Our results show comparable and in some cases exceeding performance with state-of-the-art coarse-to-fine event-based optical flow estimation., This work was supported by projects EBSLAM DPI2017-89564-P and EBCON PID2020-
119244GB-I00 funded by MCIN/AEI/10.13039/501100011033 and by an FI AGAUR PhD
grant to Yi Tian