Pasar al contenido principal

NUEVA GENERACION DE SISTEMAS DE VISION INTELIGENTES PARA PROCESAMIENTO EN TIEMPO REAL CON SENSORES BIO-INSPIRADOS

PID2019-109434RA-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE GRANADA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 1
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Visual event-based egocentric human action recognition

  • Moreno-Noguer, Francesc
  • Traver, V. Javier
  • Barranco, Francisco
  • Dimiccoli, Mariella
  • Pla, Filiberto
Trabajo presentado en la 10th Iberian Conference on Pattern Recognition and Image Analysis, celebrada en Aveiro (Portugal), del 4 al 6 de mayo de 2022, This paper lies at the intersection of three research areas: human action recognition, egocentric vision, and visual event-based sensors. The main goal is the comparison of egocentric action recognition performance under either of two visual sources: conventional images, or event-based visual data. In this work, the events, as triggered by asynchronous event sensors or their simulation, are spatio-temporally aggregated into event frames (a grid-like representation). This allows to use exactly the same neural model for both visual sources, thus easing a fair comparison. Specifically, a hybrid neural architecture combining a convolutional neural network and a recurrent network is used. It is empirically found that this general architecture works for both, conventional gray-level frames, and event frames. This finding is relevant because it reveals that no modification or adaptation is strictly required to deal with event data for egocentric action classification. Interestingly, action recognition is found to perform better with event frames, suggesting that these data provide discriminative information that aids the neural model to learn good features., Work supported by project UJI-B2018-44 from Pla de promoció de la investigació de la Universitat Jaume I, Spain, the research network RED2018-102511-T, from the Spanish Ministerio de Ciencia, Innovación y Universidades, and by National Grant PID2019-109434RA-I00/ SRA (State Research Agency /10.13039/501100011033)., Peer reviewed