DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Contribución de congreso (ConferenceOutput)
Context-aware human motion prediction
Trabajo presentado en la IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), celebrada en Seattle (Estados Unidos) del 13 al 19 de junio de 2020, The problem of predicting human motion given a sequence of past observations is at the core of many applications in robotics and computer vision. Current state-of-the-art formulate this problem as a sequence-to-sequence task, in which a historical of 3D skeletons feeds a Recurrent Neural Network (RNN) that predicts future movements, typically in the order of 1 to 2 seconds. However, one aspect that has been obviated so far, is the fact that human motion is inherently driven by interactions with objects and/or other humans in the environment. In this paper, we explore this scenario using a novel context-aware motion prediction architecture. We use a semantic-graph model where the nodes parameterize the human and objects in the scene and the edges their mutual interactions. These interactions are iteratively learned through a graph attention layer, fed with the past observations, which now include both object and human body motions. Once this semantic graph is learned, we inject it to a standard RNN to predict future movements of the human/s and object/s. We consider two variants of our architecture, either freezing the contextual interactions in the future of updating them. A thorough evaluation in the “Whole-Body Human Motion Database” [29] shows that in both cases, our context-aware networks clearly outperform baselines in which the context information is not considered., This work has been partially funded
by the Spanish government under projects HuMoUR
TIN2017-90086-R, ERA-Net Chistera project IPALM
PCI2019-103386 and Mar´ıa de Maeztu Seal of Excellence
MDM-2016-0656. We also thank Nvidia for hardware donation.
Proyecto:
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 TIN2017-90086-R
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PCI2019-103386
,
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 MDM-2016-0656