DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Contribución de congreso (ConferenceOutput)
Body size and depth disambiguation in multi-person reconstruction from single images
Trabajo presentado en la 9th International Conference on 3D Vision, celebrada online del 1 al 3 de diciembre de 2021, We address the problem of multi-person 3D body pose and shape estimation from a single image. While this problem can be addressed by applying single-person approaches multiple times for the same scene, recent works have shown the advantages of building upon deep architectures that simultaneously reason about all people in the scene in a holistic manner by enforcing, e.g., depth order constraints or minimizing interpenetration among reconstructed bodies. However, existing approaches are still unable to capture the size variability of people caused by the inherent body scale and depth ambiguity. In this work we tackle this challenge by devising a novel optimization scheme that learns the appropriate body scale and relative camera pose, by enforcing the feet of all people to remain on the ground floor. A thorough evaluation on MuPoTS-3D and 3DPW datasets demonstrates that our approach is able to robustly estimate the body translation and shape of multiple people while retrieving their spatial arrangement, consistently improving current state-of-the-art, especially in scenes with people of very different heights., This work is partly supported by
the Spanish government with the project MoHuCo PID2020-
120049RB-I00, the ERA-Net Chistera project IPALM PCI2019-
103386 and Mar´ıa de Maeztu Seal of Excellence MDM-2016-
0656. Adria Ruiz acknowledges financial support from MICINN
(Spain) through the program Juan de la Cierva.