DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication
Contribución de congreso (ConferenceOutput)
GANimation: Anatomically-aware facial animation from a single image
Trabajo presentado en la 15th European Conference, celebrada en Munich, (Germany) del 8 al 14 de septiembre de 2018, Recent advances in Generative Adversarial Networks (GANs) have shown impressive results for task of facial expression synthesis. The most successful architecture is StarGAN, that conditions GANs’ generation process with images of a specific domain, namely a set of images of persons sharing the same expression. While effective, this approach can only generate a discrete number of expressions, determined by the content of the dataset. To address this limitation, in this paper, we introduce a novel GAN conditioning scheme based on Action Units (AU) annotations, which describes in a continuous manifold the anatomical facial movements defining a human expression. Our approach allows controlling the magnitude of activation of each AU and combine several of them. Additionally, we propose a fully unsupervised strategy to train the model, that only requires images annotated with their activated AUs, and exploit attention mechanisms that make our network robust to changing backgrounds and lighting conditions. Extensive evaluation show that our approach goes beyond competing conditional generators both in the capability to synthesize a much wider range of expressions ruled by anatomically feasible muscle movements, as in the capacity of dealing with images in the wild., This work is partially supported by the Spanish Ministry of Economy and Competitiveness under projects HuMoUR TIN2017-90086-R, ColRobTransp DPI2016-78957 and María de Maeztu Seal of Excellence MDM-2016-0656; by the EU project AEROARMS ICT-2014-1-644271; and by the Grant R01-DC- 014498 of the National Institute of Health. We also thank Nvidia for hardware donation under the GPU Grant Program., Peer reviewed
Project:
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 DPI2016-78957
,
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 MDM-2016-0656
,
MINECO / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 ICT-2014-1-644271
View at: http://hdl.handle.net/10261/179724