RUC. Repositorio da Universidade da Coruña
Publicación
Artículo científico (JournalArticle)
Variable Rate Deep Image Compression With Modulated Autoencoder
This version of the paper has been accepted for publication. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., [Abstract]: Variable rate is a requirement for flexible and adaptable image and video compression. However, deep image compression methods (DIC) are optimized for a single fixed rate-distortion (R-D) tradeoff. While this can be addressed by training multiple models for different tradeoffs, the memory requirements increase proportionally to the number of models. Scaling the bottleneck representation of a shared autoencoder can provide variable rate compression with a single shared autoencoder. However, the R-D performance using this simple mechanism degrades in low bitrates, and also shrinks the effective range of bitrates. To address these limitations, we formulate the problem of variable R-D optimization for DIC, and propose modulated autoencoders (MAEs), where the representations of a shared autoencoder are adapted to the specific R-D tradeoff via a modulation network. Jointly training this modulated autoencoder and the modulation network provides an effective way to navigate the R-D operational curve. Our experiments show that the proposed method can achieve almost the same R-D performance of independent models with significantly fewer parameters, This
work was supported in part by Audi Electronics Venture GmbH. The Computer
Vision Center (CVC) was supported by the Generalitat de Catalunya CERCA
Program and its ACCIO agency. The work of F. Yang was supported by the
Chinese Scholarship Council under Grant 201706290127. The work of L. Herranz was supported by the Spanish project RTI2018-102285-A-I00. The work
of J. van de Weijer was supported by the Spanish project TIN2016-79717-R.
The work of A. M. López and J. A. I. Guitián was supported by the project
TIN2017-88709-R (MINECO/AEI/FEDER, UE). The work of A. M. López
was also supported by the ICREA Academia programme. The work of J. A. I.
Guitián and L. Herranz was supported by the EU’s Horizon 2020 Research and
Innovation Programme under the Marie Skłodowska-Curie Grant 665919
Proyecto:
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-102285-A-I00
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 TIN2016-79717-R
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2013-2016 TIN2017-88709-R
,
EC / H2020 665919
HANDLE: http://hdl.handle.net/2183/41940
Ver en: http://hdl.handle.net/2183/41940