Repositorio Digital de la UPF
Publicación
Contribución de congreso (ConferenceOutput)
A new benchmark and baseline for real-time high-resolution image inpainting on edge devices
Existing image inpainting methods have shown impressive completion results for low-resolution images. However, most of these algorithms fail at high resolutions and require powerful hardware, limiting their deployment on edge devices. Motivated by this, we propose the first baseline for REal-Time High Resolution image INpainting on Edge Devices (RETHINED) that is able to inpaint at ultra-high-resolution and can run in real-time (≤ 30ms) in a wide variety of mobile devices. A simple, yet effective novel method formed by a lightweight Convolutional Neural Network (CNN) to recover structure, followed by a resolution-agnostic patch replacement mechanism to provide detailed texture. Specially our pipeline leverages the structural capacity of CNN and the high-level detail of patch-based methods, which is a key component for highresolution image inpainting. To demonstrate the real application of our method, we conduct an extensive analysis on various mobile-friendly devices and demonstrate similar inpainting performance while being 100 × faster than existing state-of-the-art methods. Furthemore, we realease
DF8K-Inpainting, the first free-form mask UHD inpainting dataset., This project is supported by MICINN/FEDER UE project ref. PID2021-127643NB-I00 and Doctorals Industrials ref. DI 2022 075 founded by the Government of Catalonia
Proyecto:
ES / 3PE PID2021-127643