Thermal Infrared Image Inpainting via Edge-Aware Guidance

Image inpainting has achieved fundamental advances with deep learning. However, almost all existing inpainting methods aim to process natural images, while few target Thermal Infrared (TIR) images, which have widespread applications. When applied to TIR images, conventional inpainting methods usuall...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Wang, Zeyu, Shen, Haibin, Men, Changyou, Sun, Quan, Huang, Kejie
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 28.10.2022
Subjects
Deep learning
Edge detection
Image reconstruction
Infrared imagery
Online AccessGet full text

Cover

More Information
Summary:Image inpainting has achieved fundamental advances with deep learning. However, almost all existing inpainting methods aim to process natural images, while few target Thermal Infrared (TIR) images, which have widespread applications. When applied to TIR images, conventional inpainting methods usually generate distorted or blurry content. In this paper, we propose a novel task -- Thermal Infrared Image Inpainting, which aims to reconstruct missing regions of TIR images. Crucially, we propose a novel deep-learning-based model TIR-Fill. We adopt the edge generator to complete the canny edges of broken TIR images. The completed edges are projected to the normalization weights and biases to enhance edge awareness of the model. In addition, a refinement network based on gated convolution is employed to improve TIR image consistency. The experiments demonstrate that our method outperforms state-of-the-art image inpainting approaches on FLIR thermal dataset.
ISSN:2331-8422