Attention-based Convolutional Neural Network for Computer Vision Color Constancy

• Published in: 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA) pp. 372 - 377
• Main Authors: Koscevic, Karlo, Subasic, Marko, Loncaric, Sven
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2019
• Subjects: Attention mechanism; color constancy; Computer vision; Convolution; Convolutional neural networks; deep learning; Estimation; illumination estimation; Image color analysis; image enhancement; Lighting; Training
• ISSN: 1849-2266
• DOI: 10.1109/ISPA.2019.8868806

Achieving color constancy is an important part of image preprocessing pipeline of contemporary digital cameras. Its goal is to eliminate the influence of the illumination color on the colors of the objects in the image scene. State-of-the-art results have been achieved with learning-based methods, especially when the deep learning approaches have been applied. Several methods that are combining local patches for global illumination estimations exist. However, in this paper, a new convolutional neural network architecture is proposed. It is trained to look for the regions, i.e., patches in the image where the most useful information about the scene illumination is contained. This is achieved with the attention mechanism stacked on top of the pretrained convolutional neural network. Additionally, the common problem of the lack of data in color constancy benchmark datasets is alleviated utilizing the stage-wise training. Experimental results show that the proposed approach achieves competitive results.