Palette-Based Image Recoloring Using Color Decomposition Optimization

• Published in: IEEE transactions on image processing Vol. 26; no. 4; pp. 1952 - 1964
• Main Authors: Zhang, Qing, Xiao, Chunxia, Sun, Hanqiu, Tang, Feng
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.04.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Color; color decomposition; Electronic mail; Histograms; Image coding; Image color analysis; Image manipulation; Image recoloring; Image segmentation; Optimization; palette
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2017.2671779

Previous works on palette-based color manipulation typically fail to produce visually pleasing results with vivid color and natural appearance. In this paper, we present an approach to edit colors of an image by adjusting a compact color palette. Different from existing methods that fail to preserve inherent color characteristics residing in the source image, we propose a color decomposition optimization for flexible recoloring while retaining these characteristics. For an input image, we first employ a variant of the k -means algorithm to create a palette consisting of a small set of most representative colors. Next, we propose a color decomposition optimization to decompose colors of the entire image into linear combinations of basis colors in the palette. The captured linear relationships then allow us to recolor the image by recombining the coding coefficients with a user-modified palette. Qualitative comparisons with existing methods show that our approach can more effectively recolor images. Further user study quantitatively demonstrates that our method is a good candidate for color manipulation tasks. In addition, we showcase some applications enabled by our method, including pattern colorings suggesting, color transfer, tissue staining analysis and color image segmentation.