Pixelated image abstraction with integrated user constraints

• Published in: Computers & graphics Vol. 37; no. 5; pp. 333 - 347
• Main Authors: Gerstner, Timothy, DeCarlo, Doug, Alexa, Marc, Finkelstein, Adam, Gingold, Yotam, Nealen, Andrew
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.08.2013
• Subjects: Approximation; Artists; Color; Color quantization; Image abstraction; Image manipulation; Image segmentation; Manual control; Mathematical analysis; Non-photorealistic rendering; Pixel art; Pixels; Non-photorealistic rendering; Image segmentation; Image abstraction; Color quantization; Pixel art
• ISSN: 0097-8493; 1873-7684
• DOI: 10.1016/j.cag.2012.12.007

We present an automatic method that can be used to abstract high resolution images into very low resolution outputs with reduced color palettes in the style of pixel art. Our method simultaneously solves for a mapping of features and a reduced palette needed to construct the output image. The results are an approximation to the results generated by pixel artists. We compare our method against the results of two naive methods common to image manipulation programs, as well as the hand-crafted work of pixel artists. Through a formal user study and interviews with expert pixel artists we show that our results offer an improvement over the naive methods. By integrating a set of manual controls into our algorithm, we give users the ability to add constraints and incorporate their own choices into the iterative process. [Display omitted] ► We propose an automated image processing method that approximates pixel art. ► We compare our method to naive methods and the work of pixel artists. ► Formal user study and interviews with experts demonstrate advantages of our method. ► Additional user controls allow flexible use of feedback to guide algorithm.