A high resolution grammatical model for face representation and sketching

• Published in: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) Vol. 2; pp. 470 - 477 vol. 2
• Main Authors: Zijian Xu, Hong Chen, Song-Chun Zhu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2005
• Subjects: Active appearance model; Active shape model; Dictionaries; Eyebrows; Eyes; Face; Principal component analysis; Rendering (computer graphics); Skin; Switches
• ISBN: 0769523722; 9780769523729
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2005.32

In this paper we present a generative, high resolution face representation which extends the well-known active appearance model (AAM) with two additional layers. (i) One layer refines the global AAM (PCA) model with a dictionary of learned face components to account for the shape and intensity variabilities of eyes, eyebrows, nose and mouth, (ii) the other layer divides the face skin into 9 zones with a learned dictionary of sketch primitives to represent skin marks and wrinkles. This model is no longer of fixed dimensions and is flexible for it can select the diverse representations in the dictionaries of face components and skin features depending on the complexity of the face. The selection is modulated by the grammatical rules through hidden "switch " variables. Our comparison experiments demonstrate that this model can achieve nearly lossless coding of face at high resolution (256 /spl times/ 256 pixels) with low bits. We also show that the generative model can easily generate cartoon sketches by changing the rendering dictionary. Our face model is aimed at a number of applications including cartoon sketch in non-photorealistic rendering, super-resolution in image processing, and low bit face communication in wireless platforms.