A non-photorealistic rendering framework with temporal coherence for augmented reality

• Published in: 2012 IEEE International Symposium on Mixed and Augmented Reality pp. 151 - 160
• Main Authors: Chen, Jiajian, Turk, Greg, MacIntyre, Blair
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2012
• Subjects: Algorithm design and analysis; and Virtual Realities; Augmented; Brushes; Coherence; Computational modeling; H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems-Artificial; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism-Virtual Reality; Rendering (computer graphics); Solid modeling; Tensile stress
• ISBN: 9781467346603; 1467346608
• DOI: 10.1109/ISMAR.2012.6402552

Many augmented reality (AR) applications require a seamless blending of real and virtual content as key to increased immersion and improved user experiences. Photorealistic and non-photorealistic rendering (NPR) are two ways to achieve this goal. Compared with photorealistic rendering, NPR stylizes both the real and virtual content and makes them indistinguishable. Maintaining temporal coherence is a key challenge in NPR. We propose a NPR framework with support for temporal coherence by leveraging model-space information. Our systems targets painterly rendering styles of NPR. There are three major steps in this rendering framework for creating coherent results: tensor field creation, brush anchor placement, and brush stroke reshaping. To achieve temporal coherence for the final rendered results, we propose a new projection-based surface sampling algorithm which generates anchor points on model surfaces. The 2D projections of these samples are uniformly distributed in image space for optimal brush stroke placement. We also propose a general method for averaging various properties of brush stroke textures, such as their skeletons and colors, to further improve the temporal coherence. We apply these methods to both static and animated models to create a painterly rendering style for AR. Compared with existing image space algorithms our method renders AR with NPR effects with a high degree of coherence.