Real-Time Radiance Fields for Single-Image Portrait View Synthesis

• Main Authors: Trevithick, Alex, Chan, Matthew, Stengel, Michael, Chan, Eric R, Liu, Chao, Yu, Zhiding, Khamis, Sameh, Chandraker, Manmohan, Ramamoorthi, Ravi, Nagano, Koki
• Format: Journal Article
• Language: English
• Published: 03.05.2023
• Subjects: Computer Science - Artificial Intelligence; Computer Science - Computer Vision and Pattern Recognition; Computer Science - Graphics; Computer Science - Learning

We present a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time. Given a single RGB input, our image encoder directly predicts a canonical triplane representation of a neural radiance field for 3D-aware novel view syn...