NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields

• Published in: IEEE transactions on visualization and computer graphics Vol. 29; no. 5; pp. 2732 - 2742
• Main Authors: Song, Liangchen, Chen, Anpei, Li, Zhong, Chen, Zhang, Chen, Lele, Yuan, Junsong, Xu, Yi, Geiger, Andreas
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.05.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Cameras; Decomposition; Dynamics; free-viewpoint video; Image reconstruction; immersive video; Modelling; NeRF; Neural rendering; Reconstruction; Rendering; Rendering (computer graphics); Representations; Spatiotemporal phenomena; Streaming media; Three-dimensional displays; Websites

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we present an efficient framework capable of fast reconstruction, com...