A Method of Video Production Using Dynamic 3D Models and its Application to Making Scenes of a Crowd

• Published in: SMPTE motion imaging journal Vol. 118; no. 7; pp. 29 - 36
• Main Authors: Hisatomi, Kensuke, Tomiyama, Kimihiro, Katayama, Miwa, Iwadate, Yuichi, Matsunaga, Koji, Ito, Yoshiyuki, Ishihara, Wataru
• Format: Magazine Article
• Language: English
• Published: SMPTE 01.10.2009
• ISSN: 1545-0279; 2160-2492
• DOI: 10.5594/J15983

This paper describes a method of producing scenes for TV programs, using "dynamic 3D human models." Dynamic 3D human models are 3D models generated from images shot by multiple cameras surrounding an actor for each frame using 3D-reconstruction and texture-mapping techniques. They can provide highly realistic images as well as natural motions without having to use a motion-capture system. In addition, they allow production to be more flexible, enabling the positions of models to be changed or multiplying the amount used. Dynamic 3D human models are therefore suitable for producing crowd scenes. Although techniques of 3D reconstruction and texture mapping have been discussed and several applications have been proposed, they have not been widely introduced into TV or movie production, because of the huge amounts of data and insufficient textural quality. By establishing an efficient production flow with recent powerful computers and 24 HD cameras, the authors succeeded in producing crowd scenes with sufficient quality for a TV program, which will be aired in December 2009. The scenes involving 1,000 soldiers can be produced by shooting several sequences with two actors. The production flow that was established is described as well as scenes that were produced using dynamic 3D human models for a drama.