Image Surround: Automatic Projector Calibration for Indoor Adaptive Projection

• Published in: Intelligent Technologies for Interactive Entertainment pp. 156 - 162
• Main Authors: Ben Madhkour, Radhwan, Burczykowski, Ludovic, Mancaş, Matei, Gosselin, Bernard
• Format: Book Chapter
• Language: English
• Published: Cham Springer International Publishing
• Series: Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
• Subjects: calibration; projection; scene augmentation; tracking
• ISBN: 3319038915; 9783319038919
• ISSN: 1867-8211; 1867-822X
• DOI: 10.1007/978-3-319-03892-6_18

In this paper, we present a system able to calibrate projectors, perform 3D reconstruction and project shadow and textures generated in real-time. The calibration algorithm is based on Heikkila’s camera calibration algorithm. It combines Gray coded structured light patterns projection and a RGBD camera. Any projection surface can be used. Intrinsic and extrinsic parameters are computed without a scale factor uncertainty and any prior knowledge about the projector and the projection surface. The projector calibration is used as a basis to augment the scene with information from the RGBD camera. Shadows are generated with lights. Their position is modified in real-time to follow a user position. The 3D reconstruction is based on the Kinect fusion algorithm. The model of scene is used to apply texture on the scene and to generate correct shadows.