RGBD2lux: Dense Light Intensity Estimation With an RGBD Sensor

• Published in: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) pp. 501 - 510
• Main Authors: Tsesmelis, Theodore, Hasan, Irtiza, Cristani, Marco, Galasso, Fabio, Bue, Alessio Del
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.01.2019
• Subjects: Cameras; Computational modeling; Light sources; Lighting; Software; Solid modeling; Three-dimensional displays
• DOI: 10.1109/WACV.2019.00059

Lighting design and modelling or industrial applications like luminaire planning and commissioning rely heavily on time-consuming manual measurements or on physically coherent computational simulations. Regarding the latter, standard approaches are based on CAD modeling simulations and offline rendering, with long processing times and therefore inflexible workflows. Thus, in this paper we propose a computer vision based system to measure lighting with just a single RGBD camera. The proposed method uses both depth data and images from the sensor to provide a dense measure of light intensity in the field of view of the camera. We evaluate our system on novel ground truth data and compare it to state-of-the-art commercial light planning software. Our system provides improved performance, while being completely automated, given that the CAD model is extracted from the depth and the albedo estimated with the support of RGB images. To the best of our knowledge, this is the first automatic framework for the estimation of lighting in general indoor scenarios from RGBD input.