Model effectiveness prediction and system adaptation for photometric stereo in murky water

• Published in: Computer vision and image understanding Vol. 150; pp. 126 - 138
• Main Authors: Tsiotsios, C., Kim, T.K., Davison, A.J., Narasimhan, S.G.
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.09.2016
• Subjects: Dynamics; Errors; Illumination; Lighting; Mathematical models; Photometric stereo; Photometry; Reconstruction; Underwater; Underwater vision; Underwater vision; Illumination; Photometric stereo
• ISSN: 1077-3142; 1090-235X
• DOI: 10.1016/j.cviu.2016.03.002

•Different models for Photometric Stereo in murky water are evaluated considering realistic imaging conditions.•A system with dynamic lighting is proposed that predicts the validity of a photometric model without prior knowledge of the scene geometry.•The optimal light position is adapted according to the scenario. In murky water, the light interaction with the medium particles results in a complex image formation model that is hard to use effectively with a shape estimation framework like Photometric Stereo. All previous approaches have resorted to necessary model simplifications that were though used arbitrarily, without describing how their validity can be estimated in an unknown underwater situation. In this work, we evaluate the effectiveness of such simplified models and we show that this varies strongly with the imaging conditions. For this reason, we propose a novel framework that can predict the effectiveness of a photometric model when the scene is unknown. To achieve this we use a dynamic lighting framework where a robotic platform is able to probe the scene with varying light positions, and the respective change in estimated surface normals serves as a faithful proxy of the true reconstruction error. This creates important benefits over traditional Photometric Stereo frameworks, as our system can adapt some critical factors to an underwater scenario, such as the camera-scene distance and the light position or the photometric model, in order to minimize the reconstruction error. Our work is evaluated through both numerical simulations and real experiments for different distances, underwater visibilities and light source baselines.