Tangible images of real life scenes

• Published in: Computers & graphics Vol. 64; pp. 62 - 73
• Main Authors: Zhang, Xingzi, Goesele, Michael, Sourin, Alexei
• Format: Journal Article
• Language: English
• Published: Oxford Elsevier Ltd 01.05.2017; Elsevier Science Ltd
• Subjects: 3-D graphics; Computer graphics; Feasibility studies; Haptic interaction; Image reconstruction; Large-scale imperfect polygon mesh; Life assessment; Polygons; Tangible image; Virtual reality; Haptic interaction; Large-scale imperfect polygon mesh; Tangible image
• ISSN: 0097-8493; 1873-7684
• DOI: 10.1016/j.cag.2017.02.004

•A way of haptic interaction with the reconstructed real life scenes is proposed.•Original images of the real scenes are augmented with the reconstructed meshes.•Smooth interactive haptic rendering of multi-million polygons is supported.•The feasibility and usability of the proposed method is evaluated in a user study. Haptic technologies allow for adding a new “touching” modality into virtual scenes. 3D reconstruction of a real life scene results, however, often in millions of polygons which cannot be simultaneously visualized and haptically rendered. In this paper, we propose a way of haptic interaction with real life scenes where multiple original images of the real scenes are augmented with reconstructed polygon meshes. We present our solution to the problems of haptic model alignment with the images and interactive haptic rendering of large polygon meshes with reconstruction artifacts. In particular, the presented collision detection algorithm is not restricted by any hypothesis and robust enough to support smooth interaction with millions of polygons. The feasibility and usability of the proposed solution is evaluated in a user study. [Display omitted]