Interactive modelling for AR applications

• Published in: 2010 9th IEEE International Symposium on Mixed and Augmented Reality pp. 199 - 205
• Main Authors: Bastian, J, Ward, B, Hill, R, van den Hengel, A, Dick, A
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2010
• Subjects: and virtual realities; augmented; Cameras; H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems-Artificial; I.4.6 [Image Processing and Computer Vision]: Segmentation-Pixel classification; I.4.8 [Image Processing and Computer Vision]: Scene Analysis-Shape; Image color analysis; Image segmentation; Pixel; Shape; Solid modeling; Three dimensional displays
• ISBN: 9781424493432; 1424493439
• DOI: 10.1109/ISMAR.2010.5643570

We present a method for estimating the 3D shape of an object from a sequence of images captured by a hand-held device. The method is well suited to augmented reality applications in that minimal user interaction is required, and the models generated are of an appropriate form. The method proceeds by segmenting the object in every image as it is captured and using the calculated silhouette to update the current shape estimate. In contrast to previous silhouette-based modelling approaches, however, the segmentation process is informed by a 3D prior based on the previous shape estimate. A voting scheme is also introduced in order to compensate for the inevitable noise in the camera position estimates. The combination of the voting scheme with the closed-loop segmentation process provides a robust and flexible shape estimation method. We demonstrate the approach on a number of scenes where segmentation without a 3D prior would be challenging.