Structure from Motion Based Approaches to 3D Reconstruction in Minimal Invasive Laparoscopy

• Published in: Image Analysis and Recognition pp. 296 - 303
• Main Authors: Vélez, Andrés F. Mármol, Marcinczak, Jan Marek, Grigat, Rolf-Rainer
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2012
• Series: Lecture Notes in Computer Science
• Subjects: Bundle Adjustment; Computer Aided Diagnosis; Endoscopy; Epipolar geometry; Image Reconstruction; Laparoscopy; Optimal triangulation; PnP problem; Rigid Registration; Structure from Motion
• ISBN: 3642312977; 9783642312977
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-642-31298-4_35

The present article proposes a Structure from Motion (SfM) methodology to recover the liver surface from endoscopic video sequences. Features from an imaged liver are extracted and tracked for the complete sequence to generate a correspondences lookup table (C-LUT) between all frames. A keyframe selection code extracts two frames, from which the relative pose of the camera is reconstructed using a MSAC-based 5-Point algorithm. Techniques such as an optimal triangulation method and a PnP resection algorithm are also used to obtain an initial 3D surface of the liver. A global Bundle Adjustment step refines the initial reconstruction. Proper parametrization and conditioning of these techniques are compared and evaluated under typical laparoscopic uncertainties arising from patient, illumination, reflections, image quality and organs’ location among others. A robotic system and grid patterns are used to provide camera pose and surface ground truth data respectively.