The algorithm of stereo vision and shape from shading based on endoscope imaging

• Published in: Biomedical signal processing and control Vol. 76; p. 103658
• Main Authors: Cao, Ziyi, Wang, Yaxiang, Zheng, Wenfeng, Yin, Lirong, Tang, Yushan, Miao, Wang, Liu, Shan, Yang, Bo
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.07.2022
• Subjects: Binocular stereo vision; Endoscopic imaging; Minimally invasive surgery; SFS method; Three-dimensional reconstruction; Binocular stereo vision; Minimally invasive surgery; SFS method; Three-dimensional reconstruction; Endoscopic imaging
• ISSN: 1746-8094; 1746-8108
• DOI: 10.1016/j.bspc.2022.103658

•Minimally invasive surgery has become an essential technic in medical practice and has higher requirements for the operator.•This paper constructs a joint objective function based on the improved SFS and the classical stereo matching method.•The framework's effectiveness is verified by analysis based on the silica-gel-heart and real-heart image datasets.•The results show that the new framework can restore the whole heart surface shape and retain the local details.•The proposed joint reconstruction method has better robustness and reconstruction accuracy. With medical endoscopic equipment development, minimally invasive surgery (MIS) has gradually become an essential technical means in daily medical practice. In recent years, minimally invasive surgery has been widely used because of its small incision and quick recovery. However, at the same time, minimally invasive surgery has put forward higher requirements for the operator. A 3D reconstruction framework combined with stereo vision and Shape from Shading (SFS) was proposed to improve endoscopic imaging accuracy and reduce the difficulty of minimally invasive surgery. This paper constructs a joint objective function based on the improved SFS and the classical stereo matching method. The optimization algorithm of the depth map under the joint objective function is given. Finally, the experimental verification of the joint reconstruction algorithm is carried out. The joint reconstruction framework's effectiveness is verified by qualitative and quantitative comparison and analysis based on the silica-gel-heart model and real-heart image datasets. The experimental results show that the joint reconstruction framework can restore the heart surface shape as a whole and retain the local details. Compared with the classical stereo vision and SFS methods, the proposed joint reconstruction method has better robustness and reconstruction accuracy.