DESA: Disparity Estimation With Surface Awareness

• Published in: IEEE signal processing letters Vol. 28; pp. 2028 - 2032
• Main Authors: Sun, Shuqiao, Liu, Rongke, Sun, Shantong
• Format: Journal Article
• Language: English
• Published: New York IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Agglomeration; depth map; Distortion; Estimation; Geometry; Neural networks; scene reconstruction; Stereo image processing; Stereo matching; Surface distortion; surface normal; Three-dimensional displays; Training data
• ISSN: 1070-9908; 1558-2361
• DOI: 10.1109/LSP.2021.3113278

Depth map plays an important role in our daily life including automatic driving, intelligent robots, and commercial manufacture. However, existing depth estimation methods are still facing some difficulties in real-life applications. Firstly, using merely point-wise metrics during training usually causes surface distortion due to the lack of geometric restrictions. To tackle this problem, we introduce a normal restriction module to the network to improve the method performance with regards to surface integrity. Secondly, although 3D methods usually achieve higher accuracy by directly concatenating features as cost aggregation, they sacrifice the time and memory efficiency. To make the disparity estimation network light enough for adding the normal restriction, we propose a 2D aggregation method to replace the 3D ones. Experiments prove the effectiveness of our method and we show that our results are competitive to 3D methods under popular benchmarks including KITTI, SceneFlow and Midddlebury.