4D light field segmentation with spatial and angular consistencies

• Published in: 2016 IEEE International Conference on Computational Photography (ICCP) pp. 1 - 8
• Main Authors: Mihara, Hajime, Funatomi, Takuya, Tanaka, Kenichiro, Kubo, Hiroyuki, Mukaigawa, Yasuhiro, Nagahara, Hajime
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2016
• Subjects: Image color analysis; Image edge detection; Image segmentation; Minimization; Redundancy; Support vector machines; Three-dimensional displays
• DOI: 10.1109/ICCPHOT.2016.7492872

In this paper, we describe a supervised four-dimensional (4D) light field segmentation method that uses a graph-cut algorithm. Since 4D light field data has implicit depth information and contains redundancy, it differs from simple 4D hyper-volume. In order to preserve redundancy, we define two neighboring ray types (spatial and angular) in light field data. To obtain higher segmentation accuracy, we also design a learning-based likelihood, called objectness, which utilizes appearance and disparity cues. We show the effectiveness of our method via numerical evaluation and some light field editing applications using both synthetic and real-world light fields.