Towards mesh saliency in 6 degrees of freedom

• Published in: Neurocomputing (Amsterdam) Vol. 502; pp. 120 - 139
• Main Authors: Ding, Xiaoying, Chen, Zhenzhong
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.09.2022
• Subjects: 6DoF; 6DoF mesh saliency detection; Visual attention behavior; 6DoF; Visual attention behavior; 6DoF mesh saliency detection
• ISSN: 0925-2312; 1872-8286
• DOI: 10.1016/j.neucom.2022.06.088

In this work, a novel 6DoF mesh saliency database is developed which provides both the subject’s 6DoF data and eye-movement data. Different from traditional databases, subjects in the experiment are allowed to move freely to view 3D meshes in the virtual reality environment. Based on the database, we first analyze the inter-observer variation and the influence of viewing direction toward subject’s visual attention, then we provide investigations about the subject’s visual attention bias and head movement during observation. As traditional 3D mesh saliency detection algorithms do not taking the subject’s head movement into consideration, we further propose a 6DoF mesh saliency detection algorithm based on the uniqueness measure and the bias preference. To evaluate the proposed approach, we design an evaluation metric accordingly which takes the 6DoF information into consideration, and extend some state-of-the-art 3D saliency detection methods to make comparisons. The experimental results demonstrate the superior performance of our approach for 6DoF mesh saliency detection, in addition to providing benchmarks for the presented 6DoF mesh saliency database. The database and proposed method will be made publicly available for research purposes.