Elevating Mesh Saliency in VR: Introducing a Novel Prediction Network and Dataset

• Published in: ACM transactions on multimedia computing communications and applications
• Main Authors: Zhang, Kaiwei, He, Mohan, Zhu, Dandan, Zhu, Kun, Min, Xiongkuo, Zhai, Guangtao
• Format: Journal Article
• Language: English
• Published: 19.08.2025
• ISSN: 1551-6857; 1551-6865
• DOI: 10.1145/3761816

In computer graphics, polygon meshes stand out as a popular representation providing effective delineation of delicate textures and complex geometries. When dealing with geometric processing tasks for critical regions of the mesh, it is necessary to consider the human visual perception related to saliency. Therefore, we establish a novel mesh saliency dataset, facilitated by a more comprehensive gathering pipeline of eye-tracking from subjects observing mesh models at arbitrary viewpoints in a virtual reality space with six degrees of freedom. Additionally, we propose a mesh saliency prediction model that accurately infers visual attention density maps for complex and irregular mesh surfaces. This model integrates surface curvature and triangular face shape information from multiscale neighboring ranges as local geometric features, while also leveraging surface spatial positioning as a global feature. Our work aims to preserve critical areas and minimize visual loss in saliency-driven tasks such as mesh simplification, rendering, and texturing. We believe that our research can offer valuable insights for human-centered mesh computation applications.