Saliency detection for large-scale mesh decimation

Highly complex and dense models of 3D objects have recently become indispensable in digital industries. Mesh decimation then plays a crucial role in the production pipeline to efficiently get visually convincing yet compact expressions of complex meshes. However, the current pipeline typically does...

Full description

Saved in:
Bibliographic Details
Published inComputers & graphics Vol. 111; pp. 63 - 76
Main Authors Kuffner dos Anjos, Rafael, Roberts, Richard Andrew, Allen, Benjamin, Jorge, Joaquim, Anjyo, Ken
Format Journal Article
LanguageEnglish
Published Elsevier Ltd 01.04.2023
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:Highly complex and dense models of 3D objects have recently become indispensable in digital industries. Mesh decimation then plays a crucial role in the production pipeline to efficiently get visually convincing yet compact expressions of complex meshes. However, the current pipeline typically does not allow artists control the decimation process, just a simplification rate. Thus a preferred approach in production settings splits the process into a first pass of saliency detection highlighting areas of greater detail, and allowing artists to iterate until satisfied before simplifying the model. We propose a novel, efficient multi-scale method to compute mesh saliency at coarse and finer scales, based on fast mesh entropy of local surface measurements. Unlike previous approaches, we ensure a robust and straightforward calculation of mesh saliency even for densely tessellated models with millions of polygons. Moreover, we introduce a new adaptive subsampling and interpolation algorithm for saliency estimation. Our implementation achieves speedups of up to three orders of magnitude over prior approaches. Experimental results showcase its resilience to problem scenarios that efficiently scales up to process multi-million vertex meshes. Our evaluation with artists in the entertainment industry also demonstrates its applicability to real use-case scenarios. [Display omitted] •A novel multi-scale mesh saliency formulation, configurable by one hyperparameter.•An adaptive subsampling scheme which allows for speed-ups of up to three orders of magnitude at close to no introduced error.•An evaluation of our method in a production pipeline in the entertainment industry.•An interactive GUI to control the method that interfaces with common industry tools.
ISSN:0097-8493
1873-7684
DOI:10.1016/j.cag.2023.01.012