CrowdDiff: Multi-Hypothesis Crowd Density Estimation Using Diffusion Models

Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of density due to the use of broad Gaussian kernels to create th...

Full description

Saved in:
Bibliographic Details
Published in2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 12809 - 12819
Main Authors Ranasinghe, Yasiru, Nair, Nithin Gopalakrishnan, Bandara, Wele Gedara Chaminda, Patel, Vishal M.
Format Conference Proceeding
LanguageEnglish
Published IEEE 16.06.2024
Subjects
Crowd counting
Diffusion models
Diffusion processes
Estimation
Noise
Pipelines
Representation learning
Stochastic processes
Training
Online AccessGet full text

Cover

More Information
Summary:Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of density due to the use of broad Gaussian kernels to create the ground truth density maps. This issue can be overcome by narrowing the Gaussian kernel. However, existing approaches perform poorly when trained with ground truth density maps with broad kernels. To deal with this limitation, we propose using conditional diffusion models to predict density maps, as diffusion models show high fidelity to training data during generation. With that, we present CrowdDiff that generates the crowd density map as a reverse diffusion process. Further-more, as the intermediate time steps of the diffusion process are noisy, we incorporate a regression branch for direct crowd estimation only during training to improve the feature learning. In addition, owing to the stochastic nature of the diffusion model, we introduce producing multiple density maps to improve the counting performance contrary to the existing crowd counting pipelines. We conduct extensive experiments on publicly available datasets to validate the effectiveness of our method. CrowdDiff out-performs existing state-of-the-art crowd counting methods on several public crowd analysis benchmarks with significant improvements. CrowdDiff project is available at: https://dylran.github.io/crowddiffgithub.io.
ISSN:2575-7075
DOI:10.1109/CVPR52733.2024.01217