Scale-Aware Crowd Count Network with Annotation Error Correction

Traditional crowd counting networks suffer from information loss when feature maps are downsized through pooling layers, leading to inaccuracies in counting crowds at a distance. Existing methods often assume correct annotations during training, disregarding the impact of noisy annotations, especial...

Full description

Saved in:
Bibliographic Details
Main Authors Hsieh, Yi-Kuan, Hsieh, Jun-Wei, Tseng, Yu-Chee, Chang, Ming-Ching, Xin, Li
Format Journal Article
LanguageEnglish
Published 27.12.2023
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Traditional crowd counting networks suffer from information loss when feature maps are downsized through pooling layers, leading to inaccuracies in counting crowds at a distance. Existing methods often assume correct annotations during training, disregarding the impact of noisy annotations, especially in crowded scenes. Furthermore, the use of a fixed Gaussian kernel fails to account for the varying pixel distribution with respect to the camera distance. To overcome these challenges, we propose a Scale-Aware Crowd Counting Network (SACC-Net) that introduces a ``scale-aware'' architecture with error-correcting capabilities of noisy annotations. For the first time, we {\bf simultaneously} model labeling errors (mean) and scale variations (variance) by spatially-varying Gaussian distributions to produce fine-grained heat maps for crowd counting. Furthermore, the proposed adaptive Gaussian kernel variance enables the model to learn dynamically with a low-rank approximation, leading to improved convergence efficiency with comparable accuracy. The performance of SACC-Net is extensively evaluated on four public datasets: UCF-QNRF, UCF CC 50, NWPU, and ShanghaiTech A-B. Experimental results demonstrate that SACC-Net outperforms all state-of-the-art methods, validating its effectiveness in achieving superior crowd counting accuracy.
AbstractList Traditional crowd counting networks suffer from information loss when feature maps are downsized through pooling layers, leading to inaccuracies in counting crowds at a distance. Existing methods often assume correct annotations during training, disregarding the impact of noisy annotations, especially in crowded scenes. Furthermore, the use of a fixed Gaussian kernel fails to account for the varying pixel distribution with respect to the camera distance. To overcome these challenges, we propose a Scale-Aware Crowd Counting Network (SACC-Net) that introduces a ``scale-aware'' architecture with error-correcting capabilities of noisy annotations. For the first time, we {\bf simultaneously} model labeling errors (mean) and scale variations (variance) by spatially-varying Gaussian distributions to produce fine-grained heat maps for crowd counting. Furthermore, the proposed adaptive Gaussian kernel variance enables the model to learn dynamically with a low-rank approximation, leading to improved convergence efficiency with comparable accuracy. The performance of SACC-Net is extensively evaluated on four public datasets: UCF-QNRF, UCF CC 50, NWPU, and ShanghaiTech A-B. Experimental results demonstrate that SACC-Net outperforms all state-of-the-art methods, validating its effectiveness in achieving superior crowd counting accuracy.
Author Chang, Ming-Ching
Tseng, Yu-Chee
Xin, Li
Hsieh, Jun-Wei
Hsieh, Yi-Kuan
Author_xml – sequence: 1
  givenname: Yi-Kuan
  surname: Hsieh
  fullname: Hsieh, Yi-Kuan
– sequence: 2
  givenname: Jun-Wei
  surname: Hsieh
  fullname: Hsieh, Jun-Wei
– sequence: 3
  givenname: Yu-Chee
  surname: Tseng
  fullname: Tseng, Yu-Chee
– sequence: 4
  givenname: Ming-Ching
  surname: Chang
  fullname: Chang, Ming-Ching
– sequence: 5
  givenname: Li
  surname: Xin
  fullname: Xin, Li
BackLink https://doi.org/10.48550/arXiv.2312.16771$$DView paper in arXiv
BookMark eNotj8tOwzAQRb2ABZR-ACv8AwkeT2wnO6KoPKQKFu0-mjiOiCg2GgKBv4cUVke6ujrSORcnMcUgxCWovCiNUdfEX-NnrhF0DtY5OBM3O0-HkNUzcZANp7mXTfqIk3wM05z4Rc7j9CzrGNNE05ii3DAn_v0wB78MF-J0oMN7WP9zJfa3m31zn22f7h6aepuRdZD1vgIFBKVVQ6dMBxYdUucBSrR98N45FxYgGQIsdBkU-sH0qHVXFRWuxNWf9pjQvvH4SvzdLintMQV_AHv-RTo
ContentType Journal Article
Copyright http://arxiv.org/licenses/nonexclusive-distrib/1.0
Copyright_xml – notice: http://arxiv.org/licenses/nonexclusive-distrib/1.0
DBID AKY
GOX
DOI 10.48550/arxiv.2312.16771
DatabaseName arXiv Computer Science
arXiv.org
DatabaseTitleList
Database_xml – sequence: 1
  dbid: GOX
  name: arXiv.org
  url: http://arxiv.org/find
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
ExternalDocumentID 2312_16771
GroupedDBID AKY
GOX
ID FETCH-LOGICAL-a671-dc9101a1860fb05b16373abc11836decc777eecc73a5a13428e03cf5d322b9493
IEDL.DBID GOX
IngestDate Mon Jan 08 05:44:39 EST 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a671-dc9101a1860fb05b16373abc11836decc777eecc73a5a13428e03cf5d322b9493
OpenAccessLink https://arxiv.org/abs/2312.16771
ParticipantIDs arxiv_primary_2312_16771
PublicationCentury 2000
PublicationDate 2023-12-27
PublicationDateYYYYMMDD 2023-12-27
PublicationDate_xml – month: 12
  year: 2023
  text: 2023-12-27
  day: 27
PublicationDecade 2020
PublicationYear 2023
Score 1.9101653
SecondaryResourceType preprint
Snippet Traditional crowd counting networks suffer from information loss when feature maps are downsized through pooling layers, leading to inaccuracies in counting...
SourceID arxiv
SourceType Open Access Repository
SubjectTerms Computer Science - Computer Vision and Pattern Recognition
Title Scale-Aware Crowd Count Network with Annotation Error Correction
URI https://arxiv.org/abs/2312.16771
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwdV07T8MwELZKJxYEAlSe8sBq8COxk42oaqmQKANFyhb5FYklQaY8fj7nOAgWJlv2Lf78uO_suzNCV1YVPjPakBKWA8l4S4kxULPM8ZZR29I8xg4_rOXqObuv83qC8E8sjA5fLx8pP7B5uwHywa-ZVDFIfIfz6LJ191inx8khFdco_ysHHHNo-qMklvtob2R3uErTcYAmvjtEt0-AgyfVpw4ez8HsdThGgm_xOrlg43gXiquu69OzOF6E0AeQCcNp1HdHaLNcbOYrMn5cQLRUjDgLOphpVkjaGpoboDxKaGOBywvpADOllI-F0LlmAgwAT4Vtcweby5RZKY7RFGx_P0NYFs6xgjpR-BZsE2lkVhjrS2-l10rzEzQbhtu8ptwUTUSiGZA4_b_rDO3GX9OjVwZX52i6De_-AnTr1lwOAH8DEFp55w
link.rule.ids 228,230,786,891
linkProvider Cornell University
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Scale-Aware+Crowd+Count+Network+with+Annotation+Error+Correction&rft.au=Hsieh%2C+Yi-Kuan&rft.au=Hsieh%2C+Jun-Wei&rft.au=Tseng%2C+Yu-Chee&rft.au=Chang%2C+Ming-Ching&rft.date=2023-12-27&rft_id=info:doi/10.48550%2Farxiv.2312.16771&rft.externalDocID=2312_16771