STNet: Scale Tree Network With Multi-Level Auxiliator for Crowd Counting

被引:25
|
作者
Wang, Mingjie [1 ]
Cai, Hao [2 ]
Han, Xian-Feng [3 ]
Zhou, Jun [4 ]
Gong, Minglun [1 ]
机构
[1] Univ Guelph, Sch Comp Sci, Guelph, ON N1G 2W1, Canada
[2] Mem Univ Newfoundland, Dept Comp Sci, St John, NF A1B 3V6, Canada
[3] Southwest Univ, Chongqing 400715, Peoples R China
[4] Dalian Maritime Univ, Dalian 116026, Peoples R China
基金
加拿大自然科学与工程研究理事会;
关键词
Tree structure; scale enhancer; multi-level auxiliator; crowd counting; SEGMENTATION; PEOPLE;
D O I
10.1109/TMM.2022.3142398
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
State-of-the-art approaches for crowd counting resort to deepneural networks to predict density maps. However, counting people in congested scenes remains a challenging task because the presence of drastic scale variation, density inconsistency, and complex background can seriously degrade their counting accuracy. To battle the ingrained issue of accuracy degradation, in this paper, we propose a novel and powerful network called Scale Tree Network (STNet) for accurate crowd counting. STNet consists of two key components: a Scale-Tree Diversity Enhancer and a Multi-level Auxiliator. Specifically, the Diversity Enhancer is designed to enrich scale diversity, which alleviates limitations of existing methods caused by insufficient level of scales. A novel tree structure is adopted to hierarchically parse coarse-to-fine crowd regions. Furthermore, a simple yet effective Multi-level Auxiliator is presented to aid in exploiting generalisable shared characteristics at multiple levels, allowing more accurate pixel-wise background cognition. The overall STNet is trained in an end-to-end manner, without the needs for manually tuning loss weights between the main and the auxiliary tasks. Extensive experiments on five challenging crowd datasets demonstrate the superiority of the proposed method.
引用
收藏
页码:2074 / 2084
页数:11
相关论文
共 50 条
  • [1] A multi-scale and multi-level feature aggregation network for crowd counting
    Zhu, Fushun
    Yan, Hua
    Chen, Xinyue
    Li, Tong
    Zhang, Zhengyu
    NEUROCOMPUTING, 2021, 423 : 46 - 56
  • [2] Multi-level feature fusion network for crowd counting
    Wang, Luyang
    Li, Yun
    Peng, Sifan
    Tang, Xiao
    Yin, Baoqun
    IET COMPUTER VISION, 2021, 15 (01) : 60 - 72
  • [3] Multi-scale features fused network with multi-level supervised path for crowd counting
    Wang, Yongjie
    Zhang, Wei
    Huang, Dongxiao
    Liu, Yanyan
    Zhu, Jianghua
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
  • [4] MLANet: multi-level attention network with multi-scale feature fusion for crowd counting
    Xiong, Liyan
    Zeng, Yijuan
    Huang, Xiaohui
    Li, Zhida
    Huang, Peng
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (05): : 6591 - 6608
  • [5] Crowd Counting based on Multi-level Multi-scale Feature
    Di Wu
    Zheyi Fan
    Shuhan Yi
    Applied Intelligence, 2023, 53 : 21891 - 21901
  • [6] Crowd Counting based on Multi-level Multi-scale Feature
    Wu, Di
    Fan, Zheyi
    Yi, Shuhan
    APPLIED INTELLIGENCE, 2023, 53 (19) : 21891 - 21901
  • [7] Multi-level features extraction network with gating mechanism for crowd counting
    Zeng, Xin
    Guo, Qiang
    Duan, Haoran
    Wu, Yunpeng
    IET IMAGE PROCESSING, 2021, 15 (14) : 3534 - 3542
  • [8] Learning Multi-Level Density Maps for Crowd Counting
    Jiang, Xiaoheng
    Zhang, Li
    Lv, Pei
    Guo, Yibo
    Zhu, Ruijie
    Li, Yafei
    Pang, Yanwei
    Li, Xi
    Zhou, Bing
    Xu, Mingliang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (08) : 2705 - 2715
  • [9] Learning Multi-Level Features to Improve Crowd Counting
    Huo, Zhanqiang
    Lu, Bin
    Mi, Aizhong
    Luo, Fen
    Qiao, Yingxu
    IEEE ACCESS, 2020, 8 : 211391 - 211400
  • [10] MSNet: Multi-scale Network for Crowd Counting
    Shi, Ying
    Sang, Jun
    Alam, Mohammad S.
    Liu, Xinyue
    Tian, Shaoli
    PATTERN RECOGNITION AND TRACKING XXXII, 2021, 11735