MBA-Net: multi-branch attention network for occluded person re-identification

被引:1
|
作者
Hong, Xing [1 ]
Zhang, Langwen [1 ,2 ,3 ,4 ]
Yu, Xiaoyuan [5 ]
Xie, Wei [1 ,2 ,3 ,4 ]
Xie, Yumin [1 ]
机构
[1] South China Univ Technol, Sch Automat Sci & Engn, Guangzhou, Guangdong, Peoples R China
[2] South China Univ Technol, Key Lab Autonomous Syst & Networked Control, Guangzhou, Guangdong, Peoples R China
[3] South China Univ Technol, Guangdong Prov Key Lab Tech & Equipment Macromol A, Guangzhou, Guangdong, Peoples R China
[4] South China Univ Technol, Unmanned Aerial Vehicle Syst Engn Technol Res Ctr, Guangzhou, Guangdong, Peoples R China
[5] South China Normal Univ, Sch Phys & Telecommun Engn, Guangzhou, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Person Re-identification; Occlusion; Feature refinement; Attention mechanism;
D O I
10.1007/s11042-023-15312-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Occluded person re-identification (ReID) aims to retrieve the same pedestrian from partially occluded pedestrian images across non-overlapping cameras. Current state-of-the-art methods generally use auxiliary models to obtain non-occluded regions, which not only result in more complex models, but also cannot effectively handle the more generalized ReID task. To this end, a Multi-Branch Attention Network (MBA-Net) is proposed to achieve multi-level refinement of features through an end-to-end multi-branch framework with attention mechanisms. Specifically, we first achieve preliminary feature refinement through a backbone network with a non-local attention mechanism. Then, a two-level multi-branch architecture in MBA-Net is proposed with two-level features refinement to obtain aware local discriminative features from the self-attention branch, non-occluded local complementary features from the cross-attention branch, and global features from the global branch. Finally, we can obtain retrieval features that are robust to occlusion by concatenating all the above features. Experimental results show that our MBA-Net achieves state-of-the-art performance on an occluded person ReID dataset Occluded-Duke and simultaneously achieves competitive performance on two general person ReID datasets Market-1501 and DukeMTMC-ReID.
引用
收藏
页码:6393 / 6412
页数:20
相关论文
共 50 条
  • [21] Dual-branch adaptive attention transformer for occluded person re-identification
    Lu, Yunhua
    Jiang, Mingzi
    Liu, Zhi
    Mu, Xinyu
    IMAGE AND VISION COMPUTING, 2023, 131
  • [22] Learning discriminative and generalizable features with multi-branch for person re-identification
    Cheng, Ru
    Wang, Lukun
    Wei, Mingrun
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (06) : 5987 - 6001
  • [23] Multi-scale and multi-branch feature representation for person re-identification
    Jiao, Shanshan
    Pan, Zhisong
    Hu, Guyu
    Shen, Qing
    Du, Lin
    Chen, Yutian
    Wang, Jiabao
    NEUROCOMPUTING, 2020, 414 : 120 - 130
  • [24] MULTI BRANCH SIAMESE NETWORK FOR PERSON RE-IDENTIFICATION
    Munir, Asad
    Martinel, Niki
    Micheloni, Christian
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2351 - 2355
  • [25] Occluded person re-identification based on differential attention siamese network
    Liangbo Wang
    Yu Zhou
    Yanjing Sun
    Song Li
    Applied Intelligence, 2022, 52 : 7407 - 7419
  • [26] Reasoning and Tuning: Graph Attention Network for Occluded Person Re-Identification
    Huang, Meiyan
    Hou, Chunping
    Yang, Qingyuan
    Wang, Zhipeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1568 - 1582
  • [27] Multi-Branch Enhanced Discriminative Network for Vehicle Re-Identification
    Lian, Jiawei
    Wang, Da-Han
    Wu, Yun
    Zhu, Shunzhi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 1263 - 1274
  • [28] Occluded person re-identification based on differential attention siamese network
    Wang, Liangbo
    Zhou, Yu
    Sun, Yanjing
    Li, Song
    APPLIED INTELLIGENCE, 2022, 52 (07) : 7407 - 7419
  • [29] CNN Attention Enhanced ViT Network for Occluded Person Re-Identification
    Wang, Jing
    Li, Peitong
    Zhao, Rongfeng
    Zhou, Ruyan
    Han, Yanling
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [30] Joint Convolutional and Self-Attention Network for Occluded Person Re-Identification
    Yang, Chuxia
    Fan, Wanshu
    Zhou, Dongsheng
    Zhang, Qiang
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 757 - 764