PAII: A Pose Alignment Network with Information Interaction for Person Re-identification

被引:0
|
作者
Lyu, Chunyan [1 ]
Xu, Tong [1 ]
Ning, Wu [1 ]
Cheng, Qi [1 ]
Wang, Kejun [1 ,2 ]
Wang, Chenhui [3 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[2] Beijing Inst Technol Zhuhai, Sch Informat Technol, Zhuhai, Peoples R China
[3] Univ Calif Los Angeles, Dept Stat, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Semantic alignment; Information interaction; Pose estimation; ATTENTION;
D O I
10.1007/s11061-077-10947-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important part of intelligent surveillance systems, person re-identification (re-ID) has a wide range of application prospects in smart cities. However, due to occlusion, viewpoint variation, and background shift, the misalignment problem always decreases the re-ID systems' effects. To solve this problem, a pose alignment network with information interaction (PAII) is proposed. This approach consists of three cascaded modules. First, guided by a pretrained pose estimator, the backbone with a dual attention block is used to obtain local features corresponding to different pose keypoints along with the global feature. Then, a pose alignment module is constructed to group these local features into different parts and fuse them with a hyperparameter lambda, which provides the possibility to achieve semantic alignment. Finally, since different semantic features are extracted, an information interaction module consisting of graph attention layers is made to conduct message passing between different semantic features. All semantic features and the global feature are used to calculate the loss functions. Our approach considers multi-scale representations and information interaction of semantic features, which makes it more robust to misalignment problems. Thus, the proposed PAII method achieves better performance than most existing methods on multiple popular re-ID datasets.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Person re-identification based on multi-level and generated alignment network
    Chong, Yanwen
    Zhang, Chen
    Feng, Wenqiang
    Pan, Shaoming
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (04): : 64 - 70
  • [42] Multi-branch Body Region Alignment Network for Person Re-identification
    Fang, Han
    Chen, Jun
    Tian, Qi
    MULTIMEDIA MODELING (MMM 2020), PT I, 2020, 11961 : 341 - 352
  • [43] HIERARCHICAL ATTENTION IMAGE-TEXT ALIGNMENT NETWORK FOR PERSON RE-IDENTIFICATION
    Kansal, Kajal
    Subramanyam, A., V
    Wang, Zheng
    Satoh, Shinichi
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [44] PGMANet:Pose-Guided Mixed Attention Network for Occluded Person Re-Identification
    Zhai, You
    Han, Xianfeng
    Ma, Wenzhuo
    Gou, Xinye
    Xiao, Guoqiang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [45] Meta Distribution Alignment for Generalizable Person Re-Identification
    Ni, Hao
    Song, Jingkuan
    Luo, Xiaopeng
    Zheng, Feng
    Li, Wen
    Shen, Heng Tao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2477 - 2486
  • [46] Person re-identification via deep compound eye network and pose repair module
    Gu, Hongjian
    Zou, Wenxuan
    Cheng, Keyang
    Wu, Bin
    Ghafoor, Humaira Abdul
    Zhan, Yongzhao
    IET COMPUTER VISION, 2024, 18 (06) : 826 - 841
  • [47] Decoupled Pose and Similarity Based Graph Neural Network for Video Person Re-Identification
    Li, Ying
    Guo, Zixuan
    Zhang, Hengheng
    Li, Mengjing
    Ji, Genlin
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 264 - 268
  • [48] Person Re-Identification Based on Two-Stream Network With Attention and Pose Features
    Gong, Xiaowei
    Zhu, Suguo
    IEEE ACCESS, 2019, 7 : 131374 - 131382
  • [49] Person Re-Identification Based on Pose-Aware Segmentation
    Zhang, Wenfeng
    Wei, Zhiqiang
    Huang, Lei
    Nie, Jie
    Lv, Lei
    Wei, Guanqun
    MULTIMEDIA MODELING, MMM 2019, PT II, 2019, 11296 : 302 - 314
  • [50] Pose-Normalized Image Generation for Person Re-identification
    Qian, Xuelin
    Fu, Yanwei
    Xiang, Tao
    Wang, Wenxuan
    Qiu, Jie
    Wu, Yang
    Jiang, Yu-Gang
    Xue, Xiangyang
    COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 661 - 678