Cross-modal pedestrian re-recognition based on attention mechanism

被引:3
|
作者
Zhao, Yuyao [1 ]
Zhou, Hang [1 ]
Cheng, Hai [1 ]
Huang, Chunguang [1 ]
机构
[1] Heilongjiang Univ, Coll Elect & Engn, Harbin, Heilongjiang, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 04期
基金
中国国家自然科学基金;
关键词
Person re-identification; Cross-modality; Attention mechanisms; Data integration;
D O I
10.1007/s00371-023-02926-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Person re-identification, as an essential research direction in intelligent security, has gained the focus of researchers and scholars. In practical scenarios, visible light cameras depend highly on lighting conditions and have limited detection capability in poor light. Therefore, many scholars have gradually shifted their research goals to cross-modality person re-identification. However, there are few relevant studies, and challenges remain in resolving the differences in the images of different modalities. In order to solve these problems, this paper will use the research method based on the attention mechanism to narrow the difference between the two modes and guide the network in a more appropriate direction to improve the recognition performance of the network. Aiming at the problem of using the attention mechanism method can improve training efficiency. However, it is easy to cause the model training instability. This paper proposes a cross-modal pedestrian re-recognition method based on the attention mechanism. A new attention mechanism module is designed to allow the network to use less time to focus on more critical features of a person. In addition, a cross-modality hard center triplet loss is designed to supervise the model training better. The paper has conducted extensive experiments on the above two methods on two publicly available datasets, which obtained better performance than similar current methods and verified the effectiveness and feasibility of the proposed methods in this paper.
引用
收藏
页码:2405 / 2418
页数:14
相关论文
共 50 条
  • [41] CROSS-MODAL RECOGNITION IN CHIMPANZEES AND MONKEYS
    JARVIS, MJ
    ETTLINGER, G
    NEUROPSYCHOLOGIA, 1977, 15 (4-5) : 499 - 506
  • [42] CHILDRENS RECOGNITION OF CROSS-MODAL SIMILARITY
    MARKS, LE
    BORNSTEIN, MH
    CAHIERS DE PSYCHOLOGIE COGNITIVE-CURRENT PSYCHOLOGY OF COGNITION, 1985, 5 (3-4): : 322 - 322
  • [43] Cross-modal interference in object recognition
    Schmid, Carmen
    Buechel, Christian
    Rose, Michael
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2008, 43 (3-4) : 652 - 652
  • [44] CROSS-MODAL RECOGNITION IN 3 PRIMATES
    ELLIOTT, RC
    NEUROPSYCHOLOGIA, 1977, 15 (01) : 183 - 186
  • [45] Application of Multi-Feature Fusion Based on Deep Learning in Pedestrian Re-Recognition Method
    Han, Ke
    Zhang, Ning
    Xie, Haoyang
    Wang, Qianlong
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [46] Cross-modal fusion for multi-label image classification with attention mechanism
    Wang, Yangtao
    Xie, Yanzhao
    Zeng, Jiangfeng
    Wang, Hanpin
    Fan, Lisheng
    Song, Yufan
    Computers and Electrical Engineering, 2022, 101
  • [47] Cross-modal fusion for multi-label image classification with attention mechanism
    Wang, Yangtao
    Xie, Yanzhao
    Zeng, Jiangfeng
    Wang, Hanpin
    Fan, Lisheng
    Song, Yufan
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 101
  • [48] Cross-modal self-attention mechanism for controlling robot volleyball motion
    Wang, Meifang
    Liang, Zhange
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [49] Fine grained cross-modal retrieval algorithm for IETM with attention mechanism fused
    Zhai Y.
    Gu J.
    Zong F.
    Jiang W.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (12): : 3915 - 3923
  • [50] Cross-modal attention for multi-modal image registration
    Song, Xinrui
    Chao, Hanqing
    Xu, Xuanang
    Guo, Hengtao
    Xu, Sheng
    Turkbey, Baris
    Wood, Bradford J.
    Sanford, Thomas
    Wang, Ge
    Yan, Pingkun
    MEDICAL IMAGE ANALYSIS, 2022, 82