Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:8
|
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
收藏
页数:25
相关论文
共 50 条
  • [31] Radar Human Activity Recognition with an Attention-Based Deep Learning Network
    Huan, Sha
    Wu, Limei
    Zhang, Man
    Wang, Zhaoyue
    Yang, Chao
    SENSORS, 2023, 23 (06)
  • [32] A Multi-domain Named Entity Recognition Method Based on Part-of-Speech Attention Mechanism
    Zhang, Shun
    Sheng, Ying
    Gao, Jiangfan
    Chen, Jianhui
    Huang, Jiajin
    Lin, Shaofu
    COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, CHINESECSCW 2019, 2019, 1042 : 631 - 644
  • [33] Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar
    Li, Cong
    Wang, Xianpeng
    Shi, Jinmei
    Wang, Han
    Wan, Liangtian
    IEEE ACCESS, 2023, 11 : 111875 - 111887
  • [34] Multi-class Motor Imagery Recognition of Single Joint in Upper Limb Based on Multi-domain Feature Fusion
    Shan Guan
    Zhen Yuan
    Fuwang Wang
    Jixian Li
    Xiaogang Kang
    Bin Lu
    Neural Processing Letters, 2023, 55 : 8927 - 8945
  • [35] Multi-class Motor Imagery Recognition of Single Joint in Upper Limb Based on Multi-domain Feature Fusion
    Guan, Shan
    Yuan, Zhen
    Wang, Fuwang
    Li, Jixian
    Kang, Xiaogang
    Lu, Bin
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 8927 - 8945
  • [36] Human Activity Recognition Based on Feature Fusion of Millimeter Wave Radar and Inertial Navigation
    Shi, Jiajia
    Zhu, Yihan
    He, Jiaqing
    Xu, Zhihuo
    Chu, Liu
    Braun, Robin
    Shi, Quan
    IEEE JOURNAL OF MICROWAVES, 2025, 5 (02): : 409 - 424
  • [37] Radar HRRP Feature Fusion Recognition Method Based on ConvLSTM Network with Multi-Input Gate Recurrent Unit
    Yang, Wei
    Chen, Tianqi
    Lei, Shiwen
    Zhao, Zhiqin
    Hu, Haoquan
    Hu, Jun
    Remote Sensing, 2024, 16 (23)
  • [38] Radar-Based Human Activity Recognition Using Dual-Stream Spatial and Temporal Feature Fusion Network
    Li, Jianjun
    Xu, Hongji
    Zeng, Jiaqi
    Ai, Wentao
    Li, Shijie
    Li, Xiaoman
    Li, Xinya
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (02) : 1835 - 1847
  • [39] Human interactive behaviour recognition method based on multi-feature fusion
    Ye, Qing
    Li, Rui
    Yang, Hang
    Guo, Xinran
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2022, 25 (03) : 262 - 271
  • [40] Fault diagnosis of blade crack based on multi-domain feature and information fusion
    Ma, Tianchi
    Shen, Junxian
    Song, Di
    Xu, Feiyun
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2024, 54 (06): : 1567 - 1573