Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:8
|
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Multi-domain Attention Fusion Network For Language Recognition
    Ju M.
    Xu Y.
    Ke D.
    Su K.
    SN Computer Science, 4 (1)
  • [2] A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network
    Chen, Pengyun
    Jian, Qiang
    Wu, Peilun
    Guo, Shisheng
    Cui, Guolong
    Jiang, Chaoshu
    Kong, Lingjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [3] Through-Wall Human Motion Recognition Using Random Code Radar Sensor With Multi-Domain Feature Fusion
    Xu, Hang
    Li, Yong
    Li, Yingxin
    Li, Jingxia
    Wang, Bingjie
    Liu, Li
    IEEE SENSORS JOURNAL, 2022, 22 (15) : 15123 - 15132
  • [4] Active sonar target recognition method based on multi-domain transformations and attention-based fusion network
    Wang, Qingcui
    Du, Shuanping
    Zhang, Wei
    Wang, Fangyong
    IET RADAR SONAR AND NAVIGATION, 2024, 18 (10): : 1814 - 1828
  • [5] Radar emitter signal recognition based on ambiguity function multi-domain feature fusion and ensemble learning
    Pu Y.-W.
    Yu Y.-P.
    Jiang Y.
    Tian C.-J.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (01): : 39 - 48
  • [6] MDFF: Multi-Domain feature fusion for anomaly recognition
    Xu, Yuan
    Ye, Cheng-Shu
    Niu, Hai-Ming
    Chen, Si-Yuan
    Luo, Yi
    Zhu, Qun-Xiong
    He, Yan-Lin
    Zhang, Yang
    Zhang, Ming-Qing
    ADVANCED ENGINEERING INFORMATICS, 2025, 64
  • [7] Enhanced Radar Signal Recognition through Attention-Driven Multi-Domain Fusion Mechanism
    Wu, Siyuan
    Huang, Hao
    Shi, Shengnan
    Zhao, Haitao
    Guo, Lantu
    Lin, Yun
    Gui, Guan
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [8] Electricity theft detection method based on multi-domain feature fusion
    Zhao, Hong-shan
    Sun, Cheng-yan
    Ma, Li-bo
    Xue, Yang
    Guo, Xiao-mei
    Chang, Jie-ying
    IET SCIENCE MEASUREMENT & TECHNOLOGY, 2023, 17 (03) : 93 - 104
  • [9] Lightweight Multiattention Enhanced Fusion Network for Omnidirectional Human Activity Recognition With FMCW Radar
    Li, Xinglong
    Qiu, Ye
    Deng, Zhenmiao
    Liu, Xinyu
    Huang, Xiaohong
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 5755 - 5768
  • [10] RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network
    Gu, Minming
    Chen, Kaiyu
    Chen, Zhixiang
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (01) : 1517 - 1530