Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar

被引:2
|
作者
Dang, Xiaochao [1 ]
Jin, Peng [1 ]
Hao, Zhanjun [1 ]
Ke, Wenze [1 ]
Deng, Han [1 ]
Wang, Li [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point cloud; millimeter-wave radar; human movement; neural network;
D O I
10.3390/s23239430
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human movement recognition is the use of perceptual technology to collect some of the limb or body movements presented. This practice involves the use of wireless signals, processing, and classification to identify some of the regular movements of the human body. It has a wide range of application prospects, including in intelligent pensions, remote health monitoring, and child supervision. Among the traditional human movement recognition methods, the widely used ones are video image-based recognition technology and Wi-Fi-based recognition technology. However, in some dim and imperfect weather environments, it is not easy to maintain a high performance and recognition rate for human movement recognition using video images. There is the problem of a low recognition degree for Wi-Fi recognition of human movement in the case of a complex environment. Most of the previous research on human movement recognition is based on LiDAR perception technology. LiDAR scanning using a three-dimensional static point cloud can only present the point cloud characteristics of static objects; it struggles to reflect all the characteristics of moving objects. In addition, due to its consideration of privacy and security issues, the dynamic millimeter-wave radar point cloud used in the previous study on the existing problems of human body movement recognition performance is better, with the recognition of human movement characteristics in non-line-of-sight situations as well as better protection of people's privacy. In this paper, we propose a human motion feature recognition system (PNHM) based on spatiotemporal information of the 3D point cloud of millimeter-wave radar, design a neural network based on the network PointNet++ in order to effectively recognize human motion features, and study four human motions based on the threshold method. The data set of the four movements of the human body at two angles in two experimental environments was constructed. This paper compares four standard mainstream 3D point cloud human action recognition models for the system. The experimental results show that the recognition accuracy of the human body's when walking upright can reach 94%, the recognition accuracy when moving from squatting to standing can reach 84%, that when moving from standing to sitting can reach 87%, and the recognition accuracy of falling can reach 93%.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] MilliNoise: a Millimeter-wave Radar Sparse Point Cloud Dataset in Indoor Scenarios
    Brescia, Walter
    Gomes, Pedro
    Toni, Laura
    Mascolo, Saverio
    De Cicco, Luca
    PROCEEDINGS OF THE 2024 15TH ACM MULTIMEDIA SYSTEMS CONFERENCE 2024, MMSYS 2024, 2024, : 422 - 428
  • [22] A Millimeter-Wave 3D Imaging Algorithm for MIMO Synthetic Aperture Radar
    Lin, Bo
    Li, Chao
    Ji, Yicai
    Liu, Xiaojun
    Fang, Guangyou
    SENSORS, 2023, 23 (13)
  • [23] Human Gesture Recognition Based on Millimeter-Wave Radar Using Improved C3D Convolutional Neural Network
    Li, Wei
    Gao, Yang
    Chen, Jun
    Niu, Si-Yi
    Jiang, Jia-Hao
    Li, Qi
    Journal of Computers (Taiwan), 2023, 34 (03) : 1 - 18
  • [24] 3D Head Motion Detection Using Millimeter-Wave Doppler Radar
    Raja, Muneeba
    Vali, Zahra
    Palipana, Sameera
    Michelson, David G.
    Sigg, Stephan
    IEEE ACCESS, 2020, 8 (08): : 32321 - 32331
  • [25] A Novel Spatial-Temporal Network for Gait Recognition Using Millimeter-Wave Radar Point Cloud Videos
    Ma, Chongrun
    Liu, Zhenyu
    ELECTRONICS, 2023, 12 (23)
  • [26] Low-Cost, Fused Millimeter-Wave and 3D Point Cloud Imaging for Concealed Threat Detection
    Mantzavinos, Spiros
    Gonzalez-Valdes, Borja
    Busuioc, Dan
    Miller, Ryan
    Martinez-Lorenzo, Jose A.
    Rappaport, Carey M.
    2013 IEEE ANTENNAS AND PROPAGATION SOCIETY INTERNATIONAL SYMPOSIUM (APSURSI), 2013, : 1014 - 1015
  • [27] mmSkeleton: 3D Human Skeleton Estimation Using Millimeter Wave Radar Sparse Point Clouds
    Li, Wei
    Lei, Wen
    Shi, Kun
    Shi, Zhiguo
    Wang, Yong
    Zhou, Jinhai
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [28] 3D Near-Field Millimeter-Wave Synthetic Aperture Radar Imaging
    Hamidi, Shahrokh
    Safavi-Naeini, Safieddin
    2021 IEEE 19TH INTERNATIONAL SYMPOSIUM ON ANTENNA TECHNOLOGY AND APPLIED ELECTROMAGNETICS (ANTEM), 2021,
  • [29] Cross-domain Behavior Recognition Based on Millimeter-wave Radar
    Wang, Rendao
    Wang, Binquan
    APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2024, 13 (04)
  • [30] Hand gesture recognition based on millimeter-wave radar using iFormer
    Chen, Jiaxin
    Wen, Pengwei
    Chen, Gao
    Wang, Yu
    Wang, Yifan
    Zheng, Jianpeng
    2024 9TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, ICSIP, 2024, : 22 - 26