Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar

被引:2
|
作者
Dang, Xiaochao [1 ]
Jin, Peng [1 ]
Hao, Zhanjun [1 ]
Ke, Wenze [1 ]
Deng, Han [1 ]
Wang, Li [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point cloud; millimeter-wave radar; human movement; neural network;
D O I
10.3390/s23239430
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human movement recognition is the use of perceptual technology to collect some of the limb or body movements presented. This practice involves the use of wireless signals, processing, and classification to identify some of the regular movements of the human body. It has a wide range of application prospects, including in intelligent pensions, remote health monitoring, and child supervision. Among the traditional human movement recognition methods, the widely used ones are video image-based recognition technology and Wi-Fi-based recognition technology. However, in some dim and imperfect weather environments, it is not easy to maintain a high performance and recognition rate for human movement recognition using video images. There is the problem of a low recognition degree for Wi-Fi recognition of human movement in the case of a complex environment. Most of the previous research on human movement recognition is based on LiDAR perception technology. LiDAR scanning using a three-dimensional static point cloud can only present the point cloud characteristics of static objects; it struggles to reflect all the characteristics of moving objects. In addition, due to its consideration of privacy and security issues, the dynamic millimeter-wave radar point cloud used in the previous study on the existing problems of human body movement recognition performance is better, with the recognition of human movement characteristics in non-line-of-sight situations as well as better protection of people's privacy. In this paper, we propose a human motion feature recognition system (PNHM) based on spatiotemporal information of the 3D point cloud of millimeter-wave radar, design a neural network based on the network PointNet++ in order to effectively recognize human motion features, and study four human motions based on the threshold method. The data set of the four movements of the human body at two angles in two experimental environments was constructed. This paper compares four standard mainstream 3D point cloud human action recognition models for the system. The experimental results show that the recognition accuracy of the human body's when walking upright can reach 94%, the recognition accuracy when moving from squatting to standing can reach 84%, that when moving from standing to sitting can reach 87%, and the recognition accuracy of falling can reach 93%.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Precise 2D and 3D Fluoroscopic Imaging by Using an FMCW Millimeter-Wave Radar
    Wang, Yaheng
    Su, Jie
    Fukuda, Taiga
    Tonouchi, Masayoshi
    Murakami, Hironaru
    IEEE ACCESS, 2023, 11 : 84027 - 84034
  • [42] Micromachined 3D Millimeter-Wave and Terahertz Devices
    Wang, Yi
    Shang, Xiaobang
    Lancaster, Michael J.
    2015 IEEE MTT-S INTERNATIONAL MICROWAVE WORKSHOP SERIES ON ADVANCED MATERIALS AND PROCESSES FOR RF AND THZ APPLICATIONS (IMWS-AMP), 2015, : 183 - 185
  • [43] Portable Millimeter Wave 3D Imaging Radar
    Zhang, Renyuan
    Cao, Siyang
    2017 IEEE RADAR CONFERENCE (RADARCONF), 2017, : 298 - 303
  • [44] 3D High-resolution Imaging Algorithm with Sparse Trajectory for Millimeter-wave Radar
    Ma Y.
    Hai Y.
    Li Z.
    Huang P.
    Wang C.
    Wu J.
    Yang J.
    Journal of Radars, 2023, 12 (05) : 1000 - 1013
  • [45] PGGait: Gait Recognition Based on Millimeter-Wave Radar Spatio-Temporal Sensing of Multidimensional Point Clouds
    Dang, Xiaochao
    Tang, Yangyang
    Hao, Zhanjun
    Gao, Yifei
    Fan, Kai
    Wang, Yue
    SENSORS, 2024, 24 (01)
  • [46] Millimeter-wave radar body interference recognition based on spatial attribute features
    Cai, Jiayi
    Chu, Ping
    Zhuang, Luntao
    Yang, Zhaocheng
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (10): : 3365 - 3374
  • [47] Target recognition and tracking of group vehicles based on roadside millimeter-wave radar
    Li, Li
    Wu, Xiao-Qiang
    Yang, Wen-Chen
    Zhou, Rui-Jie
    Wang, Gui-Ping
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (07): : 2104 - 2114
  • [48] Pantomime: Mid-Air Gesture Recognition with Sparse Millimeter-Wave Radar Point Clouds
    Palipana, Sameera
    Salami, Dariush
    Leiva, Luis A.
    Sigg, Stephan
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (01):
  • [49] 3D UAV millimeter-wave beam tracking based on IUPF algorithm
    Zhang J.
    Zhong W.
    Zhang L.
    Wang J.
    Zhu Q.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (01): : 257 - 263
  • [50] Millimeter-Wave Radar-Based Elderly Fall Detection Fed by One-Dimensional Point Cloud and Doppler
    Kittiyanpunya, Chainarong
    Chomdee, Pongsathorn
    Boonpoonga, Akkarat
    Torrungrueng, Danai
    IEEE ACCESS, 2023, 11 : 76269 - 76283