Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar

被引:2
|
作者
Dang, Xiaochao [1 ]
Jin, Peng [1 ]
Hao, Zhanjun [1 ]
Ke, Wenze [1 ]
Deng, Han [1 ]
Wang, Li [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point cloud; millimeter-wave radar; human movement; neural network;
D O I
10.3390/s23239430
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human movement recognition is the use of perceptual technology to collect some of the limb or body movements presented. This practice involves the use of wireless signals, processing, and classification to identify some of the regular movements of the human body. It has a wide range of application prospects, including in intelligent pensions, remote health monitoring, and child supervision. Among the traditional human movement recognition methods, the widely used ones are video image-based recognition technology and Wi-Fi-based recognition technology. However, in some dim and imperfect weather environments, it is not easy to maintain a high performance and recognition rate for human movement recognition using video images. There is the problem of a low recognition degree for Wi-Fi recognition of human movement in the case of a complex environment. Most of the previous research on human movement recognition is based on LiDAR perception technology. LiDAR scanning using a three-dimensional static point cloud can only present the point cloud characteristics of static objects; it struggles to reflect all the characteristics of moving objects. In addition, due to its consideration of privacy and security issues, the dynamic millimeter-wave radar point cloud used in the previous study on the existing problems of human body movement recognition performance is better, with the recognition of human movement characteristics in non-line-of-sight situations as well as better protection of people's privacy. In this paper, we propose a human motion feature recognition system (PNHM) based on spatiotemporal information of the 3D point cloud of millimeter-wave radar, design a neural network based on the network PointNet++ in order to effectively recognize human motion features, and study four human motions based on the threshold method. The data set of the four movements of the human body at two angles in two experimental environments was constructed. This paper compares four standard mainstream 3D point cloud human action recognition models for the system. The experimental results show that the recognition accuracy of the human body's when walking upright can reach 94%, the recognition accuracy when moving from squatting to standing can reach 84%, that when moving from standing to sitting can reach 87%, and the recognition accuracy of falling can reach 93%.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Millimeter-Wave Radar and Machine Vision-Based Lane Recognition
    Li, Wei
    Guan, Yue
    Chen, Liguo
    Sun, Lining
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2018, 32 (05)
  • [32] A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar
    Wu, Zhijing
    Cao, Zhihui
    Yu, Xuliang
    Zhu, Jiang
    Song, Chunyi
    Xu, Zhiwei
    IEEE SENSORS JOURNAL, 2023, 23 (17) : 19509 - 19523
  • [33] Point Cloud and 3-D Surface Reconstruction Using Cylindrical Millimeter-Wave Holography
    Gao, Jingkun
    Deng, Bin
    Qin, Yuliang
    Li, Xiang
    Wang, Hongqiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (12) : 4765 - 4778
  • [34] Indoor human action recognition based on millimeter-wave radar micro-doppler signature
    Yin, Wei
    Shi, Ling-Feng
    Shi, Yifan
    MEASUREMENT, 2024, 235
  • [35] Human Behavior Recognition Based on Multi-Dimensional Feature Learning of Millimeter-Wave Radar
    Wang, Xiangfeng
    Xia, Zhaoyang
    Wang, Haipeng
    Xu, Feng
    2021 SIGNAL PROCESSING SYMPOSIUM (SPSYMPO), 2021, : 284 - 288
  • [36] mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point Cloud
    Dang, Xiaochao
    Ke, Wenze
    Hao, Zhanjun
    Jin, Peng
    Deng, Han
    Sheng, Ying
    SENSORS, 2023, 23 (15)
  • [37] 3D imaging system based on FMCW millimeter wave radar
    Korneev, D
    Bogdanov, L
    Nalivkin, A
    Berezin, S
    IRMMW-THZ2005: THE JOINT 30TH INTERNATIONAL CONFERENCE ON INFRARED AND MILLIMETER WAVES AND 13TH INTERNATIONAL CONFERENCE ON TERAHERTZ ELECTRONICS, VOLS 1 AND 2, 2005, : 367 - 368
  • [38] A Millimeter-Wave MIMO Radar Network for Human Activity Recognition and Fall Detection
    Froehlich, Ann-Christine
    Mejdani, Desar
    Engel, Lukas
    Braeunig, Johanna
    Kammel, Christoph
    Vossiek, Martin
    Ullmann, Ingrid
    2024 IEEE RADAR CONFERENCE, RADARCONF 2024, 2024,
  • [39] Human Detection and Action Classification Based on Millimeter Wave Radar Point Cloud Imaging Technology
    Wu, Jiayu
    Zhu, Zhanyu
    Wang, Haipeng
    2021 SIGNAL PROCESSING SYMPOSIUM (SPSYMPO), 2021, : 294 - 299
  • [40] Recursive spatial-temporal clustering-based target detection with millimeter-wave radar point cloud
    Bi, Zhicheng
    Gao, Yu
    Wang, Chaofeng
    Liu, Zhenghai
    Wan, Yaping
    Yang, Xiaohua
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (07)