3D human pose detection using nano sensor and multi-agent deep reinforcement learning

被引:2
|
作者
Sun, Yangjie [1 ]
Che, Xiaoxi [1 ]
Zhang, Nan [1 ]
机构
[1] Beijing Univ Technol, Dept Phys Educ, Beijing 100124, Peoples R China
关键词
pose detection; EMG signal; feature extraction; nano sensor; multi-agent deep reinforcement learning; pose solution; ACTION RECOGNITION; POSTURE DETECTION; NETWORK; HYBRID;
D O I
10.3934/mbe.2023230
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Due to the complexity of three-dimensional (3D) human pose, it is difficult for ordinary sensors to capture subtle changes in pose, resulting in a decrease in the accuracy of 3D human pose detection. A novel 3D human motion pose detection method is designed by combining Nano sensors and multi-agent deep reinforcement learning technology. First, Nano sensors are placed in key parts of the human to collect human electromyogram (EMG) signals. Second, after de-noising the EMG signal by blind source separation technology, the time-domain and frequency-domain features of the surface EMG signal are extracted. Finally, in the multi-agent environment, the deep reinforcement learning network is introduced to build the multi-agent deep reinforcement learning pose detection model, and the 3D local pose of the human is output according to the features of the EMG signal. The fusion and pose calculation of the multi-sensor pose detection results are performed to obtain the 3D human pose detection results. The results show that the proposed method has high accuracy for detecting various human poses, and the accuracy, precision, recall and specificity of 3D human pose detection results are 0.97, 0.98, 0.95 and 0.98, respectively. Compared with other methods, the detection results in this paper are more accurate, and can be widely used in medicine, film, sports and other fields.
引用
收藏
页码:4970 / 4987
页数:18
相关论文
共 50 条
  • [11] Learning to Communicate with Deep Multi-Agent Reinforcement Learning
    Foerster, Jakob N.
    Assael, Yannis M.
    de Freitas, Nando
    Whiteson, Shimon
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [12] Decentralized Anomaly Detection via Deep Multi-Agent Reinforcement Learning
    Szostak, Hadar
    Cohen, Kobi
    2022 58TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2022,
  • [13] Multiple Landmark Detection Using Multi-agent Reinforcement Learning
    Vlontzos, Athanasios
    Alansary, Amir
    Kamnitsas, Konstantinos
    Rueckert, Daniel
    Kainz, Bernhard
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 262 - 270
  • [14] MAGNet: Multi-agent Graph Network for Deep Multi-agent Reinforcement Learning
    Malysheva, Aleksandra
    Kudenko, Daniel
    Shpilman, Aleksei
    2019 XVI INTERNATIONAL SYMPOSIUM PROBLEMS OF REDUNDANCY IN INFORMATION AND CONTROL SYSTEMS (REDUNDANCY), 2019, : 171 - 176
  • [15] Learning 3D Navigation Protocols on Touch Interfaces with Cooperative Multi-agent Reinforcement Learning
    Debard, Quentin
    Dibangoye, Jilles Steeve
    Canu, Stephane
    Wolf, Christian
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT III, 2020, 11908 : 35 - 52
  • [16] Multi-agent reinforcement learning for intrusion detection
    Servin, Arturo
    Kudenko, Daniel
    ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS, 2008, 4865 : 211 - 223
  • [17] Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning
    Palanisamy, Praveen
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [18] Multi-agent behavioral control system using deep reinforcement learning
    Ngoc Duy Nguyen
    Thanh Nguyen
    Nahavandi, Saeid
    NEUROCOMPUTING, 2019, 359 : 58 - 68
  • [19] A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
    Yi Liu
    Xiang Wu
    Yuming Bo
    Jiacun Wang
    Lifeng Ma
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (11) : 2346 - 2348
  • [20] A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
    Liu, Yi
    Wu, Xiang
    Bo, Yuming
    Wang, Jiacun
    Ma, Lifeng
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (11) : 2346 - 2348