High Speed and Accuracy of Animation 3D Pose Recognition Based on an Improved Deep Convolution Neural Network

被引:1
|
作者
Ding, Wei [1 ]
Li, Wenfa [2 ]
机构
[1] Anhui Normal Univ, Sch Journalism & Commun, Wuhu 241002, Peoples R China
[2] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Beijing 100083, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 13期
关键词
deep convolutional neural network (DCNN); pose recognition; character animation; complex posture; computer graphics;
D O I
10.3390/app13137566
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Pose recognition in character animations is an important avenue of research in computer graphics. However, the current use of traditional artificial intelligence algorithms to recognize animation gestures faces hurdles such as low accuracy and speed. Therefore, to overcome the above problems, this paper proposes a real-time 3D pose recognition system, which includes both facial and body poses, based on deep convolutional neural networks and further designs a single-purpose 3D pose estimation system. First, we transformed the human pose extracted from the input image to an abstract pose data structure. Subsequently, we generated the required character animation at runtime based on the transformed dataset. This challenges the conventional concept of monocular 3D pose estimation, which is extremely difficult to achieve. It can also achieve real-time running speed at a resolution of 384 fps. The proposed method was used to identify multiple-character animation using multiple datasets (Microsoft COCO 2014, CMU Panoptic, Human3.6M, and JTA). The results indicated that the improved algorithm improved the recognition accuracy and performance by approximately 3.5% and 8-10 times, respectively, which is significantly superior to other classic algorithms. Furthermore, we tested the proposed system on multiple pose-recognition datasets. The 3D attitude estimation system speed can reach 24 fps with an error of 100 mm, which is considerably less than that of the 2D attitude estimation system with a speed of 60 fps. The pose recognition based on deep learning proposed in this study yielded surprisingly superior performance, proving that the use of deep-learning technology for image recognition has great potential.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Vocal Music Recognition Based on Deep Convolution Neural Network
    He, Zhuo
    SCIENTIFIC PROGRAMMING, 2022, 2022
  • [22] A Vehicle Recognition Algorithm Based on Deep Convolution Neural Network
    Yang, Yang
    TRAITEMENT DU SIGNAL, 2020, 37 (04) : 647 - 653
  • [23] Vehicle Type Recognition Based on Deep Convolution Neural Network
    Shi, Lei
    Wang, Yamin
    Cao, Yangjie
    Wei, Lin
    DATA SCIENCE, PT II, 2017, 728 : 492 - 502
  • [24] Deep Convolution Neural Network Based Speech Recognition for Chhattisgarhi
    Londhe, Narendra D.
    Kshirsagar, Ghanahshyam B.
    Tekchandani, Hitesh
    2018 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2018, : 667 - 671
  • [25] Deformable Pose Traversal Convolution for 3D Action and Gesture Recognition
    Weng, Junwu
    Liu, Mengyuan
    Jiang, Xudong
    Yuan, Junsong
    COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 142 - 157
  • [26] An improved memristor-based 3D Convolutional Neural Network for action recognition
    Wang, Yining
    Li, Ke
    Shen, Siyuan
    Duan, Shukai
    Proceedings of SPIE - The International Society for Optical Engineering, 2023, 12707
  • [27] Target Recognition and 3D Pose Estimation Based on Prior Knowledge and Convolutional Neural Network for Robots
    Sun, Jingwen
    Zhao, Lijun
    Wang, Li
    Wang, Ke
    Ma, Yuting
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 298 - 304
  • [28] Point cloud based deep convolutional neural network for 3D face recognition
    Anagha R. Bhople
    Akhilesh M. Shrivastava
    Surya Prakash
    Multimedia Tools and Applications, 2021, 80 : 30237 - 30259
  • [29] Working activity recognition approach based on 3D deep convolutional neural network
    Liu T.
    Lu Z.
    Sun Y.
    Liu F.
    He B.
    Zhong J.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2020, 26 (08): : 2143 - 2156
  • [30] Point cloud based deep convolutional neural network for 3D face recognition
    Bhople, Anagha R.
    Shrivastava, Akhilesh M.
    Prakash, Surya
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (20) : 30237 - 30259