High Speed and Accuracy of Animation 3D Pose Recognition Based on an Improved Deep Convolution Neural Network

被引:1
|
作者
Ding, Wei [1 ]
Li, Wenfa [2 ]
机构
[1] Anhui Normal Univ, Sch Journalism & Commun, Wuhu 241002, Peoples R China
[2] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Beijing 100083, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 13期
关键词
deep convolutional neural network (DCNN); pose recognition; character animation; complex posture; computer graphics;
D O I
10.3390/app13137566
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Pose recognition in character animations is an important avenue of research in computer graphics. However, the current use of traditional artificial intelligence algorithms to recognize animation gestures faces hurdles such as low accuracy and speed. Therefore, to overcome the above problems, this paper proposes a real-time 3D pose recognition system, which includes both facial and body poses, based on deep convolutional neural networks and further designs a single-purpose 3D pose estimation system. First, we transformed the human pose extracted from the input image to an abstract pose data structure. Subsequently, we generated the required character animation at runtime based on the transformed dataset. This challenges the conventional concept of monocular 3D pose estimation, which is extremely difficult to achieve. It can also achieve real-time running speed at a resolution of 384 fps. The proposed method was used to identify multiple-character animation using multiple datasets (Microsoft COCO 2014, CMU Panoptic, Human3.6M, and JTA). The results indicated that the improved algorithm improved the recognition accuracy and performance by approximately 3.5% and 8-10 times, respectively, which is significantly superior to other classic algorithms. Furthermore, we tested the proposed system on multiple pose-recognition datasets. The 3D attitude estimation system speed can reach 24 fps with an error of 100 mm, which is considerably less than that of the 2D attitude estimation system with a speed of 60 fps. The pose recognition based on deep learning proposed in this study yielded surprisingly superior performance, proving that the use of deep-learning technology for image recognition has great potential.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] 3D Pose Estimation for Robotic Grasping Using Deep Convolution Neural Network
    Wang, Yao
    Xu, Ying
    Zhang, Xiaohui
    Sun, Zhen
    Zhang, Yafang
    Song, Guoli
    Wang, Junchen
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 513 - 517
  • [2] Traffic Sign Recognition Based on Improved Deep Convolution Neural Network
    Ma Yongjie
    Li Xueyan
    Song Xiaofeng
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (12)
  • [3] FeatureNet: Machining feature recognition based on 3D Convolution Neural Network
    Zhang, Zhibo
    Jaiswal, Prakhar
    Rai, Rahul
    COMPUTER-AIDED DESIGN, 2018, 101 : 12 - 22
  • [4] High resolution network for human hand pose estimation based on 3D convolution
    Sang N.
    Li M.
    1600, Huazhong University of Science and Technology (48): : 1 - 6
  • [5] Action Recognition Using High Temporal Resolution 3D Neural Network Based on Dilated Convolution
    Xu, Yongyang
    Feng, Yaxing
    Xie, Zhong
    Xie, Mingyu
    Luo, Wei
    IEEE ACCESS, 2020, 8 : 165365 - 165372
  • [6] Enhanced 3D Action Recognition Based on Deep Neural Network
    Park, Sungjoo
    Kim, Dongchil
    2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 470 - 472
  • [7] Object Recognition and 3D Pose Estimation Using Improved VGG16 Deep Neural Network in Cluttered Scenes
    He, Shengzhan
    Liang, Guoyuan
    Chen, Fan
    Wu, Xinyu
    Feng, Wei
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND ELECTRICAL ENGINEERING 2018 (ICITEE '18), 2018,
  • [8] Study on 3D Action Recognition Based on Deep Neural Network
    Park, Sungjoo
    Kim, Dongchil
    2019 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2019, : 309 - 311
  • [9] Fetal Pose Estimation in Volumetric MRI Using a 3D Convolution Neural Network
    Xu, Junshen
    Zhang, Molin
    Turk, Esra Abaci
    Zhang, Larry
    Grant, P. Ellen
    Ying, Kui
    Golland, Polina
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT IV, 2019, 11767 : 403 - 410
  • [10] Behavior recognition method based on improved 3D convolutional neural network
    Zhang X.
    Li C.
    Sun L.
    Zhang M.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2019, 25 (08): : 2000 - 2006