3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A 3D Human Body and Face Fitting System Based on Deformation Graph and Mesh Template
    Li Z.
    Liang J.
    Xu J.
    Wang Y.
    Zou X.
    Xu L.
    Li G.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (06): : 919 - 928
  • [22] N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networks
    Li, Y. D.
    Tang, M.
    Yang, Y.
    Huang, Z.
    Tong, R. F.
    Yang, S. C.
    Li, Y.
    Manocha, D.
    COMPUTER GRAPHICS FORUM, 2022, 41 (02) : 547 - 558
  • [23] 3D Pose Based Feedback for Physical Exercises
    Zhao, Ziyi
    Kiciroglu, Sena
    Vinzant, Hugues
    Cheng, Yuan
    Katircioglu, Isinsu
    Salzmann, Mathieu
    Fua, Pascal
    COMPUTER VISION - ACCV 2022, PT IV, 2023, 13844 : 189 - 205
  • [24] Improving Quality of Free-Viewpoint Image by Mesh Based 3D Shape Deformation
    Yaguchi, Satoshi
    Saito, Hideo
    JOURNAL OF WSCG, 2006, 2006, 14 (1-3): : 57 - 64
  • [25] Animal Pose Estimation Based on 3D Priors
    Dai, Xiaowei
    Li, Shuiwang
    Zhao, Qijun
    Yang, Hongyu
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [26] GPU-Accelerated 3D Mesh Deformation for Optimization Based on the Finite Element Method
    Lamecki, Adam
    Dziekonski, Adam
    Balewski, Lukasz
    Fotyga, Grzegorz
    Mrozowski, Michal
    RADIOENGINEERING, 2017, 26 (04) : 924 - 929
  • [27] Detailed 3D Human Body Reconstruction From a Single Image Based on Mesh Deformation
    Zhang, Sizhuo
    Xiao, Nanfeng
    IEEE ACCESS, 2021, 9 : 8595 - 8603
  • [28] Bayesian Image Based 3D Pose Estimation
    Sanzari, Marta
    Ntouskos, Valsamis
    Pirri, Fiora
    COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 566 - 582
  • [29] Effect of Mesh Deformation on the Accuracy of 3D FEM Electromagnetic Analysis
    Lamecki, A.
    Balewski, L.
    Mrozowski, M.
    2016 IEEE MTT-S INTERNATIONAL CONFERENCE ON NUMERICAL ELECTROMAGNETIC AND MULTIPHYSICS MODELING AND OPTIMIZATION (NEMO), 2016,
  • [30] SMR: Spatial-Guided Model-Based Regression for 3D Hand Pose and Mesh Reconstruction
    Sun, Haifeng
    Zheng, Xiaozheng
    Ren, Pengfei
    Wang, Jingyu
    Qi, Qi
    Liao, Jianxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 299 - 314