3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Recursive Rendering of 2D Images for Accurate Pose Estimation in a 3D Mesh Map
    Hanaoka, Yohei
    Suwanwimolkul, Suwichaya
    Komorita, Satoshi
    SIGGRAPH ASIA 2022 POSTERS, SA 2022, 2022,
  • [42] THE WHOLE MESH DEFORMATION MODEL FOR 2D AND 3D IMAGE SEGMENTATION
    Lenkiewicz, Przemyslaw
    Pereira, Manuela
    Freire, Mario
    Fernandes, Jose
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 4045 - +
  • [43] Adapted human pose: monocular 3D human pose estimation with zero real 3D pose data
    Liu, Shuangjun
    Sehgal, Naveen
    Ostadabbas, Sarah
    APPLIED INTELLIGENCE, 2022, 52 (12) : 14491 - 14506
  • [44] Adapted human pose: monocular 3D human pose estimation with zero real 3D pose data
    Shuangjun Liu
    Naveen Sehgal
    Sarah Ostadabbas
    Applied Intelligence, 2022, 52 : 14491 - 14506
  • [45] Enhanced real-time motion transfer to 3D avatars using RGB-based human 3D pose estimation
    Poulios, Ilias
    Pistola, Theodora
    Symeonidis, Spyridon
    Diplaris, Sotiris
    Ioannidis, Konstantinos
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    PROCEEDINGS OF THE 2024 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE MEDIA EXPERIENCES WORKSHOPS, IMXW 2024, 2024, : 88 - 99
  • [46] Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video
    Matsuyama, T
    Wu, X
    Takai, T
    Nobuhara, S
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2004, 96 (03) : 393 - 434
  • [47] 3D Polygon Mesh Encryption Based on 3D Lorenz Chaotic Map
    Ali N.A.
    Rahma A.M.S.
    Shaker S.H.
    Int. J. Interact. Mob. Technol., 2021, 15 (103-114): : 103 - 114
  • [48] Compression of 3D mesh sequences based on an adaptive 3D wavelet transformation
    Jafari, Kian
    Dupont, Florent
    THREE-DIMENSIONAL IMAGE PROCESSING (3DIP) AND APPLICATIONS, 2010, 7526
  • [49] 3D High Resolution Mesh Deformation Based on Multi Library Wavelet Neural Network Architecture
    Dhibi, Naziha
    Elkefi, Akram
    Bellil, Wajdi
    Ben Amar, Chokri
    3D RESEARCH, 2016, 7 (04):
  • [50] A GPU-Accelerated 3D Mesh Deformation Method Based on Radial Basis Function Interpolation
    He, Jiandong
    Wu, Chong
    Jia, Yining
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022