3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] 3D Pose Transfer with Correspondence Learning and Mesh Refinement
    Song, Chaoyue
    Wei, Jiacheng
    Li, Ruibo
    Liu, Fayao
    Lin, Guosheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] Skeleton based 3D mesh deformation
    Ma Zhanguo
    Liu Bo
    Zhang Hongbin
    2007 6TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS & SIGNAL PROCESSING, VOLS 1-4, 2007, : 721 - 725
  • [3] A 3D Mesh-Based Lifting-and-Projection Network for Human Pose Transfer
    Liu, Jinxiang
    Zhao, Yangheng
    Chen, Siheng
    Zhang, Ya
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4314 - 4327
  • [4] Automatic Deformation-based animation of 3D mesh
    Muraleedharan, Lakshmi Priya
    Gowda, Vikas Kantha
    Vandrotti, Basavaraja Shanthappa
    SIGGRAPH ASIA 2022 POSTERS, SA 2022, 2022,
  • [5] Transfer Learning based Parameterized 3D Mesh Deformation with 2D Stylized Cartoon Character
    Byun, Sanghyun
    Kim, Bumsoo
    Shin, Wonseop
    Jung, Yonghoon
    Seo, Sanghyun
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2023, 17 (11): : 3121 - 3144
  • [6] MAPConNet: Self-supervised 3D Pose Transfer with Mesh and Point Contrastive Learning
    Sun, Jiaze
    Chen, Zhixiang
    Kim, Tae-Kyun
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14406 - 14416
  • [7] Mesh deformation based 3D facial modeling from images
    Dong, Hongwei
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2012, 24 (07): : 932 - 940
  • [8] 3D Dental Mesh Repairing Using Template-based Deformation
    Xia, Genyuan
    Chen, Li
    2014 7TH INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI 2014), 2014, : 410 - 414
  • [9] Deformation representation based convolutional mesh autoencoder for 3D hand generation
    Zheng, Xinqian
    Jiang, Boyi
    Zhang, Juyong
    NEUROCOMPUTING, 2021, 444 : 356 - 365
  • [10] A review of 3D human body pose estimation and mesh recovery
    Muhammad, Zaka-Ud-Din
    Huang, Zhangjin
    Khan, Rashid
    DIGITAL SIGNAL PROCESSING, 2022, 128