3D mesh pose transfer based on skeletal deformation

被引:2
|
作者
Yang, Shigeng [1 ]
Yin, Mengxiao [1 ,2 ,4 ]
Li, Ming [1 ]
Li, Guiqing [3 ]
Chang, Kan [1 ,2 ]
Yang, Feng [1 ,2 ]
机构
[1] Guangxi Univ, Sch Comp Elect & Informat, Nanning, Guangxi, Peoples R China
[2] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Nanning, Guangxi, Peoples R China
[3] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
[4] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; pose transfer; skeleton extraction; skinning deformation;
D O I
10.1002/cav.2156
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For 3D mesh pose transfer, the target model is obtained by transferring the pose of the reference mesh to the source mesh, where the shape and pose of the source are usually different from that of the reference. In this paper, pose transfer is considered as a deformation process of the source mesh, and we propose a 3D mesh pose transfer method based on skeletal deformation. First, we design a neural network based on the edge convolution operator to extract the skeleton of the 3D mesh and bind the rigid weights; then, we calculate the bone transformations between the two skeletons with different poses and use the diffusion equation to smooth the rigid weights; finally, the source mesh is deformed according to the bone transformations and the smooth weights to get the target mesh. Experiment results on different datasets show that the pose of the reference mesh can be effectively transferred to the source one while maintaining the shape and high-quality geometric details of the source mesh by using our method.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] EXTENDED WHOLE MESH DEFORMATION MODEL: FULL 3D PROCESSING
    Lenkiewicz, Przemyslaw
    Pereira, Manuela
    Freire, Mario M.
    Fernandes, Jose
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 1601 - 1604
  • [32] Mesh U-Nets for 3D Cardiac Deformation Modeling
    Beetz, Marcel
    Acero, Jorge Corral
    Banerjee, Abhirup
    Eitel, Ingo
    Zacur, Ernesto
    Lange, Torben
    Stiermaier, Thomas
    Evertz, Ruben
    Backhaus, Soeren J.
    Thiele, Holger
    Bueno-Orovio, Alfonso
    Lamata, Pablo
    Schuster, Andreas
    Grau, Vicente
    STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART: REGULAR AND CMRXMOTION CHALLENGE PAPERS, STACOM 2022, 2022, 13593 : 245 - 257
  • [33] Skeleton-Free Pose Transfer for Stylized 3D Characters
    Liao, Zhouyingcheng
    Yang, Jimei
    Saito, Jun
    Pons-Moll, Gerard
    Zhou, Yang
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 640 - 656
  • [34] Creating a 3D Mesh in A-pose from a Single Image for Character Rigging
    Lee, Seunghwan
    Liu, C. Karen
    ACM SIGGRAPH / EUROGRAPHICS SYMPOSIUM OF COMPUTER ANIMATION 2024, 2024,
  • [35] Geometry-Contrastive Transformer for Generalized 3D Pose Transfer
    Chen, Haoyu
    Tang, Hao
    Yu, Zitong
    Sebe, Nicu
    Zhao, Guoying
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 258 - 266
  • [36] Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery
    Weng, Zhenzhen
    Wang, Kuan-Chieh
    Kanazawa, Angjoo
    Yeung, Serena
    2022 INTERNATIONAL CONFERENCE ON 3D VISION, 3DV, 2022, : 261 - 270
  • [37] Unsupervised 3D Pose Transfer With Cross Consistency and Dual Reconstruction
    Song, Chaoyue
    Wei, Jiacheng
    Li, Ruibo
    Liu, Fayao
    Lin, Guosheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10488 - 10499
  • [38] Creating a 3D Mesh in A-pose from a Single Image for Character Rigging
    Lee, Seunghwan
    Liu, C. Karen
    COMPUTER GRAPHICS FORUM, 2024, 43 (08)
  • [39] Pose normalization of 3-D mesh model based on rotation transformation
    Yuan, Hao
    Lu, Zhangping
    Bi, Wei
    Nie, Qian
    Nongye Jixie Xuebao/Transactions of the Chinese Society of Agricultural Machinery, 2008, 39 (11): : 132 - 137
  • [40] SCALE-Pose: Skeletal Correction and Language Knowledge-assisted for 3D Human Pose Estimation
    Ma, Xinnan
    Li, Yaochen
    Zhao, Limeng
    Zhou, ChenXu
    Xu, Yuncheng
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 578 - 592