Pose and Skeleton-aware Neural IK for Pose and Motion Editing

被引:1
|
作者
Agrawal, Dhruv [1 ,2 ]
Guay, Martin [2 ]
Buhmann, Jakob [2 ]
Borer, Dominik [2 ]
Sumner, Robert W. [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] DisneyRes Studios, Zurich, Switzerland
关键词
skeletal networks; pose authoring; learned inverse kinematics; 3D animation;
D O I
10.1145/3610548.3618217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Posing a 3D character for film or game is an iterative and laborious process where many control handles (e.g. joints) need to be manipulated to achieve a compelling result. Neural Inverse Kinematics (IK) is a new type of IK that enables sparse control over a 3D character pose, and leverages full body correlations to complete the un-manipulated joints of the body. While neural IK is promising, current methods are not designed to preserve previous edits in posing workflows. Current models generate a single pose from the handles only-regardless of what was there previously-making it difficult to preserve any variations and hindering tasks such as pose and motion editing. In this paper, we introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose, and designed to flow information directly onto the skeletal graph structure, such that hard constraints can be enforced by blocking information flows at certain joints. As a result, we are able to satisfy both hard and soft constraints, as well as preserve un-manipulated parts of the body when desired. Finally, by controlling the base pose in different ways, we demonstrate the ability of our model to perform tasks such as generating variations and quickly editing poses and motions; with less erosion of the base poses compared to the current state-of-the-art.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Observing pose and motion through contact
    Jia, YB
    Erdmann, M
    1998 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-4, 1998, : 723 - 729
  • [42] Pose controlled physically based motion
    Fattal, Raanan
    Lischinski, Dam
    COMPUTER GRAPHICS FORUM, 2006, 25 (04) : 777 - 787
  • [43] Pose-aware video action segmentation
    Zhang M.
    Liao C.
    Li Q.
    Zhang H.
    Liu W.
    Neural Computing and Applications, 2024, 36 (27) : 17095 - 17106
  • [44] Body Pose Prediction Based on Motion Sensor Data and Recurrent Neural Network
    Wozniak, Marcin
    Wieczorek, Michal
    Silka, Jakub
    Polap, Dawid
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 2101 - 2111
  • [45] Pose Estimation of Complex Human Motion
    Lei, Fei
    An, Zhanghong
    Wang, Xueli
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 153 - 156
  • [46] Pose-Free Neural Radiance Fields via Implicit Pose Regularization
    Zhang, Jiahui
    Zhan, Fangneng
    Yu, Yingchen
    Liu, Kunhao
    Wu, Rongliang
    Zhang, Xiaoqin
    Shao, Ling
    Lu, Shijian
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3511 - 3520
  • [47] Pervasive pose-aware applications and infrastructure
    Teller, S
    Chen, JW
    Balakrishnan, H
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2003, 23 (04) : 14 - 18
  • [48] Pose and Joint-Aware Action Recognition
    Shah, Anshul
    Mishra, Shlok
    Bansal, Ankan
    Chen, Jun-Cheng
    Chellappa, Rama
    Shrivastava, Abhinav
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 141 - 151
  • [49] Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields
    Tiwari, Garvita
    Antic, Dimitrije
    Lenssen, Jan Eric
    Sarafianos, Nikolaos
    Tung, Tony
    Pons-Moll, Gerard
    COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 572 - 589
  • [50] Pose-Aware Face Recognition in the Wild
    Masi, Iacopo
    Rawls, Stephen
    Medioni, Gerard
    Natarajan, Prem
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4838 - 4846