Pose and Skeleton-aware Neural IK for Pose and Motion Editing

被引:1
|
作者
Agrawal, Dhruv [1 ,2 ]
Guay, Martin [2 ]
Buhmann, Jakob [2 ]
Borer, Dominik [2 ]
Sumner, Robert W. [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] DisneyRes Studios, Zurich, Switzerland
关键词
skeletal networks; pose authoring; learned inverse kinematics; 3D animation;
D O I
10.1145/3610548.3618217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Posing a 3D character for film or game is an iterative and laborious process where many control handles (e.g. joints) need to be manipulated to achieve a compelling result. Neural Inverse Kinematics (IK) is a new type of IK that enables sparse control over a 3D character pose, and leverages full body correlations to complete the un-manipulated joints of the body. While neural IK is promising, current methods are not designed to preserve previous edits in posing workflows. Current models generate a single pose from the handles only-regardless of what was there previously-making it difficult to preserve any variations and hindering tasks such as pose and motion editing. In this paper, we introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose, and designed to flow information directly onto the skeletal graph structure, such that hard constraints can be enforced by blocking information flows at certain joints. As a result, we are able to satisfy both hard and soft constraints, as well as preserve un-manipulated parts of the body when desired. Finally, by controlling the base pose in different ways, we demonstrate the ability of our model to perform tasks such as generating variations and quickly editing poses and motions; with less erosion of the base poses compared to the current state-of-the-art.
引用
收藏
页数:10
相关论文
共 50 条
  • [11] Boneless pose editing and animation
    Baerentzen, J. Andreas
    Hansen, Kristian Evers
    Erleben, Kenny
    IMAGE ANALYSIS, PROCEEDINGS, 2007, 4522 : 562 - +
  • [12] Motion-Pose Recurrent Neural Network with Instantaneous Kinematic Descriptor for Skeleton Based Gesture Detection and Recognition
    Zhang, Zhi
    Song, Yonghong
    Zhang, Yuanlin
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 764 - 769
  • [13] Linking Pose and Motion
    Fossati, Andrea
    Fua, Pascal
    COMPUTER VISION - ECCV 2008, PT IV, PROCEEDINGS, 2008, 5305 : 200 - 213
  • [14] Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior
    Zhao, Qingqing
    Li, Peizhuo
    Wang Yifan
    Olga, Sorkine-Hornung
    Wetzstein, Gordon
    ACM SIGGRAPH / EUROGRAPHICS SYMPOSIUM OF COMPUTER ANIMATION 2024, 2024,
  • [15] Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior
    Zhao, Qingqing
    Li, Peizhuo
    Wang, Yifan
    Olga, Sorkine-Hornung
    Wetzstein, Gordon
    COMPUTER GRAPHICS FORUM, 2024, 43 (08)
  • [16] CullNet: Calibrated and Pose Aware Confidence Scores for Object Pose Estimation
    Gupta, Kartik
    Petersson, Lars
    Hartley, Richard
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2758 - 2766
  • [17] CoMo: Controllable Motion Generation Through Language Guided Pose Code Editing
    Huang, Yiming
    Wan, Weilin
    Yang, Yue
    Callison-Burch, Chris
    Yatskar, Mark
    Liu, Lingjie
    COMPUTER VISION - ECCV 2024, PT XXIX, 2025, 15087 : 180 - 196
  • [18] Progressive Direction-Aware Pose Grammar for Human Pose Estimation
    Zhou, Lu
    Chen, Yingying
    Wang, Jinqiao
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2023, 5 (04): : 593 - 605
  • [19] Precision Vehicle Pose Estimation with Uncertainty-aware Neural Network
    Nowak, Tomasz
    Skrzypczynski, Piotr
    WALKING ROBOTS INTO REAL WORLD, CLAWAR 2024 CONFERENCE, VOL 1, 2024, 1114 : 22 - 33
  • [20] Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part
    Hu, Lei
    Zhang, Zihao
    Zhong, Chongyang
    Jiang, Boyuan
    Xia, Shihong
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 4792 - 4808