Deductive Learning for Weakly-Supervised 3D Human Pose Estimation via Uncalibrated Cameras

被引:0
|
作者
Chen, Xipeng [1 ]
Wei, Pengxu [1 ]
Lin, Liang [1 ,2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] DarkMatter AI Res, Guangzhou, Peoples R China
来源
THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE | 2021年 / 35卷
基金
中国博士后科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Without prohibitive and laborious 3D annotations, weakly-supervised 3D human pose methods mainly employ the model regularization with geometric projection consistency or geometry estimation from multi-view images. Nevertheless, those approaches explicitly need known parameters of calibrated cameras, exhibiting a limited model generalization in various realistic scenarios. To mitigate this issue, in this paper, we propose a Deductive Weakly-Supervised Learning (DWSL) for 3D human pose machine. Our DWSL firstly learns latent representations on depth and camera pose for 3D pose reconstruction. Since weak supervision usually causes ill-conditioned learning or inferior estimation, our DWSL introduces deductive reasoning to make an inference for human pose from a view to another and develops a reconstruction loss to demonstrate what the model learns and infers is reliable. This learning by deduction strategy employs the view-transform demonstration and structural rules derived from depth, geometry and angle constraints, which improves the reliability of the model training with weak supervision. On three 3D human pose benchmarks, we conduct extensive experiments to evaluate our proposed method, which achieves superior performance in comparison with state-of-the-art weak-supervised methods. Particularly, our model shows an appealing potential for learning from 2D data captured in dynamic outdoor scenes, which demonstrates promising robustness and generalization in realistic scenarios. Our code is publicly available at https://github.com/XipengChen/DWSL-3D-pose.
引用
收藏
页码:1089 / 1096
页数:8
相关论文
共 50 条
  • [31] Weakly-supervised temporal attention 3D network for human action recognition
    Kim, Jonghyun
    Li, Gen
    Yun, Inyong
    Jung, Cheolkon
    Kim, Joongkyu
    PATTERN RECOGNITION, 2021, 119
  • [32] Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving
    Bauer, Peter
    Bouazizi, Arij
    Kressel, Ulrich
    Flohr, Fabian B.
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [33] Distill Knowledge from NRSfM for Weakly Supervised 3D Pose Learning
    Wang, Chaoyang
    Kong, Chen
    Lucey, Simon
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 743 - 752
  • [34] SEMI-SUPERVISED 3D HAND-OBJECT POSE ESTIMATION VIA POSE DICTIONARY LEARNING
    Cheng, Zida
    Chen, Siheng
    Zhang, Ya
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3632 - 3636
  • [35] From Pose to Part: Weakly-Supervised Pose Evolution for Human Part Segmentation
    Zhao, Yifan
    Li, Jia
    Zhang, Yu
    Tian, Yonghong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3107 - 3120
  • [36] Lifting 2d Human Pose to 3d: A Weakly Supervised Approach
    Biswas, Sandika
    Sinha, Sanjana
    Gupta, Kavya
    Bhowmick, Brojeshwar
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [37] C3P: Cross-Domain Pose Prior Propagation for Weakly Supervised 3D Human Pose Estimation
    Wu, Cunlin
    Xiao, Yang
    Zhang, Boshen
    Zhang, Mingyang
    Cao, Zhiguo
    Zhou, Joey Tianyi
    COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 554 - 571
  • [38] 3D FACE RECONSTRUCTION BASED ON WEAKLY-SUPERVISED LEARNING MORPHABLE FACE MODEL
    Liang, Kai-Wen
    Li, Pin-Hsuan
    Lo, Chung-Hsun
    Wang, Chien-Yao
    Chen, Yung-Fang
    Wang, Jia-Ching
    Chang, Pao-Chi
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3523 - 3527
  • [39] ComplementMe: Weakly-Supervised Component Suggestions for 3D Modeling
    Sung, Minhyuk
    Su, Hao
    Kim, Vladimir G.
    Chaudhuri, Siddhartha
    Guibas, Leonidas
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):
  • [40] Robust 3D Human Pose Estimation via Dual Dictionaries Learning
    Ji, Hao
    Su, Fei
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 3370 - 3373