Deductive Learning for Weakly-Supervised 3D Human Pose Estimation via Uncalibrated Cameras

被引:0
|
作者
Chen, Xipeng [1 ]
Wei, Pengxu [1 ]
Lin, Liang [1 ,2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] DarkMatter AI Res, Guangzhou, Peoples R China
来源
THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE | 2021年 / 35卷
基金
中国博士后科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Without prohibitive and laborious 3D annotations, weakly-supervised 3D human pose methods mainly employ the model regularization with geometric projection consistency or geometry estimation from multi-view images. Nevertheless, those approaches explicitly need known parameters of calibrated cameras, exhibiting a limited model generalization in various realistic scenarios. To mitigate this issue, in this paper, we propose a Deductive Weakly-Supervised Learning (DWSL) for 3D human pose machine. Our DWSL firstly learns latent representations on depth and camera pose for 3D pose reconstruction. Since weak supervision usually causes ill-conditioned learning or inferior estimation, our DWSL introduces deductive reasoning to make an inference for human pose from a view to another and develops a reconstruction loss to demonstrate what the model learns and infers is reliable. This learning by deduction strategy employs the view-transform demonstration and structural rules derived from depth, geometry and angle constraints, which improves the reliability of the model training with weak supervision. On three 3D human pose benchmarks, we conduct extensive experiments to evaluate our proposed method, which achieves superior performance in comparison with state-of-the-art weak-supervised methods. Particularly, our model shows an appealing potential for learning from 2D data captured in dynamic outdoor scenes, which demonstrates promising robustness and generalization in realistic scenarios. Our code is publicly available at https://github.com/XipengChen/DWSL-3D-pose.
引用
收藏
页码:1089 / 1096
页数:8
相关论文
共 50 条
  • [21] Error Bounds of Projection Models in Weakly Supervised 3D Human Pose Estimation
    Klug, Nikolas
    Einfalt, Moritz
    Brehm, Stephan
    Lienhart, Rainer
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 898 - 907
  • [22] Weakly supervised 3D human pose estimation based on PnP projection model
    Zhang, Xiaoyan
    Chen, Yunlai
    Lai, Huaijing
    Zhang, Hongzheng
    PATTERN RECOGNITION, 2025, 163
  • [23] Weakly-supervised learning for catheter segmentation in 3D frustum ultrasound
    Yang, Hongxu
    Shan, Caifeng
    Kolen, Alexander F.
    De With, Peter H. N.
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2022, 96
  • [24] Estimating 3D body pose using uncalibrated cameras
    Rosales, R
    Siddiqui, M
    Alon, J
    Sclaroff, S
    2001 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2001, : 821 - 827
  • [25] A Normalization Strategy for Weakly Supervised 3D Hand Pose Estimation
    Guo, Zizhao
    Li, Jinkai
    Tan, Jiyong
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [26] Integrating Multiple Uncalibrated Views for Human 3D Pose Estimation
    Wang, Zibin
    Chung, Ronald
    ADVANCES IN VISUAL COMPUTING, PT III, 2010, 6455 : 280 - +
  • [27] RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimation
    Wandt, Bastian
    Rosenhahn, Bodo
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7774 - 7783
  • [28] Weakly-Supervised Learning of Category-Specific 3D Object Shapes
    Han, Junwei
    Yang, Yang
    Zhang, Dingwen
    Huang, Dong
    Xu, Dong
    De La Torre, Fernando
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (04) : 1423 - 1437
  • [29] BSTS: A Weakly-Supervised Method for Semantic Learning of 3D Point Clouds
    Liu, Yan
    Hu, Qingyong
    Guo, Yulan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11386 - 11399
  • [30] Three-dimensional human pose estimation based on multi-source image weakly-supervised learning
    Cai Y.
    Wang X.
    Hu S.
    Liu J.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2019, 45 (12): : 2375 - 2384