Human Pose Estimation by Exploiting Spatial and Temporal Constraints in Body-Part Configurations

被引:7
|
作者
Li, Qingwu [1 ]
He, Feijia [1 ]
Wang, Tian [1 ]
Zhou, Liangji [1 ]
Xi, Shuya [1 ]
机构
[1] Hohai Univ, Key Lab Sensor Networks & Environm Sensing, Changzhou 213022, Peoples R China
来源
IEEE ACCESS | 2017年 / 5卷
基金
中国国家自然科学基金;
关键词
Pose estimation; object detection; motion detection; PICTORIAL STRUCTURES; FLEXIBLE MIXTURES; RECOGNITION; MODELS;
D O I
10.1109/ACCESS.2016.2643439
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present an algorithm for estimating a sequence of articulated upper-body human pose in unconstrained videos. Most previous work often fails to locate forearms in those video scenes suffering from illumination varieties, background clutter, camera shake, or occlusion. In order to deal with such intractable cases, we propose a novel algorithm for addressing the problem of certain body parts localization. The proposed approach can be roughly divided into two steps: first, a spatial model is designed to capture the high-order relationship between adjacent parts and meanwhile to generate a set of configurations in each frame under the temporal context constraint; second, a competitive method is presented to select the best body parts among diverse pose configurations. In this paper, the proposed algorithm focuses on the unconstrained video scenes and improves the detection precision of certain body parts with high degree of freedom. Moreover, the proposed algorithm can be well applied to a very challenging dataset named Movies. Experimental results show that the proposed algorithm can dramatically improve performance compared with those related algorithms on two benchmark datasets (MPII and SHPED datasets) and on our Movies dataset.
引用
收藏
页码:443 / 454
页数:12
相关论文
共 50 条
  • [31] Human pose estimation using partial configurations and probabilistic regions
    Roberts, Timothy J.
    Mckenna, Stephen J.
    Ricketts, Ian W.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 73 (03) : 285 - 306
  • [32] Active Learning for Human Pose Estimation based on Temporal Pose Continuity
    Mori, Taro
    Deguchi, Daisuke
    Kawanishi, Yasutomo
    Ide, Ichiro
    Murase, Hiroshi
    Inoshita, Tetsuo
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [33] Human Pose Estimation Using Partial Configurations and Probabilistic Regions
    Timothy J. Roberts
    Stephen J. McKenna
    Ian W. Ricketts
    International Journal of Computer Vision, 2007, 73 : 285 - 306
  • [34] Using Hierarchical Models for 3D Human Body-Part Tracking
    Raskin, Leonid
    Rudzsky, Michael
    Rivlin, Ehud
    IMAGE ANALYSIS, PROCEEDINGS, 2009, 5575 : 11 - 20
  • [35] Exploiting spatio-temporal constraints for robust 2D pose tracking
    Rogez, Gregory
    Rius, Ignasi
    Martinez-del-Rincon, Jesus
    Orrite, Carlos
    HUMAN MOTION - UNDERSTANDING, MODELING, CAPTURE AND ANIMATION, PROCEEDINGS, 2007, 4814 : 58 - +
  • [36] Learning Temporal-Spatial Contextual Adaptation for Three-Dimensional Human Pose Estimation
    Wang, Hexin
    Quan, Wei
    Zhao, Runjing
    Zhang, Miaomiao
    Jiang, Na
    SENSORS, 2024, 24 (13)
  • [37] Three-Dimensional Human Pose Estimation with Spatial-Temporal Interaction Enhancement Transformer
    Wang, Haijian
    Shi, Qingxuan
    Shan, Beiguang
    APPLIED SCIENCES-BASEL, 2023, 13 (08):
  • [38] STRFormer: Spatial-Temporal-ReTemporal Transformer for 3D human pose estimation
    Liu, Xing
    Tang, Hao
    IMAGE AND VISION COMPUTING, 2023, 140
  • [39] Spatial-Temporal Multiscale Constrained Learning for mmWave-Based Human Pose Estimation
    Chen, Lin
    Guo, Xuemei
    Wang, Guoli
    Li, Hongyi
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (03) : 1108 - 1120
  • [40] Body-part specificity for learning of multiple prior distributions in human coincidence timing
    Matsumura, Yoshiki
    Roach, Neil W.
    Heron, James
    Miyazaki, Makoto
    NPJ SCIENCE OF LEARNING, 2024, 9 (01)