Depth-Based Efficient PnP: A Rapid and Accurate Method for Camera Pose Estimation

被引:0
|
作者
Xie, Xinyue [1 ]
Zou, Deyue [1 ,2 ]
机构
[1] Dalian Univ Technol, Dalian 116024, Peoples R China
[2] Harbin Inst Technol, Harbin 150001, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Cameras; Accuracy; Uncertainty; Three-dimensional displays; Computational efficiency; Pose estimation; Robustness; Optimization; perspective-n-point (PnP); real-time pose estimation; SLAM; vision-based navigation;
D O I
10.1109/LRA.2024.3438037
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This letter presents a novel approach, DEPnP (Depth-based Efficient PnP), addressing the Perspective-n-Point (PnP) problem crucial in vision-based navigation and SLAM (Simultaneous Localization and Mapping) in robotics and automation, which estimates the pose of a calibrated camera by observing the 2D projections of known 3D points onto the camera image plane. The method employs eight variables to control the depth of control points and orientation of camera, formulating camera pose estimation as an optimization task. By optimizing these variables utilizing mean-subtracted rotation equations, rapid and accurate camera pose estimation is achieved. Notably, the careful selection of variables and objective function simplifies the computation of the Jacobian matrix, ensuring computational efficiency. DEPnP demonstrates robustness against noise and inlier disturbances, consistently delivering accurate camera pose estimation. Experimental evaluations validate the effectiveness and accuracy of DEPnP, positioning it as a competitive solution for real-time applications requiring precise camera pose estimation in robotics and automation. Our code has been open-sourced on GitHub.
引用
收藏
页码:9287 / 9294
页数:8
相关论文
共 50 条
  • [1] Efficient intensity-based camera pose estimation in presence of depth
    El Choubassi, Maha
    Nestares, Oscar
    Wu, Yi
    Kozintsev, Igor
    Haussecker, Horst
    THREE-DIMENSIONAL IMAGE PROCESSING (3DIP) AND APPLICATIONS 2013, 2013, 8650
  • [2] Efficient Convolutional Neural Networks for Depth-Based Multi-Person Pose Estimation
    Martinez-Gonzalez, Angel
    Villamizar, Michael
    Canevet, Olivier
    Odobez, Jean-Marc
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 4207 - 4221
  • [3] Depth-based hand pose estimation: data, methods, and challenges
    Supancic, James Steven, III
    Rogez, Gregory
    Yang, Yi
    Shotton, Jamie
    Ramanan, Deva
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1868 - 1876
  • [4] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges
    Supancic, James Steven, III
    Rogez, Gregory
    Yang, Yi
    Shotton, Jamie
    Ramanan, Deva
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (11) : 1180 - 1198
  • [5] Combining Kinect and PnP for Camera Pose Estimation
    Zhang, Shu
    Yu, Hui
    Dong, Junyu
    Wang, Ting
    Qv, Lin
    Liu, Honghai
    2015 8TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2015, : 357 - 361
  • [6] Depth-Based Hand Pose Estimation: Methods, Data, and Challenges
    James Steven Supančič
    Grégory Rogez
    Yi Yang
    Jamie Shotton
    Deva Ramanan
    International Journal of Computer Vision, 2018, 126 : 1180 - 1198
  • [7] TriHorn-Net: A model for accurate depth-based 3D hand pose estimation
    Rezaei, Mohammad
    Rastgoo, Razieh
    Athitsos, Vassilis
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 223
  • [8] Advancement in the head pose estimation via depth-based face spotting
    Saeed, Anwar
    Al-Hamadi, Ayoub
    Handrich, Sebastian
    PROCEEDINGS OF 2016 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2016,
  • [9] Augmented Skeleton Space Transfer for Depth-based Hand Pose Estimation
    Baek, Seungryul
    Kim, Kwang In
    Kim, Tae-Kyun
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8330 - 8339
  • [10] Residual Pose: A Decoupled Approach for Depth-based 3D Human Pose Estimation
    Martinez-Gonzalez, Angel
    Villamizar, Michael
    Canevet, Olivier
    Odobez, Jean-Marc
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10313 - 10318