6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [21] Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching
    Chen, Yan
    Yi, Pengfei
    Guo, Yujie
    Liu, Rui
    Dong, Jing
    Zhou, Dongsheng
    2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [22] SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again
    Kehl, Wadim
    Manhardt, Fabian
    Tombari, Federico
    Ilic, Slobodan
    Navab, Nassir
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1530 - 1538
  • [23] A Novel Method for Preoperative 6D Pose Estimation of Rat Skull Based on 3D Vision Techniques
    Wu, Yujun
    Chen, Hanwei
    Han, Bo
    Liu, Chao
    Sheng, Xinjun
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [24] A Probabilistic Framework for Stereo-Vision Based 3D Object Search with 6D Pose Estimation
    Ma, Jeremy
    Burdick, Joel W.
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 2036 - 2042
  • [25] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [26] 6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics
    Ulmer, Maximilian
    Durner, Maximilian
    Sundermeyer, Martin
    Stoiber, Manuel
    Triebel, Rudolph
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 10749 - 10756
  • [27] A Review on Six Degrees of Freedom (6D) Pose Estimation for Robotic Applications
    Chen, Yuanwei
    Zaman, Mohd Hairi Mohd
    Ibrahim, Mohd Faisal
    IEEE ACCESS, 2024, 12 : 161002 - 161017
  • [28] 6D Pose estimation and robotic arm grabbing based on minimum size points model
    Wu, Jichun
    Fang, Haiguo
    Yang, Guangxing
    Fan, Dapeng
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2022, 28 (08): : 2472 - 2480
  • [29] 6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping
    Peng, Yueyan
    Yang, Xuyun
    Wei, Sheng
    Gao, Xiang
    Li, Wei
    Wen, James Zhiging
    2022 INTERNATIONAL CONFERENCE ON INDUSTRIAL AUTOMATION, ROBOTICS AND CONTROL ENGINEERING, IARCE, 2022, : 19 - 23
  • [30] Robotic grasping method with 6D pose estimation and point cloud fusion
    Ma, Haofei
    Wang, Gongcheng
    Bai, Hua
    Xia, Zhiyu
    Wang, Weidong
    Du, Zhijiang
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 134 (11-12): : 5603 - 5613