6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [41] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [42] 3D Model-Based 6D Object Pose Tracking on RGB Images
    Majcher, Mateusz
    Kwolek, Bogdan
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS (ACIIDS 2020), PT I, 2020, 12033 : 271 - 282
  • [43] Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
    Kehl, Wadim
    Milletari, Fausto
    Tombari, Federico
    Ilic, Slobodan
    Navab, Nassir
    COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 205 - 220
  • [44] 6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model
    Matteo, Bortolon
    Tsesmelis, Theodore
    James, Stuart
    Poiesi, Fabio
    Del Bue, Alessio
    COMPUTER VISION - ECCV 2024, PT LII, 2025, 15110 : 420 - 436
  • [45] 6IMPOSE: bridging the reality gap in 6D pose estimation for robotic grasping
    Cao, Hongpeng
    Dirnberger, Lukas
    Bernardini, Daniele
    Piazza, Cristina
    Caccamo, Marco
    FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [46] Unsupervised Joint 3D Object Model Learning and 6D Pose Estimation for Depth-Based Instance Segmentation
    Wu, Yuanwei
    Marks, Tim K.
    Cherian, Anoop
    Chen, Siheng
    Feng, Chen
    Wang, Guanghui
    Sullivan, Alan
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2777 - 2786
  • [47] RGB-Based Set Prediction Transformer of 6D Pose Estimation for Robotic Grasping Application
    Ning, Xiao
    Yang, Beining
    Huang, Si
    Zhang, Zhenzhe
    Pan, Binhui
    IEEE ACCESS, 2024, 12 : 138047 - 138060
  • [48] Hough-space-based hypothesis generation and hypothesis verification for 3D object recognition and 6D pose estimation
    Zhou, Wei
    Ma, Caiwen
    Kuijper, Arjan
    COMPUTERS & GRAPHICS-UK, 2018, 72 : 122 - 134
  • [49] Object Detection and 6D Pose Estimation for Precise Robotic Manipulation in Unstructured Environments
    di Castro, Mario
    Camarero Vera, Jorge
    Ferre, Manuel
    Masi, Alessandro
    INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, ICINCO 2017, 2020, 495 : 392 - 403
  • [50] An image appearance based optimization scheme for monocular 6D pose estimation of SOR cabins
    Yin, Xuyue
    Fan, Xiumin
    Yang, Xu
    Qiu, Shiguang
    OPTIK, 2019, 199