PoseDiffusion: A Coarse-to-Fine Framework for Unseen Object 6-DoF Pose Estimation

被引:2
|
作者
Zhou, Jiaming [1 ,2 ]
Zhu, Qing [1 ,2 ]
Wang, Yaonan [1 ,2 ]
Feng, Mingtao [3 ]
Wu, Chengzhong [4 ]
Liu, Xuebing [1 ,2 ]
Huang, Jianan [1 ,2 ]
Mian, Ajmal [5 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410012, Peoples R China
[2] Natl Engn Res Ctr Robot Visual Percept & Control, Changsha 410082, Peoples R China
[3] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
[4] Jiangxi Prov Commun Terminal Ind Co Ltd, Jian 343000, Peoples R China
[5] Univ Western Australia, Dept Comp Sci & Software Engn, Perth, WA 6009, Australia
关键词
Diffusion model; robotic grasping; transformer; unseen object pose estimation;
D O I
10.1109/TII.2024.3399886
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurately estimating the six-degrees of freedom (DoF) pose of unseen objects is crucial for successful robotic manipulation in industrial automation. Some existing methods for this task rely on prior knowledge of individual objects, i.e., the model must be trained on the exact object instance or object category. Others perform unseen object pose estimation but are limited in their feature learning and pose refinement ability. To address these problems, we propose an unseen object pose estimation method that follows a coarse-to-fine framework and leverages the powerful learning ability of diffusion models. We introduce a diffusion model for generating object poses, and conduct a comparison between the generated poses and the original pose to determine the optimal one. We design a novel pose estimation module to provide coarse poses for the PoseDiffusion. This module comprises two feature extraction modules that extract global and masked features. In addition, we propose a strategy to estimate the pose by comparing the similarity between rendered and query poses. The renderings of an unseen object from various viewpoints are generated from its computer-aided design (CAD) model. Our method requires a CAD model of the unseen object only during inference, a scenario well suited to industrial applications. Experimental evaluation on benchmark datasets demonstrates that the proposed framework outperforms existing approaches, achieving state-of-the-art performance in six-DoF object pose estimation.
引用
收藏
页码:11127 / 11138
页数:12
相关论文
共 50 条
  • [21] Evaluation of PoseNet for 6-DOF Underwater Pose Estimation
    Nielsen, Mikkel Cornelius
    Leonhardsen, Mari Hovem
    Schjolberg, Ingrid
    OCEANS 2019 MTS/IEEE SEATTLE, 2019,
  • [22] The Icosahedron Marker for Robots 6-Dof Pose Estimation
    Duan, Lunhui
    Sun, Hao
    Xuan, Bokai
    Tan, Yinglun
    Cui, Rui
    Wu, Mengkun
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1028 - 1033
  • [23] Research of 6-DOF pose estimation in stacked scenes
    Teng, Qi
    Yi, Jianjun
    Li, Huazhong
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (03):
  • [24] Coarse-to-Fine 3D Human Pose Estimation
    Guo, Yu
    Zhao, Lin
    Zhang, Shanshan
    Yang, Jian
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 579 - 592
  • [25] Deep Learning-Based 6-DoF Object Pose Estimation Considering Synthetic Dataset
    Zheng, Tianyu
    Zhang, Chunyan
    Zhang, Shengwen
    Wang, Yanyan
    SENSORS, 2023, 23 (24)
  • [26] Coarse-to-Fine Hand-Object Pose Estimation with Interaction-Aware Graph Convolutional Network
    Zhang, Maomao
    Li, Ao
    Liu, Honglei
    Wang, Minghui
    SENSORS, 2021, 21 (23)
  • [27] Cylinder object 6-DOF pose estimation via single perspective circle on cylindrical surface
    Yu, Aidi
    Wang, Yujia
    Guo, Bing
    Li, Haoyuan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [28] Iterative Coarse-to-Fine 6D-Pose Estimation Using Back-propagation
    Araki, Ryosuke
    Mano, Kohsuke
    Hirano, Tadanori
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3587 - 3594
  • [29] 6-DoF grasp pose estimation based on instance reconstruction
    Han, Huiyan
    Wang, Wenjun
    Han, Xie
    Yang, Xiaowen
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (02) : 251 - 264
  • [30] 6-DoF grasp pose estimation based on instance reconstruction
    Huiyan Han
    Wenjun Wang
    Xie Han
    Xiaowen Yang
    Intelligent Service Robotics, 2024, 17 : 251 - 264