SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

被引:0
|
作者
Cao, Zhenzhong [1 ,2 ,3 ]
Zhang, Qianyi [1 ,2 ,3 ]
Guang, Jinzheng [1 ,2 ,3 ]
Wu, Shichao [1 ,2 ,3 ]
Hu, Zhengxi [1 ,2 ,3 ]
Liu, Jingtai [1 ,2 ,3 ]
机构
[1] Inst Robot & Automat Informat Syst, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
[3] Nankai Univ, TBI Ctr, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
SLAM; localization; semantic scene understanding; VERSATILE; ROBUST;
D O I
10.1109/LRA.2024.3374169
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positive detections in loop closure. To address these issues, we first propose a semantic loop detection method based on quadric-level object map topology, which represents scenes through the topological graph of quadric-level objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Next, to solve the data association problem between frame and map in loop closure, we propose an object data association method based on multi-level verification, which can associate 2D semantic features of the current frame with 3D object landmarks of the map. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall, and localization accuracy metrics.
引用
收藏
页码:4257 / 4264
页数:8
相关论文
共 50 条
  • [41] Deformable 3D Clothed Humans Reconstruction by a Multi-Level Topological Graph Convolutional Network
    Mao A.
    Zhuo G.
    Xuan J.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (12): : 1899 - 1910
  • [42] Pose-graph Based 3D Map Fusion with Distributed Robot System
    Chen, Haoyao
    Zhong, Jin
    Fu, Yanling
    Lou, Yunjiang
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS IEEE-ROBIO 2014, 2014, : 1608 - 1613
  • [43] Single-view 3D object reconstruction based on NFFD and graph convolution
    Lian Y.
    Pei S.
    Hu W.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (10): : 1189 - 1202
  • [44] 3D Object retrieval based on non-local graph neural networks
    Li, Yin-min
    Gao, Zan
    Tao, Ya-bin
    Wang, Li-li
    Xue, Yan-bing
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (45-46) : 34011 - 34027
  • [45] A Similarity-Based Aspect-Graph Approach to 3D Object Recognition
    Christopher M. Cyr
    Benjamin B. Kimia
    International Journal of Computer Vision, 2004, 57 : 5 - 22
  • [46] 3D object retrieval approach based on directed acyclic graph lightfield feature
    Xiao, Q. K.
    Dai, Q. H.
    Wang, H. Y.
    ELECTRONICS LETTERS, 2008, 44 (14) : 847 - U170
  • [47] Object tracking based on siamese network with 3D attention and multiple graph attention
    Yan, Shilei
    Qi, Yujuan
    Liu, Mengxue
    Wang, Yanjiang
    Liu, Baodi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [48] 3D Object retrieval based on non-local graph neural networks
    Yin-min Li
    Zan Gao
    Ya-bin Tao
    Li-li Wang
    Yan-bing Xue
    Multimedia Tools and Applications, 2020, 79 : 34011 - 34027
  • [49] Graph-cut-based 3D Model Segmentation for Articulated Object Reconstruction
    Han, Inkyu
    Kim, Hyoungnyoun
    Park, Ji-Hyung
    2011 10TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2011,
  • [50] A similarity-based aspect-graph approach to 3D object recognition
    Cyr, CM
    Kimia, BB
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 57 (01) : 5 - 22