SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

被引:0
|
作者
Cao, Zhenzhong [1 ,2 ,3 ]
Zhang, Qianyi [1 ,2 ,3 ]
Guang, Jinzheng [1 ,2 ,3 ]
Wu, Shichao [1 ,2 ,3 ]
Hu, Zhengxi [1 ,2 ,3 ]
Liu, Jingtai [1 ,2 ,3 ]
机构
[1] Inst Robot & Automat Informat Syst, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
[3] Nankai Univ, TBI Ctr, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
SLAM; localization; semantic scene understanding; VERSATILE; ROBUST;
D O I
10.1109/LRA.2024.3374169
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positive detections in loop closure. To address these issues, we first propose a semantic loop detection method based on quadric-level object map topology, which represents scenes through the topological graph of quadric-level objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Next, to solve the data association problem between frame and map in loop closure, we propose an object data association method based on multi-level verification, which can associate 2D semantic features of the current frame with 3D object landmarks of the map. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall, and localization accuracy metrics.
引用
收藏
页码:4257 / 4264
页数:8
相关论文
共 50 条
  • [1] SemanticLoop: Loop Closure With 3D Semantic Graph Matching
    Yu, Junfeng
    Shen, Shaojie
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 568 - 575
  • [2] A Semantic-Based Loop Closure Detection of 3D Point Cloud
    Fan, Yanfu
    Yuan, Haihui
    Zhu, Shiqiang
    Zhou, Guangzhao
    Du, Ruilong
    Gu, Jason
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1184 - 1189
  • [3] Efficient construction of topological semantic map with 3D information
    Wang, Peng
    Cheng, Jun
    Feng, Wei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (03) : 3011 - 3020
  • [4] Semantic Topological Descriptor for Loop Closure Detection within 3D Point Clouds In Outdoor Environment
    Liao, Ming
    Zhang, Yunzhou
    Zhang, Jinpeng
    Liang, Liang
    Coleman, Sonya
    Kerr, Dermot
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 2856 - 2863
  • [5] 3D Topological Map Extraction from Oriented Boundary Graph
    Baldacci, Fabien
    Braquelaire, Achille
    Damiand, Guillaume
    GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, PROCEEDINGS, 2009, 5534 : 283 - +
  • [6] A graph-with-loop structure for a topological representation of 3D objects
    Gonzalez-Diaz, Rocio
    Jimenez, Maria Jose
    Medrano, Belen
    Real, Pedro
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PROCEEDINGS, 2007, 4673 : 506 - 513
  • [7] Scene understanding using natural language description based on 3D semantic graph map
    Jiyoun Moon
    Beomhee Lee
    Intelligent Service Robotics, 2018, 11 : 347 - 354
  • [8] Scene understanding using natural language description based on 3D semantic graph map
    Moon, Jiyoun
    Lee, Beomhee
    INTELLIGENT SERVICE ROBOTICS, 2018, 11 (04) : 347 - 354
  • [9] Semantic-Context Graph Network for Point-Based 3D Object Detection
    Dong, Shuwei
    Kong, Xiaoyu
    Pan, Xingjia
    Tang, Fan
    Li, Wei
    Chang, Yi
    Dong, Weiming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6474 - 6486
  • [10] Towards Accurate Loop Closure Detection in Semantic SLAM With 3D Semantic Covisibility Graphs
    Qian, Zhentian
    Fu, Jie
    Xiao, Jing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 2455 - 2462