SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

被引:0
|
作者
Cao, Zhenzhong [1 ,2 ,3 ]
Zhang, Qianyi [1 ,2 ,3 ]
Guang, Jinzheng [1 ,2 ,3 ]
Wu, Shichao [1 ,2 ,3 ]
Hu, Zhengxi [1 ,2 ,3 ]
Liu, Jingtai [1 ,2 ,3 ]
机构
[1] Inst Robot & Automat Informat Syst, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
[3] Nankai Univ, TBI Ctr, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
SLAM; localization; semantic scene understanding; VERSATILE; ROBUST;
D O I
10.1109/LRA.2024.3374169
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positive detections in loop closure. To address these issues, we first propose a semantic loop detection method based on quadric-level object map topology, which represents scenes through the topological graph of quadric-level objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Next, to solve the data association problem between frame and map in loop closure, we propose an object data association method based on multi-level verification, which can associate 2D semantic features of the current frame with 3D object landmarks of the map. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall, and localization accuracy metrics.
引用
收藏
页码:4257 / 4264
页数:8
相关论文
共 50 条
  • [21] 3D object detection based on high⁃precision map enhancement
    Tao B.
    Yan F.-W.
    Yin Z.-S.
    Wu D.-M.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (03): : 802 - 809
  • [22] GRAPH-BASED APPROACH FOR 3D OBJECT DUPLICATE DETECTION
    Vajda, Peter
    Dufaux, Frederic
    Minh, Thien Ha
    Ebrahimi, Touradj
    2009 10TH INTERNATIONAL WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES, 2009, : 254 - 257
  • [23] Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graph
    Yang, Honghui
    Liu, Zili
    Wu, Xiaopei
    Wang, Wenxiao
    Qian, Wei
    He, Xiaofei
    Cai, Deng
    COMPUTER VISION, ECCV 2022, PT VIII, 2022, 13668 : 662 - 679
  • [24] Building and optimization of 3D semantic map based on Lidar and camera fusion
    Li, Jing
    Zhang, Xin
    Li, Jiehao
    Liu, Yanyu
    Wang, Junzheng
    NEUROCOMPUTING, 2020, 409 : 394 - 407
  • [25] 3D Semantic Map Construction System Based on Visual SLAM and CNNs
    Lai, Lei
    Yu, Xinyi
    Qian, Xuecheng
    Ou, Linlin
    IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 4727 - 4732
  • [26] 3D semantic map construction based on point cloud and image fusion
    Li, Huijun
    Zhao, Hailong
    Ye, Bin
    Zhang, Yu
    IET CYBER-SYSTEMS AND ROBOTICS, 2023, 5 (01)
  • [27] Sphere-Graph: A Compact 3D Topological Map for Robotic Navigation and Segmentation of Complex Environments
    Spencer, Meryl
    Sawtell, Reid
    Kitchen, Sarah
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) : 2567 - 2574
  • [28] Graph-Based 3D Building Semantic Segmentation for Sustainability Analysis
    Mao, Bo
    Li, Bingchan
    JOURNAL OF GEOVISUALIZATION AND SPATIAL ANALYSIS, 2020, 4 (01)
  • [29] Graph-Based 3D Building Semantic Segmentation for Sustainability Analysis
    Bo Mao
    Bingchan Li
    Journal of Geovisualization and Spatial Analysis, 2020, 4
  • [30] 3D Object Detection Based on Strong Semantic Key Point Sampling
    Che, Yunlong
    Yuan, Liang
    Sun, Lihui
    Computer Engineering and Applications, 60 (09): : 254 - 260