SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

被引:0
|
作者
Cao, Zhenzhong [1 ,2 ,3 ]
Zhang, Qianyi [1 ,2 ,3 ]
Guang, Jinzheng [1 ,2 ,3 ]
Wu, Shichao [1 ,2 ,3 ]
Hu, Zhengxi [1 ,2 ,3 ]
Liu, Jingtai [1 ,2 ,3 ]
机构
[1] Inst Robot & Automat Informat Syst, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
[3] Nankai Univ, TBI Ctr, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
SLAM; localization; semantic scene understanding; VERSATILE; ROBUST;
D O I
10.1109/LRA.2024.3374169
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positive detections in loop closure. To address these issues, we first propose a semantic loop detection method based on quadric-level object map topology, which represents scenes through the topological graph of quadric-level objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Next, to solve the data association problem between frame and map in loop closure, we propose an object data association method based on multi-level verification, which can associate 2D semantic features of the current frame with 3D object landmarks of the map. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall, and localization accuracy metrics.
引用
收藏
页码:4257 / 4264
页数:8
相关论文
共 50 条
  • [31] Object-Oriented 3D Semantic Mapping Based on Instance Segmentation
    Chi, Jinxin
    Wu, Hao
    Tian, Guohui
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2019, 23 (04) : 695 - 704
  • [32] Graph-based 3D collaborative disparity map estimation technique
    Altantawy, Doaa A.
    Kishk, Sherif
    2015 TENTH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2015, : 261 - 266
  • [33] 3D object retrieval with graph-based collaborative feature learning
    Chen, Feng
    Li, Bo
    Li, Liang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 261 - 268
  • [34] 3D Object Detection in Substation Scene Based on Graph Neural Network
    Zhang, Ting
    Zhang, Xingzhong
    Wang, Huimin
    Yang, Gang
    Wang, Dawei
    Computer Engineering and Applications, 2023, 59 (09) : 329 - 336
  • [35] 3D articulated object retrieval using a graph-based representation
    Agathos, Alexander
    Pratikakis, Ioannis
    Papadakis, Panagiotis
    Perantonis, Stavros
    Azariadis, Philip
    Sapidis, Nickolas S.
    VISUAL COMPUTER, 2010, 26 (10): : 1301 - 1319
  • [36] 3D articulated object retrieval using a graph-based representation
    Alexander Agathos
    Ioannis Pratikakis
    Panagiotis Papadakis
    Stavros Perantonis
    Philip Azariadis
    Nickolas S. Sapidis
    The Visual Computer, 2010, 26 : 1301 - 1319
  • [37] Object-level 3D Semantic Mapping using a Network of Smart Edge Sensors
    Hau, Julian
    Bultmann, Simon
    Behnke, Sven
    2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 198 - 206
  • [38] SGFormer: Semantic Graph Transformer for Point Cloud-Based 3D Scene Graph Generation
    Lv, Changsheng
    Qi, Mengshi
    Li, Xia
    Yang, Zhengyuan
    Ma, Huadong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4035 - 4043
  • [39] Hybrid Semi-Dense 3D Semantic-Topological Mapping From Stereo Visual-Inertial Odometry SLAM With Loop Closure Detection
    Wen, Shuhuan
    Zhao, Yanfang
    Liu, Xin
    Sun, Fuchun
    Lu, Huibin
    Wang, Zhe
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) : 16057 - 16066
  • [40] Semantic Scene Manipulation Based on 3D Spatial Object Relations and Language Instructions
    Kartmann, Rainer
    Liu, Danqing
    Asfour, Tamim
    PROCEEDINGS OF THE 2020 IEEE-RAS 20TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS 2020), 2021, : 306 - 313