An improved multi-object classification algorithm for visual SLAM under dynamic environment

被引:7
|
作者
Wen, Shuhuan [1 ,2 ]
Liu, Xin [1 ,2 ]
Wang, Zhe [1 ,2 ]
Zhang, Hong [3 ]
Zhang, Zhishang [1 ,2 ]
Tian, Wenbo [1 ,2 ]
机构
[1] Yanshan Univ, Key Lab Ind Comp Control Engn Hebei Prov, Qinhuangdao, Hebei, Peoples R China
[2] Yanshan Univ, Engn Res Ctr, Minist Educ Intelligent Control Syst & Intelligen, Qinhuangdao, Hebei, Peoples R China
[3] Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
ORB-SLAM2; Multi-object classification; Reprojection error algorithm; Dynamic indoor environments;
D O I
10.1007/s11370-021-00400-8
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this paper, a novel dynamic multi-object classification method is proposed based on real-time localization of a robot equipped with a vision sensor that captures a sparse three-dimensional environment. Specifically, we build upon ORB-SLAM2 and improve its formulation to better handle moving objects in a dynamic environment. We propose a feature classification algorithm for ORB (oriented FAST and rotated BRIEF) features in complex environments. Based on inter-frame texture constraints, we add the reprojection error algorithm, which can reduce the influence of illumination and dynamic objects on the simultaneous localization and mapping (SLAM) algorithm. We then propose a new dynamic initialization strategy and apply the proposed feature classification algorithm to the ORB-SLAM2 tracking thread. For real-world implementations, we focus on the robustness and real-time performance of dynamic target segmentation simultaneously, which cannot be satisfied by existing geometric segmentation and semantic segmentation methods. From an engineering point of view, the proposed work can quickly separate dynamic feature points based on traditional methods, which makes the proposed algorithm has better real time in practical applications. We thoroughly evaluate our approach on the TUM and KITTI benchmark database and on a real environment using the Turtlebot platform equipped with a Bumblebee camera. The experimental results indicate that the proposed method is more robust and accurate than current state-of-the-art methods in different environments.
引用
收藏
页码:39 / 55
页数:17
相关论文
共 50 条
  • [31] Multi-object Optimal Design of Analog Filter Based on Improved Genetic Algorithm
    Xie Qinlan
    Chen Hong
    ICICTA: 2009 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION, VOL I, PROCEEDINGS, 2009, : 362 - 365
  • [32] Semantic geometric fusion multi-object tracking and lidar odometry in dynamic environment
    Ma, Tingchen
    Jiang, Guolai
    Ou, Yongsheng
    Xu, Sheng
    ROBOTICA, 2024, 42 (03) : 891 - 910
  • [33] Multi-object segmentation algorithm based on improved Chan-Vese model
    Fu, Xiaowei
    Ding, Mingyue
    Zhou, Chengping
    Cai, Chao
    MIPPR 2007: AUTOMATIC TARGET RECOGNITION AND IMAGE ANALYSIS; AND MULTISPECTRAL IMAGE ACQUISITION, PTS 1 AND 2, 2007, 6786
  • [34] AFO-SLAM: an improved visual SLAM in dynamic scenes using acceleration of feature extraction and object detection
    Wei, Jinbi
    Deng, Heng
    Wang, Jihong
    Zhang, Liguo
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (11)
  • [35] Multi-Object Tracking by Hierarchical Visual Representations
    Cao, Jinkun
    Pang, Jiangmiao
    Kitani, Kris
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 2667 - 2674
  • [36] Optimized feature extraction and object detection for indoor dynamic environment visual SLAM study
    Wang, Wencheng
    Wang, Yingchao
    Wu, Zhenmin
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2024, 21 (05):
  • [37] Learned Filters for Object Detection in Multi-object Visual Tracking
    Stamatescu, Victor
    Wong, Sebastien
    McDonnell, Mark D.
    Kearney, David
    AUTOMATIC TARGET RECOGNITION XXVI, 2016, 9844
  • [38] Multi-object monocular SLAM based on instance segmentation and 3D reconstruction in dynamic scene
    Feng Z.
    Xu X.
    Zheng Y.
    Cheng L.
    Li P.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (08): : 51 - 62
  • [39] A NOVEL INSTANCE SEGMENTATION ALGORITHM BASED ON IMPROVED DEEP LEARNING ALGORITHM FOR MULTI-OBJECT IMAGES
    Abuowaida, Suhaila Farhan Ahmad
    Chan, Huah Yong
    Alshdaifat, Nawaf Farhan Funkur
    Abualigah, Laith
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2021, 7 (01): : 74 - 88
  • [40] Contour Based Multi-object Classification Technology
    Nie, Qing
    Zhan, Shou-yi
    INTELLIGENT ROBOTICS AND APPLICATIONS, PT I, PROCEEDINGS, 2008, 5314 : 795 - +