Visual place recognition: A survey from deep learning perspective

被引:144
|
作者
Zhang, Xiwu [1 ]
Wang, Lei [2 ]
Su, Yan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
基金
澳大利亚研究理事会;
关键词
Visual place recognition; Deep learning; Visual SLAM; Survey; LARGE-SCALE; LOOP CLOSURE; FEATURE-SELECTION; IMAGE SEQUENCES; NEURAL-NETWORKS; FAB-MAP; LOCALIZATION; GRAPH; TIME; REPRESENTATIONS;
D O I
10.1016/j.patcog.2020.107760
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition has attracted widespread research interest in multiple fields such as computer vision and robotics. Recently, researchers have employed advanced deep learning techniques to tackle this problem. While an increasing number of studies have proposed novel place recognition methods based on deep learning, few of them has provided a whole picture about how and to what extent deep learning has been utilized for this issue. In this paper, by delving into over 200 references, we present a comprehensive survey that covers various aspects of place recognition from deep learning perspective. We first present a brief introduction of deep learning and discuss its opportunities for recognizing places. After that, we focus on existing approaches built upon convolutional neural networks, including off-the-shelf and specifically designed models as well as novel image representations. We also discuss challenging problems in place recognition and present an extensive review of the corresponding datasets. To explore the future directions, we describe open issues and some new tools, for instance, generative adversarial networks, semantic scene understanding and multi-modality feature learning for this research topic. Finally, a conclusion is drawn for this paper. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Deep Audio-visual Learning: A Survey
    Hao Zhu
    Man-Di Luo
    Rui Wang
    Ai-Hua Zheng
    Ran He
    International Journal of Automation and Computing, 2021, 18 (03) : 351 - 376
  • [32] Survey of Deep Learning Technology in Visual SLAM
    Meng, Haijun
    Lu, Huimin
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 37 - 42
  • [33] Deep Audio-visual Learning: A Survey
    Hao Zhu
    Man-Di Luo
    Rui Wang
    Ai-Hua Zheng
    Ran He
    International Journal of Automation and Computing, 2021, 18 : 351 - 376
  • [34] Deep Learning Techniques for Visual SLAM: A Survey
    Mokssit, Saad
    Licea, Daniel Bonilla
    Guermah, Bassma
    Ghogho, Mounir
    IEEE ACCESS, 2023, 11 : 20026 - 20050
  • [35] Deep Learning for Visual Localization and Mapping: A Survey
    Chen, Changhao
    Wang, Bing
    Lu, Chris Xiaoxuan
    Trigoni, Niki
    Markham, Andrew
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 17000 - 17020
  • [36] Survey of Visual SLAM Based on Deep Learning
    Huang Z.
    Shao C.
    Jiqiren/Robot, 2023, 45 (06): : 756 - 768
  • [37] Deep Learning for Visual Speech Analysis: A Survey
    Sheng, Changchong
    Kuang, Gangyao
    Bai, Liang
    Hou, Chenping
    Guo, Yulan
    Xu, Xin
    Pietikainen, Matti
    Liu, Li
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 6001 - 6022
  • [38] Deep Audio-visual Learning: A Survey
    Zhu, Hao
    Luo, Man-Di
    Wang, Rui
    Zheng, Ai-Hua
    He, Ran
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2021, 18 (03) : 351 - 376
  • [39] Deep Learning for Visual Tracking: A Comprehensive Survey
    Marvasti-Zadeh, Seyed Mojtaba
    Cheng, Li
    Ghanei-Yakhdan, Hossein
    Kasaei, Shohreh
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (05) : 3943 - 3968
  • [40] Biometrics recognition using deep learning: a survey
    Minaee, Shervin
    Abdolrashidi, Amirali
    Su, Hang
    Bennamoun, Mohammed
    Zhang, David
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (08) : 8647 - 8695