Visual place recognition: A survey from deep learning perspective

被引:144
|
作者
Zhang, Xiwu [1 ]
Wang, Lei [2 ]
Su, Yan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
基金
澳大利亚研究理事会;
关键词
Visual place recognition; Deep learning; Visual SLAM; Survey; LARGE-SCALE; LOOP CLOSURE; FEATURE-SELECTION; IMAGE SEQUENCES; NEURAL-NETWORKS; FAB-MAP; LOCALIZATION; GRAPH; TIME; REPRESENTATIONS;
D O I
10.1016/j.patcog.2020.107760
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition has attracted widespread research interest in multiple fields such as computer vision and robotics. Recently, researchers have employed advanced deep learning techniques to tackle this problem. While an increasing number of studies have proposed novel place recognition methods based on deep learning, few of them has provided a whole picture about how and to what extent deep learning has been utilized for this issue. In this paper, by delving into over 200 references, we present a comprehensive survey that covers various aspects of place recognition from deep learning perspective. We first present a brief introduction of deep learning and discuss its opportunities for recognizing places. After that, we focus on existing approaches built upon convolutional neural networks, including off-the-shelf and specifically designed models as well as novel image representations. We also discuss challenging problems in place recognition and present an extensive review of the corresponding datasets. To explore the future directions, we describe open issues and some new tools, for instance, generative adversarial networks, semantic scene understanding and multi-modality feature learning for this research topic. Finally, a conclusion is drawn for this paper. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Deep learning applications in games: a survey from a data perspective
    Hu, Zhipeng
    Ding, Yu
    Wu, Runze
    Li, Lincheng
    Zhang, Rongsheng
    Hu, Yujing
    Qiu, Feng
    Zhang, Zhimeng
    Wang, Kai
    Zhao, Shiwei
    Zhang, Yongqiang
    Jiang, Ji
    Xi, Yadong
    Pu, Jiashu
    Zhang, Wei
    Wang, Suzhen
    Chen, Ke
    Zhou, Tianze
    Chen, Jiarui
    Song, Yan
    Lv, Tangjie
    Fan, Changjie
    APPLIED INTELLIGENCE, 2023, 53 (24) : 31106 - 31128
  • [22] Deep learning applications in games: a survey from a data perspective
    Zhipeng Hu
    Yu Ding
    Runze Wu
    Lincheng Li
    Rongsheng Zhang
    Yujing Hu
    Feng Qiu
    Zhimeng Zhang
    Kai Wang
    Shiwei Zhao
    Yongqiang Zhang
    Ji Jiang
    Yadong Xi
    Jiashu Pu
    Wei Zhang
    Suzhen Wang
    Ke Chen
    Tianze Zhou
    Jiarui Chen
    Yan Song
    Tangjie Lv
    Changjie Fan
    Applied Intelligence, 2023, 53 : 31129 - 31164
  • [23] Collaborative Visual Place Recognition through Federated Learning
    Dutto, Mattia
    Berton, Gabriele
    Caldarola, Debora
    Fani, Eros
    Trivigno, Gabriele
    Masone, Carlo
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2024, : 4215 - 4225
  • [24] Semantic Reinforced Attention Learning for Visual Place Recognition
    Peng, Guohao
    Yue, Yufeng
    Zhang, Jun
    Wu, Zhenyu
    Tang, Xiaoyu
    Wang, Danwei
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 13415 - 13422
  • [25] Learning to Fuse Multiscale Features for Visual Place Recognition
    Mao, Jun
    Hu, Xiaoping
    He, Xiaofeng
    Zhang, Lilian
    Wu, Liao
    Milford, Michael J.
    IEEE ACCESS, 2019, 7 : 5723 - 5735
  • [26] Unifying Visual Contrastive Learning for Object Recognition from a Graph Perspective
    Tang, Shixiang
    Zhu, Feng
    Bai, Lei
    Zhao, Rui
    Wang, Chenyu
    Ouyang, Wanli
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 649 - 667
  • [27] Evaluation of Long-term Deep Visual Place Recognition
    Alijani, Farid
    Peltomaki, Jukka
    Puura, Jussi
    Huttunen, Heikki
    Kamarainen, Joni-Kristian
    Rahtu, Esa
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 437 - 447
  • [28] Deep Learning for Audio Visual Emotion Recognition
    Hussain, T.
    Wang, W.
    Bouaynaya, N.
    Fathallah-Shaykh, H.
    Mihaylova, L.
    2022 25TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2022), 2022,
  • [29] Deep Learning Off-the-shelf Holistic Feature Descriptors for Visual Place Recognition in Challenging Conditions
    Aliajni, Farid
    Rahtu, Esa
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [30] Visual Place Recognition From Eye Reflection
    Ohshima, Yuki
    Maeda, Kyosuke
    Edamoto, Yusuke
    Nakazawa, Atsushi
    IEEE ACCESS, 2021, 9 : 57364 - 57371