Weak-supervised Visual Geo-localization via Attention-based Knowledge Distillation

被引:0
|
作者
Xu, Yifan [1 ]
Shamsolmoali, Pourya [1 ]
Yang, Jie [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai, Peoples R China
关键词
D O I
10.1109/ICPR56361.2022.9956641
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual geo-localization aims to estimate the geographical location of a query image by identifying the best-matched reference image from a GPS-tagged database. It remains a challenging task because of image appearance changes such as lighting, scale and pose. The current approaches do not have satisfactory performance for large-scale environments owing to the lack of learning discriminative features for image matching. To address the above problem, we introduce a practical method to exploit a weak-supervised model with selective transfer for feature distillation. We propose an image matching method that uses image sub-regions to adequately analyze the potential of difficult positive images. For improving the network generations and performance, the model estimates image-to-region similarity labels at no additional parameters or manual annotations by use of soft-labeled loss. Moreover, to have optimal training we propose a novel knowledge distillation (KD) method to effectively capture and transfer knowledge of a teacher network to a student network. More specifically, our method uses an attention network to learn relative similarities within features and utilizes these similarities to enhance the distillation intensities by further exploring the potential of difficult positive images. Our model achieves significant localization performance over large variations of appearance on three challenging datasets with satisfactory efficiency. Our code is available at https://github.com/XuYifan98/WAKD.
引用
收藏
页码:1815 / 1821
页数:7
相关论文
共 50 条
  • [21] SSA-Net: Spatial Scale Attention Network for Image-Based Geo-Localization
    Zhang, Xiuwei
    Meng, Xiangchuang
    Yin, Hanlin
    Wang, Yixin
    Yue, Yuanzeng
    Xing, Yinghui
    Zhang, Yanning
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [22] Visual-based simultaneous localization and mapping and global positioning system correction for geo-localization of a mobile robot
    Berrabah, Sid Ahmed
    Sahli, Hichem
    Baudoin, Yvan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2011, 22 (12)
  • [23] SACNet: A Scattered Attention-Based Network With Feature Compensator for Visual Localization
    Wang, Ke
    Jiang, Zhiqiang
    Dai, Kun
    Xie, Tao
    Jin, Ducheng
    Li, Ruifeng
    Zhao, Lijun
    Chen, Xiao
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04) : 3586 - 3593
  • [24] Attention-Based Dropout Layer for Weakly Supervised Single Object Localization and Semantic Segmentation
    Choe, Junsuk
    Lee, Seungho
    Shim, Hyunjung
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4256 - 4271
  • [25] Attention-Based Knowledge Distillation in Scene Recognition: The Impact of a DCT-Driven Loss
    Lopez-Cifuentes, Alejandro
    Escudero-Vinolo, Marcos
    Bescos, Jesus
    San Miguel, Juan C.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4769 - 4783
  • [26] Visual Landmark Learning Via Attention-Based Deep Neural Networks
    You, Mingyu
    Luo, Chaoxian
    Zhou, Hongjun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [27] LogLAB: Attention-Based Labeling of Log Data Anomalies via Weak Supervision
    Wittkopp, Thorsten
    Wiesner, Philipp
    Scheinert, Dominik
    Acker, Alexander
    SERVICE-ORIENTED COMPUTING (ICSOC 2021), 2021, 13121 : 700 - 707
  • [28] Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation
    Wu, Yimeng
    Rezagholizadeh, Mehdi
    Ghaddar, Abbas
    Haidar, Md Akmal
    Ghodsi, Ali
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 7649 - 7661
  • [29] Enhancing Recommendation Capabilities Using Multi-Head Attention-Based Federated Knowledge Distillation
    Wu, Aming
    Kwon, Young-Woo
    IEEE ACCESS, 2023, 11 : 45850 - 45861
  • [30] Aerial-view geo-localization based on multi-layer local pattern cross-attention network
    Li, Haoran
    Wang, Tingyu
    Chen, Quan
    Zhao, Qiang
    Jiang, Shaowei
    Yan, Chenggang
    Zheng, Bolun
    APPLIED INTELLIGENCE, 2024, 54 (21) : 11034 - 11053