Weak-supervised Visual Geo-localization via Attention-based Knowledge Distillation

被引:0
|
作者
Xu, Yifan [1 ]
Shamsolmoali, Pourya [1 ]
Yang, Jie [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai, Peoples R China
关键词
D O I
10.1109/ICPR56361.2022.9956641
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual geo-localization aims to estimate the geographical location of a query image by identifying the best-matched reference image from a GPS-tagged database. It remains a challenging task because of image appearance changes such as lighting, scale and pose. The current approaches do not have satisfactory performance for large-scale environments owing to the lack of learning discriminative features for image matching. To address the above problem, we introduce a practical method to exploit a weak-supervised model with selective transfer for feature distillation. We propose an image matching method that uses image sub-regions to adequately analyze the potential of difficult positive images. For improving the network generations and performance, the model estimates image-to-region similarity labels at no additional parameters or manual annotations by use of soft-labeled loss. Moreover, to have optimal training we propose a novel knowledge distillation (KD) method to effectively capture and transfer knowledge of a teacher network to a student network. More specifically, our method uses an attention network to learn relative similarities within features and utilizes these similarities to enhance the distillation intensities by further exploring the potential of difficult positive images. Our model achieves significant localization performance over large variations of appearance on three challenging datasets with satisfactory efficiency. Our code is available at https://github.com/XuYifan98/WAKD.
引用
收藏
页码:1815 / 1821
页数:7
相关论文
共 50 条
  • [1] TransVLAD: Multi-Scale Attention-Based Global Descriptors for Visual Geo-Localization
    Xu, Yifan
    Shamsolmoali, Pourya
    Granger, Eric
    Nicodeme, Claire
    Gardes, Laurent
    Yang, Jie
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2839 - 2848
  • [2] Effective Online Knowledge Distillation via Attention-Based Model Ensembling
    Borza, Diana-Laura
    Darabant, Adrian Sergiu
    Ileni, Tudor Alexandru
    Marinescu, Alexandru-Ion
    MATHEMATICS, 2022, 10 (22)
  • [3] Patch Similarity Self-Knowledge Distillation for Cross-View Geo-Localization
    Li, Songlian
    Hu, Min
    Xiao, Xiongwu
    Tu, Zhigang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 5091 - 5103
  • [4] HAMCap: A Weak-Supervised Hybrid Attention-Based Capsule Neural Network for Fine-Grained Climate Change Debate Analysis
    Xiang, Kun
    Fujii, Akihiro
    BIG DATA AND COGNITIVE COMPUTING, 2023, 7 (04)
  • [5] Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching
    Ji, Mingi
    Heo, Byeongho
    Park, Sungrae
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7945 - 7952
  • [6] Attention-based neural network with Generalized Mean Pooling for cross-view geo-localization between UAV and satellite
    Bui, Duc Viet
    Kubo, Masao
    Sato, Hiroshi
    ARTIFICIAL LIFE AND ROBOTICS, 2023, 28 (03) : 560 - 570
  • [7] High-precision visual geo-localization of UAV based on hierarchical localization
    Qiu, Xiong
    Liao, Shouyi
    Yang, Dongfang
    Li, Yongfei
    Wang, Shicheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 267
  • [8] Attention-based neural network with Generalized Mean Pooling for cross-view geo-localization between UAV and satellite
    Duc Viet Bui
    Masao Kubo
    Hiroshi Sato
    Artificial Life and Robotics, 2023, 28 : 560 - 570
  • [9] Multilevel Attention-Based Sample Correlations for Knowledge Distillation
    Gou, Jianping
    Sun, Liyuan
    Yu, Baosheng
    Wan, Shaohua
    Ou, Weihua
    Yi, Zhang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (05) : 7099 - 7109
  • [10] Cross-View Geo-Localization via Learning Correspondence Semantic Similarity Knowledge
    Chen, Guanli
    Huang, Guoheng
    Yuan, Xiaochen
    Chen, Xuhang
    Zhong, Guo
    Pun, Chi-Man
    MULTIMEDIA MODELING, MMM 2025, PT I, 2025, 15520 : 220 - 233