Weak-supervised Visual Geo-localization via Attention-based Knowledge Distillation

被引:0
|
作者
Xu, Yifan [1 ]
Shamsolmoali, Pourya [1 ]
Yang, Jie [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai, Peoples R China
关键词
D O I
10.1109/ICPR56361.2022.9956641
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual geo-localization aims to estimate the geographical location of a query image by identifying the best-matched reference image from a GPS-tagged database. It remains a challenging task because of image appearance changes such as lighting, scale and pose. The current approaches do not have satisfactory performance for large-scale environments owing to the lack of learning discriminative features for image matching. To address the above problem, we introduce a practical method to exploit a weak-supervised model with selective transfer for feature distillation. We propose an image matching method that uses image sub-regions to adequately analyze the potential of difficult positive images. For improving the network generations and performance, the model estimates image-to-region similarity labels at no additional parameters or manual annotations by use of soft-labeled loss. Moreover, to have optimal training we propose a novel knowledge distillation (KD) method to effectively capture and transfer knowledge of a teacher network to a student network. More specifically, our method uses an attention network to learn relative similarities within features and utilizes these similarities to enhance the distillation intensities by further exploring the potential of difficult positive images. Our model achieves significant localization performance over large variations of appearance on three challenging datasets with satisfactory efficiency. Our code is available at https://github.com/XuYifan98/WAKD.
引用
收藏
页码:1815 / 1821
页数:7
相关论文
共 50 条
  • [31] Efficient Object Detection in Optical Remote Sensing Imagery via Attention-Based Feature Distillation
    Shamsolmoali P.
    Chanussot J.
    Zhou H.
    Lu Y.
    IEEE Transactions on Geoscience and Remote Sensing, 2023, 61 : 1 - 12
  • [32] Spatial-frequency attention-based optical and scene flow with cross-modal knowledge distillation
    Zhou, Youjie
    Jiao, Runyu
    Tao, Zhonghan
    Liang, Xichang
    Wan, Yi
    VISUAL COMPUTER, 2024, : 4183 - 4198
  • [33] Dissolved oxygen prediction in the Taiwan Strait with the attention-based multi-teacher knowledge distillation model
    Chen, Lei
    Lin, Ye
    Guo, Minquan
    Lu, Wenfang
    Li, Xueding
    Zhang, Zhenchang
    OCEAN & COASTAL MANAGEMENT, 2025, 265
  • [34] FusionDTA: attention-based feature polymerizer and knowledge distillation for drug-target binding affinity prediction
    Yuan, Weining
    Chen, Guanxing
    Chen, Calvin Yu-Chian
    BRIEFINGS IN BIOINFORMATICS, 2022, 23 (01)
  • [35] Zero-Shot Visual Recognition via Semantic Attention-Based Compare Network
    Nian, Fudong
    Sheng, Yikun
    Wang, Junfeng
    Li, Teng
    IEEE ACCESS, 2020, 8 : 26002 - 26011
  • [36] ARCTIC: A knowledge distillation approach via attention-based relation matching and activation region constraint for RGB-to-Infrared videos action recognition
    Quan, Zhenzhen
    Chen, Qingshan
    Li, Yujun
    Liu, Zhi
    Cui, Yan
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 237
  • [37] An Attention-based Bi-LSTM Method for Visual Object Classification via EEG
    Zheng, Xiao
    Chen, Wanzhong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63
  • [38] Visual question answering via Attention-based syntactic structure tree-LSTM
    Liu, Yun
    Zhang, Xiaoming
    Huang, Feiran
    Tang, Xianghong
    Li, Zhoujun
    APPLIED SOFT COMPUTING, 2019, 82
  • [39] BadCleaner: Defending Backdoor Attacks in Federated Learning via Attention-Based Multi-Teacher Distillation
    Zhang, Jiale
    Zhu, Chengcheng
    Ge, Chunpeng
    Ma, Chuan
    Zhao, Yanchao
    Sun, Xiaobing
    Chen, Bing
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (05) : 4559 - 4573
  • [40] Learning Attention-Based Translational Knowledge Graph Embedding via Nonlinear Dynamic Mapping
    Wang, Zhihao
    Xu, Honggang
    Li, Xin
    Deng, Yuxin
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 141 - 154