Dual-Awareness Attention for Few-Shot Object Detection

被引:60
|
作者
Chen, Tung-, I [1 ]
Liu, Yueh-Cheng [1 ]
Su, Hung-Ting [1 ]
Chang, Yu-Cheng [1 ]
Lin, Yu-Hsiang [1 ]
Yeh, Jia-Fong [1 ]
Chen, Wen-Chin [1 ]
Hsu, Winston H. [1 ,2 ]
机构
[1] Natl Taiwan Univ, Taipei 106, Taiwan
[2] Mobile Drive Technol, Taipei 236, Taiwan
关键词
Feature extraction; Object detection; Detectors; Correlation; Task analysis; Power capacitors; Adaptation models; Deep learning; object detection; visual attention; few-shot object detection; NETWORKS;
D O I
10.1109/TMM.2021.3125195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel Dual-Awareness Attention (DAnA) mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into query-position-aware (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47% (+6.9 AP), showing remarkable ability under various evaluation settings.
引用
收藏
页码:291 / 301
页数:11
相关论文
共 50 条
  • [31] DUAL-ATTENTION NETWORK FOR FEW-SHOT SEGMENTATION
    Chen, Zhikui
    Wang, Han
    Zhang, Suhua
    Zhong, Fangming
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2210 - 2214
  • [32] IMPROVING FEW-SHOT OBJECT DETECTION WITH OBJECT PART PROPOSALS
    Chevalley, Arthur
    Tomoiaga, Ciprian
    Detyniecki, Marcin
    Russwurm, Marc
    Tuia, Devis
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6502 - 6505
  • [33] Few-Shot Object Detection with Attention-RPN and Multi-Relation Detector
    Fan, Qi
    Zhuo, Wei
    Tang, Chi-Keung
    Tai, Yu-Wing
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4012 - 4021
  • [34] CobNet: Cross Attention on Object and Background for Few-Shot Segmentation
    Guan, Haoyan
    Michael, Spratling
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 39 - 45
  • [35] FSNA: Few-Shot Object Detection via Neighborhood Information Adaption and All Attention
    Zhu, Jinxiang
    Wang, Qi
    Dong, Xinyu
    Ruan, Weijian
    Chen, Haolin
    Lei, Liang
    Hao, Gefei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7121 - 7134
  • [36] Few-shot warhead fragment group object detection based on feature reassembly and attention
    He, Meng
    Wu, Jiangpeng
    Liang, Chao
    Hu, Pengyu
    Ren, Yuan
    He, Xuan
    Liu, Qianghui
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (12): : 1929 - 1940
  • [37] Few-shot Object Detection with Feature Attention Highlight Module in Remote Sensing Images
    Xiao, Zixuan
    Zhong, Ping
    Quan, Yuan
    Yin, Xuping
    Xue, Wei
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [38] Few-Shot Object Detection in Remote Sensing Images With Multiscale Spatial Selective Attention
    Yu, Yingnan
    Chen, Si-Bao
    Huang, Li-Li
    Tang, Jin
    Luo, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 1
  • [39] Few-Shot Object Detection via Association and DIscrimination
    Cao, Yuhang
    Wang, Jiaqi
    Jin, Ying
    Wu, Tong
    Chen, Kai
    Liu, Ziwei
    Lin, Dahua
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [40] Dynamic relevance learning for few-shot object detection
    Liu, Weijie
    Cai, Xiaojie
    Wang, Chong
    Li, Haohe
    Yu, Shenghao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)