Dual-Awareness Attention for Few-Shot Object Detection

被引:60
|
作者
Chen, Tung-, I [1 ]
Liu, Yueh-Cheng [1 ]
Su, Hung-Ting [1 ]
Chang, Yu-Cheng [1 ]
Lin, Yu-Hsiang [1 ]
Yeh, Jia-Fong [1 ]
Chen, Wen-Chin [1 ]
Hsu, Winston H. [1 ,2 ]
机构
[1] Natl Taiwan Univ, Taipei 106, Taiwan
[2] Mobile Drive Technol, Taipei 236, Taiwan
关键词
Feature extraction; Object detection; Detectors; Correlation; Task analysis; Power capacitors; Adaptation models; Deep learning; object detection; visual attention; few-shot object detection; NETWORKS;
D O I
10.1109/TMM.2021.3125195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel Dual-Awareness Attention (DAnA) mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into query-position-aware (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47% (+6.9 AP), showing remarkable ability under various evaluation settings.
引用
收藏
页码:291 / 301
页数:11
相关论文
共 50 条
  • [21] Few-Shot Object Detection with Model Calibration
    Fan, Qi
    Tang, Chi-Keung
    Tai, Yu-Wing
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 720 - 739
  • [22] A Closer Look at Few-Shot Object Detection
    Liu, Yuhao
    Dong, Le
    He, Tengyang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 430 - 447
  • [23] Few-Shot Object Detection: A Comprehensive Survey
    Koehler, Mona
    Eisenbach, Markus
    Gross, Horst-Michael
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 11958 - 11978
  • [24] Industrial few-shot fractal object detection
    Haoran Huang
    Xiaochuan Luo
    Chen Yang
    Neural Computing and Applications, 2023, 35 : 21055 - 21069
  • [25] Transformation Invariant Few-Shot Object Detection
    Li, Aoxue
    Li, Zhenguo
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3093 - 3101
  • [26] Few-Shot Object Detection with Weight Imprinting
    Dingtian Yan
    Jitao Huang
    Hai Sun
    Fuqiang Ding
    Cognitive Computation, 2023, 15 : 1725 - 1735
  • [27] Few-Shot Object Detection with Foundation Models
    Han, Guangxing
    Lim, Ser-Nam
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 28608 - 28618
  • [28] Few-Shot Object Detection in Unseen Domains
    Guirguis, Karim
    Eskandar, George
    Kayser, Matthias
    Yang, Bin
    Beyerer, Juergen
    2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS, 2022, : 98 - 107
  • [29] Few-Shot Object Detection via Dual-Domain Feature Fusion and Patch-Level Attention
    Ren, Guangli
    Liu, Jierui
    Wang, Mengyao
    Guan, Peiyu
    Cao, Zhiqiang
    Yu, Junzhi
    TSINGHUA SCIENCE AND TECHNOLOGY, 2025, 30 (03): : 1237 - 1250
  • [30] Few-Shot Few-Shot Learning and the role of Spatial Attention
    Lifchitz, Yann
    Avrithis, Yannis
    Picard, Sylvaine
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2693 - 2700