Dual-Awareness Attention for Few-Shot Object Detection

被引:60
|
作者
Chen, Tung-, I [1 ]
Liu, Yueh-Cheng [1 ]
Su, Hung-Ting [1 ]
Chang, Yu-Cheng [1 ]
Lin, Yu-Hsiang [1 ]
Yeh, Jia-Fong [1 ]
Chen, Wen-Chin [1 ]
Hsu, Winston H. [1 ,2 ]
机构
[1] Natl Taiwan Univ, Taipei 106, Taiwan
[2] Mobile Drive Technol, Taipei 236, Taiwan
关键词
Feature extraction; Object detection; Detectors; Correlation; Task analysis; Power capacitors; Adaptation models; Deep learning; object detection; visual attention; few-shot object detection; NETWORKS;
D O I
10.1109/TMM.2021.3125195
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel Dual-Awareness Attention (DAnA) mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into query-position-aware (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47% (+6.9 AP), showing remarkable ability under various evaluation settings.
引用
收藏
页码:291 / 301
页数:11
相关论文
共 50 条
  • [41] A Survey on Recent Advances in Few-Shot Object Detection
    Shi Y.-Y.
    Shi D.-X.
    Qiao Z.-T.
    Zhang Y.
    Liu Y.-Y.
    Yang S.-W.
    Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (08): : 1753 - 1780
  • [42] σ-Adaptive Decoupled Prototype for Few-Shot Object Detection
    Du, Jinhao
    Zhang, Shan
    Chen, Qiang
    Le, Haifeng
    Sun, Yanpeng
    Ni, Yao
    Wang, Jian
    He, Bin
    Wang, Jingdong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18904 - 18914
  • [43] A Few-Shot Object Detection Method for Endangered Species
    Yan, Hongmei
    Ruan, Xiaoman
    Zhu, Daixian
    Kong, Haoran
    Liu, Peixuan
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [44] Proposal Distribution Calibration for Few-Shot Object Detection
    Li, Bohao
    Liu, Chang
    Shi, Mengnan
    Chen, Xiaozhong
    Ji, Xiangyang
    Ye, Qixiang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 1911 - 1918
  • [45] Few-Shot Object Detection Based on Association and Discrimination
    Jia Jianli
    Han Huiyan
    Kuang Liqun
    Han Fangzheng
    Zheng Xinyi
    Zhang Xiuquan
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (08)
  • [46] Few-Shot Object Detection via Sample Processing
    Xu, Honghui
    Wang, Xinqing
    Shao, Faming
    Duan, Baoguo
    Zhang, Peng
    IEEE ACCESS, 2021, 9 (09): : 29207 - 29221
  • [47] Temporal Speciation Network for Few-Shot Object Detection
    Zhao, Xiaowei
    Liu, Xianglong
    Ma, Yuqing
    Bai, Shihao
    Shen, Yifan
    Hao, Zeyu
    Liu, Aishan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8267 - 8278
  • [48] Orthogonal Progressive Network for Few-shot Object Detection
    Wang, Bingxin
    Yu, Dehong
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 264
  • [49] Generalized Few-Shot Object Detection without Forgetting
    Fan, Zhibo
    Ma, Yuchen
    Li, Zeming
    Sun, Jian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4525 - 4534
  • [50] Open-World Few-Shot Object Detection
    Chen, Wei
    Zhang, Shengchuan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT I, 2023, 14086 : 556 - 567