Attention CoupleNet: Fully Convolutional Attention Coupling Network for Object Detection

被引:98
|
作者
Zhu, Yousong [1 ,2 ]
Zhao, Chaoyang [1 ,2 ]
Guo, Haiyun [1 ,2 ]
Wang, Jinqiao [1 ,2 ]
Zhao, Xu [1 ,2 ]
Lu, Hanqing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Object detection; cascade attention; global structure; local parts;
D O I
10.1109/TIP.2018.2865280
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The field of object detection has made great progress in recent years. Most of these improvements are derived from using a more sophisticated convolutional neural network. However, in the case of humans, the attention mechanism, global structure information, and local details of objects all play an important role for detecting an object. In this paper, we propose a novel fully convolutional network, named as Attention CoupleNet, to incorporate the attention-related information and global and local information of objects to improve the detection performance. Specifically, we first design a cascade attention structure to perceive the global scene of the image and generate class-agnostic attention maps. Then the attention maps are encoded into the network to acquire object-aware features. Next, we propose a unique fully convolutional coupling structure to couple global structure and local parts of the object to further formulate a discriminative feature representation. To fully explore the global and local properties, we also design different coupling strategies and normalization ways to make full use of the complementary advantages between the global and local information. Extensive experiments demonstrate the effectiveness of our approach. We achieve state-of-the-art results on all three challenging data sets, i. e., a mAP of 85.7% on VOC07, 84.3% on VOC12, and 35.4% on COCO. Codes are publicly available at https://github. com/tshizys/CoupleNet.
引用
收藏
页码:113 / 126
页数:14
相关论文
共 50 条
  • [21] Fusion Convolutional Attention Network for Opinion Spam Detection
    Li, Jiacheng
    Ma, Qianwen
    Yuan, Chunyuan
    Zhou, Wei
    Han, Jizhong
    Hu, Songlin
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 223 - 235
  • [22] A fully convolutional network with channel and spatial attention for hyperspectral image classification
    Jiang, Gangwu
    Sun, Yifan
    Liu, Bing
    REMOTE SENSING LETTERS, 2021, 12 (12) : 1238 - 1249
  • [23] Trend attention fully convolutional network for remaining useful life estimation
    Fan, Linchuan
    Chai, Yi
    Chen, Xiaolong
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 225
  • [24] Field-matching attention network for object detection
    Dong, Yongsheng
    Shen, Longchao
    Pei, Yuanhua
    Yang, Haotian
    Li, Xuelong
    NEUROCOMPUTING, 2023, 535 : 123 - 133
  • [25] Guided Attention Network for Object Detection and Counting on Drones
    Cai, Yuanqiang
    Du, Dawei
    Zhang, Libo
    Wen, Longyin
    Wang, Weiqiang
    Wu, Yanjun
    Lyu, Siwei
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 709 - 717
  • [26] Lightweight small object detection network with attention mechanism
    Zhu W.
    Wang L.
    Jin Z.
    He D.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (08): : 998 - 1010
  • [27] End-to-End Object Detection with Fully Convolutional Network
    Wang, Jianfeng
    Song, Lin
    Li, Zeming
    Sun, Hongbin
    Sun, Jian
    Zheng, Nanning
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15844 - 15853
  • [28] Object detection in road based on efficient convolutional attention feature fusion
    Luo W.
    Li X.
    Sun Z.
    Yuan J.
    Zhu J.
    Wang B.
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2024, 54 (04): : 1005 - 1013
  • [29] Method of convolutional neural network with hybrid attention for crack detection
    Qu, Zhong
    Chen, Shuwei
    Li, Yanxin
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [30] ColonNeXt: Fully Convolutional Attention for Polyp Segmentation
    Nguyen, Dinh Cong
    Nguyen, Hoang Long
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024,