Edge detection networks inspired by neural mechanisms of selective attention in biological visual cortex

被引:2
|
作者
Zhang, Zhenguang [1 ]
Lin, Chuan [1 ]
Qiao, Yakun [1 ]
Pan, Yongcai [1 ]
机构
[1] Guangxi Univ Sci & Technol, Sch Automation, Liuzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
edge detection; biological vision; visual cortex; self-attention mechanism; convolutional neural network; AREAS V1; INFEROTEMPORAL CORTEX; REFINEMENT NETWORK; COLOR; V4; V2;
D O I
10.3389/fnins.2022.1073484
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Edge detection is of great importance to the middle and high-level vision task in computer vision, and it is useful to improve its performance. This paper is different from previous edge detection methods designed only for decoding networks. We propose a new edge detection network composed of modulation coding network and decoding network. Among them, modulation coding network is the combination of modulation enhancement network and coding network designed by using the self-attention mechanism in Transformer, which is inspired by the selective attention mechanism of V1, V2, and V4 in biological vision. The modulation enhancement network effectively enhances the feature extraction ability of the encoding network, realizes the selective extraction of the global features of the input image, and improves the performance of the entire model. In addition, we designed a new decoding network based on the function of integrating feature information in the IT layer of the biological vision system. Unlike previous decoding networks, it combines top-down decoding and bottom-up decoding, uses down-sampling decoding to extract more features, and then achieves better performance by fusing up-sampling decoding features. We evaluated the proposed method experimentally on multiple publicly available datasets BSDS500, NYUD-V2, and barcelona images for perceptual edge detection (BIPED). Among them, the best performance is achieved on the NYUD and BIPED datasets, and the second result is achieved on the BSDS500. Experimental results show that this method is highly competitive among all methods.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A new image edge detection method inspired from biological visual cortex
    Li, Zuojin
    Chen, Liukui
    Yin, Hongpeng
    Yu, Jia
    WSEAS Transactions on Computers, 2010, 9 (12): : 1381 - 1390
  • [2] Neural Mechanisms of Selective Visual Attention
    Moore, Tirin
    Zirnsak, Marc
    ANNUAL REVIEW OF PSYCHOLOGY, VOL 68, 2017, 68 : 47 - 72
  • [3] NEURAL MECHANISMS OF VISUAL SELECTIVE ATTENTION
    MANGUN, GR
    PSYCHOPHYSIOLOGY, 1995, 32 (01) : 4 - 18
  • [4] NEURAL MECHANISMS OF SELECTIVE VISUAL-ATTENTION
    DESIMONE, R
    DUNCAN, J
    ANNUAL REVIEW OF NEUROSCIENCE, 1995, 18 : 193 - 222
  • [5] Synchronized neural activity and selective attention in visual cortex
    Desimone, R
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2004, 39 (5-6) : 474 - 474
  • [6] Selective visual attention and visual search: Behavioral and neural mechanisms
    Geng, JJ
    Behrmann, M
    PSYCHOLOGY OF LEARNING AND MOTIVATION: ADVANCES IN RESEARCH AND THEORY: COGNITVE VISION, VOL 42, 2003, 42 : 157 - +
  • [7] Integrating Multiple Visual Attention Mechanisms in Deep Neural Networks
    Martinez, Fernando
    Zhao, Yijun
    2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 1191 - 1196
  • [8] Visual vs internal attention mechanisms in deep neural networks for image classification and object detection
    Obeso, Abraham Montoya
    Benois-Pineau, Jenny
    Vazquez, Mireya Sarai Garcia
    Acosta, Alejandro Alvaro Ramirez
    PATTERN RECOGNITION, 2022, 123
  • [9] Mechanisms of visual attention in the human cortex
    Kastner, S
    Ungerleider, LG
    ANNUAL REVIEW OF NEUROSCIENCE, 2000, 23 : 315 - 341
  • [10] Mechanisms of visual attention in human cortex
    Ungerleider, L
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2000, 35 (3-4) : 295 - 295