Research of Self-Attention in Image Segmentation

被引：1

作者：

Cao, Fude ^{[1
]}

Zheng, Chunguang ^{[1
]}

Huang, Limin ^{[1
]}

Wang, Aihua ^{[1
]}

Zhang, Jiong ^{[1
]}

Zhou, Feng ^{[1
]}

Ju, Haoxue ^{[1
]}

Guo, Haitao ^{[1
]}

Du, Yuxia ^{[1
]}

机构：

[1] Shandong Inst Commerce & Technol, Jinan, Shandong, Peoples R China

来源：

JOURNAL OF INFORMATION TECHNOLOGY RESEARCH | 2022年 / 15卷 / 01期

关键词：

Convolutional Neural Networks; Image Segmentation; Self-Attention;

D O I：

10.4018/JITR.298619

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

Although the traditional convolutional neural network is applied to image segmentation successfully, it has some limitations. That's the context information of the long-range on the image is not well captured. With the success of the introduction of self-attentional mechanisms in the field of natural language processing (NLP), people have tried to introduce the attention mechanism in the field of computer vision. It turns out that self-attention can really solve this long-range dependency problem. This paper is a summary on the application of self-attention to image segmentation in the past two years.

引用

页数：12

共 50 条

[21] Sparse self-attention transformer for image inpainting
Huang, Wenli
Deng, Ye
Hui, Siqi
Wu, Yang
Zhou, Sanping
Wang, Jinjun
PATTERN RECOGNITION, 2024, 145
[22] Self-attention CNN for retinal layer segmentation in OCT
Cao, Guogang
Wu, Yan
Peng, Zeyu
Zhou, Zhilin
Dai, Cuixia
BIOMEDICAL OPTICS EXPRESS, 2024, 15 (03) : 1605 - 1617
[23] Multiple Self-attention Network for Intracranial Vessel Segmentation
Li, Yang
Ni, Jiajia
Elazab, Ahmed
Wu, Jianhuang
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
[24] Self-attention feature fusion network for semantic segmentation
Zhou, Zhen
Zhou, Yan
Wang, Dongli
Mu, Jinzhen
Zhou, Haibin
NEUROCOMPUTING, 2021, 453 : 50 - 59
[25] Relation constraint self-attention for image captioning
Ji, Junzhong
Wang, Mingzhan
Zhang, Xiaodan
Lei, Minglong
Qu, Liangqiong
NEUROCOMPUTING, 2022, 501 : 778 - 789
[26] SATS: Self-attention transfer for continual semantic segmentation
Qiu, Yiqiao
Shen, Yixing
Sun, Zhuohao
Zheng, Yanchong
Chang, Xiaobin
Zheng, Weishi
Wang, Ruixuan
PATTERN RECOGNITION, 2023, 138
[27] HIGSA: Human image generation with self-attention
Wu, Haoran
He, Fazhi
Si, Tongzhen
Duan, Yansong
Yan, Xiaohu
ADVANCED ENGINEERING INFORMATICS, 2023, 55
[28] Progressive Scene Segmentation Based on Self-Attention Mechanism
Pan, Yunyi
Gan, Yuan
Liu, Kun
Zhang, Yan
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3985 - 3992
[29] Investigating Self-Attention Network for Chinese Word Segmentation
Gan, Leilei
Zhang, Yue
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 2933 - 2941
[30] Weakly supervised action segmentation with effective use of attention and self-attention
Bin Ng, Yan
Fernando, Basura
COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 213

← 1 2 3 4 5 →