MATNet: Multilevel attention-based transformers for change detection in remote sensing images

被引:0
|
作者
Zhang, Zhongyu [1 ]
Liu, Shujun [2 ]
Qin, Yingxiang [3 ]
Wang, Huajun [4 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Prot, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Minist Educ, Key Lab Earth Explorat & Infomat Tech, Chengdu 610059, Peoples R China
[3] Chengdu Univ Technol, Coll Geog & Planning, Chengdu 610059, Peoples R China
[4] Chengdu Univ Technol, Coll Math & Phys, Chengdu 610059, Peoples R China
关键词
Change detection; Attention mechanism; High-resolution (HR) optical image; Transformers; CLASSIFICATION; NETWORK;
D O I
10.1016/j.imavis.2024.105294
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing image change detection is crucial for natural disaster monitoring and land use change. As the resolution increases, the scenes covered by remote sensing images become more complex, and traditional methods have difficulties in extracting detailed information. With the development of deep learning, the field of change detection has new opportunities. However, existing algorithms mainly focus on the difference analysis between bi-temporal images, while ignoring the semantic information between images, resulting in the global and local information not being able to interact effectively. In this paper, we introduce a new transformer-based multilevel attention network (MATNet), which is capable of extracting multilevel features of global and local information, enabling information interaction and fusion, and thus modeling the global context more effectively. Specifically, we extract multilevel semantic features through the Transformer encoder, and utilize the Feature Enhancement Module (FEM) to perform feature summing and differencing on the multilevel features in order to better extract the local detail information, and thus better detect the changes in small regions. In addition, we employ a multilevel attention decoder (MAD) to obtain information in spatial and spectral dimensions, which can effectively fuse global and local information. In experiments, our method performs excellently on CDD, DSIFNCD, LEVIR-CD, and SYSU-CD datasets, with F1 scores and OA reaching 95.67%/87.75%/90.94%/86.82% and 98.95%/95.93%/99.11%/90.53% respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Attention-based object detection with saliency loss in remote sensing images
    Wu, Qin
    Yuan, Xingxing
    Yao, Zikang
    Chai, Zhilei
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (01)
  • [2] Change Detection of Remote Sensing Images Based on Attention Mechanism
    Chen, Long
    Zhang, Dezheng
    Li, Peng
    Lv, Peng
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
  • [3] An attention-based multiscale transformer network for remote sensing image change detection
    Liu, Wei
    Lin, Yiyuan
    Liu, Weijia
    Yu, Yongtao
    Li, Jonathan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 202 : 599 - 609
  • [4] SWIN RESNETSWIN TRANSFORMERS FOR CHANGE DETECTION IN REMOTE SENSING IMAGES
    Liu, Xu
    Liu, Yu
    Jiao, Licheng
    Li, Lingling
    Liu, Fang
    Zhang, Dan
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6660 - 6663
  • [5] Attention-based pyramid decoder network for salient object detection in remote sensing images
    Liu, Yu
    Lin, Jie
    Yue, Gongtao
    Shao, Zhaosheng
    Zhang, Shanwen
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (04)
  • [6] Attention-Based Matching Approach for Heterogeneous Remote Sensing Images
    Hou, Huitai
    Lan, Chaozhen
    Xu, Qing
    Lv, Liang
    Xiong, Xin
    Yao, Fushan
    Wang, Longhao
    REMOTE SENSING, 2023, 15 (01)
  • [7] Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images
    Dong, Xiaohu
    Qin, Yao
    Gao, Yinghui
    Fu, Ruigang
    Liu, Songlin
    Ye, Yuanxin
    REMOTE SENSING, 2022, 14 (15)
  • [8] Attention-Based Convolutional Networks for Ship Detection in High-Resolution Remote Sensing Images
    Ma, Xiaofeng
    Li, Wenyuan
    Shi, Zhenwei
    PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT IV, 2018, 11259 : 373 - 383
  • [9] Attention-Based and Staged Iterative Networks for Pansharpening of Remote Sensing Images
    Su, Xunyang
    Li, Jinjiang
    Hua, Zhen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] STCD: efficient Siamese transformers-based change detection method for remote sensing images
    Wang, Decheng
    Chen, Xiangning
    Guo, Ningbo
    Yi, Hui
    Li, Yinan
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (04): : 1192 - 1211