MATNet: Multilevel attention-based transformers for change detection in remote sensing images

被引:0
|
作者
Zhang, Zhongyu [1 ]
Liu, Shujun [2 ]
Qin, Yingxiang [3 ]
Wang, Huajun [4 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Prot, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Minist Educ, Key Lab Earth Explorat & Infomat Tech, Chengdu 610059, Peoples R China
[3] Chengdu Univ Technol, Coll Geog & Planning, Chengdu 610059, Peoples R China
[4] Chengdu Univ Technol, Coll Math & Phys, Chengdu 610059, Peoples R China
关键词
Change detection; Attention mechanism; High-resolution (HR) optical image; Transformers; CLASSIFICATION; NETWORK;
D O I
10.1016/j.imavis.2024.105294
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing image change detection is crucial for natural disaster monitoring and land use change. As the resolution increases, the scenes covered by remote sensing images become more complex, and traditional methods have difficulties in extracting detailed information. With the development of deep learning, the field of change detection has new opportunities. However, existing algorithms mainly focus on the difference analysis between bi-temporal images, while ignoring the semantic information between images, resulting in the global and local information not being able to interact effectively. In this paper, we introduce a new transformer-based multilevel attention network (MATNet), which is capable of extracting multilevel features of global and local information, enabling information interaction and fusion, and thus modeling the global context more effectively. Specifically, we extract multilevel semantic features through the Transformer encoder, and utilize the Feature Enhancement Module (FEM) to perform feature summing and differencing on the multilevel features in order to better extract the local detail information, and thus better detect the changes in small regions. In addition, we employ a multilevel attention decoder (MAD) to obtain information in spatial and spectral dimensions, which can effectively fuse global and local information. In experiments, our method performs excellently on CDD, DSIFNCD, LEVIR-CD, and SYSU-CD datasets, with F1 scores and OA reaching 95.67%/87.75%/90.94%/86.82% and 98.95%/95.93%/99.11%/90.53% respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Attention-Based Monocular Depth Estimation Considering Global and Local Information in Remote Sensing Images
    Lv, Junwei
    Zhang, Yueting
    Guo, Jiayi
    Zhao, Xin
    Gao, Ming
    Lei, Bin
    REMOTE SENSING, 2024, 16 (03)
  • [32] Multilevel Deformable Attention-Aggregated Networks for Change Detection in Bitemporal Remote Sensing Imagery
    Zhang, Xiaokang
    Yu, Weikang
    Pun, Man-On
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [33] Attention-Guided Siamese Fusion Network for Change Detection of Remote Sensing Images
    Chen, Puhua
    Guo, Lei
    Zhang, Xiangrong
    Qin, Kai
    Ma, Wentao
    Jiao, Licheng
    REMOTE SENSING, 2021, 13 (22)
  • [34] Targeted Change Detection in Remote Sensing Images
    Ignatiev, V.
    Trekin, A.
    Lobachev, V.
    Potapov, G.
    Burnaev, E.
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041
  • [35] Change Detection in Multispectral Remote Sensing Images
    Vidya, Kolli Naga
    Parvathaneni, Sai Sanjana
    Haritha, Yamarthi
    Phaneendra Kumar, Boggavarapu L. N.
    Lecture Notes in Mechanical Engineering, 2023, : 405 - 414
  • [36] Light-Weight Cloud Detection Network for Optical Remote Sensing Images with Attention-Based DeeplabV3+Architecture
    Yao, Xudong
    Guo, Qing
    Li, An
    REMOTE SENSING, 2021, 13 (18)
  • [37] Remote Sensing Change Detection With Transformers Trained From Scratch
    Noman, Mubashir
    Fiaz, Mustansar
    Cholakkal, Hisham
    Narayan, Sanath
    Muhammad Anwer, Rao
    Khan, Salman
    Shahbaz Khan, Fahad
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [38] Change Detection on Remote Sensing Images Using Dual-Branch Multilevel Intertemporal Network
    Feng, Yuchao
    Jiang, Jiawei
    Xu, Honghui
    Zheng, Jianwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [39] MATNet: multiattention Transformer network for cropland semantic segmentation in remote sensing images
    Zhang, Zixuan
    Huang, Liang
    Tang, Bo-Hui
    Le, Weipeng
    Wang, Meiqi
    Cheng, Jiapei
    Wu, Qiang
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [40] Change detection network for high-resolution remote sensing images based on hybrid backbone and attention fusion
    Wang, Zhenzhen
    Yang, Bohao
    Du, Ruheng
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 914 - 917