MATNet: Multilevel attention-based transformers for change detection in remote sensing images

被引:0
|
作者
Zhang, Zhongyu [1 ]
Liu, Shujun [2 ]
Qin, Yingxiang [3 ]
Wang, Huajun [4 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Prot, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Minist Educ, Key Lab Earth Explorat & Infomat Tech, Chengdu 610059, Peoples R China
[3] Chengdu Univ Technol, Coll Geog & Planning, Chengdu 610059, Peoples R China
[4] Chengdu Univ Technol, Coll Math & Phys, Chengdu 610059, Peoples R China
关键词
Change detection; Attention mechanism; High-resolution (HR) optical image; Transformers; CLASSIFICATION; NETWORK;
D O I
10.1016/j.imavis.2024.105294
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing image change detection is crucial for natural disaster monitoring and land use change. As the resolution increases, the scenes covered by remote sensing images become more complex, and traditional methods have difficulties in extracting detailed information. With the development of deep learning, the field of change detection has new opportunities. However, existing algorithms mainly focus on the difference analysis between bi-temporal images, while ignoring the semantic information between images, resulting in the global and local information not being able to interact effectively. In this paper, we introduce a new transformer-based multilevel attention network (MATNet), which is capable of extracting multilevel features of global and local information, enabling information interaction and fusion, and thus modeling the global context more effectively. Specifically, we extract multilevel semantic features through the Transformer encoder, and utilize the Feature Enhancement Module (FEM) to perform feature summing and differencing on the multilevel features in order to better extract the local detail information, and thus better detect the changes in small regions. In addition, we employ a multilevel attention decoder (MAD) to obtain information in spatial and spectral dimensions, which can effectively fuse global and local information. In experiments, our method performs excellently on CDD, DSIFNCD, LEVIR-CD, and SYSU-CD datasets, with F1 scores and OA reaching 95.67%/87.75%/90.94%/86.82% and 98.95%/95.93%/99.11%/90.53% respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] FastSAM-based Change Detection Network for Remote Sensing Images
    Kong, Xiangshuo
    Wang, Jiapeng
    Shen, Jiaxiao
    Ling, Zaiying
    Jing, Changwei
    Zhang, Dengrong
    Hu, Zunying
    2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, : 53 - 58
  • [42] Statistical Similarity Based Change Detection for Multitemporal Remote Sensing Images
    Aktar M.
    Mamun M.A.
    Hossain M.A.
    Aktar, Mumu (mumu.ruet@gmail.com), 2017, Hindawi Limited, 410 Park Avenue, 15th Floor, 287 pmb, New York, NY 10022, United States (2017)
  • [43] Remote Sensing Images Change Detection Based on Level Set Model
    Ma, Dengcan
    Zhang, Yusha
    Tan, Kun
    Chen, Yu
    2018 FIFTH INTERNATIONAL WORKSHOP ON EARTH OBSERVATION AND REMOTE SENSING APPLICATIONS (EORSA), 2018, : 190 - 193
  • [44] Multitemporal remote sensing images change detection based on linear feature
    ATR Key Lab, National Univ. of Defense Technology, Changsha 410073, China
    Guofang Keji Daxue Xuebao, 2006, 5 (80-83):
  • [45] Deep Siamese Networks Based Change Detection with Remote Sensing Images
    Yang, Le
    Chen, Yiming
    Song, Shiji
    Li, Fan
    Huang, Gao
    REMOTE SENSING, 2021, 13 (17)
  • [46] Anomaly Detection of Remote Sensing Images Based on the Channel Attention Mechanism and LRX
    Guo, Huinan
    Wang, Hua
    Song, Xiaodong
    Ruan, Zhongling
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [47] Small Object Detection in Remote Sensing Images Based on Feature Fusion and Attention
    Zhang Yin
    Zhu Guiyi
    Shi Tianjun
    Zhang Kun
    Yan Junhua
    ACTA OPTICA SINICA, 2022, 42 (24)
  • [48] ACMFNet: Attention-Based Cross-Modal Fusion Network for Building Extraction of Remote Sensing Images
    Chen, Baiyu
    Pan, Zongxu
    Yang, Jianwei
    Long, Hui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [49] AANet: an attention-based alignment semantic segmentation network for high spatial resolution remote sensing images
    Xue, Gunagkuo
    Liu, Yikun
    Huang, Yuwen
    Li, Mingsong
    Yang, Gongping
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (13) : 4836 - 4852
  • [50] Attention-Based Pyramid Network for Segmentation and Classification of High-Resolution and Hyperspectral Remote Sensing Images
    Xu, Qingsong
    Yuan, Xin
    Ouyang, Chaojun
    Zeng, Yue
    REMOTE SENSING, 2020, 12 (21) : 1 - 34