A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

被引:85
|
作者
Wang, Wei [1 ]
Tan, Xinai [1 ]
Zhang, Peng [2 ]
Wang, Xin [1 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen Campus, Shenzhen 518107, Peoples R China
关键词
Transformers; Feature extraction; Remote sensing; Context modeling; Data mining; Semantics; Decoding; Change detection; convolutional block attention module (CBAM); multiscale; remote sensing; transformer; NETWORK;
D O I
10.1109/JSTARS.2022.3198517
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection methods play an indispensable role in remote sensing. Some change detection methods have obtained a fairly good performance by introducing attention mechanism on the basis of the convolutional neural network (CNN), but identifying intricate changes remains difficult. In response to these problems, this article proposes a new model for detecting changes in remote sensing, namely, MTCNet, which combines the advantages of multiscale transformer with the convolutional block attention module (CBAM) to improve the detection quality of different remote sensing images. On the basis of traditional convolutions, the transformer module is introduced to extract bitemporal image features by modeling contextual information. Based on the transformer module, a multiscale module is designed to form a multiscale transformer, which can obtain features at different scales in bitemporal images, thereby identifying the changes we are interested in. Based on the multiscale transformer module, the CBAM is introduced. The CBAM is split into a spatial attention module and a channel attention module, which are applied to the front and back ends of the multiscale transformer, respectively. Spatial information and channel information of feature maps are modeled separately. In this article, the validity and efficiency of the method are verified by a large number of experiments on the LEVIR-CD dataset and the WHU-CD dataset.
引用
收藏
页码:6817 / 6825
页数:9
相关论文
共 50 条
  • [1] Remote Sensing Image Change Detection Based on Lightweight Transformer and Multiscale Feature Fusion
    Li, Jingming
    Zheng, Panpan
    Wang, Liejun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 5460 - 5473
  • [2] An attention-based multiscale transformer network for remote sensing image change detection
    Liu, Wei
    Lin, Yiyuan
    Liu, Weijia
    Yu, Yongtao
    Li, Jonathan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 202 : 599 - 609
  • [3] Transformer With Feature Interaction and Fusion for Remote Sensing Image Change Detection
    Guo, Dongen
    Zou, Tao
    Xia, Ying
    Feng, Jiangfan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15407 - 15419
  • [4] Multiscale Fusion CNN-Transformer Network for High-Resolution Remote Sensing Image Change Detection
    Jiang, Ming
    Chen, Yimin
    Dong, Zhe
    Liu, Xiaoping
    Zhang, Xinchang
    Zhang, Honghui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5280 - 5293
  • [5] Multiscale Spatial-Channel Transformer Architecture Search for Remote Sensing Image Change Detection
    Zhang, Mengxuan
    Liu, Long
    Lei, Zhikun
    Ma, Kun
    Feng, Jie
    Liu, Zhao
    Jiao, Licheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [6] Object Detection For Remote Sensing Image Based on Multiscale Feature Fusion Network
    Tian Tingting
    Yang Jun
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [7] A Siamese Network with a Multiscale Window-Based Transformer via an Adaptive Fusion Strategy for High-Resolution Remote Sensing Image Change Detection
    Tao, Chao
    Kuang, Dongsheng
    Wu, Kai
    Zhao, Xiaomei
    Zhao, Chunyan
    Du, Xin
    Zhang, Yunsheng
    REMOTE SENSING, 2023, 15 (09)
  • [8] Multispectral Remote Sensing Image Change Detection Based on Markovian Fusion
    Xu, Qiongcheng
    Pu, Yunchen
    Wang, Wei
    Zhong, Huamin
    2012 FIRST INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2012, : 628 - 632
  • [9] WSMsFNet: Joint the Whole Supervision and Multiscale Fusion Network for Remote Sensing Image Change Detection
    Wang, Bin
    Jiang, Xiaohu
    Qin, Pinle
    Zeng, Jianchao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 14656 - 14669
  • [10] Remote sensing image change detection based on CNN-Transformer structure
    Pan, Mengyang
    Yang, Hang
    Fan, Xianghui
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10) : 1361 - 1379