Relating CNN-Transformer Fusion Network for Remote Sensing Change Detection

被引:0
|
作者
Gao, Yuhao [1 ]
Pei, Gensheng [1 ]
Sheng, Mengmeng [1 ]
Sun, Zeren [1 ]
Chen, Tao [1 ]
Yao, Yazhou [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Change Detection; Cross-Stage Aggregation; Multi-Scale Fusion; VISUAL RECOGNITION;
D O I
10.1109/ICME57554.2024.10687791
中图分类号
学科分类号
摘要
While deep learning, particularly convolutional neural networks (CNNs), has revolutionized remote sensing (RS) change detection (CD), existing approaches often miss crucial features due to neglecting global context and incomplete change learning. Additionally, transformer networks struggle with low-level details. RCTNet addresses these limitations by introducing (1) an early fusion backbone to exploit both spatial and temporal features early on, (2) a Cross-Stage Aggregation (CSA) module for enhanced temporal representation, (3) a Multi-Scale Feature Fusion (MSF) module for enriched feature extraction in the decoder, and (4) an Efficient Self-deciphering Attention (ESA) module utilizing transformers to capture global information and finegrained details for accurate change detection. Extensive experiments demonstrate RCTNet's clear superiority over traditional RS image CD methods, showing significant improvement and an optimal balance between accuracy and computational cost. Our source codes and pre-trained models are available at: https: //github.com/NUST- Machine- Intelligence-Laboratory/RCTNet.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] CTMFNet: CNN and Transformer Multiscale Fusion Network of Remote Sensing Urban Scene Imagery
    Song, Pengfei
    Li, Jinjiang
    An, Zhiyong
    Fan, Hui
    Fan, Linwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [32] Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery
    Yuan, Qinglie
    Xia, Bin
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (09) : 2893 - 2914
  • [33] CTFU-Net:CNN-Transformer Fusion U-shaped Network for Moving Object Detection
    Xia, Tingting
    Yang, Yizhong
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 44 - 50
  • [34] CTST: CNN and Transformer-Based Spatio-Temporally Synchronized Network for Remote Sensing Change Detection
    Wang, Shuo
    Wu, Wenbin
    Zheng, Zhiqing
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 16272 - 16288
  • [35] CNN-TRANSFORMER WITH SELF-ATTENTION NETWORK FOR SOUND EVENT DETECTION
    Wakayama, Keigo
    Saito, Shoichiro
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 806 - 810
  • [36] A CNN-transformer fusion network for COVID-19 CXR image classification
    Cao, Kai
    Deng, Tao
    Zhang, Chuanlin
    Lu, Limeng
    Li, Lin
    PLOS ONE, 2022, 17 (10):
  • [37] LOW LIGHT RGB AND IR IMAGE FUSION WITH SELECTIVE CNN-TRANSFORMER NETWORK
    Jin, Haiyan
    Yang, Yue
    Su, Haonan
    Xiao, Zhaolin
    Wang, Bin
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1255 - 1259
  • [38] A synergistic CNN-transformer network with pooling attention fusion for hyperspectral image classification
    Chen, Peng
    He, Wenxuan
    Qian, Feng
    Shi, Guangyao
    Yan, Jingwen
    DIGITAL SIGNAL PROCESSING, 2025, 160
  • [39] EEG classification algorithm of motor imagery based on CNN-Transformer fusion network
    Liu, Haofeng
    Liu, Yuefeng
    Wang, Yue
    Liu, Bo
    Bao, Xiang
    2022 IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, 2022, : 1302 - 1309
  • [40] DECT: Diffusion-Enhanced CNN-Transformer for Multisource Remote Sensing Data Classification
    Zhang, Guanglian
    Zhang, Lan
    Zhang, Zhanxu
    Deng, Jiangwei
    Bian, Lifeng
    Yang, Chen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19288 - 19301