Relating CNN-Transformer Fusion Network for Remote Sensing Change Detection

被引:0
|
作者
Gao, Yuhao [1 ]
Pei, Gensheng [1 ]
Sheng, Mengmeng [1 ]
Sun, Zeren [1 ]
Chen, Tao [1 ]
Yao, Yazhou [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Change Detection; Cross-Stage Aggregation; Multi-Scale Fusion; VISUAL RECOGNITION;
D O I
10.1109/ICME57554.2024.10687791
中图分类号
学科分类号
摘要
While deep learning, particularly convolutional neural networks (CNNs), has revolutionized remote sensing (RS) change detection (CD), existing approaches often miss crucial features due to neglecting global context and incomplete change learning. Additionally, transformer networks struggle with low-level details. RCTNet addresses these limitations by introducing (1) an early fusion backbone to exploit both spatial and temporal features early on, (2) a Cross-Stage Aggregation (CSA) module for enhanced temporal representation, (3) a Multi-Scale Feature Fusion (MSF) module for enriched feature extraction in the decoder, and (4) an Efficient Self-deciphering Attention (ESA) module utilizing transformers to capture global information and finegrained details for accurate change detection. Extensive experiments demonstrate RCTNet's clear superiority over traditional RS image CD methods, showing significant improvement and an optimal balance between accuracy and computational cost. Our source codes and pre-trained models are available at: https: //github.com/NUST- Machine- Intelligence-Laboratory/RCTNet.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Multiscale Fusion CNN-Transformer Network for High-Resolution Remote Sensing Image Change Detection
    Jiang, Ming
    Chen, Yimin
    Dong, Zhe
    Liu, Xiaoping
    Zhang, Xinchang
    Zhang, Honghui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 5280 - 5293
  • [2] Remote sensing image change detection based on CNN-Transformer structure
    Pan, Mengyang
    Yang, Hang
    Fan, Xianghui
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10) : 1361 - 1379
  • [3] A Full-Scale Connected CNN-Transformer Network for Remote Sensing Image Change Detection
    Chen, Min
    Zhang, Qiangjiang
    Ge, Xuming
    Xu, Bo
    Hu, Han
    Zhu, Qing
    Zhang, Xin
    REMOTE SENSING, 2023, 15 (22)
  • [4] A Multitask CNN-Transformer Network for Semantic Change Detection From Bitemporal Remote Sensing Images
    Liu, Wei
    Kang, Ziwen
    Liu, Jiawei
    Lin, Yiyuan
    Yu, Yongtao
    Li, Jonathan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] A CNN-Transformer Network Combining CBAM for Change Detection in High-Resolution Remote Sensing Images
    Yin, Mengmeng
    Chen, Zhibo
    Zhang, Chengjian
    REMOTE SENSING, 2023, 15 (09)
  • [6] CTFNet: CNN-Transformer Fusion Network for Remote-Sensing Image Semantic Segmentation
    Wu, Honglin
    Huang, Peng
    Zhang, Min
    Tang, Wenlong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [7] A semi-parallel CNN-transformer fusion network for semantic change detection
    Zou, Changzhong
    Wang, Ziyuan
    IMAGE AND VISION COMPUTING, 2024, 149
  • [8] A CNN-Transformer Combined Remote Sensing Imagery Spatiotemporal Fusion Model
    Jiang, Mingyu
    Shao, Hua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 13995 - 14009
  • [9] A Hybrid CNN-Transformer Network for Object Detection in Optical Remote Sensing Images: Integrating Local and Global Feature Fusion
    Huang, Youxiang
    Jiao, Donglai
    Huang, Xingru
    Tang, Tiantian
    Gui, Guan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 241 - 254
  • [10] DBCT-Net:A dual branch hybrid CNN-transformer network for remote sensing image fusion
    Wang, Quanli
    Jin, Xin
    Jiang, Qian
    Wu, Liwen
    Zhang, Yunchun
    Zhou, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 233