LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

被引:5
|
作者
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Transformers; Task analysis; Dams; Convolutional neural networks; Computational modeling; Attention mechanism; change detection (CD); depthwise over-parameterized convolutional (Do-Conv); remote sensing (RS) images; transformer (TR);
D O I
10.1109/LGRS.2023.3323367
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the significant advancements of deep learning (DL) in the field of remote sensing (RS) imagery, a plethora of change detection (CD) methods based on CNNs, attention mechanisms, and transformers (TRs) have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This letter is dedicated to integrating lightweight approaches into the CD task. We introduce a lightweight hybrid dual-attention CNN and TR (LHDACT) network based on depthwise over-parameterized convolutional (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the multiscale average pooling (MSAP) module, ensuring global context with low computational overhead. To better discern regions of interest within complex images, we enhance the dual attention module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. At last, we employ a compact TR module to capture feature differences, enabling precise CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Robust feature aggregation network for lightweight and effective remote sensing image change detection
    You, Zhi-Hui
    Chen, Si-Bao
    Wang, Jia-Xin
    Luo, Bin
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 215 : 31 - 43
  • [42] LFHNet: Lightweight Full-Scale Hybrid Network for Remote Sensing Change Detection
    Jiang, Xintao
    Zhang, Shubin
    Gan, Jun
    Wei, Jujie
    Luo, Qingli
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10266 - 10278
  • [43] ACTNet: A Dual-Attention Adapter with a CNN-Transformer Network for the Semantic Segmentation of Remote Sensing Imagery
    Zhang, Zheng
    Liu, Fanchen
    Liu, Changan
    Tian, Qing
    Qu, Hongquan
    REMOTE SENSING, 2023, 15 (09)
  • [44] A CNN-transformer hybrid network with selective fusion and dual attention for image super-resolution
    Zhang, Chun
    Wang, Jin
    Shi, Yunhui
    Yin, Baocai
    Ling, Nam
    MULTIMEDIA SYSTEMS, 2025, 31 (02)
  • [45] Remote sensing image change detection based on swin transformer and cross-attention mechanism
    Yan, Weidong
    Cao, Li
    Yan, Pei
    Zhu, Chaosheng
    Wang, Mengtian
    EARTH SCIENCE INFORMATICS, 2025, 18 (01)
  • [46] A Graph-Semantic Guided Transformer Network for Remote Sensing Image Change Detection
    Shi, Aiye
    Liu, Yuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [47] TChange: A Hybrid Transformer-CNN Change Detection Network
    Deng, Yupeng
    Meng, Yu
    Chen, Jingbo
    Yue, Anzhi
    Liu, Diyou
    Chen, Jing
    REMOTE SENSING, 2023, 15 (05)
  • [48] TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images
    Li, Qingyang
    Zhong, Ruofei
    Du, Xin
    Du, Yu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] Hybrid transformer-CNN networks using superpixel segmentation for remote sensing building change detection
    Liang, Shike
    Hua, Zhen
    Li, Jinjiang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (08) : 2754 - 2780
  • [50] CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Yao, Yongxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20