LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

被引:5
|
作者
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Transformers; Task analysis; Dams; Convolutional neural networks; Computational modeling; Attention mechanism; change detection (CD); depthwise over-parameterized convolutional (Do-Conv); remote sensing (RS) images; transformer (TR);
D O I
10.1109/LGRS.2023.3323367
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the significant advancements of deep learning (DL) in the field of remote sensing (RS) imagery, a plethora of change detection (CD) methods based on CNNs, attention mechanisms, and transformers (TRs) have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This letter is dedicated to integrating lightweight approaches into the CD task. We introduce a lightweight hybrid dual-attention CNN and TR (LHDACT) network based on depthwise over-parameterized convolutional (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the multiscale average pooling (MSAP) module, ensuring global context with low computational overhead. To better discern regions of interest within complex images, we enhance the dual attention module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. At last, we employ a compact TR module to capture feature differences, enabling precise CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] STLNet: Symmetric Transformer Learning Network for Remote Sensing Image Change Detection
    Mei, Liye
    Huang, Andong
    Ye, Zhaoyi
    Yalikun, Yaxiaer
    Wang, Ying
    Xu, Chuan
    Yang, Wei
    Li, Xinghua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 2655 - 2667
  • [32] Frequency-driven transformer network for remote sensing image change detection
    Liu, Yuan
    Shi, Aiye
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (03)
  • [33] Dual-branch network for change detection of remote sensing image
    Ma, Chong
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    Qian, Ming
    Zhang, Yonghong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [34] A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioning
    Sun, Dongwei
    Bao, Yajie
    Liu, Junmin
    Cao, Xiangyong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 18727 - 18738
  • [35] Attention Filtering Network Based on Branch Transformer for Change Detection in Remote Sensing Images
    Yu, Shangguan
    Li, Jinjiang
    Liu, Yepeng
    Fan, Zhang
    Zhang, Caiming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [36] Heterogeneous remote sensing image change detection based on hybrid network
    Zhou Y.
    Li X.
    Yang J.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (03): : 451 - 460
  • [37] Prior Guidance and Principal Attention Network for Remote Sensing Image Change Detection
    Shu, Qing-Ling
    Chen, Si-Bao
    You, Zhi-Hui
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [38] Transformer with Transfer CNN for Remote-Sensing-Image Object Detection
    Li, Qingyun
    Chen, Yushi
    Zeng, Ying
    REMOTE SENSING, 2022, 14 (04)
  • [39] From Macro to Micro: A Lightweight Interleaved Network for Remote Sensing Image Change Detection
    Xu, Yetong
    Lei, Tao
    Ning, Hailong
    Lin, Shaoxiong
    Liu, Tongfei
    Gong, Maoguo
    Nandi, Asoke K.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [40] CCTNet: CNN and Cross-Shaped Transformer Hybrid Network for Remote Sensing Image Semantic Segmentation
    Wu, Honglin
    Zeng, Zhaobin
    Huang, Peng
    Yu, Xinyu
    Zhang, Min
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19986 - 19997