LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

被引:5
|
作者
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Transformers; Task analysis; Dams; Convolutional neural networks; Computational modeling; Attention mechanism; change detection (CD); depthwise over-parameterized convolutional (Do-Conv); remote sensing (RS) images; transformer (TR);
D O I
10.1109/LGRS.2023.3323367
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the significant advancements of deep learning (DL) in the field of remote sensing (RS) imagery, a plethora of change detection (CD) methods based on CNNs, attention mechanisms, and transformers (TRs) have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This letter is dedicated to integrating lightweight approaches into the CD task. We introduce a lightweight hybrid dual-attention CNN and TR (LHDACT) network based on depthwise over-parameterized convolutional (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the multiscale average pooling (MSAP) module, ensuring global context with low computational overhead. To better discern regions of interest within complex images, we enhance the dual attention module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. At last, we employ a compact TR module to capture feature differences, enabling precise CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Bitemporal Attention Sharing Network for Remote Sensing Image Change Detection
    Wang, Zhongchen
    Gu, Guowei
    Xia, Min
    Weng, Liguo
    Hu, Kai
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10368 - 10379
  • [22] CANet: A Combined Attention Network for Remote Sensing Image Change Detection
    Lu, Di
    Wang, Liejun
    Cheng, Shuli
    Li, Yongming
    Du, Anyu
    INFORMATION, 2021, 12 (09)
  • [23] Dense Hybrid Attention Network for Remote Sensing Building Change Detection
    Tian, Qinglin
    Lu, Donghua
    Li, Yao
    Pei, Chengkai
    ACTA OPTICA SINICA, 2025, 45 (06)
  • [24] A Network Combining a Transformer and a Convolutional Neural Network for Remote Sensing Image Change Detection
    Wang, Guanghui
    Li, Bin
    Zhang, Tao
    Zhang, Shubi
    REMOTE SENSING, 2022, 14 (09)
  • [25] Dual-Attention-Guided Multiscale Feature Aggregation Network for Remote Sensing Image Change Detection
    Ren, Hongjin
    Xia, Min
    Weng, Liguo
    Hu, Kai
    Lin, Haifeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4899 - 4916
  • [26] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [27] Mutiscale Hybrid Attention Transformer for Remote Sensing Image Pansharpening
    Zhu, Wengang
    Li, Jinjiang
    An, Zhiyong
    Hua, Zhen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [28] A Lightweight CNN-Transformer Implemented via Structural Re-Parameterization and Hybrid Attention for Remote Sensing Image Super-Resolution
    Wang, Jie
    Li, Hongwei
    Li, Yifan
    Qin, Zilong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2025, 14 (01)
  • [29] Lightweight remote sensing road detection with an attention-augmented transformer
    Deng, Feng
    Tian, Hongyan
    Zhao, Xu
    Han, Duo
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2024, 46 (04)
  • [30] PSTNet: Progressive Sampling Transformer Network for Remote Sensing Image Change Detection
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 8442 - 8455