CCDFormer: A dual-backbone complex crack detection network with transformer

被引:0
|
作者
Hu, Xiangkun [1 ]
Li, Hua [1 ,2 ]
Feng, Yixiong [1 ,3 ]
Qian, Songrong [1 ]
Li, Jian [1 ]
Li, Shaobo [1 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] Tsinghua Univ, Dept Mech Engn, Beijing 100084, Peoples R China
[3] Zhejiang Univ, Sch Mech Engn, Hangzhou 310058, Zhejiang, Peoples R China
基金
中国博士后科学基金;
关键词
Concrete crack detection; Semantic segmentation; Transformer; Convolution neural network; UNet;
D O I
10.1016/j.patcog.2024.111251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Concrete crack detection is a critical aspect of infrastructure maintenance. However, existing methods often fail to deliver satisfactory results in real-world scenarios where various detection challenges coexist. We propose a Transformer-based model to enhance feature extraction for complex crack detection (CCDFormer). CCDFormer employs a dual-backbone U-shaped structure to independently capture crack features from different perspectives, avoiding interference. Deformable linear convolution align with crack structures, while the proposed feature enhancement module enriches semantic features by boosting local features at multiple scales. The pyramid-shaped Transformer models long-range dependencies across different scales. A carefully designed feature fusion module addresses the shortcomings of local and contextual features, generating robust crack features. On a challenging public dataset for concrete crack detection, CCDFormer improves accuracy, recall, Fmeasure, and IoU by 3.54%, 0.71%, 2.17%, and 1.48%, compared to existing models. CCDFormer demonstrates higher precision and crack detection rates across various challenges, proving practical for real-world crack detection.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] An improved Yolov5s based on transformer backbone network for detection and classification of bronchoalveolar lavage cells
    Wu, Puzhen
    Weng, Han
    Luo, Wenting
    Zhan, Yi
    Xiong, Lixia
    Zhang, Hongyan
    Yan, Hai
    COMPUTATIONAL AND STRUCTURAL BIOTECHNOLOGY JOURNAL, 2023, 21 : 2985 - 3001
  • [32] Dead Broiler Detection and Segmentation Using Transformer-Based Dual Stream Network
    Ham, Gyu-Sung
    Oh, Kanghan
    AGRICULTURE-BASEL, 2024, 14 (11):
  • [33] Dual-Branch Fourier-Mixing Transformer Network for Hyperspectral Target Detection
    Jiao, Jinyue
    Gong, Zhiqiang
    Zhong, Ping
    REMOTE SENSING, 2023, 15 (19)
  • [34] Comment-Context Dual Collaborative Masked Transformer Network for Fake News Detection
    Wang, Jinguang
    Qian, Shengsheng
    Hu, Jun
    Hong, Richang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 (5170-5180) : 5170 - 5180
  • [35] CosineTR: A dual-branch transformer-based network for semantic line detection
    Zhang, Yuqi
    Ma, Bole
    Jin, Luyang
    Yang, Yuancheng
    Tong, Chao
    PATTERN RECOGNITION, 2025, 158
  • [36] Multimodal driver distraction detection using dual-channel network of CNN and Transformer
    Mou, Luntian
    Chang, Jiali
    Zhou, Chao
    Zhao, Yiyuan
    Ma, Nan
    Yin, Baocai
    Jain, Ramesh
    Gao, Wen
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 234
  • [37] A Smart Dual-modal Aligned Transformer Deep Network for Robotic Grasp Detection
    Cang, Xin
    Zhang, Haojun
    Yang, Yuequan
    Cao, Zhiqiang
    Li, Fudong
    Zhu, Jiaming
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 1230 - 1235
  • [38] Dynamic region-aware transformer backbone network for visual tracking
    Wang, Jun
    Yang, Shuai
    Wang, Yuanyun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [39] DefNet: A multi-scale dual-encoding fusion network aggregating Transformer and CNN for crack segmentation
    Xiong, Bing
    Hong, Rong
    Wang, Jianxin
    Li, Wei
    Zhang, Jin
    Lv, Songtao
    Ge, Dongdong
    CONSTRUCTION AND BUILDING MATERIALS, 2024, 448
  • [40] Ship Recognition for Complex SAR Images via Dual-Branch Transformer Fusion Network
    Sun, Zhongzhen
    Leng, Xiangguang
    Zhang, Xianghui
    Xiong, Boli
    Ji, Kefeng
    Kuang, Gangyao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21