A hybrid attention deep learning network for refined segmentation of cracks from shield tunnel lining images

被引:17
|
作者
Zhao, Shuai [1 ]
Zhang, Guokai [2 ]
Zhang, Dongming [3 ]
Tan, Daoyuan [1 ]
Huang, Hongwei [3 ]
机构
[1] Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hong Kong 999077, Peoples R China
[2] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[3] Tongji Univ, Key Lab Geotech & Underground Engn, Minist Educ, Shanghai 200092, Peoples R China
关键词
Crack segmentation; Crack disjoint problem; U-net; Channel attention; Position attention; IDENTIFICATION; DEFECTS;
D O I
10.1016/j.jrmge.2023.02.025
中图分类号
P5 [地质学];
学科分类号
0709 ; 081803 ;
摘要
This research developed a hybrid position-channel network (named PCNet) through incorporating newly designed channel and position attention modules into U-Net to alleviate the crack discontinuity problem in channel and spatial dimensions. In PCNet, the U-Net is used as a baseline to extract informative spatial and channel-wise features from shield tunnel lining crack images. A channel and a position attention module are designed and embedded after each convolution layer of U-Net to model the feature interdependencies in channel and spatial dimensions. These attention modules can make the U-Net adaptively integrate local crack features with their global dependencies. Experiments were conducted utilizing the dataset based on the images from Shanghai metro shield tunnels. The results validate the effectiveness of the designed channel and position attention modules, since they can individually increase balanced accuracy (BA) by 11.25% and 12.95%, intersection over union (IoU) by 10.79% and 11.83%, and F1 score by 9.96% and 10.63%, respectively. In comparison with the state-of-the-art models (i.e. LinkNet, PSPNet, U-Net, PANet, and Mask R-CNN) on the testing dataset, the proposed PCNet out-performs others with an improvement of BA, IoU, and F-1 score owing to the implementation of the channel and position attention modules. These evaluation metrics indicate that the proposed PCNet presents refined crack segmentation with improved performance and is a practicable approach to segment shield tunnel lining cracks in field practice. (c) 2023 Institute of Rock and Soil Mechanics, Chinese Academy of Sciences. Production and hosting by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:3105 / 3117
页数:13
相关论文
共 50 条
  • [1] Deep learning-based instance segmentation of cracks from shield tunnel lining images
    Huang, Hongwei
    Zhao, Shuai
    Zhang, Dongming
    Chen, Jiayao
    STRUCTURE AND INFRASTRUCTURE ENGINEERING, 2022, 18 (02) : 183 - 196
  • [2] A deep learning-based approach for refined crack evaluation from shield tunnel lining images
    Zhao, Shuai
    Zhang, Dongming
    Xue, Yadong
    Zhou, Mingliang
    Huang, Hongwei
    AUTOMATION IN CONSTRUCTION, 2021, 132
  • [3] Diagnosis of structural cracks of shield tunnel lining based on digital images
    Li Q.
    Huang H.
    Yanshilixue Yu Gongcheng Xuebao/Chinese Journal of Rock Mechanics and Engineering, 2020, 39 (08): : 1658 - 1670
  • [4] Deep learning-based image instance segmentation for moisture marks of shield tunnel lining
    Zhao, Shuai
    Zhang, Dong Ming
    Huang, Hong Wei
    TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2020, 95
  • [5] Hybrid semantic segmentation for tunnel lining cracks based on Swin Transformer and convolutional neural network
    Zhou, Zhong
    Zhang, Junjie
    Gong, Chenjie
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2023, 38 (17) : 2491 - 2510
  • [6] Efficient segmentation of water leakage in shield tunnel lining with convolutional neural network
    Wang, Wenjun
    Su, Chao
    Han, Guohui
    Dong, Yijia
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2024, 23 (02): : 671 - 685
  • [7] Deep learning based water leakage detection for shield tunnel lining
    Liu, Shichang
    Xu, Xu
    Jeon, Gwanggil
    Chen, Junxin
    He, Ben-Guo
    FRONTIERS OF STRUCTURAL AND CIVIL ENGINEERING, 2024, 18 (06) : 887 - 898
  • [8] Method for rapid detection and treatment of cracks in tunnel lining based on deep learning
    Yan, Xu
    Zhou, Guangyi
    Zhao, Xuefeng
    HEALTH MONITORING OF STRUCTURAL AND BIOLOGICAL SYSTEMS IX, 2020, 11381
  • [9] Esophageal tissue segmentation on OCT images with hybrid attention network
    Li, Deyin
    Cheng, Yuhao
    Guo, Yunbo
    Wang, Lirong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (14) : 42609 - 42628
  • [10] Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images
    Niu, Ruigang
    Sun, Xian
    Tian, Yu
    Diao, Wenhui
    Chen, Kaiqiang
    Fu, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60