Selective Feature Fusion and Irregular-Aware Network for Pavement Crack Detection

被引:7
|
作者
Cheng, Xu [1 ]
He, Tian [1 ]
Shi, Fan [1 ]
Zhao, Meng [1 ]
Liu, Xiufeng [2 ]
Chen, Shengyong [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Kongens Lyngby, Denmark
基金
中国国家自然科学基金;
关键词
Deep learning; irregular-aware; pavement crack detection; selective feature fusion; ARCHITECTURE; SYSTEM;
D O I
10.1109/TITS.2023.3325989
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road cracks on highways and main roads are among the most prominent defects. Given the inherent inaccuracy, time-consuming nature, and labor intensiveness of manual road crack detection, there's a compelling need for automated solutions. The irregular shape of cracks, along with complex background conditions encompassing varying lighting, tree shadows, and dark stains, poses a significant challenge for computer vision-based approaches. Most cracks exhibit irregular edge patterns, which are pivotal features for accurate detection. In response to recent advancements in deep learning within the realm of computer vision, this paper introduces an innovative neural network architecture termed the 'Selective Feature Fusion and Irregular-Aware Network (SFIAN)' designed specifically for crack detection on pavements. The proposed network selectively integrates features from multiple levels, enhancing and controlling the flow of valuable information at each stage while effectively modeling irregular crack objects. In an extensive evaluation, this paper conducts experiments on five distinct crack datasets and compares the results with twelve state-of-the-art crack detection methods, including the latest edge detection and semantic segmentation techniques. The experimental findings demonstrate the superior performance of the proposed method, surpassing baseline methods by a notable margin, with an increase of approximately 13.3% in the F1-score, all without introducing additional time complexity. Furthermore, the model achieves real-time processing, achieving a remarkable speed of 35 frames per second (FPS) on images at 320 x 480 pixels, facilitated by NVIDIA 3090 hardware.
引用
收藏
页码:3445 / 3456
页数:12
相关论文
共 50 条
  • [1] A Deep Supervised Pavement Crack Detection Network with Multiscale Feature Fusion and Feature Learning
    Yang, Lei
    Huang, Hanyun
    Kong, Shuyi
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1002 - 1007
  • [2] A Lightweight Network with Dual Encoder and Cross Feature Fusion for Cement Pavement Crack Detection
    Qu, Zhong
    Mu, Guoqing
    Yuan, Bin
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 140 (01): : 255 - 273
  • [3] A Deeply Supervised Convolutional Neural Network for Pavement Crack Detection With Multiscale Feature Fusion
    Qu, Zhong
    Cao, Chong
    Liu, Ling
    Zhou, Dong-Yang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) : 4890 - 4899
  • [4] A lightweight feature attention fusion network for pavement crack segmentation
    Huang, Yucheng
    Liu, Yuchen
    Liu, Fang
    Liu, Wei
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2024, 39 (18) : 2811 - 2825
  • [5] Gabor filter fusion network for pavement crack detection
    Chen Xiao-Dong
    Ai Da-Hang
    Zhang Jia-Chen
    Cai Huai-Yu
    Cui Ke-Rang
    CHINESE OPTICS, 2020, 13 (06) : 1293 - 1301
  • [6] Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection
    Yang, Fan
    Zhang, Lei
    Yu, Sijia
    Prokhorov, Danil
    Mei, Xue
    Ling, Haibin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (04) : 1525 - 1535
  • [7] A Directional Connectivity Feature Enhancement Network for Pavement Crack Detection
    Qu, Zhong
    Wang, Jian-Dong
    Yin, Xue-Hui
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 1039 - 1054
  • [8] Pavement distress detection based on improved feature fusion network
    Wu, Peng
    Wu, Jing
    Xie, Luqi
    MEASUREMENT, 2024, 236
  • [9] Method of feature pyramid and attention enhancement network for pavement crack detection
    Qu, Zhong
    Dong, Xiao-Yu
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [10] Multi-scale feature fusion for pavement crack detection based on Transformer
    Yang, Yalong
    Niu, Zhen
    Su, Liangliang
    Xu, Wenjing
    Wang, Yuanhang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (08) : 14920 - 14937