Selective Feature Fusion and Irregular-Aware Network for Pavement Crack Detection

被引:7
|
作者
Cheng, Xu [1 ]
He, Tian [1 ]
Shi, Fan [1 ]
Zhao, Meng [1 ]
Liu, Xiufeng [2 ]
Chen, Shengyong [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Kongens Lyngby, Denmark
基金
中国国家自然科学基金;
关键词
Deep learning; irregular-aware; pavement crack detection; selective feature fusion; ARCHITECTURE; SYSTEM;
D O I
10.1109/TITS.2023.3325989
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road cracks on highways and main roads are among the most prominent defects. Given the inherent inaccuracy, time-consuming nature, and labor intensiveness of manual road crack detection, there's a compelling need for automated solutions. The irregular shape of cracks, along with complex background conditions encompassing varying lighting, tree shadows, and dark stains, poses a significant challenge for computer vision-based approaches. Most cracks exhibit irregular edge patterns, which are pivotal features for accurate detection. In response to recent advancements in deep learning within the realm of computer vision, this paper introduces an innovative neural network architecture termed the 'Selective Feature Fusion and Irregular-Aware Network (SFIAN)' designed specifically for crack detection on pavements. The proposed network selectively integrates features from multiple levels, enhancing and controlling the flow of valuable information at each stage while effectively modeling irregular crack objects. In an extensive evaluation, this paper conducts experiments on five distinct crack datasets and compares the results with twelve state-of-the-art crack detection methods, including the latest edge detection and semantic segmentation techniques. The experimental findings demonstrate the superior performance of the proposed method, surpassing baseline methods by a notable margin, with an increase of approximately 13.3% in the F1-score, all without introducing additional time complexity. Furthermore, the model achieves real-time processing, achieving a remarkable speed of 35 frames per second (FPS) on images at 320 x 480 pixels, facilitated by NVIDIA 3090 hardware.
引用
收藏
页码:3445 / 3456
页数:12
相关论文
共 50 条
  • [41] Asphalt Pavement Crack Detection Based on SegNet Network
    Zhao, M. Jun
    Song, Beibei
    He, M. Fan
    Ma, M. Suina
    Kong, M. Fangfang
    CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 1930 - 1942
  • [42] Improved Global Convolutional Network for Pavement Crack Detection
    Li Gang
    Gao Zhenyang
    Zhang Xinchun
    Zhao Huaixin
    Liu Zhuo
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (08)
  • [43] Automatic Pavement Crack Detection by Multi-Scale Image Fusion
    Li, Haifeng
    Song, Dezhen
    Liu, Yu
    Li, Binbin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (06) : 2025 - 2036
  • [44] Pavement crack detection based on point cloud data and data fusion
    Dong, Qiao
    Wang, Sike
    Chen, Xueqin
    Jiang, Wanqi
    Li, Ruiqi
    Gu, Xingyu
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2023, 381 (2254):
  • [45] Selective Feature Network for Object Detection
    Cui, Yuning
    Shi, Dianxi
    Zhang, Yongjun
    Sung, Qianchong
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [46] DMF-Net: A Dual-Encoding Multi-Scale Fusion Network for Pavement Crack Detection
    Bai, Suli
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (06) : 5981 - 5996
  • [47] BARNet: Boundary Aware Refinement Network for Crack Detection
    Guo, Jing-Ming
    Markoni, Herleeyandi
    Lee, Jiann-Der
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 7343 - 7358
  • [48] Hardware-Aware and Efficient Feature Fusion Network Search
    Guo J.-M.
    Zhang R.
    Zhi T.
    He D.-Y.
    Huang D.
    Chang M.
    Zhang X.-S.
    Guo Q.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (11): : 2420 - 2432
  • [49] Semantic-Aware Dehazing Network With Adaptive Feature Fusion
    Zhang, Shengdong
    Ren, Wenqi
    Tan, Xin
    Wang, Zhi-Jie
    Liu, Yong
    Zhang, Jingang
    Zhang, Xiaoqin
    Cao, Xiaochun
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (01) : 454 - 467
  • [50] Efficient pavement Distress Detection Based on Attention Fusion and Feature Integration
    Xie, Andong
    Yu, Zhi
    Cao, Xiaochun
    Wang, Yangyang
    Yan, Shoujing
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 374 - 377