A Dual Deep Network Based on the Improved YOLO for Fast Bridge Surface Defect Detection

被引:0
|
作者
Peng Y.-N. [1 ,2 ]
Liu M. [1 ,2 ]
Wan Z. [3 ]
Jiang W.-B. [1 ,2 ]
He W.-X. [1 ,2 ]
Wang Y.-N. [1 ,2 ]
机构
[1] College of Electrical and Information Engineering, Hunan University, Changsha
[2] National Engineering Research Center for Robot Visual Perception and Control Technology, Hunan University, Changsha
[3] Hunan Qiaokang Intelligent Technology Company Limited, Changsha
来源
基金
中国国家自然科学基金;
关键词
Attention mechanism; Bridge surface defect detection; Deep convolutional neural network; Spatial pyramid module;
D O I
10.16383/j.aas.c210807
中图分类号
学科分类号
摘要
Surface defect detection is a critical step to ensure bridge safety. However, there are various types of bridge surface defects, different defects have a wide range of variation in appearance and generally overlap with each other. The existing algorithms cannot efficiently and precisely detect such defects. To solve this problem, we improve the YOLO (You only look once) to enhance the performance of the network to detect multiple defects, YOLO-lump and YOLO-crack are proposed to form a dual deep network for fast bridge surface defect detection. On the one hand, the YOLO-lump can realize the detection of the lump defects on larger sub-images, by employing a hybrid dilated pyramid module based on the hybrid dilated convolution and the spatial pyramid pooling to extract multi-scale features and to avoid losing local information caused by the dilated convolution. On the other hand, the YOLO-crack can realize the detection of the crack defects on smaller sub-images, by proposing a downsampling attention module which uses the 1×1 convolution and the 3×3 group convolution to respectively map cross-channel correlation and spatial correlation of features, enhancing the foreground response of the crack in the downsampling stage and reducing the loss of spatial information. Experimental results show that the proposed algorithm can improve the detection accuracy of the bridge surface defects and realize real-time detection. Copyright ©2022 Acta Automatica Sinica. All rights reserved.
引用
收藏
页码:1018 / 1032
页数:14
相关论文
共 49 条
  • [1] Ma Jian, Sun Shou-Zeng, Yang Qi, Review on china's bridge engineering research: 2014, China Journal of High-way and Transport, 27, 5, pp. 1-96, (2014)
  • [2] Chen Rong-Feng, Xu Kai-Li, Qin Kai-Qiang, Research progress of intelligent bridge crack detection system, Highway, 64, pp. 101-105, (2019)
  • [3] Zhong Xin-Gu, Peng Xiong, Shen Ming-Yan, Study on the feasibility of identifying concrete crack width with images acquired by unmanned aerial vehicles, China Civil Engineering Journal, 52, 4, pp. 52-61, (2019)
  • [4] Lin W G, Sun Y C, Yang Q N., Real-time comprehensive image processing system for detecting concrete bridges crack, Computers and Concrete, 23, 6, pp. 445-457, (2019)
  • [5] Sutter B, Leleve A, Pham M T, Gouin O, Jupille N, Kuhn M., A semi-autonomous mobile robot for bridge inspection, Automation Construction, 91, pp. 111-119, (2018)
  • [6] Hirai H, Ishii K., Development of dam inspection underwater robot, Journal of Robotics, Networking and Artificial Life, 6, 1, pp. 18-22, (2019)
  • [7] Zhong Fan, Zhou Ji-Liu, He Kun, Huang Mei, Adaptive scale filtering for edge detection, Acta Automatica Sinica, 33, 8, pp. 867-870, (2007)
  • [8] Win M, Bushroa A R, Hassan M A., A contrast adjustment thresholding method for surface defect detection based on mesoscopy, IEEE Transactions on Industrial Informatics, 11, 3, pp. 642-649, (2017)
  • [9] Kamaliardakani M, Sun L, Ardakani M K., Sealed-crack detection algorithm using heuristic thresholding approach, Journal of Computing in Civil Engineering, 30, 1, (2016)
  • [10] German S, Brilakis I, Desroches R., Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments, Advanced Engineering Informatics, 26, 4, pp. 846-858, (2012)