An effective automatic object detection algorithm for continuous sonar image sequences

被引:2
|
作者
Shi, Pengfei [1 ]
Sun, Huanru [1 ]
Fan, Xinnan [1 ]
He, Qi [1 ]
Zhou, Xuan [1 ]
Lu, Liang [1 ]
机构
[1] HoHai Univ, Coll Internet Things Engn, Jinling North Rd, Changzhou 213022, Jiangsu, Peoples R China
基金
国家重点研发计划;
关键词
Continuous sonar image sequences; Deep learning; Ocean object detection; Long short-term memory; Cross-detection model;
D O I
10.1007/s11042-023-15837-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Object detection of continuous sonar image sequences has become an efficient way for underwater environment exploration. However, the task always suffers from the influence of th e complex underwater environment. In particular, the existing algorithms mainly focus on image-based detection and can not balance the detection speed and accuracy in continuous sonar image sequences. To solve the problem, this paper proposes a novel automatic detection algorithm based on deep learning for continuous sonar image sequences. Firstly, the convLSTM (convolution Long Short-Term Memory) is improved to fuse sonar features obtained from the cross-detection model, which are from three aspects: 1) The original convolution is replaced by depthwise separable convolution; 2) The original network input is divided into G groups and processed by group convolution; 3) A connection layer between the Bottleneck convolution layer and output is added to further capture feature information between frames. Then, to fully extract sonar features, a cross-detection network is established by fusing two different feature extraction networks MobileNetV3-Large and MobileNetV3-Small. Finally, we combine thecross-detection network with the improved convLSTM to establish the whole model, which can fully extract and utilize temporal information in continuous sonar image sequences. The experimental results show that the proposed model has effectively improved the detection speed in sonar image sequences at 150 FPS, simultaneously keeping an 85.8% mAP.
引用
收藏
页码:10233 / 10246
页数:14
相关论文
共 50 条
  • [31] Joint Representation of Temporal Image Sequences and Object Motion for Video Object Detection
    Koh, Junho
    Kim, Jaekyum
    Shin, Younji
    Lee, Byeongwon
    Yang, Seungji
    Choi, Jun Won
    Choi, Jun Won (junwchoi@hanyang.ac.kr), 2021, Institute of Electrical and Electronics Engineers Inc. (2021-May): : 11118 - 11124
  • [32] Improved YOLOv7 model for underwater sonar image object detection
    Qin, Ken Sinkou
    Liu, Di
    Wang, Fei
    Zhou, Jingchun
    Yang, Jiaxuan
    Zhang, Weishi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [33] Realistic Sonar Image Simulation Using Deep Learning for Underwater Object Detection
    Sung, Minsung
    Kim, Jason
    Lee, Meungsuk
    Kim, Byeongjin
    Kim, Taesik
    Kim, Juhwan
    Yu, Son-Cheol
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (03) : 523 - 534
  • [34] Joint Representation of Temporal Image Sequences and Object Motion for Video Object Detection
    Koh, Junho
    Kim, Jaekyum
    Shin, Younji
    Lee, Byeongwon
    Yang, Seungji
    Choi, Jun Won
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 13370 - 13376
  • [35] Realistic Sonar Image Simulation Using Deep Learning for Underwater Object Detection
    Minsung Sung
    Jason Kim
    Meungsuk Lee
    Byeongjin Kim
    Taesik Kim
    Juhwan Kim
    Son-Cheol Yu
    International Journal of Control, Automation and Systems, 2020, 18 : 523 - 534
  • [36] Training with Noise Adversarial Network: A Generalization Method for Object Detection on Sonar Image
    Ma, Qixiang
    Jiang, Longyu
    Yu, Wenxue
    Jin, Rui
    Wu, Zhixiang
    Xu, Fangjin
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 718 - 727
  • [37] Automatic Object Detection for AUV Navigation using Imaging Sonar within Confined Environments
    Zhao, Shi
    Lu, Tien-Fu
    Anvar, Amir
    ICIEA: 2009 4TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, VOLS 1-6, 2009, : 3639 - 3644
  • [38] Multi-object Tracking in Aerial Image Sequences using Aerial Tracking Learning and Detection Algorithm
    Malagi, Vindhya P.
    Babu, Ramesh D. R.
    Rangarajan, Krishnan
    DEFENCE SCIENCE JOURNAL, 2016, 66 (02) : 122 - 129
  • [39] An Effective Method for People Detection in Grayscale Image Sequences
    Popa, Mircea
    Lazea, Gheorghe
    Majdik, Andras
    Tamas, Levente
    Szoke, Istvan
    2009 IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, PROCEEDINGS, 2009, : 181 - 184
  • [40] A Novel Quantum-inspired Algorithm for Edge Detection of Sonar Image
    Wang Xingmei
    Liu Guangyu
    Li Lin
    Liu Zhipeng
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 4836 - 4841