Practical Study of Recurrent Neural Networks for Efficient Real-Time Drone Sound Detection: A Review

被引:18
|
作者
Utebayeva, Dana [1 ]
Ilipbayeva, Lyazzat [2 ]
Matson, Eric T. [3 ]
机构
[1] Satbayev Univ, Dept ET & ST, Alma Ata 050013, Kazakhstan
[2] Int IT Univ, Dept RET, Alma Ata 050040, Kazakhstan
[3] Purdue Univ, Dept CIT, W Lafayette, IN 47907 USA
关键词
RNN; simpleRNN; LSTM; BiLSTM; bidirectional LSTM; gated recurrent networks; GRU; Kapre method; Mel-spectrogram; deep learning; UAV sound; sound detection; loaded UAV; unloaded UAV; drone detection; real-time UAV detection;
D O I
10.3390/drones7010026
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The detection and classification of engine-based moving objects in restricted scenes from acoustic signals allow better Unmanned Aerial System (UAS)-specific intelligent systems and audio-based surveillance systems. Recurrent Neural Networks (RNNs) provide wide coverage in the field of acoustic analysis due to their effectiveness in widespread practical applications. In this work, we propose to study SimpleRNN, LSTM, BiLSTM, and GRU recurrent network models for real-time UAV sound recognition systems based on Mel-spectrogram using Kapre layers. The main goal of the work is to study the types of RNN networks in a practical sense for a reliable drone sound recognition system. According to the results of an experimental study, the GRU (Gated Recurrent Units) network model demonstrated a higher prediction ability than other RNN architectures for detecting differences and the state of objects from acoustic signals. That is, RNNs gave higher recognition than CNNs for loaded and unloaded audio states of various UAV models, while the GRU model showed about 98% accuracy for determining the UAV load states and 99% accuracy for background noise, which consisted of more other data.
引用
收藏
页数:25
相关论文
共 50 条
  • [41] Real-Time Pedestrian Detection Using Convolutional Neural Networks
    Kuang, Ping
    Ma, Tingsong
    Li, Fan
    Chen, Ziwei
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2018, 32 (11)
  • [42] Exploring Compact and Efficient Neural Networks for Real-Time Semantic Segmentation
    Li, Zijia
    Xiao, ZhenZhong
    Song, Zhan
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 291 - 297
  • [43] Evolving Efficient Deep Neural Networks for Real-time Object Recognition
    Lan, Gongjin
    de Vries, Lucas
    Wang, Shuai
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2571 - 2578
  • [44] Development and Real-Time Implementation of Recurrent Neural Networks for AFR Prediction and Control
    Arsie, Ivan
    Pianese, Cesare
    Sorrentino, Marco
    SAE INTERNATIONAL JOURNAL OF PASSENGER CARS-ELECTRONIC AND ELECTRICAL SYSTEMS, 2009, 1 (01): : 403 - 412
  • [45] An improved approximation of the error function of recurrent neural networks for the real-time learning
    Tatsumi, K
    Kitano, Y
    Tanino, T
    Fukushima, M
    KNOWLEDGE-BASED INTELLIGENT INFORMATION ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, PTS 1 AND 2, 2001, 69 : 152 - 156
  • [46] Ask Your TV: Real-Time Question Answering with Recurrent Neural Networks
    Ture, Ferhan
    Jojic, Oliver
    SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, : 457 - 458
  • [47] REAL-TIME SYNCHRONIZATION IN NEURAL NETWORKS FOR MULTIVARIATE TIME SERIES ANOMALY DETECTION
    Abdulaal, Ahmed
    Lancewicki, Tomer
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3570 - 3574
  • [48] Real-Time Recurrent Neural State Estimation
    Alanis, Alma Y.
    Sanchez, Edgar N.
    Loukianov, Alexander G.
    Perez, Marco A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (03): : 497 - 505
  • [49] Real-time construction of neural networks
    Li, Kang
    Peng, Jian Xun
    Fei, Minrui
    ARTIFICIAL NEURAL NETWORKS - ICANN 2006, PT 1, 2006, 4131 : 140 - 149
  • [50] Neural networks for real-time control
    Narendra, KS
    PROCEEDINGS OF THE 36TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 1997, : 1026 - 1031