A Real-Time Tracking Algorithm for Multi-Target UAV Based on Deep Learning

被引:14
|
作者
Hong, Tao [1 ,2 ]
Liang, Hongming [2 ]
Yang, Qiye [3 ]
Fang, Linquan [1 ]
Kadoch, Michel [4 ]
Cheriet, Mohamed [4 ]
机构
[1] Yunnan Innovat Inst BUAA, Kunming 650233, Peoples R China
[2] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[3] AVIC Chengdu Aircraft Design & Res Inst, Chengdu 610041, Peoples R China
[4] Univ Quebec, Ecole Technol Super ETS, Montreal, PQ H2L 2C4, Canada
基金
中国国家自然科学基金;
关键词
UAV; 5G; multi-target detection and tracking; YOLOv4; DeepSORT;
D O I
10.3390/rs15010002
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV technology is a basic technology aiming to help realize smart living and the construction of smart cities. Its vigorous development in recent years has also increased the presence of unmanned aerial vehicles (UAVs) in people's lives, and it has been increasingly used in logistics, transportation, photography and other fields. However, the rise in the number of drones has also put pressure on city regulation. Using traditional methods to monitor small objects flying slowly at low altitudes would be costly and ineffective. This study proposed a real-time UAV tracking scheme that uses the 5G network to transmit UAV monitoring images to the cloud and adopted a machine learning algorithm to detect and track multiple targets. Aiming at the difficulties in UAV detection and tracking, we optimized the network structure of the target detector yolo4 (You Only Look Once V4) and improved the target tracker DeepSORT, adopting the detection-tracking mode. In order to verify the reliability of the algorithm, we built a data set containing 3200 pictures of four UAVs in different environments, conducted training and testing on the model, and achieved 94.35% tracking accuracy and 69FPS detection speed under the GPU environment. The model was then deployed on ZCU104 to prove the feasibility of the scheme.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Resource Constrained Particle Filtering for Real-time Multi-Target Tracking in Sensor Networks
    Ong, Lee-Ling
    Xiao, Wendong
    Tham, Chen-Khong
    Ang, Marcelo H., Jr.
    2009 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS (PERCOM), VOLS 1 AND 2, 2009, : 479 - +
  • [42] A multi-target tracking algorithm based on multiple cameras
    Jiang, Ming-Xin
    Wang, Hong-Yu
    Liu, Xiao-Kai
    Zidonghua Xuebao/Acta Automatica Sinica, 2012, 38 (04): : 531 - 539
  • [43] Multi-Target Tracking Algorithm Based on FIR Filters
    Lee, Chang Joo
    Min, Kyung Min
    Choi, Hyun Duck
    Ahn, Choon Ki
    Lim, Myo Taeg
    2014 14TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2014), 2014, : 1112 - 1116
  • [44] A lightweight multi-target real-time detection model
    Qiu B.
    Liu X.
    Shi Y.
    Shang Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2020, 46 (09): : 1778 - 1785
  • [45] Real-time deep learning based multi object tracking of spermatozoa in fresh samples
    Thambawita, V.
    Hicks, S. A.
    Storas, A.
    Witczak, O.
    Andersen, J. M.
    Hammer, H. L.
    Halvorsen, P.
    Riegler, M. A.
    Haugen, T. B.
    HUMAN REPRODUCTION, 2022, 37 : 241 - 241
  • [46] Real-time infrared multi-class multi-target anchor-free tracking network
    Song Z.
    Yang J.
    Zhang D.
    Wang S.
    Zhang S.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (02): : 401 - 409
  • [47] UAV Sensor Scheduling for Enhanced Multi-Target Tracking: A Reinforcement Learning Approach
    Koch, Simon
    Stuetz, Peter
    AIAA SCITECH 2024 FORUM, 2024,
  • [48] Deep Meta Learning for Real-Time Target-Aware Visual Tracking
    Choi, Janghoon
    Kwon, Junseok
    Lee, Kyoung Mu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 911 - 920
  • [49] Real-time Multi-Target Tracking at 210 Megapixels/second in Wide Area Motion Imagery
    Basharat, Arslan
    Turek, Matt
    Xu, Yiliang
    Atkins, Chuck
    Stoup, David
    Fieldhouse, Keith
    Tunison, Paul
    Hoogs, Anthony
    2014 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2014, : 839 - 846
  • [50] A Real-Time Target-Tracking Algorithm Based on Improved SiamFC
    Zhang Hongying
    He Pengyi
    Wang Huisan
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)