A Real-Time Tracking Algorithm for Multi-Target UAV Based on Deep Learning

被引:14
|
作者
Hong, Tao [1 ,2 ]
Liang, Hongming [2 ]
Yang, Qiye [3 ]
Fang, Linquan [1 ]
Kadoch, Michel [4 ]
Cheriet, Mohamed [4 ]
机构
[1] Yunnan Innovat Inst BUAA, Kunming 650233, Peoples R China
[2] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[3] AVIC Chengdu Aircraft Design & Res Inst, Chengdu 610041, Peoples R China
[4] Univ Quebec, Ecole Technol Super ETS, Montreal, PQ H2L 2C4, Canada
基金
中国国家自然科学基金;
关键词
UAV; 5G; multi-target detection and tracking; YOLOv4; DeepSORT;
D O I
10.3390/rs15010002
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV technology is a basic technology aiming to help realize smart living and the construction of smart cities. Its vigorous development in recent years has also increased the presence of unmanned aerial vehicles (UAVs) in people's lives, and it has been increasingly used in logistics, transportation, photography and other fields. However, the rise in the number of drones has also put pressure on city regulation. Using traditional methods to monitor small objects flying slowly at low altitudes would be costly and ineffective. This study proposed a real-time UAV tracking scheme that uses the 5G network to transmit UAV monitoring images to the cloud and adopted a machine learning algorithm to detect and track multiple targets. Aiming at the difficulties in UAV detection and tracking, we optimized the network structure of the target detector yolo4 (You Only Look Once V4) and improved the target tracker DeepSORT, adopting the detection-tracking mode. In order to verify the reliability of the algorithm, we built a data set containing 3200 pictures of four UAVs in different environments, conducted training and testing on the model, and achieved 94.35% tracking accuracy and 69FPS detection speed under the GPU environment. The model was then deployed on ZCU104 to prove the feasibility of the scheme.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Investigating a Real-Time Dose Calculation to Guide Multi-Target MLC Tracking
    Hewson, E.
    Nguyen, D.
    Le, A.
    Booth, J.
    Keall, P.
    Mejnertsen, L.
    MEDICAL PHYSICS, 2022, 49 (06) : E332 - E332
  • [32] Learning Target-Aware Vision Transformers for Real-Time UAV Tracking
    Li, Shuiwang
    Yang, Xiangyang
    Wang, Xucheng
    Zeng, Dan
    Ye, Hengzhou
    Zhao, Qijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [33] Traffic Flow Video Image Recognition and Analysis Based on Multi-Target Tracking Algorithm and Deep Learning
    Zou, Songshang
    Chen, Hao
    Feng, Hui
    Xiao, Guangyi
    Qin, Zhen
    Cai, Weiwei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) : 8762 - 8775
  • [34] Real-Time target tracking and locating system for UAV
    Zhang, Chao
    Tang, Linbo
    Fu, Huiquan
    Li, Maowen
    NINTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2017), 2017, 10420
  • [35] Real-time UAV Detection based on Deep Learning Network
    Hassan, Syed Ali
    Rahim, Tariq
    Shin, Soo Young
    2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 630 - 632
  • [36] A Real-Time Moving Target Tracking Algorithm Based on SIFT
    Qiang, Hequn
    Qian, Chunhua
    Zhong, Baojiang
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 569 - 572
  • [37] A Real-Time UAV Target Detection Algorithm Based on Edge Computing
    Cheng, Qianqing
    Wang, Hongjun
    Zhu, Bin
    Shi, Yingchun
    Xie, Bo
    DRONES, 2023, 7 (02)
  • [38] Multitarget Real-Time Tracking Algorithm for UAV IoT
    Hong, Tao
    Yang, Qiye
    Wang, Peng
    Zhang, Jinmeng
    Sun, Wenbo
    Tao, Lei
    Fang, Chaoqun
    Cao, Jihan
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [39] Real time multi-target visual tracking based on velocity segmentation technique
    Chwan-Hsen, Chen
    Chan, Yung-Pyng
    IECON 2007: 33RD ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-3, CONFERENCE PROCEEDINGS, 2007, : 2813 - +
  • [40] Multi-Agent Graphic Reinforcement Learning for Real-Time UAV Video Transmission with Predictive Target Tracking
    Duan, Fan
    Zhu, Kun
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 287 - 293