3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [1] Adaptive Deep Reinforcement Learning for Efficient 3D Navigation of Autonomous Underwater Vehicles
    Politi, Elena
    Stefanidou, Artemis
    Chronis, Christos
    Dimitrakopoulos, George
    Varlamis, Iraklis
    IEEE ACCESS, 2024, 12 : 178209 - 178221
  • [2] A Hybrid Approach for Autonomous Collision-Free UAV Navigation in 3D Partially Unknown Dynamic Environments
    Elmokadem, Taha
    Savkin, Andrey, V
    DRONES, 2021, 5 (03)
  • [3] COLLISION-FREE UAV NAVIGATION WITH A MONOCULAR CAMERA USING DEEP REINFORCEMENT LEARNING
    Chen, Yun
    Gonzalez-Prelcic, Nuria
    Heath, Robert W., Jr.
    PROCEEDINGS OF THE 2020 IEEE 30TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2020,
  • [4] Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach
    Abedin, Sarder Fakhrul
    Munir, Md Shirajum
    Tran, Nguyen H.
    Han, Zhu
    Hong, Choong Seon
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (09) : 5994 - 6006
  • [5] Energy-Efficient 3D Vehicular Crowdsourcing For Disaster Response by Distributed Deep Reinforcement Learning
    Wang, Hao
    Liu, Chi Harold
    Dai, Zipeng
    Tang, Jian
    Wang, Guoren
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 3679 - 3687
  • [6] Reinforcement Learning for Energy-Efficient Trajectory Design of UAVs
    Arani, Atefeh Hajijamali
    Azari, M. Mahdi
    Hu, Peng
    Zhu, Yeying
    Yanikomeroglu, Halim
    Safavi-Naeini, Safieddin
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (11): : 9060 - 9070
  • [7] Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach
    Wang, Chao
    Wang, Jian
    Shen, Yuan
    Zhang, Xudong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (03) : 2124 - 2136
  • [8] Beamforming in the Body: Energy-efficient and Collision-free Communication for Implants
    Swaminathan, Meenupriya
    Vizziello, Anna
    Duong, Davy
    Savazzi, Pietro
    Chowdhury, Kaushik R.
    IEEE INFOCOM 2017 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2017,
  • [9] Deep Reinforcement Learning-Based Collision-Free Navigation for Magnetic Helical Microrobots in Dynamic Environments
    Wang, Huaping
    Qiu, Yukang
    Hou, Yaozhen
    Shi, Qing
    Huang, Hen-Wei
    Huang, Qiang
    Fukuda, Toshio
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024,
  • [10] Performance-Designated Reinforcement Learning Enclosing Control for UAVs With Collision-Free Capability
    Xia, Yi
    Shao, Xingling
    Mei, Zewei
    Zhang, Wendong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 12644 - 12656