3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [21] Deep Reinforcement Learning Controller for 3D Path Following and Collision Avoidance by Autonomous Underwater Vehicles
    Havenstrom, Simen Theie
    Rasheed, Adil
    San, Omer
    FRONTIERS IN ROBOTICS AND AI, 2021, 7
  • [22] Deep Reinforcement Learning of Collision-Free Flocking Policies for Multiple Fixed-Wing UAVs Using Local Situation Maps
    Yan, Chao
    Wang, Chang
    Xiang, Xiaojia
    Lan, Zhen
    Jiang, Yuna
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) : 1260 - 1270
  • [23] Mapless Navigation for Autonomous Robots: A Deep Reinforcement Learning Approach
    Zhang, Pengpeng
    Wei, Changyun
    Cai, Boliang
    Ouyang, Yongping
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3141 - 3146
  • [24] Energy-efficient, collision-free medium access control for wireless sensor networks
    Rajendran, V
    Obraczka, K
    Garcia-Luna-Aceves, J
    WIRELESS NETWORKS, 2006, 12 (01) : 63 - 78
  • [25] Energy-Efficient Collision-Free Trajectory Planning Using Alternating Quadratic Programming
    Zhao, Yiming
    Wang, Yebin
    Bortoff, Scott A.
    Nikovski, Daniel
    2014 AMERICAN CONTROL CONFERENCE (ACC), 2014, : 1249 - 1254
  • [26] Towards Energy-Efficient Autonomous Driving: A Multi-Objective Reinforcement Learning Approach
    He, Xiangkun
    Lv, Chen
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (05) : 1329 - 1331
  • [27] Towards Energy-Efficient Autonomous Driving: A Multi-Objective Reinforcement Learning Approach
    Xiangkun He
    Chen Lv
    IEEE/CAA Journal of Automatica Sinica, 2023, 10 (05) : 1329 - 1331
  • [28] Energy-Efficient, Collision-Free Medium Access Control for Wireless Sensor Networks
    Venkatesh Rajendran
    Katia Obraczka
    J. J. Garcia-Luna-Aceves
    Wireless Networks, 2006, 12 : 63 - 78
  • [29] A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments
    Xue, Yuntao
    Chen, Weisheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) : 3001 - 3014
  • [30] 3D Collision-Free Trajectory Generation Using Elastic Band Technique for an Autonomous Helicopter
    Lee, Chi-Tai
    Tsai, Ching-Chih
    NEXT WAVE IN ROBOTICS, 2011, 212 : 34 - 41