3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [31] Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot
    Zhai, Yu
    Liu, Zhe
    Miao, Yanzi
    Wang, Hesheng
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3755 - 3760
  • [32] A fast learning approach for autonomous navigation using a deep reinforcement learning method
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    ELECTRONICS LETTERS, 2021, 57 (02) : 50 - 53
  • [33] Deep Reinforcement Learning for Energy-Efficient Beamforming Design in Cell-Free Networks
    Li, Weilai
    Ni, Wanli
    Tian, Hui
    Hua, Meihui
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2021,
  • [34] Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles
    Zhang, Qingrui
    Pan, Wei
    Reppa, Vasso
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8770 - 8781
  • [35] Peduncle collision-free grasping based on deep reinforcement learning for tomato harvesting robot
    Li, Yajun
    Feng, Qingchun
    Zhang, Yifan
    Peng, Chuanlang
    Ma, Yuhang
    Liu, Cheng
    Ru, Mengfei
    Sun, Jiahui
    Zhao, Chunjiang
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 216
  • [36] A 3D Simulation Environment and Navigation Approach for Robot Navigation via Deep Reinforcement Learning in Dense Pedestrian Environment
    Liu, Qi
    Li, Yanjie
    Liu, Lintao
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 1514 - 1519
  • [37] An energy-efficient, scalable and collision-free MAC layer protocol for wireless sensor networks
    Jolly, G
    Younis, M
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2005, 5 (03): : 285 - 304
  • [38] 3D Distance Filter for the Autonomous Navigation of UAVs in Agricultural Scenarios
    Donati, Cesare
    Mammarella, Martina
    Comba, Lorenzo
    Biglia, Alessandro
    Gay, Paolo
    Dabbene, Fabrizio
    REMOTE SENSING, 2022, 14 (06)
  • [39] Energy-Efficient Collision-Free Machine/AGV Scheduling Using Vehicle Edge Intelligence
    Cai, Zhengying
    Du, Jingshu
    Huang, Tianhao
    Lu, Zhuimeng
    Liu, Zeya
    Gong, Guoqiang
    Sensors, 2024, 24 (24)
  • [40] Energy-Efficient Mobile Crowdsensing by Unmanned Vehicles: A Sequential Deep Reinforcement Learning Approach
    Piao, Chengzhe
    Liu, Chi Harold
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6312 - 6324