TinyDeepUAV: A Tiny Deep Reinforcement Learning Framework for UAV Task Offloading in Edge-Based Consumer Electronics

被引:1
|
作者
Bebortta, Sujit [1 ]
Tripathy, Subhranshu Sekhar [2 ,4 ,5 ]
Khan, Surbhi Bhatia [3 ]
Al Dabel, Maryam M. [6 ]
Almusharraf, Ahlam [7 ]
Bashir, Ali Kashif [8 ,9 ,10 ]
机构
[1] Ravenshaw Univ, Dept Comp Sci, Cuttack 753003, India
[2] KIIT Deemed Univ, Sch Comp Engn, Bhubaneswar 751024, India
[3] Univ Salford, Sch Sci Engn & Environm, Salford M5 4WT, England
[4] Lebanese Amer Univ, Dept Elect & Comp Engn, Byblos 03797, Lebanon
[5] Chitkara Univ, Ctr Res Impact & Outcome, Chandigarh 140401, Punjab, India
[6] Univ Hafr Al Batin, Coll Comp Sci & Engn, Dept Comp Sci & Engn, Hafar Al Batin 39524, Saudi Arabia
[7] Princess Nourah Bint Abdulrahman Univ, Coll Business & Adm, Dept Business Adm, POB 84428, Riyadh 11671, Saudi Arabia
[8] Manchester Metropolitan Univ, Dept Comp & Math, Manchester M15 6GB, England
[9] Lebanese Amer Univ, Dept Comp Sci & Math, Beirut 03797751, Lebanon
[10] Woxsen Univ, Woxsen Sch Business, Hyderabad 502345, India
关键词
Task analysis; Autonomous aerial vehicles; Optimization; Delays; Energy consumption; Deep reinforcement learning; Consumer electronics; Unmanned aerial vehicles; Internet of Things; TinyML; deep reinforcement learning; edge intelligence; multi objective optimization; energy efficiency; delay minimization; OPTIMIZATION; ALGORITHM;
D O I
10.1109/TCE.2024.3445290
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, there has been a rise in the use of Unmanned Areal Vehicles (UAVs) in consumer electronics, particularly for the critical situations. Internet of Things (IoT) technology and the accessibility of inexpensive edge computing devices present novel prospects for enhanced functionality in various domains through the utilization of IoT-based UAVs. One major difficulty of this perspective is the challenges of computation offloading between resource-constrained edge devices, and UAVs. This paper proposes an innovative framework to solve the computation offloading problem using a multi-objective Deep reinforcement learning (DRL) technique. The proposed approach helps in finding a balance between delays and energy consumption by using the concept of Tiny Machine Learning (TinyML). It develops a low complexity frameworks that make it feasible for offloading tasks to edge devices. Catering to the dynamic nature of edge-based UAV networks, TinyDeepUAV suggests a vector reinforcement that can change weights dynamically based on various user preferences. It is further conjectured that the structure can be enhanced by Double Dueling Deep Q Network (D3QN) for optimal improvement of the optimization problem. The simulation results depicts a trade-off between delay and energy consumption, enabling more effective offloading decisions while outperforming benchmark approaches.
引用
收藏
页码:7357 / 7364
页数:8
相关论文
共 50 条
  • [31] Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
    Alfakih, Taha
    Hassan, Mohammad Mehedi
    Gumaei, Abdu
    Savaglio, Claudio
    Fortino, Giancarlo
    IEEE ACCESS, 2020, 8 : 54074 - 54084
  • [32] Federated Deep Reinforcement Learning-based task offloading system in edge computing environment
    Merakchi, Hiba
    Bagaa, Miloud
    Messaoud, Ahmed Ouameur
    Ksentini, Adlen
    Sehad, Abdenour
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 5580 - 5586
  • [33] Federated Deep Reinforcement Learning Based Task Offloading with Power Control in Vehicular Edge Computing
    Moon, Sungwon
    Lim, Yujin
    SENSORS, 2022, 22 (24)
  • [34] Federated Deep Reinforcement Learning for Task Offloading in Digital Twin Edge Networks
    Dai, Yueyue
    Zhao, Jintang
    Zhang, Jing
    Zhang, Yan
    Jiang, Tao
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (03): : 2849 - 2863
  • [35] Parameterized Deep Reinforcement Learning With Hybrid Action Space for Edge Task Offloading
    Wang, Ting
    Deng, Yuxiang
    Yang, Zhao
    Wang, Yang
    Cai, Haibin
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) : 10754 - 10767
  • [36] Adaptive Task Offloading in Coded Edge Computing: A Deep Reinforcement Learning Approach
    Nguyen Van Tam
    Nguyen Quang Hieu
    Nguyen Thi Thanh Van
    Nguyen Cong Luong
    Niyato, Dusit
    Kim, Dong In
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (12) : 3878 - 3882
  • [37] Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT
    Hu, Jiangyi
    Li, Yang
    Zhao, Gaofeng
    Xu, Bo
    Ni, Yiyang
    Zhao, Haitao
    IEEE ACCESS, 2021, 9 : 93892 - 93901
  • [38] Task graph offloading via deep reinforcement learning in mobile edge computing
    Liu, Jiagang
    Mi, Yun
    Zhang, Xinyu
    Li, Xiaocui
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 158 : 545 - 555
  • [39] Task offloading in vehicular edge computing networks via deep reinforcement learning
    Karimi, Elham
    Chen, Yuanzhu
    Akbari, Behzad
    COMPUTER COMMUNICATIONS, 2022, 189 : 193 - 204
  • [40] Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning
    Cao, Zequn
    Deng, Xiaoheng
    Yue, Sheng
    Jiang, Ping
    Ren, Ju
    Gui, Jinsong
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21632 - 21646