Deep Q learning cloud task scheduling algorithm based on improved exploration strategy

被引:0
|
作者
Cheng, Chenyu [1 ]
Li, Gang [2 ]
Fan, Jiaqing [1 ]
机构
[1] Jilin Inst Chem Technol, Sch Informat & Control Engn, Jilin, Peoples R China
[2] Baicheng Normal Univ, Sch Mech & Control Engn, Baicheng 137000, Jilin, Peoples R China
关键词
Cloud computing; deep reinforcement learning; cloud task scheduling; deep Q-learning; exploration strategy;
D O I
10.3233/JCM-247229
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In cloud computing, task scheduling is a critical process that involves efficiently allocating computing resources to fulfill diverse task requirements. To address issues such as unstable response times, extensive computations, and challenges in parameter adjustment faced by traditional task scheduling methods, an enhanced deep Q-learning cloud-task-scheduling algorithm was proposed. This algorithm utilizes deep reinforcement learning and introduces an improved strategy. The optimization of the objective function was achieved by defining the state space, action space, and reward function. The agent's exploration capability was enhanced through the utilization of a UCB exploration strategy and Boltzmann action exploration. Simulation experiments were conducted using Pycloudsim. The average instruction response time ratio and standard deviation of CPU utilization were compared to measure the advantages and disadvantages of the algorithm. The results indicate that the proposed algorithm surpasses the random, earliest, and RR algorithms in terms of the instruction-to-response time ratio and CPU utilization, demonstrating enhanced efficiency and performance in cloud-task scheduling.
引用
收藏
页码:2095 / 2107
页数:13
相关论文
共 50 条
  • [31] Cloud Computing Task Scheduling Model Based on Improved Whale Optimization Algorithm
    Jia, LiWei
    Li, Kun
    Shi, Xiaoming
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [32] Cloud computing task scheduling based on Improved Particle Swarm Optimization Algorithm
    Zhang, Yuping
    Yang, Rui
    IECON 2017 - 43RD ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2017, : 8768 - 8772
  • [33] An Improved Task Scheduling Algorithm Based on Multi-QoS in Cloud Computing
    Li, Fengsong
    Lou, Yuansheng
    MECHANICAL, ELECTRONIC AND ENGINEERING TECHNOLOGIES (ICMEET 2014), 2014, 538 : 512 - 515
  • [34] Task Scheduling in Cloud Using Deep Reinforcement Learning
    Swarup, Shashank
    Shakshuki, Elhadi M.
    Yasar, Ansar
    12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 42 - 51
  • [35] Improved Double Deep Q Network-Based Task Scheduling Algorithm in Edge Computing for Makespan Optimization
    Zeng, Lei
    Liu, Qi
    Shen, Shigen
    Liu, Xiaodong
    TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (03): : 806 - 817
  • [36] Task scheduling optimization strategy using improved ant colony optimization algorithm in cloud computing
    Wei, Xianyong
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020,
  • [37] An improved genetic algorithm using greedy strategy toward task scheduling optimization in cloud environments
    Zhou Zhou
    Fangmin Li
    Huaxi Zhu
    Houliang Xie
    Jemal H. Abawajy
    Morshed U. Chowdhury
    Neural Computing and Applications, 2020, 32 : 1531 - 1541
  • [38] An Improved Ant Algorithm for Grid Task Scheduling Strategy
    Wei, Laizhi
    Zhang, Xiaobin
    Li, Yun
    Li, Yujie
    INTERNATIONAL CONFERENCE ON APPLIED PHYSICS AND INDUSTRIAL ENGINEERING 2012, PT C, 2012, 24 : 1974 - 1981
  • [39] An Improved Ant Algorithm for Grid Task Scheduling Strategy
    Wei, Laizhi
    Zhang, Xiaobin
    Li, Yun
    Li, Yujie
    2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL III, 2010, : 747 - 750
  • [40] An improved genetic algorithm using greedy strategy toward task scheduling optimization in cloud environments
    Zhou, Zhou
    Li, Fangmin
    Zhu, Huaxi
    Xie, Houliang
    Abawajy, Jemal H.
    Chowdhury, Morshed U.
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (06): : 1531 - 1541