Deep reinforcement learning for scheduling in large-scale networked control systems

被引:9
|
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [1] Deep and reinforcement learning for automated task scheduling in large-scale cloud computing systems
    Rjoub, Gaith
    Bentahar, Jamal
    Wahab, Omar Abdel
    Bataineh, Ahmed Saleh
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (23):
  • [2] Deep Reinforcement Learning for Large-Scale Epidemic Control
    Libin, Pieter J. K.
    Moonens, Arno
    Verstraeten, Timothy
    Perez-Sanjines, Fabian
    Hens, Niel
    Lemey, Philippe
    Nowe, Ann
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2020, PT V, 2021, 12461 : 155 - 170
  • [3] Distributed Control of Networked Large-Scale Systems Based on A Scheduling Middleware
    Lin, Yufeng
    Wang, Jia
    Han, Qing-Long
    Jarvis, Dennis
    IECON 2017 - 43RD ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2017, : 5523 - 5528
  • [4] large-scale systems and networked control
    Tian, Yu-Chu
    Sun, Youxian
    ASIA-PACIFIC JOURNAL OF CHEMICAL ENGINEERING, 2008, 3 (06) : 587 - 588
  • [5] Stochastic Event-Based Control and Scheduling of Large-Scale Networked Control Systems
    Al-Areqi, Sanad
    Goerges, Daniel
    Liu, Steven
    2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, : 2316 - 2321
  • [6] Energy-aware task scheduling optimization with deep reinforcement learning for large-scale heterogeneous systems
    Li, Jingbo
    Zhang, Xingjun
    Wei, Zheng
    Wei, Jia
    Ji, Zeyu
    CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING, 2021, 3 (04) : 383 - 392
  • [7] Energy-aware task scheduling optimization with deep reinforcement learning for large-scale heterogeneous systems
    Jingbo Li
    Xingjun Zhang
    Zheng Wei
    Jia Wei
    Zeyu Ji
    CCF Transactions on High Performance Computing, 2021, 3 : 383 - 392
  • [8] Tractable large-scale deep reinforcement learning
    Sarang, Nima
    Poullis, Charalambos
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 232
  • [9] Efficient Pump Scheduling for Large-Scale Multiproduct Pipelines Using Deep Reinforcement Learning
    Shao, Kai
    Wang, Xinmin
    Liu, Min
    Xu, Aobo
    Jian, Ling
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2024,
  • [10] Distributed Resource Scheduling for Large-Scale MEC Systems: A Multiagent Ensemble Deep Reinforcement Learning With Imitation Acceleration
    Jiang, Feibo
    Dong, Li
    Wang, Kezhi
    Yang, Kun
    Pan, Cunhua
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (09) : 6597 - 6610