Deep reinforcement learning for scheduling in large-scale networked control systems

被引:9
|
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [21] Prediction-Based Control of Large-Scale Networked Control Systems
    Guo, Xiaoxiao
    Xia, Jianwei
    Park, Ju H.
    Chen, Guoliang
    Xie, Xiangpeng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (08): : 4736 - 4748
  • [22] Large-scale power inspection: A deep reinforcement learning approach
    Guan, Qingshu
    Zhang, Xiangquan
    Xie, Minghui
    Nie, Jianglong
    Cao, Hui
    Chen, Zhao
    He, Zhouqiang
    FRONTIERS IN ENERGY RESEARCH, 2023, 10
  • [23] MULTITASK SCHEDULING IN NETWORKED CONTROL SYSTEMS WITH APPLICATION TO LARGE SCALE VEHICLE CONTROL
    YANG Liman LI Yunhua School of Automation Science and Electric Engineering
    Chinese Journal of Mechanical Engineering, 2007, (01) : 69 - 72
  • [24] Large-Scale Wildfire Mitigation Through Deep Reinforcement Learning
    Altamimi, Abdulelah
    Lagoa, Constantino
    Borges, Jose G.
    McDill, Marc E.
    Andriotis, C. P.
    Papakonstantinou, K. G.
    FRONTIERS IN FORESTS AND GLOBAL CHANGE, 2022, 5
  • [25] Simulation of large-scale networked control systems using GTSNetS
    Ould-Ahmed-Vall, ElMoustapha
    Heck, Bonnie S.
    Riley, George F.
    NETWORKED EMBEDDED SENSING AND CONTROL, 2006, 331 : 87 - 106
  • [26] Special issue uncertainties in large-scale networked control systems
    Zhang, Qichun
    Dai, Xuewu
    AIMS Electronics and Electrical Engineering, 2020, 4 (04): : 345 - 346
  • [27] Efficient Criteria for Stability of Large-Scale Networked Control Systems
    Ogura, Masaki
    Cetinkaya, Ahmet
    Hayakawa, Tomohisa
    Preciado, Victor M.
    IFAC PAPERSONLINE, 2016, 49 (22): : 13 - 18
  • [28] Fault Estimation and Networked Reconfiguration in Large-Scale Control Systems
    Marton, Lorinc
    Schenk, Kai
    Lunze, Jan
    IFAC PAPERSONLINE, 2017, 50 (01): : 10342 - 10349
  • [29] A Reinforcement Learning Based Large-Scale Refinery Production Scheduling Algorithm
    Chen, Yuandong
    Ding, Jinliang
    Chen, Qingda
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (04) : 6041 - 6055
  • [30] Multi-task deep reinforcement learning for dynamic scheduling of large-scale fleets in earthmoving operations
    Zhang, Yunuo
    Zhang, Jun
    Wang, Xiaoling
    Zeng, Tuocheng
    AUTOMATION IN CONSTRUCTION, 2025, 174