Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
|
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Designing Deep Reinforcement Learning for Human Parameter Exploration
    Scurto, Hugo
    Van Kerrebroeck, Bavo
    Caramiaux, Baptiste
    Bevilacqua, Frederic
    ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION, 2021, 28 (01)
  • [42] Detecting and adapting to crisis pattern with context based Deep Reinforcement Learning
    Benhamou, Eric
    Saltiel, David
    Ohana, Jean-Jacques
    Atif, Jamal
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10050 - 10057
  • [43] Self-adapting Machine Learning-based Systems via a Probabilistic Model Checking Framework
    Casimiro, Maria
    Soares, Diogo
    Garlan, David
    Rodrigues, Luis
    Romano, Paolo
    ACM TRANSACTIONS ON AUTONOMOUS AND ADAPTIVE SYSTEMS, 2024, 19 (03)
  • [44] CALCULATION OF THE VISCOUS SUPERSONIC JET FLOW IN A SUPERSONIC AIRSTREAM WITH USING A SELF-ADAPTING GRID
    GERM, VE
    VESTNIK LENINGRADSKOGO UNIVERSITETA SERIYA MATEMATIKA MEKHANIKA ASTRONOMIYA, 1986, (04): : 42 - 43
  • [45] Forecasting the natural gas demand in China using a self-adapting intelligent grey model
    Zeng, Bo
    Li, Chuan
    ENERGY, 2016, 112 : 810 - 825
  • [46] Optimized Information Discovery using Self-adapting Indices over Distributed Hash Tables
    Memon, Faraz
    Tiebler, Daniel
    Duerr, Frank
    Rothermel, Kurt
    2010 IEEE 29TH INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC), 2010, : 105 - 113
  • [47] Electric power quality disturbance classification using self-adapting artificial neural networks
    Wijayakulasooriya, JV
    Putrus, GA
    Minns, PD
    IEE PROCEEDINGS-GENERATION TRANSMISSION AND DISTRIBUTION, 2002, 149 (01) : 98 - 101
  • [48] Towards Efficient Mapless Navigation Using Deep Reinforcement Learning with Parameter Space Noise
    Liu, Xiaoyun
    Zhou, Qingrui
    Wang, Hui
    Yang, Ying
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 8833 - 8837
  • [49] Self-Paced Deep Reinforcement Learning
    Klink, Pascal
    D'Eramo, Carlo
    Peters, Jan
    Pajarinen, Joni
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [50] WECC Composite Load Model Parameter Identification Using Evolutionary Deep Reinforcement Learning
    Bu, Fankun
    Ma, Zixiao
    Yuan, Yuxuan
    Wang, Zhaoyu
    IEEE TRANSACTIONS ON SMART GRID, 2020, 11 (06) : 5407 - 5417