Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
|
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] Self-Adapting Model-Based SDSec For IoT Networks Using Machine Learning
    Narayanankutty, Hrishikesh
    2021 IEEE 18TH INTERNATIONAL CONFERENCE ON SOFTWARE ARCHITECTURE COMPANION (ICSA-C), 2021, : 92 - 93
  • [12] Efficiency Testing of Self-adapting Systems by Learning of Event Sequences
    Hudson, Jonathan
    Denzinger, Jorg
    Kasinger, Holger
    Bauer, Bernhard
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON ADAPTIVE AND SELF-ADAPTIVE SYSTEMS AND APPLICATIONS (ADAPTIVE 2010), 2010, : 200 - 205
  • [13] Delay lines using self-adapting time constants
    Lim, SJ
    Harris, JG
    SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 2853 - 2858
  • [14] Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimization
    Sehgal, Adarsh
    Hung Manh La
    Louis, Sushil J.
    Hai Nguyen
    2019 THIRD IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2019), 2019, : 596 - 601
  • [15] VLSI Placement Parameter Optimization using Deep Reinforcement Learning
    Agnesina, Anthony
    Chang, Kyungwook
    Lim, Sung Kyu
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED-DESIGN (ICCAD), 2020,
  • [16] A Probabilistic Model Checking Approach to Self-adapting Machine Learning Systems
    Casimiro, Maria
    Garlan, David
    Camara, Javier
    Rodrigues, Luis
    Romano, Paolo
    SOFTWARE ENGINEERING AND FORMAL METHODS: SEFM 2021 COLLOCATED WORKSHOPS, 2022, 13230 : 317 - 332
  • [17] Network parameter setting for reinforcement learning approaches using neural networks
    Yamada, Kazuaki
    Ohkura, Kazuhiro
    Nihon Kikai Gakkai Ronbunshu, C Hen/Transactions of the Japan Society of Mechanical Engineers, Part C, 2012, 78 (792): : 2950 - 2961
  • [18] Network Parameter Setting for Reinforcement Learning Approaches Using Neural Networks
    Yamada, Kazuaki
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2011, 15 (07) : 822 - 830
  • [19] Radar image segmentation using self-adapting recurrent networks
    Ziemke, T
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 1997, 8 (01) : 47 - 54
  • [20] Self-Adapting Recurrent Models for Object Pushing from Learning in Simulation
    Cong, Lin
    Grner, Michael
    Ruppel, Philipp
    Liang, Hongzhuo
    Hendrich, Norman
    Zhang, Jianwei
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 5304 - 5310