Self-adapting WIP parameter setting using deep reinforcement learning

被引:4
|
作者
De Andrade e Silva, Manuel Tome [1 ]
Azevedo, Americo [1 ,2 ]
机构
[1] Univ Porto, Fac Engn, Porto, Portugal
[2] Inst Syst & Comp Engn, Technol & Sci, Porto, Portugal
关键词
WIP reduction; CONWIP; Deep reinforcement learning; WORKLOAD CONTROL; SYSTEMS; CONWIP; NUMBER; KANBANS; MULTIPRODUCT; THROUGHPUT; ALGORITHM; TIMES;
D O I
10.1016/j.cor.2022.105854
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates the potential of dynamically adjusting WIP cap levels to maximize the throughput (TH) performance and minimize work in process (WIP), according to real-time system state arising from process variability associated with low volume and high-variety production systems. Using an innovative approach based on state-of-the-art deep reinforcement learning (proximal policy optimization algorithm), we attain WIP reductions of up to 50% and 30%, with practically no losses in throughput, against pure-push systems and the statistical throughput control method (STC), respectively. An exploratory study based on simulation experiments was performed to provide support to our research. The reinforcement learning agent's performance was shown to be robust to variability changes within the production systems.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Building self-adapting services using service-specific knowledge
    Huang, AC
    Steenkiste, P
    14TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, PROCEEDINGS, 2005, : 34 - 43
  • [32] Using context and preferences to implement self-adapting pervasive computing applications
    Henricksen, Karen
    Indulska, Jadwiga
    Rakotonirainy, Andry
    SOFTWARE-PRACTICE & EXPERIENCE, 2006, 36 (11-12): : 1307 - 1330
  • [33] Using self-adapting navigation data for intelligent, personalized vehicle guidance
    Vesely, Michal
    Mayr, Herwig
    COMPUTER AIDED SYSTEMS THEORY- EUROCAST 2007, 2007, 4739 : 1097 - 1104
  • [34] Enhancing the diversity of self-replicating structures using active self-adapting mechanisms
    Xu, Wenli
    Wu, Chunrong
    Peng, Qinglan
    Lee, Jia
    Xia, Yunni
    Kawasaki, Shuji
    FRONTIERS IN GENETICS, 2022, 13
  • [35] A new whale optimisation algorithm based on self-adapting parameter adjustment and mix mutation strategy
    Tong, Wangyu
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2020, 33 (10-11) : 949 - 961
  • [36] Deep reinforcement learning based parameter self-tuning control strategy for VSG
    Xiong, Kang
    Hu, Weihao
    Zhang, Guozhou
    Zhang, Zhenyuan
    Chen, Zhe
    ENERGY REPORTS, 2022, 8 : 219 - 226
  • [37] Investigation of Self-adapting Genetic Algorithms Using Some Multimodal Benchmark Functions
    Smetek, Magdalena
    Trawinski, Bogdan
    COMPUTATIONAL COLLECTIVE INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS, PT I, 2011, 6922 : 213 - 223
  • [38] Online evolution for a self-adapting robotic navigation system using evolvable hardware
    Keymeulen, D
    Iwata, M
    Kuniyoshi, Y
    Higuchi, T
    ARTIFICIAL LIFE, 1998, 4 (04) : 359 - 393
  • [39] GPS Positioning-based Trajectory Parameter Estimation and Ejection Point Self-adapting Control Method
    Shen, Qiang
    He, Xin
    2009 SECOND INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING: KAM 2009, VOL 3, 2009, : 194 - 197
  • [40] Adaptive manufacturing control with Deep Reinforcement Learning for dynamic WIP management in industry 4.0
    Vespoli, Silvestro
    Mattera, Giulio
    Marchesano, Maria Grazia
    Nele, Luigi
    Guizzi, Guido
    COMPUTERS & INDUSTRIAL ENGINEERING, 2025, 202