Deep Reinforcement Learning for Semiconductor Production Scheduling

被引:0
|
作者
Waschneck, Bernd [1 ]
Reichstaller, Andre [2 ]
Belzner, Lenz [3 ]
Altenmueller, Thomas [4 ]
Bauernhansl, Thomas [5 ]
Knapp, Alexander [2 ]
Kyek, Andreas [4 ]
机构
[1] Univ Stuttgart, GSaME, Nobelstr 12, D-70569 Stuttgart, Germany
[2] Univ Augsburg, Inst Software & Syst Engn, Augsburg, Germany
[3] Lenz Belzner AI Consulting, Munich, Germany
[4] Infineon Technol AG, Campeon 1-12, D-85579 Neubiberg, Germany
[5] Fraunhofer Inst Mfg Engn & Automat IPA, Nobelstr 12, D-70569 Stuttgart, Germany
关键词
Production Scheduling; Reinforcement Learning; Machine Learning; Semiconductor Manufacturing;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite producing tremendous success stories by identifying cat videos [1] or solving computer as well as board games [2], [3], the adoption of deep learning in the semiconductor industry is moderatre. In this paper, we apply Google DeepMind's Deep Q Network (DQN) agent algorithm for Reinforcement Learning (RL) to semiconductor production scheduling. In an RL environment several cooperative DQN agents, which utilize deep neural networks, are trained with flexible user-defined objectives. We show benchmarks comparing standard dispatching heuristics with the DQN agents in an abstract frontend-of-line semiconductor production facility. Results are promising and show that DQN agents optimize production autonomously for different targets.
引用
收藏
页码:301 / 306
页数:6
相关论文
共 50 条
  • [1] Deep reinforcement learning based scheduling within production plan in semiconductor fabrication
    Lee, Young Hoon
    Lee, Seunghoon
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 191
  • [2] A Practical Deep Reinforcement Learning Approach to Semiconductor Equipment Scheduling
    Lee, Changhee
    Lee, Sunghee
    2021 22ND IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2021, : 979 - 985
  • [3] Optimization of global production scheduling with deep reinforcement learning
    Waschneck, Bernd
    Reichstaller, Andre
    Belzner, Lenz
    Altenmueller, Thomas
    Bauernhansl, Thomas
    Knapp, Alexander
    Kyek, Andreas
    51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 : 1264 - 1269
  • [4] A deep reinforcement learning approach for chemical production scheduling
    Hubbs, Christian D.
    Li, Can
    Sahinidis, Nikolaos, V
    Grossmann, Ignacio E.
    Wassick, John M.
    COMPUTERS & CHEMICAL ENGINEERING, 2020, 141
  • [5] Scalable Scheduling of Semiconductor Packaging Facilities Using Deep Reinforcement Learning
    Park, In-Beom
    Park, Jonghun
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) : 3518 - 3531
  • [6] Deep Reinforcement Learning for Long Term Hydropower Production Scheduling
    Riemer-Sorensen, Signe
    Rosenlund, Gjert H.
    2020 INTERNATIONAL CONFERENCE ON SMART ENERGY SYSTEMS AND TECHNOLOGIES (SEST), 2020,
  • [7] Deep reinforcement learning optimization scheduling algorithm for continuous production line
    Zhu, Guang-He
    Zhu, Zhi-Qiang
    Yuan, Yi-Ping
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (07): : 2086 - 2092
  • [8] Smart Master Production Scheduling by Deep Reinforcement Learning: An Exploratory Analysis
    Serrano-Ruiz, Julio C.
    Mula, Josefa
    Poler, Raul
    Diaz-Madronero, Manuel
    NAVIGATING UNPREDICTABILITY: COLLABORATIVE NETWORKS IN NON-LINEAR WORLDS, PRO-VE 2024, PT II, 2024, 727 : 228 - 244
  • [9] A DEEP REINFORCEMENT LEARNING APPROACH FOR PRODUCTION SCHEDULING IN COMPUTER SERVER INDUSTRY
    Radman, Azzam
    Aqlan, Faisal
    Parikh, Pratik
    Noor-E-Alam, Md
    PROCEEDINGS OF ASME 2024 19TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE, MSEC2024, VOL 2, 2024,
  • [10] Injection Mold Production Sustainable Scheduling Using Deep Reinforcement Learning
    Lee, Seunghoon
    Cho, Yongju
    Lee, Young Hoon
    SUSTAINABILITY, 2020, 12 (20) : 1 - 17