Deep Reinforcement Learning Based Optimization Algorithm for Permutation Flow-Shop Scheduling

被引:65
|
作者
Pan, Zixiao [1 ]
Wang, Ling [1 ]
Wang, Jingjing [1 ]
Lu, Jiawen [2 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Huawei Noahs Ark Lab, Shenzhen 518129, Peoples R China
基金
中国国家自然科学基金;
关键词
Optimization; Job shop scheduling; Decoding; Reinforcement learning; Dynamic scheduling; Encoding; Computational intelligence; deep neural network; flow-shop scheduling; optimization algorithm; improvement strategy; HEURISTIC ALGORITHM; MINIMIZE MAKESPAN; M-MACHINE; N-JOB;
D O I
10.1109/TETCI.2021.3098354
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a new analogy paradigm of human learning process, reinforcement learning (RL) has become an emerging topic in computational intelligence (CI). The synergy between the RL and CI is an emerging way to develop efficient solution algorithms for solving complex combinatorial optimization (CO) problems like machine scheduling problem. In this paper, we proposed an efficient optimization algorithm based on Deep RL for solving permutation flow-shop scheduling problem (PFSP) to minimize the maximum completion time. Firstly, a new deep neural network (PFSPNet) is designed for the PFSP to achieve the end-to-end output without limitation of problem sizes. Secondly, an actor-critic method of RL is used to train the PFSPNet without depending on the collection of high-quality labelled data. Thirdly, an improvement strategy is designed to refine the solution provided by the PFSPNet. Simulation results and statistical comparison show that the proposed optimization algorithm based on deep RL can obtain better results than the existing heuristics in similar computational time for solving the PFSP.
引用
收藏
页码:983 / 994
页数:12
相关论文
共 50 条
  • [21] A hybrid discrete fruit fly optimization algorithm for solving permutation flow-shop scheduling problem
    Wang, L. (wangling@tsinghua.edu.cn), 1600, South China University of Technology (31):
  • [22] A DISCRETE BUTTERFLY-INSPIRED OPTIMIZATION ALGORITHM FOR SOLVING PERMUTATION FLOW-SHOP SCHEDULING PROBLEMS
    Qi, X.
    Yuan, Z.
    Han, X.
    Liu, S.
    NEURAL NETWORK WORLD, 2020, 30 (04) : 211 - 229
  • [23] Multimodal Optimization of Permutation Flow-Shop Scheduling Problems Using a Clustering-Genetic-Algorithm-Based Approach
    Zou, Pan
    Rajora, Manik
    Liang, Steven Y.
    APPLIED SCIENCES-BASEL, 2021, 11 (08):
  • [24] Permutation flow-shop scheduling using a hybrid differential evolution algorithm
    Wang, Hai-yan
    Lu, Ye-bo
    Peng, Wen-li
    INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2013, 4 (03) : 298 - 307
  • [25] An effective hybrid biogeography-based optimization algorithm for the distributed assembly permutation flow-shop scheduling problem
    Lin, Jian
    Zhang, Shuai
    COMPUTERS & INDUSTRIAL ENGINEERING, 2016, 97 : 128 - 136
  • [26] A novel deep reinforcement learning-based algorithm for multi-objective energy-efficient flow-shop scheduling
    Liang, Peng
    Xiao, Pengfei
    Li, Zeya
    Luo, Min
    Zhang, Chaoyong
    IET COLLABORATIVE INTELLIGENT MANUFACTURING, 2024, 6 (04)
  • [27] A Reinforcement Learning Method for a Hybrid Flow-Shop Scheduling Problem
    Han, Wei
    Guo, Fang
    Su, Xichao
    ALGORITHMS, 2019, 12 (11)
  • [28] Ant colony optimization based algorithm for permutation flow shop scheduling
    Liu, Yan-Feng
    Liu, San-Yang
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2008, 30 (09): : 1690 - 1692
  • [29] A Reinforcement Learning Approach to Robust Scheduling of Permutation Flow Shop
    Zhou, Tao
    Luo, Liang
    Ji, Shengchen
    He, Yuanxin
    BIOMIMETICS, 2023, 8 (06)
  • [30] A hybrid ant colony optimization algorithm for permutation flow-shop scheduling in manufacturing systems and industrial process
    Chen, Jing
    Zhang, Xiaoxia
    Ma, Yunyong
    ADVANCED RESEARCH ON MECHANICAL ENGINEERING, INDUSTRY AND MANUFACTURING ENGINEERING III, 2013, 345 : 438 - 441