Literacy Deep Reinforcement Learning-Based Federated Digital Twin Scheduling for the Software-Defined Factory

被引:0
|
作者
Ahn, Jangsu [1 ]
Yun, Seongjin [1 ]
Kwon, Jin-Woo [1 ]
Kim, Won-Tae [1 ]
机构
[1] Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn Major, Cheonan 31253, South Korea
关键词
industrial metaverse; federated digital twins; large language model; flexible job-shop; scheduling; the software-defined factory; MASS CUSTOMIZATION;
D O I
10.3390/electronics13224452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As user requirements become increasingly complex, the demand for product personalization is growing, but traditional hardware-centric production relies on fixed procedures that lack the flexibility to support diverse requirements. Although bespoke manufacturing has been introduced, it provides users with only a few standardized options, limiting its ability to meet a wide range of needs. To address this issue, a new manufacturing concept called the software-defined factory has emerged. It is an autonomous manufacturing system that provides reconfigurable manufacturing services to produce tailored products. Reinforcement learning has been suggested for flexible scheduling to satisfy user requirements. However, fixed rule-based methods struggle to accommodate conflicting needs. This study proposes a novel federated digital twin scheduling that combines large language models and deep reinforcement learning algorithms to meet diverse user requirements in the software-defined factory. The large language model-based literacy module analyzes requirements in natural language and assigns weights to digital twin attributes to achieve highly relevant KPIs, which are used to guide scheduling decisions. The deep reinforcement learning-based scheduling module optimizes scheduling by selecting the job and machine with the maximum reward. Different types of user requirements, such as reducing manufacturing costs and improving productivity, are input and evaluated by comparing the flow-shop scheduling with job-shop scheduling based on reinforcement learning. Experimental results indicate that in requirement case 1 (the manufacturing cost), the proposed method outperforms flow-shop scheduling by up to 14.9% and job-shop scheduling by 5.6%. For requirement case 2 (productivity), it exceeds the flow-shop method by up to 13.4% and the job-shop baseline by 7.2%. The results confirm that the literacy DRL scheduling proposed in this paper can handle the individual characteristics of requirements.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] DRSIR: A Deep Reinforcement Learning Approach for Routing in Software-Defined Networking
    Casas-Velasco, Daniela M.
    Rendon, Oscar Mauricio Caicedo
    da Fonseca, Nelson L. S.
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4807 - 4820
  • [22] Deep Reinforcement Learning for the management of Software-Defined Networks in Smart Farming
    Alonso, Ricardo S.
    Sitton-Candanedo, Ines
    Casado-Vara, Roberto
    Prieto, Javier
    Corchado, Juan M.
    2020 INTERNATIONAL CONFERENCE ON OMNI-LAYER INTELLIGENT SYSTEMS (IEEE COINS 2020), 2020, : 135 - 140
  • [23] DROM: Optimizing the Routing in Software-Defined Networks With Deep Reinforcement Learning
    Yu, Changhe
    Lan, Julong
    Guo, Zehua
    Hu, Yuxiang
    IEEE ACCESS, 2018, 6 : 64533 - 64539
  • [24] Deep Learning-Based Approach for Detecting DDoS Attack on Software-Defined Networking Controller
    Mansoor, Amran
    Anbar, Mohammed
    Bahashwan, Abdullah Ahmed
    Alabsi, Basim Ahmad
    Rihan, Shaza Dawood Ahmed
    SYSTEMS, 2023, 11 (06):
  • [25] Deep Learning-Based Traffic Prediction for Energy Efficiency Optimization in Software-Defined Networking
    Chen, Xiangyi
    Wang, Xingwei
    Yi, Bo
    He, Qiang
    Huang, Min
    IEEE SYSTEMS JOURNAL, 2021, 15 (04): : 5583 - 5594
  • [26] DEEP REINFORCEMENT LEARNING-BASED IRRIGATION SCHEDULING
    Yang, Y.
    Hu, J.
    Porter, D.
    Marek, T.
    Heflin, K.
    Kong, H.
    Sun, L.
    TRANSACTIONS OF THE ASABE, 2020, 63 (03) : 549 - 556
  • [27] Intelligent Routing Based on Reinforcement Learning for Software-Defined Networking
    Casas-Velasco, Daniela M.
    Rendon, Oscar Mauricio Caicedo
    da Fonseca, Nelson L. S.
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (01): : 870 - 881
  • [28] Intelligent Digital Twin-Based Software-Defined Vehicular Networks
    Zhao, Liang
    Han, Guangjie
    Li, Zhuhui
    Shu, Lei
    IEEE NETWORK, 2020, 34 (05): : 178 - 184
  • [29] Applying Federated Learning in Software-Defined Networks: A Survey
    Ma, Xiaohang
    Liao, Lingxia
    Li, Zhi
    Lai, Roy Xiaorong
    Zhang, Miao
    SYMMETRY-BASEL, 2022, 14 (02):
  • [30] Mix-flow scheduling using deep reinforcement learning for software-defined data-center networks
    Liu, Wai-Xi
    Cai, Jun
    Wang, Yu
    Chen, Qing C.
    Tang, Dong
    INTERNET TECHNOLOGY LETTERS, 2019, 2 (03)