Towards a Deep Reinforcement Learning Model of Master Bay Stowage Planning

被引:1
|
作者
Van Twiller, Jaike [1 ]
Grbic, Djordje [1 ]
Jensen, Rune Moller [1 ]
机构
[1] IT Univ Copenhagen, Rued Langgaards Vej 7, DK-2300 Copenhagen, Denmark
来源
关键词
Maritime logistics; Liner shipping; Stowage planning; Deep reinforcement learning; Markov decision processes; CONTAINER SHIPS; METHODOLOGY; ALGORITHM; NUMBER; REDUCE;
D O I
10.1007/978-3-031-43612-3_6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Major liner shipping companies aim to solve the stowage planning problem by optimally allocating containers to vessel locations during a multi-port voyage. Due to a large variety of combinatorial aspects, a scalable algorithm to solve a representative problem is yet to be found. This paper will show that deep reinforcement learning can optimize a non-trivial master bay planning problem. Our experiments show that proximal policy optimization efficiently finds reasonable solutions, serving as preliminary evidence of the potential value of deep reinforcement learning in stowage planning. In future work, we will extend our architecture to address a full-featured master bay planning problem.
引用
收藏
页码:105 / 121
页数:17
相关论文
共 50 条
  • [1] Lashing Force Prediction Model with Multimodal Deep Learning and AutoML for Stowage Planning Automation in Containerships
    Lee, Chaemin
    Lee, Mun Keong
    Shin, Jae Young
    LOGISTICS-BASEL, 2021, 5 (01):
  • [2] A DEEP Q-LEARNING NETWORK FOR SHIP STOWAGE PLANNING PROBLEM
    Shen, Yifan
    Zhao, Ning
    Xia, Mengjue
    Du, Xueqiang
    POLISH MARITIME RESEARCH, 2017, 24 : 102 - 109
  • [3] A decentralized path planning model based on deep reinforcement learning
    Guo, Dong
    Ji, Shouwen
    Yao, Yanke
    Chen, Cheng
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 117
  • [4] GAN-Based Planning Model in Deep Reinforcement Learning
    Chen, Song
    Jiang, Junpeng
    Zhang, Xiaofang
    Wu, Jinjin
    Lu, Gongzheng
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 323 - 334
  • [5] An Efficient Integer Programming Model for Solving the Master Planning Problem of Container Vessel Stowage
    van Twiller, Jaike
    Sivertsen, Agnieszka
    Jensen, Rune M.
    Andersen, Kent H.
    COMPUTATIONAL LOGISTICS, ICCL 2024, 2024, 15168 : 236 - 253
  • [6] Network Planning with Deep Reinforcement Learning
    Zhu, Hang
    Gupta, Varun
    Ahuja, Satyajeet Singh
    Tian, Yuandong
    Zhang, Ying
    Jin, Xin
    SIGCOMM '21: PROCEEDINGS OF THE 2021 ACM SIGCOMM 2021 CONFERENCE, 2021, : 258 - 271
  • [7] Towards a Deep Reinforcement Learning Solution to the Coverage Path Planning Problem<bold> </bold>
    Abdelaziz, Shaza I. Kaoud
    Noureldin, Aboelmagd
    Givigi, Sidney
    2024 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE 2024, 2024, : 152 - 153
  • [8] Strategic Workforce Planning with Deep Reinforcement Learning
    Smit, Yannick
    Den Hengst, Floris
    Bhulai, Sandjai
    Mehdad, Ehsan
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2022, PT II, 2023, 13811 : 108 - 122
  • [9] GROUP-BAY STOWAGE PLANNING PROBLEM FOR CONTAINER SHIP
    Shen Yifan
    Zhao Ning
    Mi Weijian
    POLISH MARITIME RESEARCH, 2016, 23 : 152 - 159
  • [10] An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning
    Guo, Siyu
    Zhang, Xiuguo
    Zheng, Yisong
    Du, Yiquan
    SENSORS, 2020, 20 (02)