Towards a Deep Reinforcement Learning Model of Master Bay Stowage Planning

被引:1
|
作者
Van Twiller, Jaike [1 ]
Grbic, Djordje [1 ]
Jensen, Rune Moller [1 ]
机构
[1] IT Univ Copenhagen, Rued Langgaards Vej 7, DK-2300 Copenhagen, Denmark
来源
关键词
Maritime logistics; Liner shipping; Stowage planning; Deep reinforcement learning; Markov decision processes; CONTAINER SHIPS; METHODOLOGY; ALGORITHM; NUMBER; REDUCE;
D O I
10.1007/978-3-031-43612-3_6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Major liner shipping companies aim to solve the stowage planning problem by optimally allocating containers to vessel locations during a multi-port voyage. Due to a large variety of combinatorial aspects, a scalable algorithm to solve a representative problem is yet to be found. This paper will show that deep reinforcement learning can optimize a non-trivial master bay planning problem. Our experiments show that proximal policy optimization efficiently finds reasonable solutions, serving as preliminary evidence of the potential value of deep reinforcement learning in stowage planning. In future work, we will extend our architecture to address a full-featured master bay planning problem.
引用
收藏
页码:105 / 121
页数:17
相关论文
共 50 条
  • [11] Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning
    Xie, Yuansheng
    Vosoughi, Soroush
    Hassanpour, Saeed
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 5067 - 5074
  • [12] Towards Knowledge Transfer in Deep Reinforcement Learning
    Glatt, Ruben
    da Silva, Felipe Leno
    Reali Costa, Anna Helena
    PROCEEDINGS OF 2016 5TH BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS 2016), 2016, : 91 - 96
  • [13] RARSMSDou: Master the Game of DouDiZhu With Deep Reinforcement Learning Algorithms
    Luo, Qian
    Tan, Tien-Ping
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 427 - 439
  • [14] An LNS Approach for Container Stowage Multi-port Master Planning
    Pacino, Dario
    COMPUTATIONAL LOGISTICS, ICCL 2013, 2013, 8197 : 35 - 44
  • [15] Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning
    You, Changxi
    Lu, Jianbo
    Filev, Dimitar
    Tsiotras, Panagiotis
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 114 : 1 - 18
  • [16] Towards Automated Imbalanced Learning with Deep Hierarchical Reinforcement Learning
    Zha, Daochen
    Lai, Kwei-Herng
    Tan, Qiaoyu
    Ding, Sirui
    Zou, Na
    Hu, Xia Ben
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2476 - 2485
  • [17] Study on bay-filling problem in stowage planning of export containers
    Zhao, Ning
    Shen, Yifan
    Chai, Jiaqi
    Mi, Chao
    Mi, Weijian
    Information Technology Journal, 2013, 12 (21) : 5967 - 5974
  • [18] Deep reinforcement learning for motion planning of mobile robots
    Sun H.-H.
    Hu C.-H.
    Zhang J.-G.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (06): : 1281 - 1292
  • [19] Socially Aware Motion Planning with Deep Reinforcement Learning
    Chen, Yu Fan
    Everett, Michael
    Liu, Miao
    How, Jonathan P.
    2017 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2017, : 1343 - 1350
  • [20] Consistent epistemic planning for multiagent deep reinforcement learning
    Peiliang Wu
    Shicheng Luo
    Liqiang Tian
    Bingyi Mao
    Wenbai Chen
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 1663 - 1675