Towards a Deep Reinforcement Learning Model of Master Bay Stowage Planning

被引:1
|
作者
Van Twiller, Jaike [1 ]
Grbic, Djordje [1 ]
Jensen, Rune Moller [1 ]
机构
[1] IT Univ Copenhagen, Rued Langgaards Vej 7, DK-2300 Copenhagen, Denmark
来源
关键词
Maritime logistics; Liner shipping; Stowage planning; Deep reinforcement learning; Markov decision processes; CONTAINER SHIPS; METHODOLOGY; ALGORITHM; NUMBER; REDUCE;
D O I
10.1007/978-3-031-43612-3_6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Major liner shipping companies aim to solve the stowage planning problem by optimally allocating containers to vessel locations during a multi-port voyage. Due to a large variety of combinatorial aspects, a scalable algorithm to solve a representative problem is yet to be found. This paper will show that deep reinforcement learning can optimize a non-trivial master bay planning problem. Our experiments show that proximal policy optimization efficiently finds reasonable solutions, serving as preliminary evidence of the potential value of deep reinforcement learning in stowage planning. In future work, we will extend our architecture to address a full-featured master bay planning problem.
引用
收藏
页码:105 / 121
页数:17
相关论文
共 50 条
  • [21] Assembly sequence planning based on deep reinforcement learning
    Zhao M.-H.
    Zhang X.-B.
    Guo X.
    Ou Y.-S.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2021, 38 (12): : 1901 - 1910
  • [22] Efficient Deep Reinforcement Learning for Optimal Path Planning
    Ren, Jing
    Huang, Xishi
    Huang, Raymond N.
    ELECTRONICS, 2022, 11 (21)
  • [23] Road Planning for Slums via Deep Reinforcement Learning
    Zheng, Yu
    Su, Hongyuan
    Ding, Jingtao
    Jin, Depeng
    Li, Yong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 5695 - 5706
  • [24] Task Planning in "Block World" with Deep Reinforcement Learning
    Ayunts, Edward
    Panov, Alekasndr I.
    BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES (BICA) FOR YOUNG SCIENTISTS, 2018, 636 : 3 - 9
  • [25] Robot path planning based on deep reinforcement learning
    Long, Yinxin
    He, Huajin
    2020 IEEE CONFERENCE ON TELECOMMUNICATIONS, OPTICS AND COMPUTER SCIENCE (TOCS), 2020, : 151 - 154
  • [26] Robot Path Planning Based on Deep Reinforcement Learning
    Zhang, Rui
    Jiang, Yuhao
    Wu Fenghua
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1697 - 1701
  • [27] Deep Reinforcement Learning for UAV Intelligent Mission Planning
    Yue, Longfei
    Yang, Rennong
    Zhang, Ying
    Yu, Lixin
    Wang, Zhuangzhuang
    COMPLEXITY, 2022, 2022
  • [28] Connectivity conservation planning through deep reinforcement learning
    Equihua, Julian
    Beckmann, Michael
    Seppelt, Ralf
    METHODS IN ECOLOGY AND EVOLUTION, 2024, 15 (04): : 779 - 790
  • [29] Deep Reinforcement Learning for Task Planning of Virtual Characters
    Souza, Caio
    Velhor, Luiz
    INTELLIGENT COMPUTING, VOL 2, 2021, 284 : 694 - 711
  • [30] Consistent epistemic planning for multiagent deep reinforcement learning
    Wu, Peiliang
    Luo, Shicheng
    Tian, Liqiang
    Mao, Bingyi
    Chen, Wenbai
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 1663 - 1675