Monte-Carlo Tree Search in Dragline Operation Planning

被引:1
|
作者
Liu, Haoquan [1 ]
Austin, Kevin [1 ]
Forbes, Michael [2 ]
Kearney, Michael [1 ]
机构
[1] Univ Queensland, Sch Mech & Min Engn, Brisbane, Qld 4072, Australia
[2] Univ Queensland, Sch Math & Phys, Brisbane, Qld 4072, Australia
来源
关键词
Optimization and optimal control; mining robotics; Monte-Carlo tree search (MCTS); excavation planning; AUTOMATION;
D O I
10.1109/LRA.2017.2757964
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Draglines are one of the largest earthmoving machines in surface mining. They are employed to remove the overburden near the surface, giving access to a seam of the target mineral or coal underneath. Their excavation productivity is significantly affected by the high-level operation strategy of where to position the dragline, what to dig at each position and where to dump the removed material. This letter explores the potential of using the Monte-Carlo tree search (MCTS) algorithm for planning this operation strategy. To this end, we adapt the MCTS algorithm to compute the dragline positioning sequences when a fixed digging and dumping strategy is applied at each position. The performance of the adapted MCTS algorithm is compared to a previously developed A* search algorithm and a greedy algorithm. Simulation results show that the MCTS algorithm is able to find near-optimal positioning sequences using significantly less time and memory than the A* algorithm. The solutions from the MCTS algorithm also largely outperform the solutions from the greedy algorithm in all the test scenarios. These results suggest that the MCTS algorithm can be used to plan the operation strategy when decisions about the digging and dumping operations are also considered.
引用
收藏
页码:419 / 425
页数:7
相关论文
共 50 条
  • [1] Monte-Carlo Tree Search for Logistics
    Edelkamp, Stefan
    Gath, Max
    Greulich, Christoph
    Humann, Malte
    Herzog, Otthein
    Lawo, Michael
    COMMERCIAL TRANSPORT, 2016, : 427 - 440
  • [2] Parallel Monte-Carlo Tree Search
    Chaslot, Guillaume M. J. -B.
    Winands, Mark H. M.
    van den Herik, H. Jaap
    COMPUTERS AND GAMES, 2008, 5131 : 60 - +
  • [3] Monte-Carlo Tree Search Solver
    Winands, Mark H. M.
    Bjornsson, Yngvi
    Saito, Jahn-Takeshi
    COMPUTERS AND GAMES, 2008, 5131 : 25 - +
  • [4] Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning
    Labbe, Yann
    Zagoruyko, Sergey
    Kalevatykh, Igor
    Laptev, Ivan
    Carpentier, Justin
    Aubry, Mathieu
    Sivic, Josef
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 3715 - 3722
  • [5] Nested Monte-Carlo Tree Search for Online Planning in Large MDPs
    Baier, Hendrik
    Winands, Mark H. M.
    20TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (ECAI 2012), 2012, 242 : 109 - 114
  • [6] Monte-Carlo Tree Search with Tree Shape Control
    Marchenko, Oleksandr I.
    Marchenko, Oleksii O.
    2017 IEEE FIRST UKRAINE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (UKRCON), 2017, : 812 - 817
  • [7] Monte-Carlo Tree Search for Constrained POMDPs
    Lee, Jongmin
    Kim, Geon-Hyeong
    Poupart, Pascal
    Kim, Kee-Eung
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [8] Monte-Carlo Tree Search: To MC or to DP?
    Feldman, Zohar
    Domshlak, Carmel
    21ST EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (ECAI 2014), 2014, 263 : 321 - 326
  • [9] Monte-Carlo Tree Search in Settlers of Catan
    Szita, Istvan
    Chaslot, Guillaume
    Spronck, Pieter
    ADVANCES IN COMPUTER GAMES, 2010, 6048 : 21 - +
  • [10] Monte-Carlo Tree Search for Policy Optimization
    Ma, Xiaobai
    Driggs-Campbell, Katherine
    Zhang, Zongzhang
    Kochenderfer, Mykel J.
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3116 - 3122