Monte-Carlo Tree Search in Dragline Operation Planning

被引:1
|
作者
Liu, Haoquan [1 ]
Austin, Kevin [1 ]
Forbes, Michael [2 ]
Kearney, Michael [1 ]
机构
[1] Univ Queensland, Sch Mech & Min Engn, Brisbane, Qld 4072, Australia
[2] Univ Queensland, Sch Math & Phys, Brisbane, Qld 4072, Australia
来源
关键词
Optimization and optimal control; mining robotics; Monte-Carlo tree search (MCTS); excavation planning; AUTOMATION;
D O I
10.1109/LRA.2017.2757964
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Draglines are one of the largest earthmoving machines in surface mining. They are employed to remove the overburden near the surface, giving access to a seam of the target mineral or coal underneath. Their excavation productivity is significantly affected by the high-level operation strategy of where to position the dragline, what to dig at each position and where to dump the removed material. This letter explores the potential of using the Monte-Carlo tree search (MCTS) algorithm for planning this operation strategy. To this end, we adapt the MCTS algorithm to compute the dragline positioning sequences when a fixed digging and dumping strategy is applied at each position. The performance of the adapted MCTS algorithm is compared to a previously developed A* search algorithm and a greedy algorithm. Simulation results show that the MCTS algorithm is able to find near-optimal positioning sequences using significantly less time and memory than the A* algorithm. The solutions from the MCTS algorithm also largely outperform the solutions from the greedy algorithm in all the test scenarios. These results suggest that the MCTS algorithm can be used to plan the operation strategy when decisions about the digging and dumping operations are also considered.
引用
收藏
页码:419 / 425
页数:7
相关论文
共 50 条
  • [41] Monte-Carlo Tree Search for Scalable Coalition Formation
    Wu, Feng
    Ramchurn, Sarvapali D.
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 407 - 413
  • [42] EXPERIMENTS WITH MONTE-CARLO TREE SEARCH IN THE GAME OF HAVANNAH
    Lorentz, Richard J.
    ICGA JOURNAL, 2011, 34 (03) : 140 - 149
  • [43] Monte-Carlo tree search as regularized policy optimization
    Grill, Jean-Bastien
    Altche, Florent
    Tang, Yunhao
    Hubert, Thomas
    Valko, Michal
    Antonoglou, Ioannis
    Munos, Remi
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [44] Monte-Carlo tree search for Bayesian reinforcement learning
    Ngo Anh Vien
    Wolfgang Ertel
    Viet-Hung Dang
    TaeChoong Chung
    Applied Intelligence, 2013, 39 : 345 - 353
  • [45] Using evaluation functions in Monte-Carlo Tree Search
    Lorentz, Richard
    THEORETICAL COMPUTER SCIENCE, 2016, 644 : 106 - 113
  • [46] Monte-Carlo tree search for Bayesian reinforcement learning
    Ngo Anh Vien
    Ertel, Wolfgang
    Viet-Hung Dang
    Chung, TaeChoong
    APPLIED INTELLIGENCE, 2013, 39 (02) : 345 - 353
  • [47] Backpropagation Modification in Monte-Carlo Game Tree Search
    Xie, Fan
    Liu, Zhiqing
    2009 THIRD INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL 2, PROCEEDINGS, 2009, : 125 - 128
  • [48] Single-Player Monte-Carlo Tree Search
    Schadd, Maarten P. D.
    Winands, Mark H. M.
    van den Herik, H. Jaap
    Chaslot, Guillaume M. J. -B.
    Uiterwijk, Jos W. H. M.
    COMPUTERS AND GAMES, 2008, 5131 : 1 - +
  • [49] Combining Monte-Carlo Tree Search with Proof-Number Search
    Doe, Elliot
    Winands, Mark H. M.
    Soemers, Dennis J. N. J.
    Browne, Cameron
    2022 IEEE CONFERENCE ON GAMES, COG, 2022, : 206 - 212
  • [50] Planning spatial networks with Monte Carlo tree search
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2023, 479 (2269):