Monte-Carlo Tree Search in Dragline Operation Planning

被引:1
|
作者
Liu, Haoquan [1 ]
Austin, Kevin [1 ]
Forbes, Michael [2 ]
Kearney, Michael [1 ]
机构
[1] Univ Queensland, Sch Mech & Min Engn, Brisbane, Qld 4072, Australia
[2] Univ Queensland, Sch Math & Phys, Brisbane, Qld 4072, Australia
来源
关键词
Optimization and optimal control; mining robotics; Monte-Carlo tree search (MCTS); excavation planning; AUTOMATION;
D O I
10.1109/LRA.2017.2757964
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Draglines are one of the largest earthmoving machines in surface mining. They are employed to remove the overburden near the surface, giving access to a seam of the target mineral or coal underneath. Their excavation productivity is significantly affected by the high-level operation strategy of where to position the dragline, what to dig at each position and where to dump the removed material. This letter explores the potential of using the Monte-Carlo tree search (MCTS) algorithm for planning this operation strategy. To this end, we adapt the MCTS algorithm to compute the dragline positioning sequences when a fixed digging and dumping strategy is applied at each position. The performance of the adapted MCTS algorithm is compared to a previously developed A* search algorithm and a greedy algorithm. Simulation results show that the MCTS algorithm is able to find near-optimal positioning sequences using significantly less time and memory than the A* algorithm. The solutions from the MCTS algorithm also largely outperform the solutions from the greedy algorithm in all the test scenarios. These results suggest that the MCTS algorithm can be used to plan the operation strategy when decisions about the digging and dumping operations are also considered.
引用
收藏
页码:419 / 425
页数:7
相关论文
共 50 条
  • [21] KB-Tree: Learnable and Continuous Monte-Carlo Tree Search for Autonomous Driving Planning
    Lei, Lanxin
    Luo, Ruiming
    Zheng, Renjie
    Wang, Jingke
    Zhang, JianWei
    Qiu, Cong
    Ma, Liulong
    Jin, Liyang
    Zhang, Ping
    Chen, Junbo
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 4493 - 4500
  • [22] Multiple Tree for Partially Observable Monte-Carlo Tree Search
    Auger, David
    APPLICATIONS OF EVOLUTIONARY COMPUTATION, PT I, 2011, 6624 : 53 - 62
  • [23] Tactical Cooperative Planning for Autonomous Highway Driving using Monte-Carlo Tree Search
    Lenz, David
    Kessler, Tobias
    Knoll, Alois
    2016 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2016, : 447 - 453
  • [24] From Bandits to Monte-Carlo Tree Search: The Optimistic Principle Applied to Optimization and Planning
    Munos, Remi
    FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2014, 7 (01): : 1 - 129
  • [25] Monte-Carlo tree search as regularized policy optimization
    Grill, Jean-Bastien
    Altche, Florent
    Tang, Yunhao
    Hubert, Thomas
    Valko, Michal
    Antonoglou, Ioannis
    Munos, Remi
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [26] Converging to a Player Model In Monte-Carlo Tree Search
    Sarratt, Trevor
    Pynadath, David V.
    Jhala, Arnav
    2014 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND GAMES (CIG), 2014,
  • [27] A SHOGI PROGRAM BASED ON MONTE-CARLO TREE SEARCH
    Sato, Yoshikuni
    Takahashi, Daisuke
    Grimbergen, Reijer
    ICGA JOURNAL, 2010, 33 (02) : 80 - 92
  • [28] AIs for Dominion Using Monte-Carlo Tree Search
    Tollisen, Robin
    Jansen, Jon Vegard
    Goodwin, Morten
    Glimsdal, Sondre
    CURRENT APPROACHES IN APPLIED ARTIFICIAL INTELLIGENCE, 2015, 9101 : 43 - 52
  • [29] Parallel Monte-Carlo Tree Search with Simulation Servers
    Kato, Hideki
    Takeuchi, Ikuo
    INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2010), 2010, : 491 - 498
  • [30] Generalized Mean Estimation in Monte-Carlo Tree Search
    Dam, Tuan
    Klink, Pascal
    D'Eramo, Carlo
    Peters, Jan
    Pajarinen, Joni
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2397 - 2404