Satellite Autonomous Mission Planning Based on Improved Monte Carlo Tree Search

被引:0
|
作者
Li, Zichao [1 ]
Li, You [1 ]
Luo, Rongzheng [2 ]
机构
[1] Xidian Univ, Sch Aerosp Sci & Technol, Xian 710126, Peoples R China
[2] China Acad Space Technol, Inst Remote Sensing Satellite, Beijing 100094, Peoples R China
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 08期
关键词
Monte Carlo tree search; timeliness; autonomous mission planning;
D O I
10.3390/sym16081039
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This paper improves the timeliness of satellite mission planning to cope with the rapid response to changes. In this paper, satellite mission planning is investigated. Firstly, the satellite dynamics model and mission planning model are established, and an improved Monte Carlo tree (Improved-MCTS) algorithm is proposed, which utilizes the Monte Carlo tree search in combination with the state uncertainty network (State-UN) to reduce the time of exploring the nodes (At the MCTS selection stage, the exploration of nodes specifically refers to the algorithm needing to decide whether to choose nodes that have already been visited (exploitation) or nodes that have not been visited yet (exploration)). The results show that this algorithm performs better in terms of profit (in this paper, the observation task is given a weight of 0-1, and each planned task will receive a profit; that is, a profit will be assigned at the initial moment) and convergence speed compared to the ant colony algorithm (ACO) and the asynchronous advantage actor critic (A3C).
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Optimization Algorithm Based on Monte Carlo Tree Search for Single Satellite Task Planning
    Zhao, Jie
    Liu, Ruixia
    Han, Yang
    PROCEEDINGS OF THE 2024 3RD INTERNATIONAL SYMPOSIUM ON INTELLIGENT UNMANNED SYSTEMS AND ARTIFICIAL INTELLIGENCE, SIUSAI 2024, 2024, : 264 - 267
  • [2] A Path Planning Method Based on Improved Single Player-Monte Carlo Tree Search
    Xia, Yu-Wei
    Yang, Chao
    Chen, Bing-Qiu
    IEEE ACCESS, 2020, 8 : 163694 - 163702
  • [3] KB-Tree: Learnable and Continuous Monte-Carlo Tree Search for Autonomous Driving Planning
    Lei, Lanxin
    Luo, Ruiming
    Zheng, Renjie
    Wang, Jingke
    Zhang, JianWei
    Qiu, Cong
    Ma, Liulong
    Jin, Liyang
    Zhang, Ping
    Chen, Junbo
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 4493 - 4500
  • [4] Planning spatial networks with Monte Carlo tree search
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2023, 479 (2269):
  • [5] Interplanetary Trajectory Planning with Monte Carlo Tree Search
    Hennes, Daniel
    Izzo, Dario
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 769 - 775
  • [6] Tactical Cooperative Planning for Autonomous Highway Driving using Monte-Carlo Tree Search
    Lenz, David
    Kessler, Tobias
    Knoll, Alois
    2016 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2016, : 447 - 453
  • [7] The hierarchical task network planning method based on Monte Carlo Tree Search
    Shao, Tianhao
    Zhang, Hongjun
    Cheng, Kai
    Zhang, Ke
    Bie, Lin
    KNOWLEDGE-BASED SYSTEMS, 2021, 225
  • [8] Autonomous Demand-Side Management System Based on Monte Carlo Tree Search
    Galvan-Lopez, Edgar
    Harris, Colin
    Trujillo, Leonardo
    Rodriguez-Vazquez, Katya
    Clarke, Siobhan
    Cahill, Vinny
    2014 IEEE INTERNATIONAL ENERGY CONFERENCE (ENERGYCON 2014), 2014, : 1263 - 1270
  • [9] Monte Carlo Tree Search With Reinforcement Learning for Motion Planning
    Weingertner, Philippe
    Ho, Minnie
    Timofeev, Andrey
    Aubert, Sebastien
    Pita-Gil, Guillermo
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [10] Hierarchical Monte Carlo Tree Search for Latent Skill Planning
    Pei, Yue
    2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, : 6 - 12