Satellite Autonomous Mission Planning Based on Improved Monte Carlo Tree Search

被引:0
|
作者
Li, Zichao [1 ]
Li, You [1 ]
Luo, Rongzheng [2 ]
机构
[1] Xidian Univ, Sch Aerosp Sci & Technol, Xian 710126, Peoples R China
[2] China Acad Space Technol, Inst Remote Sensing Satellite, Beijing 100094, Peoples R China
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 08期
关键词
Monte Carlo tree search; timeliness; autonomous mission planning;
D O I
10.3390/sym16081039
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This paper improves the timeliness of satellite mission planning to cope with the rapid response to changes. In this paper, satellite mission planning is investigated. Firstly, the satellite dynamics model and mission planning model are established, and an improved Monte Carlo tree (Improved-MCTS) algorithm is proposed, which utilizes the Monte Carlo tree search in combination with the state uncertainty network (State-UN) to reduce the time of exploring the nodes (At the MCTS selection stage, the exploration of nodes specifically refers to the algorithm needing to decide whether to choose nodes that have already been visited (exploitation) or nodes that have not been visited yet (exploration)). The results show that this algorithm performs better in terms of profit (in this paper, the observation task is given a weight of 0-1, and each planned task will receive a profit; that is, a profit will be assigned at the initial moment) and convergence speed compared to the ant colony algorithm (ACO) and the asynchronous advantage actor critic (A3C).
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Scalable Monte Carlo Tree Search for CAVs Action Planning in Colliding Scenarios
    Patel, Dhruvkumar
    Zalila-Wenkstern, Rym
    2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 1065 - 1072
  • [42] Pareto Monte Carlo Tree Search for Multi-Objective Informative Planning
    Chen, Weizhe
    Liu, Lantao
    ROBOTICS: SCIENCE AND SYSTEMS XV, 2019,
  • [43] Decentralized Cooperative Planning for Automated Vehicles with Continuous Monte Carlo Tree Search
    Kurzer, Karl
    Engelhorn, Florian
    Zoellner, J. Marius
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 452 - 459
  • [44] Nested Monte-Carlo Tree Search for Online Planning in Large MDPs
    Baier, Hendrik
    Winands, Mark H. M.
    20TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (ECAI 2012), 2012, 242 : 109 - 114
  • [45] Decentralized Cooperative Planning for Automated Vehicles with Hierarchical Monte Carlo Tree Search
    Kurzer, Karl
    Zhou, Chenyang
    Zoellner, J. Marius
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 529 - 536
  • [46] Decoupled Monte Carlo Tree Search for Cooperative Multi-Agent Planning
    Asik, Okan
    Aydemir, Fatma Basak
    Akin, Huseyin Levent
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [47] Multi-objective synthesis planning by means of Monte Carlo Tree search
    Lai, Helen
    Kannas, Christos
    Hassen, Alan Kai
    Granqvist, Emma
    Westerlund, Annie M.
    Clevert, Djork-Arne
    Preuss, Mike
    Genheden, Samuel
    ARTIFICIAL INTELLIGENCE IN THE LIFE SCIENCES, 2025, 7
  • [48] Adaptive Reward for CAV Action Planning using Monte Carlo Tree Search
    Patel, Dhruvkumar
    Zalila-Wenkstern, Rym
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 1105 - 1111
  • [49] A SHOGI PROGRAM BASED ON MONTE-CARLO TREE SEARCH
    Sato, Yoshikuni
    Takahashi, Daisuke
    Grimbergen, Reijer
    ICGA JOURNAL, 2010, 33 (02) : 80 - 92
  • [50] MOTiFS: Monte Carlo Tree Search Based Feature Selection
    Chaudhry, Muhammad Umar
    Lee, Jee-Hyong
    ENTROPY, 2018, 20 (05)