DeepMCTS: Deep Reinforcement Learning Assisted Monte Carlo Tree Search for MIMO Detection

被引:3
|
作者
Mo, Tz-Wei [1 ]
Chang, Ronald Y. [1 ]
Kan, Te-Yi [1 ]
机构
[1] Acad Sinica, Res Ctr Informat Technol Innovat, Taipei, Taiwan
关键词
MIMO detection; neural networks; deep reinforcement learning; Monte Carlo tree search; SOFT INTERFERENCE CANCELLATION;
D O I
10.1109/VTC2022-Spring54318.2022.9860565
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. A self-designed deep reinforcement learning agent, consisting of a policy value network and a state value network, is trained to detect MIMO symbols. The outputs of the trained networks are adopted into a modified MCTS detection algorithm to provide useful node statistics and facilitate enhanced tree search process. The resulted scheme, termed the DeepMCTS detector, demonstrates significant performance and complexity advantages over the original MCTS detection algorithm under varying channel conditions.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Maximum Entropy Inverse Reinforcement Learning Using Monte Carlo Tree Search for Autonomous Driving
    da Silva, Junior Anderson Rodrigues
    Grassi Jr, Valdir
    Wolf, Denis Fernando
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 11552 - 11562
  • [22] Towards efficient discovery of green synthetic pathways with Monte Carlo tree search and reinforcement learning
    Wang, Xiaoxue
    Qian, Yujie
    Gao, Hanyu
    Coley, Connor W.
    Mo, Yiming
    Barzilay, Regina
    Jensen, Klavs F.
    CHEMICAL SCIENCE, 2020, 11 (40) : 10959 - 10972
  • [23] Adaptive Playouts in Monte-Carlo Tree Search with Policy-Gradient Reinforcement Learning
    Graf, Tobias
    Platzner, Marco
    ADVANCES IN COMPUTER GAMES, ACG 2015, 2015, 9525 : 1 - 11
  • [24] Tensor Implementation of Monte-Carlo Tree Search for Model-Based Reinforcement Learning
    Balaz, Marek
    Tarabek, Peter
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [25] Design of a Block Go program using deep learning and Monte Carlo tree search
    Lin, Ching-Nung
    Chen, Jr-Chang
    Yen, Shi-Jim
    Chen, Chan-San
    ICGA JOURNAL, 2018, 40 (03) : 149 - 159
  • [26] Deep learning inspired routing in ICN using Monte Carlo Tree Search algorithm
    Dutta, Nitul
    Patel, Shobhit K.
    Samusenkov, Vadim
    Vigneswaran, D.
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2021, 150 : 104 - 111
  • [27] Monte-Carlo Tree Search and Reinforcement Learning for Reconfiguring Data Stream Processing on Edge Computing
    Veith, Alexandre da Silva
    de Assuncao, Marcos Dias
    Lefevre, Laurent
    2019 31ST INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD 2019), 2019, : 48 - 55
  • [28] Scalable and Efficient Bayes-Adaptive Reinforcement Learning Based on Monte-Carlo Tree Search
    Guez, Arthur
    Silver, David
    Dayan, Peter
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2013, 48 : 841 - 883
  • [29] Monte Carlo tree search algorithms for risk-aware and multi-objective reinforcement learning
    Conor F. Hayes
    Mathieu Reymond
    Diederik M. Roijers
    Enda Howley
    Patrick Mannion
    Autonomous Agents and Multi-Agent Systems, 2023, 37
  • [30] Routing optimization with Monte Carlo Tree Search-based multi-agent reinforcement learning
    Qi Wang
    Yongsheng Hao
    Applied Intelligence, 2023, 53 : 25881 - 25896