DeepMCTS: Deep Reinforcement Learning Assisted Monte Carlo Tree Search for MIMO Detection

被引:3
|
作者
Mo, Tz-Wei [1 ]
Chang, Ronald Y. [1 ]
Kan, Te-Yi [1 ]
机构
[1] Acad Sinica, Res Ctr Informat Technol Innovat, Taipei, Taiwan
关键词
MIMO detection; neural networks; deep reinforcement learning; Monte Carlo tree search; SOFT INTERFERENCE CANCELLATION;
D O I
10.1109/VTC2022-Spring54318.2022.9860565
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. A self-designed deep reinforcement learning agent, consisting of a policy value network and a state value network, is trained to detect MIMO symbols. The outputs of the trained networks are adopted into a modified MCTS detection algorithm to provide useful node statistics and facilitate enhanced tree search process. The resulted scheme, termed the DeepMCTS detector, demonstrates significant performance and complexity advantages over the original MCTS detection algorithm under varying channel conditions.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Developing an Adaptive AI Agent using Supervised and Reinforcement Learning with Monte Carlo Tree Search in FightingICE
    Tomas, John Paul Q.
    Aguas, Nathanael Jhonn R.
    De Villa, Angela N.
    Lim, Jasmin Rose G.
    2021 THE 4TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INTELLIGENT SYSTEMS, CIIS 2021, 2021, : 31 - 36
  • [32] Autonomous maneuver decision-making method based on reinforcement learning and Monte Carlo tree search
    Zhang, Hongpeng
    Zhou, Huan
    Wei, Yujie
    Huang, Changqiang
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [33] Intelligent Adjustment Approach for Train Operation Based on Monte Carlo Tree Search-Reinforcement Learning
    Wang R.
    Zhang Q.
    Zhang T.
    Wang T.
    Ding S.
    Zhongguo Tiedao Kexue/China Railway Science, 2022, 43 (05): : 146 - 156
  • [34] Routing optimization with Monte Carlo Tree Search-based multi-agent reinforcement learning
    Wang, Qi
    Hao, Yongsheng
    APPLIED INTELLIGENCE, 2023, 53 (21) : 25881 - 25896
  • [35] Scalable and efficient bayes-adaptive reinforcement learning based on Monte-Carlo tree search
    Guez, Arthur
    Silver, David
    Dayan, Peter
    1600, AI Access Foundation (48): : 841 - 883
  • [36] Monte Carlo tree search algorithms for risk-aware and multi-objective reinforcement learning
    Hayes, Conor F.
    Reymond, Mathieu
    Roijers, Diederik M.
    Howley, Enda
    Mannion, Patrick
    AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2023, 37 (02)
  • [37] Automated Machine Learning with Monte-Carlo Tree Search
    Rakotoarison, Herilalaina
    Schoenauer, Marc
    Sebag, Michele
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3296 - 3303
  • [38] A Monte Carlo tree search approach to learning decision trees
    Nunes, Cecilia
    De Craene, Mathieu
    Langet, Helene
    Camara, Oscar
    Jonsson, Anders
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 429 - 435
  • [39] Industrial scheduling with Monte Carlo tree search and machine learning
    Lubosch, Marco
    Kunath, Martin
    Winkler, Herwig
    51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 : 1283 - 1287
  • [40] Learning to Stop: Dynamic Simulation Monte Carlo Tree Search
    Lan, Li-Cheng
    Wu, Ti-Rong
    Wu, I-Chen
    Hsieh, Cho-Jui
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 259 - 267