DeepMCTS: Deep Reinforcement Learning Assisted Monte Carlo Tree Search for MIMO Detection

被引:3
|
作者
Mo, Tz-Wei [1 ]
Chang, Ronald Y. [1 ]
Kan, Te-Yi [1 ]
机构
[1] Acad Sinica, Res Ctr Informat Technol Innovat, Taipei, Taiwan
关键词
MIMO detection; neural networks; deep reinforcement learning; Monte Carlo tree search; SOFT INTERFERENCE CANCELLATION;
D O I
10.1109/VTC2022-Spring54318.2022.9860565
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. A self-designed deep reinforcement learning agent, consisting of a policy value network and a state value network, is trained to detect MIMO symbols. The outputs of the trained networks are adopted into a modified MCTS detection algorithm to provide useful node statistics and facilitate enhanced tree search process. The resulted scheme, termed the DeepMCTS detector, demonstrates significant performance and complexity advantages over the original MCTS detection algorithm under varying channel conditions.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Intelligent Massive MIMO Antenna Selection Using Monte Carlo Tree Search
    Chen, Jienan
    Chen, Siyu
    Qi, Yunlong
    Fu, Shengli
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (20) : 5380 - 5390
  • [42] Using Deep Convolutional Neural Networks in Monte Carlo Tree Search
    Graf, Tobias
    Platzner, Marco
    COMPUTERS AND GAMES, CG 2016, 2016, 10068 : 11 - 21
  • [43] MapZero: Mapping for Coarse-grained Reconfigurable Architectures with Reinforcement Learning and Monte-Carlo Tree Search
    Kong, Xiangyu
    Huang, Yi
    Zhu, Jianfeng
    Man, Xingchen
    Liu, Yang
    Feng, Chunyang
    Gou, Pengfei
    Tang, Minggui
    Wei, Shaojun
    Liu, Leibo
    PROCEEDINGS OF THE 2023 THE 50TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE, ISCA 2023, 2023, : 646 - 659
  • [44] Wind farm layout optimization using adaptive evolutionary algorithm with Monte Carlo Tree Search reinforcement learning
    Bai, Fangyun
    Ju, Xinglong
    Wang, Shouyi
    Zhou, Wenyong
    Liu, Feng
    Energy Conversion and Management, 2022, 252
  • [45] Beyond Trial and Error: Lane Keeping with Monte Carlo Tree Search-Driven Optimization of Reinforcement Learning
    Kovari, Balint
    Pelenczei, Balint
    Knab, Istvan Gellert
    Becsi, Tamas
    ELECTRONICS, 2024, 13 (11)
  • [46] A Reinforcement Learning Application of Guided Monte Carlo Tree Search Algorithm for Beam Orientation Selection in Radiation Therapy
    Barkousaraie, A. Sadeghnejad
    Ogunmolu, O.
    Jiang, S.
    Nguyen, D.
    MEDICAL PHYSICS, 2019, 46 (06) : E236 - E236
  • [47] Wind farm layout optimization using adaptive evolutionary algorithm with Monte Carlo Tree Search reinforcement learning
    Bai, Fangyun
    Ju, Xinglong
    Wang, Shouyi
    Zhou, Wenyong
    Liu, Feng
    ENERGY CONVERSION AND MANAGEMENT, 2022, 252
  • [48] A reinforcement learning application of a guided Monte Carlo Tree Search algorithm for beam orientation selection in radiation therapy
    Sadeghnejad-Barkousaraie, Azar
    Bohara, Gyanendra
    Jiang, Steve
    Nguyen, Dan
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (03):
  • [49] Neural Architecture Search Using Deep Neural Networks and Monte Carlo Tree Search
    Wang, Linnan
    Zhao, Yiyang
    Yuu Jinnai
    Tian, Yuandong
    Fonseca, Rodrigo
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9983 - 9991
  • [50] Multiagent Monte Carlo Tree Search
    Zerbel, Nicholas
    Yliniemi, Logan
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 2309 - 2311