DeepMCTS: Deep Reinforcement Learning Assisted Monte Carlo Tree Search for MIMO Detection

被引:3
|
作者
Mo, Tz-Wei [1 ]
Chang, Ronald Y. [1 ]
Kan, Te-Yi [1 ]
机构
[1] Acad Sinica, Res Ctr Informat Technol Innovat, Taipei, Taiwan
关键词
MIMO detection; neural networks; deep reinforcement learning; Monte Carlo tree search; SOFT INTERFERENCE CANCELLATION;
D O I
10.1109/VTC2022-Spring54318.2022.9860565
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. A self-designed deep reinforcement learning agent, consisting of a policy value network and a state value network, is trained to detect MIMO symbols. The outputs of the trained networks are adopted into a modified MCTS detection algorithm to provide useful node statistics and facilitate enhanced tree search process. The resulted scheme, termed the DeepMCTS detector, demonstrates significant performance and complexity advantages over the original MCTS detection algorithm under varying channel conditions.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] On Monte Carlo Tree Search and Reinforcement Learning
    Vodopivec, Tom
    Samothrakis, Spyridon
    Ster, Branko
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2017, 60 : 881 - 936
  • [2] Deep Reinforcement Learning Using Optimized Monte Carlo Tree Search in EWN
    Zhang, Yixian
    Li, Zhuoxuan
    Cao, Yiding
    Zhao, Xuan
    Cao, Jinde
    IEEE TRANSACTIONS ON GAMES, 2024, 16 (03) : 544 - 555
  • [3] Monte Carlo Tree Search for Bayesian Reinforcement Learning
    Vien, Ngo Anh
    Ertel, Wolfgang
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, : 138 - 143
  • [4] Monte Carlo Tree Search With Reinforcement Learning for Motion Planning
    Weingertner, Philippe
    Ho, Minnie
    Timofeev, Andrey
    Aubert, Sebastien
    Pita-Gil, Guillermo
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [5] Monte-Carlo tree search for Bayesian reinforcement learning
    Ngo Anh Vien
    Wolfgang Ertel
    Viet-Hung Dang
    TaeChoong Chung
    Applied Intelligence, 2013, 39 : 345 - 353
  • [6] Monte-Carlo tree search for Bayesian reinforcement learning
    Ngo Anh Vien
    Ertel, Wolfgang
    Viet-Hung Dang
    Chung, TaeChoong
    APPLIED INTELLIGENCE, 2013, 39 (02) : 345 - 353
  • [7] MetroZero: Deep Reinforcement Learning and Monte Carlo Tree Search for Optimized Metro Network Expansion
    Alkilane, Khaled
    Lee, Der-Horng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 810 - 823
  • [8] Safe Reinforcement Learning for Autonomous Vehicle Using Monte Carlo Tree Search
    Mo, Shuojie
    Pei, Xiaofei
    Wu, Chaoxian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 6766 - 6773
  • [9] Reinforcement Learning Based Monte Carlo Tree Search for Temporal Path Discovery
    Ding, Pengfei
    Liu, Guanfeng
    Zhao, Pengpeng
    Liu, An
    Li, Zhixu
    Zheng, Kai
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 140 - 149
  • [10] Hierarchical Reinforcement Learning With Monte Carlo Tree Search in Computer Fighting Game
    Pinto, Ivan Pereira
    Coutinho, Luciano Reis
    IEEE TRANSACTIONS ON GAMES, 2019, 11 (03) : 290 - 295