Cooperative Multi-Target Positioning for Cell-Free Massive MIMO With Multi-Agent Reinforcement Learning

被引:0
|
作者
Liu, Ziheng [1 ,2 ]
Zhang, Jiayi [1 ,2 ]
Shi, Enyu [1 ,2 ]
Zhu, Yiyang [1 ,2 ]
Ng, Derrick Wing Kwan [3 ]
Ai, Bo [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Frontiers Sci Ctr Smart High Speed Railway Syst, Beijing 100044, Peoples R China
[3] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
基金
中国国家自然科学基金;
关键词
Computer architecture; Wireless communication; Scalability; Artificial neural networks; Estimation; Computational complexity; Accuracy; Reinforcement learning; Databases; Channel estimation; Cell-free massive MIMO; cooperative WKNN; multi-agent reinforcement learning; user positioning; COMMUNICATION; TECHNOLOGIES; OPTIMIZATION; NETWORKS;
D O I
10.1109/TWC.2024.3478232
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cell-free massive multiple-input multiple-output (mMIMO) is a promising technology to empower next-generation mobile communication networks. In this paper, to address the computational complexity associated with conventional fingerprint positioning, we consider a novel cooperative positioning architecture that involves certain relevant access points (APs) to establish positioning similarity coefficients. Then, we propose an innovative joint positioning and correction framework employing multi-agent reinforcement learning (MARL) to tackle the challenges of high-dimensional sophisticated signal processing, which mainly leverages on the received signal strength information for preliminary positioning, supplemented by the angle of arrival information to refine the initial position estimation. Moreover, to mitigate the bias effects originating from remote APs, we design a cooperative weighted K-nearest neighbor (Co-WKNN)-based estimation scheme to select APs with a high correlation to participate in user positioning. In the numerical results, we present comparisons of various user positioning schemes, which reveal that the proposed MARL-based positioning scheme with Co-WKNN can effectively improve positioning performance. It is important to note that the cooperative positioning architecture is a critical element in striking a balance between positioning performance and computational complexity.
引用
收藏
页码:19034 / 19049
页数:16
相关论文
共 50 条
  • [1] Distributed Collaborative User Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning
    Liu, Ziheng
    Zhang, Jiayi
    Shi, Enyu
    Zhu, Yiyang
    Ng, Derrick Wing Kwan
    Ai, Bo
    2024 IEEE 25TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS, SPAWC 2024, 2024, : 466 - 470
  • [2] Mobile Cell-Free Massive MIMO With Multi-Agent Reinforcement Learning: A Scalable Framework
    Liu, Ziheng
    Zhang, Jiayi
    Zhu, Yiyang
    Shi, Enyu
    Ai, Bo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2025, 24 (03) : 1817 - 1831
  • [3] Access Point Clustering in Cell-Free Massive MIMO Using Multi-Agent Reinforcement Learning
    Banerjee, Bitan
    Elliott, Robert C.
    Krzymien, Witold A.
    Farmanbar, Hamid
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 1086 - 1092
  • [4] Multi-Agent Reinforcement Learning-Based Pilot Assignment for Cell-Free Massive MIMO Systems
    Rahmani, Mostafa
    Dehghani, Mohammad Javad
    Xiao, Pei
    Bashar, Manijeh
    Debbah, Merouane
    IEEE ACCESS, 2022, 10 : 120492 - 120502
  • [5] Access Point Clustering in Cell-Free Massive MIMO Using Conventional and Federated Multi-Agent Reinforcement Learning
    Banerjee, Bitan
    Elliott, Robert C.
    Krzymień, Witold A.
    Medra, Mostafa
    IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1 : 107 - 123
  • [6] Cooperative multi-target hunting by unmanned surface vehicles based on multi-agent reinforcement learning
    Xia, Jiawei
    Luo, Yasong
    Liu, Zhikun
    Zhang, Yalun
    Shi, Haoran
    Liu, Zhong
    DEFENCE TECHNOLOGY, 2023, 29 : 80 - 94
  • [7] Cooperative multi-target hunting by unmanned surface vehicles based on multi-agent reinforcement learning
    Jiawei Xia
    Yasong Luo
    Zhikun Liu
    Yalun Zhang
    Haoran Shi
    Zhong Liu
    Defence Technology, 2023, 29 (11) : 80 - 94
  • [8] Multi-Agent and Multi-Target Reinforcement Learning for Satellite Sensor Tasking
    Saeed, Amir K.
    Holguin, Francisco
    Yasin, Alhassan S.
    Johnson, Benjamin A.
    Rodriguez, Benjamin M.
    2024 IEEE AEROSPACE CONFERENCE, 2024,
  • [9] Improving multi-target cooperative tracking guidance for UAV swarms using multi-agent reinforcement learning
    Zhou, Wenhong
    LI, Jie
    Liu, Zhihong
    Shen, Lincheng
    CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (07) : 100 - 112
  • [10] Improving Cooperative Multi-Target Tracking Control for UAV Swarm Using Multi-Agent Reinforcement Learning
    Yue, Longfei
    Lv, Maolong
    Yan, Mengda
    Zhao, Xiaoru
    Wu, Ao
    Li, Leyan
    Zuo, Jialiang
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 179 - 186