Cooperative Multi-Target Positioning for Cell-Free Massive MIMO With Multi-Agent Reinforcement Learning

被引:0
|
作者
Liu, Ziheng [1 ,2 ]
Zhang, Jiayi [1 ,2 ]
Shi, Enyu [1 ,2 ]
Zhu, Yiyang [1 ,2 ]
Ng, Derrick Wing Kwan [3 ]
Ai, Bo [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Frontiers Sci Ctr Smart High Speed Railway Syst, Beijing 100044, Peoples R China
[3] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
基金
中国国家自然科学基金;
关键词
Computer architecture; Wireless communication; Scalability; Artificial neural networks; Estimation; Computational complexity; Accuracy; Reinforcement learning; Databases; Channel estimation; Cell-free massive MIMO; cooperative WKNN; multi-agent reinforcement learning; user positioning; COMMUNICATION; TECHNOLOGIES; OPTIMIZATION; NETWORKS;
D O I
10.1109/TWC.2024.3478232
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cell-free massive multiple-input multiple-output (mMIMO) is a promising technology to empower next-generation mobile communication networks. In this paper, to address the computational complexity associated with conventional fingerprint positioning, we consider a novel cooperative positioning architecture that involves certain relevant access points (APs) to establish positioning similarity coefficients. Then, we propose an innovative joint positioning and correction framework employing multi-agent reinforcement learning (MARL) to tackle the challenges of high-dimensional sophisticated signal processing, which mainly leverages on the received signal strength information for preliminary positioning, supplemented by the angle of arrival information to refine the initial position estimation. Moreover, to mitigate the bias effects originating from remote APs, we design a cooperative weighted K-nearest neighbor (Co-WKNN)-based estimation scheme to select APs with a high correlation to participate in user positioning. In the numerical results, we present comparisons of various user positioning schemes, which reveal that the proposed MARL-based positioning scheme with Co-WKNN can effectively improve positioning performance. It is important to note that the cooperative positioning architecture is a critical element in striking a balance between positioning performance and computational complexity.
引用
收藏
页码:19034 / 19049
页数:16
相关论文
共 50 条
  • [21] Cooperative Fingerprint Positioning for Cell-Free Massive MIMO Systems
    Qiu, Jiahua
    Xu, Kui
    Shen, Zhexian
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 382 - 387
  • [22] Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
    Xu, Zhiwei
    Zhang, Bin
    Li, Dapeng
    Zhang, Zeren
    Zhou, Guangchong
    Chen, Hao
    Fan, Guoliang
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 10, 2023, : 11726 - 11734
  • [23] Double-Layer Power Control for Mobile Cell-Free XL-MIMO With Multi-Agent Reinforcement Learning
    Liu, Ziheng
    Zhang, Jiayi
    Liu, Zhilong
    Xiao, Huahua
    Ai, Bo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (05) : 4658 - 4674
  • [24] Deep Reinforcement Learning for Energy Efficiency Maximization in Cache-Enabled Cell-Free Massive MIMO Networks: Single- and Multi-Agent Approaches
    Chuang, Yu-Chieh
    Chiu, Wei-Yu
    Chang, Ronald Y.
    Lai, Yi-Cheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10826 - 10839
  • [25] Multi-Agent Reinforcement Learning-Based Joint Precoding and Phase Shift Optimization for RIS-Aided Cell-Free Massive MIMO Systems
    Zhu, Yiyang
    Shi, Enyu
    Liu, Ziheng
    Zhang, Jiayi
    Ai, Bo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (09) : 14015 - 14020
  • [26] UAV Swarm Cooperative Target Search: A Multi-Agent Reinforcement Learning Approach
    Hou, Yukai
    Zhao, Jin
    Zhang, Rongqing
    Cheng, Xiang
    Yang, Liuqing
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 568 - 578
  • [27] Cooperative Multi-agent Systems for the Multi-target K-Coverage Problem
    Frasheri, Mirgita
    Esterle, Lukas
    Papadopoulos, Alessandro Vittorio
    AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2020, 2021, 12613 : 106 - 131
  • [28] Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning
    Kouzeghar, Maryam
    Song, Youngbin
    Meghjani, Malika
    Bouffanais, Roland
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3289 - 3295
  • [29] Preference-based experience sharing scheme for multi-agent reinforcement learning in multi-target environments
    Zuo, Xuan
    Zhang, Pu
    Li, Hui-Yan
    Liu, Zhun-Ga
    EVOLVING SYSTEMS, 2024, 15 (05) : 1681 - 1699
  • [30] Cooperative Multi-Agent Reinforcement Learning with Hypergraph Convolution
    Bai, Yunpeng
    Gong, Chen
    Zhang, Bin
    Fan, Guoliang
    Hou, Xinwen
    Lu, Yu
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,