Deep Reinforcement Learning for Cognitive Radar Spectrum Sharing: A Continuous Control Approach

被引：6
|
作者：
Flandermeyer, Shane A. [1 ]
Mattingly, Rylee G. [1 ]
Metcalf, Justin G. [1 ]
机构：
[1] The University of Oklahoma, Advanced Radar Research Center (ARRC), The Department of Electrical and Computer Engineering (ECE), Norman,OK,73072, United States
来源：
IEEE Transactions on Radar Systems | 2024年 / 2卷
关键词：
The growing demand for RF spectrum has placed considerable strain on radar systems; which must share limited spectrum resources with an ever-increasing number of devices. It is necessary to design radar systems with coexistence in mind so that the radar avoids harmful mutual interference that compromises the quality of service for other users in the channel. This work presents a deep reinforcement learning (RL) approach to spectrum sharing that enables a pulse-agile radar to operate in heavily congested spectral environments. A cognitive agent dynamically adapts the radar waveform to trade off collision avoidance; bandwidth utilization; and distortion losses due to pulse-agile behavior. Unlike existing RL approaches; this method formulates waveform parameter selection as a continuous control task; significantly increasing the flexibility of the agent and making it possible to scale its behavior to wideband; high-resolution operation. The RL agent uses a recurrent attention-based neural network to select actions; making it suitable for parallelized; real-time implementation. The proposed algorithm makes minimal assumptions about the spectral environment or other users in the spectrum; and the performance of the approach is evaluated on over-the-air data collected from a USRP X310 software-defined radio (SDR) system. Through these experiments; it is shown that the RL approach provides a flexible method for solving multi-objective waveform design problems in dynamic; high-dimensional spectrum environments. © 2023 IEEE;
D O I：
10.1109/TRS.2024.3353112
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：125 / 137
相关论文
共 50 条
  • [41] Y Closing the Loop on Cognitive Radar for Spectrum Sharing
    Martone, Anthony F.
    Kovarskiy, Jacob A.
    Thornton, Charles E.
    Kirk, Benjamin H.
    Owen, Jonathan W.
    Ravenscroft, Brandon
    Egbert, Austin
    Goad, Adam
    Buehrer, R. Michael
    Narayanan, Ram M.
    Blunt, Shannon
    Baylis, Charles
    Sherbondy, Kelly D.
    IEEE AEROSPACE AND ELECTRONIC SYSTEMS MAGAZINE, 2021, 36 (09) : 44 - 55
  • [42] Deep Reinforcement Learning Approach to QoE-Driven Resource Allocation for Spectrum Underlay in Cognitive Radio Networks
    Shah-Mohammadi, Fatemeh
    Kwasinski, Andres
    2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2018,
  • [43] A Reinforcement Learning Decentralized Multi-Agent Control Approach exploiting Cognitive Cooperation on Continuous Environments
    Camacho-Gonzalez, Gerardo
    D'Avella, Salvatore
    Avizzano, Carlo A.
    Tripicchio, Paolo
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 1557 - 1562
  • [44] Reinforcement Learning for Cognitive Radar Task Scheduling
    Gaafar, Mohamed
    Shaghaghi, Mandi
    Adve, Raviraj S.
    Ding, Zhen
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1653 - 1657
  • [45] Learning to Control Random Boolean Networks: A Deep Reinforcement Learning Approach
    Papagiannis, Georgios
    Moschoyiannis, Sotiris
    COMPLEX NETWORKS AND THEIR APPLICATIONS VIII, VOL 1, 2020, 881 : 721 - 734
  • [46] A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control
    Bao, Yaoyao
    Zhu, Yuanming
    Qian, Feng
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2021, 60 (15) : 5504 - 5515
  • [47] A Deep Reinforcement Learning Approach to Fair Distributed Dynamic Spectrum Access
    Jalil, Syed Qaisar
    Rehmani, Mubashir Husain
    Chalup, Stephan
    PROCEEDINGS OF THE 17TH EAI INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES (MOBIQUITOUS 2020), 2021, : 236 - 244
  • [48] Reinforcement Learning in Continuous Time and Space: A Stochastic Control Approach
    Wang, Haoran
    Zariphopoulou, Thaleia
    Zhou, Xun Yu
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [49] A practical Reinforcement Learning implementation approach for continuous process control
    Patel, Kalpesh M.
    COMPUTERS & CHEMICAL ENGINEERING, 2023, 174
  • [50] Reinforcement learning in continuous time and space: A stochastic control approach
    Wang, Haoran
    Zariphopoulou, Thaleia
    Zhou, Xun Yu
    Journal of Machine Learning Research, 2020, 21
12345