Self-Supervised RF Signal Representation Learning for NextG Signal Classification With Deep Learning

被引:12
|
作者
Davaslioglu, Kemal [1 ,2 ]
Boztas, Serdar [1 ,2 ]
Ertem, Mehmet Can [1 ,2 ]
Sagduyu, Yalin E. [3 ]
Ayanoglu, Ender [4 ]
机构
[1] Univ Tech Serv Inc, Dept Appl Res, Greenbelt, MD 20770 USA
[2] Univ Tech Serv Inc, Engn Div, Greenbelt, MD 20770 USA
[3] Virginia Tech, Natl Secur Inst, Arlington, VA 22203 USA
[4] Univ Calif Irvine, Ctr Pervas Commun & Comp, Irvine, CA 92697 USA
关键词
Task analysis; Wireless communication; Modulation; Wireless sensor networks; Radio frequency; Signal to noise ratio; Semantics; Automatic modulation recognition; wireless signal classification; contrastive learning; deep learning; self-supervised learning; spectrum awareness;
D O I
10.1109/LWC.2022.3217292
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) finds rich applications in the wireless domain to improve spectrum awareness. Typically, DL models are either randomly initialized following a statistical distribution or pretrained on tasks from other domains in the form of transfer learning without accounting for the unique characteristics of wireless signals. Self-supervised learning (SSL) enables the learning of useful representations from Radio Frequency (RF) signals themselves even when only limited training data samples with labels are available. We present a self-supervised RF signal representation learning method and apply it to the automatic modulation recognition (AMR) task by specifically formulating a set of transformations to capture the wireless signal characteristics. We show that the sample efficiency (the number of labeled samples needed to achieve a certain performance) of AMR can be significantly increased (almost an order of magnitude) by learning signal representations with SSL. This translates to substantial time and cost savings. Furthermore, SSL increases the model accuracy compared to the state-of-the-art DL methods and maintains high accuracy when limited training data is available.
引用
收藏
页码:65 / 69
页数:5
相关论文
共 50 条
  • [31] Self-supervised representation learning for trip recommendation
    Gao, Qiang
    Wang, Wei
    Zhang, Kunpeng
    Yang, Xin
    Miao, Congcong
    Li, Tianrui
    KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [32] Self-supervised Representation Learning for Astronomical Images
    Hayat, Md Abul
    Stein, George
    Harrington, Peter
    Lukic, Zarija
    Mustafa, Mustafa
    ASTROPHYSICAL JOURNAL LETTERS, 2021, 911 (02)
  • [33] Revisiting Self-Supervised Visual Representation Learning
    Kolesnikov, Alexander
    Zhai, Xiaohua
    Beyer, Lucas
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1920 - 1929
  • [34] Self-Distilled Self-supervised Representation Learning
    Jang, Jiho
    Kim, Seonhoon
    Yoo, Kiyoon
    Kong, Chaerin
    Kim, Jangho
    Kwak, Nojun
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2828 - 2838
  • [35] SelfDoc: Self-Supervised Document Representation Learning
    Li, Peizhao
    Gu, Jiuxiang
    Kuen, Jason
    Morariu, Vlad, I
    Zhao, Handong
    Jain, Rajiv
    Manjunatha, Varun
    Liu, Hongfu
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5648 - 5656
  • [36] Solving Inefficiency of Self-supervised Representation Learning
    Wang, Guangrun
    Wang, Keze
    Wang, Guangcong
    Torr, Philip H. S.
    Lin, Liang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9485 - 9495
  • [37] MusicBERT: A Self-supervised Learning of Music Representation
    Zhu, Hongyuan
    Niu, Ye
    Fu, Di
    Wang, Hao
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3955 - 3963
  • [38] Self-Supervised Dense Visual Representation Learning
    Ozcelik, Timoteos Onur
    Gokberk, Berk
    Akarun, Lale
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [39] Self-supervised Representation Learning on Dynamic Graphs
    Tian, Sheng
    Wu, Ruofan
    Shi, Leilei
    Zhu, Liang
    Xiong, Tao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 1814 - 1823
  • [40] DEEP SELF-SUPERVISED PIXEL-LEVEL LEARNING FOR HYPERSPECTRAL CLASSIFICATION
    Gonzalez-Santiago, Jonathan
    Schenkel, Fabian
    Gross, Wolfgang
    Middelmann, Wolfgang
    2022 12TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2022,