Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication

被引:36
|
作者
Zhang, Wenyu [1 ]
Zhang, Haijun [2 ,3 ]
Ma, Hui [1 ]
Shao, Hua [1 ]
Wang, Ning [4 ]
Leung, Victor C. M. [5 ,6 ]
机构
[1] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Sch Intelligence Sci & Technol, Beijing 100083, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing, Peoples R China
[3] Univ Sci & Technol Beijing, Beijing Engn & Technol Res Ctr Convergence Network, Beijing, Peoples R China
[4] Zhengzhou Univ, Sch Informat Engn, Henan Joint Int Res Lab Intelligent Networking & D, Zhengzhou 450001, Henan, Peoples R China
[5] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[6] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Adaptive code length; joint source channel coding; quality prediction; semantic communication; wireless image transmission;
D O I
10.1109/TWC.2023.3234408
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communication is a newly emerged communication paradigm that exploits deep learning (DL) models to realize communication processes like source coding and channel coding. Recent advances have demonstrated that DL-based joint source-channel coding (DeepJSCC) can achieve exciting data compression and noise-resiliency performances for wireless image transmission tasks, especially in environments with low channel signal-to-noises (SNRs). However, existing DeepJSCC-based semantic communication frameworks still cannot achieve adaptive code rates for different channel SNRs and image contents, which reduces its flexibility and bandwidth efficiency. In this paper, we propose a predictive and adaptive deep coding (PADC) framework for realizing flexible code rate optimization with a given target transmission quality requirement. PADC is realized by a variable code length enabled DeepJSCC (DeepJSCC-V) model for realizing flexible code length adjustment, an Oracle Network (OraNet) model for predicting peak-signal-to-noise (PSNR) value for an image transmission task according to its contents, channel signal to noise ratio (SNR) and the compression ratio (CR) value, and a CR optimizer aims at finding the minimal data-level or instance-level CR with a PSNR quality constraint. By using the above three modules, PADC can transmit the image data with minimal CR, which greatly increases bandwidth efficiency. Simulation results demonstrate that the proposed DeepJSCC-V model can achieve similar PSNR performances compared with the state-of-the-art Attention-based DeepJSCC (ADJSCC) model, and the proposed OraNet model is able to predict high-quality PSNR values with an average error lower than 0.5dB. Results also demonstrate that the proposed PADC can use nearly minimal bandwidth consumption for wireless image transmission tasks with different channel SNR and image contents, at the same time guaranteeing the PSNR constraint for each image data.
引用
收藏
页码:5486 / 5501
页数:16
相关论文
共 50 条
  • [41] Optimization of Image Transmission in Cooperative Semantic Communication Networks
    Zhang, Wenjing
    Wang, Yining
    Chen, Mingzhe
    Luo, Tao
    Niyato, Dusit
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (02) : 861 - 873
  • [42] Toward Semantic Communications: Deep Learning-Based Image Semantic Coding
    Huang, Danlan
    Gao, Feifei
    Tao, Xiaoming
    Du, Qiyuan
    Lu, Jianhua
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (01) : 55 - 71
  • [43] Deep Joint Source-Channel Coding for Adaptive Image Transmission Over MIMO Channels
    Wu, Haotian
    Shao, Yulin
    Bian, Chenghong
    Mikolajczyk, Krystian
    Gunduz, Deniz
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 15002 - 15017
  • [44] An Adaptive Transmission Scheme for Deep Space Communication
    SUN Zezhou
    WANG Le
    WANG Chenghua
    ZHU Qiuming
    ZHANG Xiaofei
    LIU Weiqiang
    LI Xiangyu
    TransactionsofNanjingUniversityofAeronauticsandAstronautics, 2019, 36 (01) : 26 - 35
  • [45] An Adaptive Transmission Scheme for Deep Space Communication
    Sun Z.
    Wang L.
    Wang C.
    Zhu Q.
    Zhang X.
    Liu W.
    Li X.
    Transactions of Nanjing University of Aeronautics and Astronautics, 2019, 36 (01) : 26 - 35
  • [46] An Image Adaptive Rate Mechanism in Semantic Communication for Image Endogenous Semantics
    Shi, Guangming
    Li, Haixiong
    Gao, Dahua
    Yang, Minxi
    Dong, Yubo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (09) : 13425 - 13439
  • [47] Resolution-Adaptive Source-Channel Coding for End-to-End Wireless Image Transmission
    Yang, Ke
    Wang, Sixian
    Tan, Kailin
    Dai, Jincheng
    Zhou, Dekun
    Niu, Kai
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1460 - 1465
  • [48] Adaptive Secure Transmission for Wireless Powered Communication Networks
    Yong Wang
    Weiwei Yang
    Tao Zhang
    Yong Chen
    Xiaohui Shang
    Quan Wang
    中国通信, 2021, 18 (03) : 155 - 173
  • [49] Adaptive Secure Transmission for Wireless Powered Communication Networks
    Wang, Yong
    Yang, Weiwei
    Zhang, Tao
    Chen, Yong
    Shang, Xiaohui
    Wang, Quan
    CHINA COMMUNICATIONS, 2021, 18 (03) : 155 - 173
  • [50] Adaptive transmission technique in underwater acoustic wireless communication
    Zhou, Guoqing
    Shim, Taebo
    EVOLVABLE SYSTEMS: FROM BIOLOGY TO HARDWARE, PROCEEDINGS, 2007, 4684 : 268 - +