Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication

被引:36
|
作者
Zhang, Wenyu [1 ]
Zhang, Haijun [2 ,3 ]
Ma, Hui [1 ]
Shao, Hua [1 ]
Wang, Ning [4 ]
Leung, Victor C. M. [5 ,6 ]
机构
[1] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Sch Intelligence Sci & Technol, Beijing 100083, Peoples R China
[2] Univ Sci & Technol Beijing, Beijing Adv Innovat Ctr Mat Genome Engn, Beijing, Peoples R China
[3] Univ Sci & Technol Beijing, Beijing Engn & Technol Res Ctr Convergence Network, Beijing, Peoples R China
[4] Zhengzhou Univ, Sch Informat Engn, Henan Joint Int Res Lab Intelligent Networking & D, Zhengzhou 450001, Henan, Peoples R China
[5] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[6] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Adaptive code length; joint source channel coding; quality prediction; semantic communication; wireless image transmission;
D O I
10.1109/TWC.2023.3234408
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communication is a newly emerged communication paradigm that exploits deep learning (DL) models to realize communication processes like source coding and channel coding. Recent advances have demonstrated that DL-based joint source-channel coding (DeepJSCC) can achieve exciting data compression and noise-resiliency performances for wireless image transmission tasks, especially in environments with low channel signal-to-noises (SNRs). However, existing DeepJSCC-based semantic communication frameworks still cannot achieve adaptive code rates for different channel SNRs and image contents, which reduces its flexibility and bandwidth efficiency. In this paper, we propose a predictive and adaptive deep coding (PADC) framework for realizing flexible code rate optimization with a given target transmission quality requirement. PADC is realized by a variable code length enabled DeepJSCC (DeepJSCC-V) model for realizing flexible code length adjustment, an Oracle Network (OraNet) model for predicting peak-signal-to-noise (PSNR) value for an image transmission task according to its contents, channel signal to noise ratio (SNR) and the compression ratio (CR) value, and a CR optimizer aims at finding the minimal data-level or instance-level CR with a PSNR quality constraint. By using the above three modules, PADC can transmit the image data with minimal CR, which greatly increases bandwidth efficiency. Simulation results demonstrate that the proposed DeepJSCC-V model can achieve similar PSNR performances compared with the state-of-the-art Attention-based DeepJSCC (ADJSCC) model, and the proposed OraNet model is able to predict high-quality PSNR values with an average error lower than 0.5dB. Results also demonstrate that the proposed PADC can use nearly minimal bandwidth consumption for wireless image transmission tasks with different channel SNR and image contents, at the same time guaranteeing the PSNR constraint for each image data.
引用
收藏
页码:5486 / 5501
页数:16
相关论文
共 50 条
  • [31] SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module
    Yang Yujia
    Liu Yiming
    Zhang Wenjia
    Zhang Zhi
    The Journal of China Universities of Posts and Telecommunications, 2024, 31 (01) : 1 - 11
  • [32] Deep Learning-Based Image Semantic Coding for Semantic Communications
    Huang, Danlan
    Tao, Xiaoming
    Gao, Feifei
    Lu, Jianhua
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [33] Adaptive Wireless Image Transmission Transformer Architecture for Image Transmission and Reconstruction
    Li, Hongcheng
    Xia, Geming
    Yu, Chaodong
    Zhang, Yuze
    Li, Hongfeng
    SENSORS, 2024, 24 (21)
  • [34] Adaptive rate coding for image data transmission
    Bhaskar, V
    Joiner, LL
    PROCEEDINGS OF THE THIRTY-FOURTH SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY, 2002, : 251 - 255
  • [35] Semantic segmentation-based semantic communication system for image transmission
    Wu, Jiale
    Wu, Celimuge
    Lin, Yangfei
    Yoshinaga, Tsutomu
    Zhong, Lei
    Chen, Xianfu
    Ji, Yusheng
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (03) : 519 - 527
  • [36] Semantic segmentation-based semantic communication system for image transmission
    Jiale Wu
    Celimuge Wu
    Yangfei Lin
    Tsutomu Yoshinaga
    Lei Zhong
    Xianfu Chen
    Yusheng Ji
    Digital Communications and Networks, 2024, 10 (03) : 519 - 527
  • [37] Deep Joint Source-Channel Coding Based on Semantics of Pixels for Wireless Image Transmission
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Tang, Rui
    Liu, Chuanhong
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [38] The Study of UAV Wireless Image Adaptive Transmission
    Wang, Min
    Zhou, Shudao
    Wen, Zimu
    Jia, Yun
    2ND INTERNATIONAL CONFERENCE ON COMMUNICATION AND TECHNOLOGY (ICCT 2015), 2015, : 281 - 288
  • [39] Adaptive image compression for wireless multimedia communication
    Taylor, CN
    Dey, S
    2001 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-10, CONFERENCE RECORD, 2001, : 1925 - 1929
  • [40] SUBBAND CODING WITH MULTISTAGE VQ FOR WIRELESS IMAGE COMMUNICATION
    JANG, ES
    NASRABADI, NM
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1995, 5 (03) : 247 - 253