SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module

被引:0
|
作者
Yujia Y. [1 ]
Yiming L. [1 ]
Wenjia Z. [1 ]
Zhi Z. [1 ]
机构
[1] State Key Laboratory of Networking and Switch Technology, Beijing University of Posts and Telecommunications, Beijing
基金
中国国家自然科学基金;
关键词
image transmission; joint source-channel coding; semantic communication;
D O I
10.19682/j.cnki.1005-8885.2024.2001
中图分类号
学科分类号
摘要
With the development of deep learning (DL), joint source-channel coding (JSCC) solutions for end-to-end transmission have gained a lot of attention. Adaptive deep JSCC schemes support dynamically adjusting the rate according to different channel conditions during transmission, enhancing robustness in dynamic wireless environment. However, most of the existing adaptive JSCC schemes only consider different channel conditions, ignoring the different feature importance in the image processing and transmission. The uniform compression of different features in the image may result in the compromise of critical image details, particularly in low signal-to-noise ratio (SNR) scenarios. To address the above issues, in this paper, a dual attention mechanism is introduced and an SNR-adaptive deep JSCC mechanism with a convolutional block attention module (CBAM) is proposed, in which matrix operations are applied to features in spatial and channel dimensions respectively. The proposed solution concatenates the pooling feature with the SNR level and passes it sequentially through the channel attention network and spatial attention network to obtain the importance evaluation result. Experiments show that the proposed solution outperforms other baseline schemes in terms of peak SNR (PSNR) and structural similarity (SSIM), particularly in low SNR scenarios or when dealing with complex image content. © 2024, Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:1 / 11
页数:10
相关论文
共 50 条
  • [41] Joint Source-Channel Coding for Wireless Image Transmission: A Deep Compressed-Sensing Based Method
    Jarrahi, Mohammad Amin
    Bourtsoulatze, Eirina
    Abolghasemi, Vahid
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [42] Semantics-Guided Contrastive Joint Source-Channel Coding for Image Transmission
    Hua, Wenhui
    Chen, Dezhao
    Fang, Junli
    Chen, Lingyu
    Mota, Joao F. C.
    Hong, Xuemin
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 505 - 510
  • [43] Robust Airborne Image Transmission Using Joint Source-Channel Coding with UEP
    Li, Lun
    Wang, Gang
    Chen, Genshe
    Chen, Hua-Mei
    Blasch, Erik
    Khanh Pham
    2016 IEEE AEROSPACE CONFERENCE, 2016,
  • [44] Joint source-channel coding for highly efficient error resilient image transmission
    Vass, J
    Zhuang, XH
    ISCAS 2000: IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS - PROCEEDINGS, VOL III: EMERGING TECHNOLOGIES FOR THE 21ST CENTURY, 2000, : 311 - 314
  • [45] Robust joint source-channel coding for image transmission over wireless channels
    Cai, JF
    Chen, CW
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2000, 10 (06) : 962 - 966
  • [46] Transmission Map-Guided Joint Source-Channel Coding for Underwater Semantic Communication
    Cheng, Simeng
    Jin, Zhigang
    Chang, Lixiang
    Liang, Jiawei
    Li, Haoyong
    Su, Yishan
    Li, Gen
    IEEE SENSORS JOURNAL, 2025, 25 (07) : 12198 - 12209
  • [47] Joint source-channel coding based on adaptive wavelet pretreatment for image transmission over frequency selective fading channel
    Guo, Rui
    Zhou, Pino
    Liu, Ji-Lin
    2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 1411 - 1415
  • [48] Deep Joint Source-Channel Coding Over the Relay Channel
    Bian, Chenghong
    Shao, Yulin
    Wu, Haotian
    Gunduz, Deniz
    2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024, 2024, : 374 - 379
  • [49] Joint source-channel coding based on adaptive wavelet pretreatment for image transmission over frequency selective fading channel
    Guo, Rui
    Liu, Ji-Lin
    SIMULATED EVOLUTION AND LEARNING, PROCEEDINGS, 2006, 4247 : 929 - 936
  • [50] A Joint Source-Channel Video Coding Scheme Based on Distributed Source Coding
    Zhang, Yixuan
    Ieee, Ce ZhuSenior Member
    Yap, Kim-Hui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2008, 10 (08) : 1648 - 1656