SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module

被引:0
|
作者
Yujia Y. [1 ]
Yiming L. [1 ]
Wenjia Z. [1 ]
Zhi Z. [1 ]
机构
[1] State Key Laboratory of Networking and Switch Technology, Beijing University of Posts and Telecommunications, Beijing
基金
中国国家自然科学基金;
关键词
image transmission; joint source-channel coding; semantic communication;
D O I
10.19682/j.cnki.1005-8885.2024.2001
中图分类号
学科分类号
摘要
With the development of deep learning (DL), joint source-channel coding (JSCC) solutions for end-to-end transmission have gained a lot of attention. Adaptive deep JSCC schemes support dynamically adjusting the rate according to different channel conditions during transmission, enhancing robustness in dynamic wireless environment. However, most of the existing adaptive JSCC schemes only consider different channel conditions, ignoring the different feature importance in the image processing and transmission. The uniform compression of different features in the image may result in the compromise of critical image details, particularly in low signal-to-noise ratio (SNR) scenarios. To address the above issues, in this paper, a dual attention mechanism is introduced and an SNR-adaptive deep JSCC mechanism with a convolutional block attention module (CBAM) is proposed, in which matrix operations are applied to features in spatial and channel dimensions respectively. The proposed solution concatenates the pooling feature with the SNR level and passes it sequentially through the channel attention network and spatial attention network to obtain the importance evaluation result. Experiments show that the proposed solution outperforms other baseline schemes in terms of peak SNR (PSNR) and structural similarity (SSIM), particularly in low SNR scenarios or when dealing with complex image content. © 2024, Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:1 / 11
页数:10
相关论文
共 50 条
  • [31] Joint Task and Data-Oriented Semantic Communications: A Deep Separate Source-Channel Coding Scheme
    Huang, Jianhao
    Li, Dongxu
    Huang, Chuan
    Qin, Xiaoqi
    Zhang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02): : 2255 - 2272
  • [32] Joint source-channel coding for image transmission over noisy channels
    Su, YJ
    Lu, JH
    Wang, J
    Gu, J
    2000 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY PROCEEDINGS, VOLS. I & II, 2000, : 136 - 139
  • [33] Channel adaptive joint source-channel coding of speech
    Bernard, A
    Liu, XT
    Alwan, A
    Wesel, R
    CONFERENCE RECORD OF THE THIRTY-SECOND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, VOLS 1 AND 2, 1998, : 357 - 361
  • [34] Deep Joint Source-Channel Coding with Optimal Compression Rate for mmWave Mobile Image Transmission
    Yamada, Junichiro
    Suto, Katsuya
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024, : 1068 - 1069
  • [35] Implementation of Deep Joint Source-Channel Coding on 5G Systems for Image Transmission
    Matsumoto, Keigo
    Inoue, Yoshiaki
    Hara-Azumi, Yuko
    Maruta, Kazuki
    Nakayama, Yu
    Shinohara, Yoshinori
    Ikeda, Hiroki
    Hisano, Daisuke
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [36] Joint Source-Channel Coding for Deep-Space Image Transmission using Rateless Codes
    Bursalioglu, O. Y.
    Caire, G.
    Divsalar, D.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2013, 61 (08) : 3448 - 3461
  • [37] Joint source-channel decoding scheme for image transmission over wireless channel
    Xiao, Dong-Liang
    Sun, Hong
    Wuhan University Journal of Natural Sciences, 2002, 7 (03) : 307 - 312
  • [39] Lightweight Joint Source-Channel Coding for Semantic Communications
    Jia, Yunjian
    Huang, Zhen
    Luo, Kun
    Wen, Wanli
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (12) : 3161 - 3165
  • [40] Adaptive segmentation based joint source-channel coding for wireless video transmission
    Su, YJ
    Lu, JH
    Wang, J
    Letaief, KB
    Gu, J
    IEEE VTC 53RD VEHICULAR TECHNOLOGY CONFERENCE, SPRING 2001, VOLS 1-4, PROCEEDINGS, 2001, : 2076 - 2080