SNR-adaptive deep joint source-channel coding scheme for image semantic transmission with convolutional block attention module

被引:0
|
作者
Yujia Y. [1 ]
Yiming L. [1 ]
Wenjia Z. [1 ]
Zhi Z. [1 ]
机构
[1] State Key Laboratory of Networking and Switch Technology, Beijing University of Posts and Telecommunications, Beijing
基金
中国国家自然科学基金;
关键词
image transmission; joint source-channel coding; semantic communication;
D O I
10.19682/j.cnki.1005-8885.2024.2001
中图分类号
学科分类号
摘要
With the development of deep learning (DL), joint source-channel coding (JSCC) solutions for end-to-end transmission have gained a lot of attention. Adaptive deep JSCC schemes support dynamically adjusting the rate according to different channel conditions during transmission, enhancing robustness in dynamic wireless environment. However, most of the existing adaptive JSCC schemes only consider different channel conditions, ignoring the different feature importance in the image processing and transmission. The uniform compression of different features in the image may result in the compromise of critical image details, particularly in low signal-to-noise ratio (SNR) scenarios. To address the above issues, in this paper, a dual attention mechanism is introduced and an SNR-adaptive deep JSCC mechanism with a convolutional block attention module (CBAM) is proposed, in which matrix operations are applied to features in spatial and channel dimensions respectively. The proposed solution concatenates the pooling feature with the SNR level and passes it sequentially through the channel attention network and spatial attention network to obtain the importance evaluation result. Experiments show that the proposed solution outperforms other baseline schemes in terms of peak SNR (PSNR) and structural similarity (SSIM), particularly in low SNR scenarios or when dealing with complex image content. © 2024, Beijing University of Posts and Telecommunications. All rights reserved.
引用
收藏
页码:1 / 11
页数:10
相关论文
共 50 条
  • [21] Joint Source-Channel Coding for Channel-Adaptive Digital Semantic Communications
    Park, Joohyuk
    Oh, Yongjeong
    Kim, Seonjung
    Jeon, Yo-Seb
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2025, 11 (01) : 75 - 89
  • [22] Bounds for Joint Source-Channel Coding at High SNR
    Tridenski, Sergey
    Zamir, Ram
    2011 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2011, : 771 - 775
  • [23] Scheme of source-channel image coding
    Gu, Wei
    Hu, Bo
    Ling, Xie-Ting
    Hongwai Yu Haomibo Xuebao/Journal of Infrared and Millimeter Waves, 2002, 21 (01): : 44 - 48
  • [24] Deep Joint Source-Channel Coding for Wireless Image Transmission with Entropy-Aware Adaptive Rate Control
    Chen, Weixuan
    Chen, Yuhao
    Yang, Qianqian
    Huang, Chongwen
    Wang, Qian
    Zhang, Zhaoyang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2239 - 2244
  • [25] Deep Joint Source-Channel Coding Based on Semantics of Pixels for Wireless Image Transmission
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Tang, Rui
    Liu, Chuanhong
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [26] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE RETRIEVAL
    Jankowski, Mikolaj
    Gunduz, Deniz
    Mikolajczyk, Krystian
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5070 - 5074
  • [27] Deep Joint Source-Channel and Encryption Coding: Secure Semantic Communications
    Tung, Tze-Yang
    Gunduz, Deniz
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 5620 - 5625
  • [28] Block Compressed Sensing-Based Joint Source-Channel Coding for Wireless Image Transmission
    Zheng, Leqi
    Zhu, Tingling
    Ma, Xiao
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 13 - 18
  • [29] A joint source-channel coding scheme for image-in-image data hiding
    Solanki, K
    Dabeer, O
    Manjunath, BS
    Madhow, U
    Chandrasekaran, S
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 2, PROCEEDINGS, 2003, : 743 - 746
  • [30] Channel-Blind Joint Source-Channel Coding for Wireless Image Transmission
    Yuan, Hongjie
    Xu, Weizhang
    Wang, Yuhuan
    Wang, Xingxing
    SENSORS, 2024, 24 (12)