Semantic-aware Speech to Text Transmission with Redundancy Removal

被引:0
|
作者
Han, Tianxiao [1 ]
Yang, Qianqian
Shi, Zhiguo
He, Shibo
Zhang, Zhaoyang
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
关键词
D O I
10.1109/ICCWORKSHOPS53468.2022.9814492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.
引用
收藏
页码:717 / 722
页数:6
相关论文
共 50 条
  • [21] Semantic-aware visual scene representation
    Mohammad Javad Parseh
    Mohammad Rahmanimanesh
    Parviz Keshavarzi
    Zohreh Azimifar
    International Journal of Multimedia Information Retrieval, 2022, 11 : 619 - 638
  • [22] Semantic-aware coordinated transmission in cohesive clustered satellites: utility of information perspective
    Liang XU
    Jian JIAO
    Shiyao JIANG
    Ye WANG
    Qinyu ZHANG
    ScienceChina(InformationSciences), 2024, 67 (09) : 338 - 339
  • [23] SemAudio: Semantic-Aware Streaming Communications for Real-Time Audio Transmission
    Wei, Hao
    Xu, Wenjun
    Wang, Fengyu
    Du, Xin
    Zhang, Tiankui
    Zhang, Ping
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3965 - 3970
  • [24] Semantic-Aware Domain Generalized Segmentation
    Peng, Duo
    Lei, Yinjie
    Hayat, Munawar
    Guo, Yulan
    Li, Wen
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2584 - 2595
  • [25] Semantic-aware components and services of ActiveMath
    Melis, E
    Goguadze, G
    Homik, M
    Libbrecht, P
    Ullrich, C
    Winterstein, S
    BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2006, 37 (03) : 405 - 423
  • [26] Semantic-Aware Service Quality Negotiation
    Comuzzi, Marco
    Kritikos, Kyriakos
    Plebani, Pierluigi
    TOWARDS A SERVICE-BASED INTERNET, 2008, 5377 : 312 - +
  • [27] Semantic-aware visual scene representation
    Parseh, Mohammad Javad
    Rahmanimanesh, Mohammad
    Keshavarzi, Parviz
    Azimifar, Zohreh
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2022, 11 (04) : 619 - 638
  • [28] Semantic-aware neural style transfer
    Park, Joo Hyun
    Park, Song
    Shim, Hyunjung
    IMAGE AND VISION COMPUTING, 2019, 87 : 13 - 23
  • [29] Semantic-Aware Blocking for Entity Resolution
    Wang, Qing
    Cui, Mingyuan
    Liang, Huizhi
    2016 32ND IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2016, : 1468 - 1469
  • [30] Semantic-Aware Mixup for Domain Generalization
    Xu, Chengchao
    Tian, Xinmei
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,