Semantic-aware Speech to Text Transmission with Redundancy Removal

被引:0
|
作者
Han, Tianxiao [1 ]
Yang, Qianqian
Shi, Zhiguo
He, Shibo
Zhang, Zhaoyang
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
关键词
D O I
10.1109/ICCWORKSHOPS53468.2022.9814492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.
引用
收藏
页码:717 / 722
页数:6
相关论文
共 50 条
  • [31] Semantic-Aware Log Understanding and Analysis
    Huang, Shaohan
    Luan, Zhongzhi
    PROCEEDINGS OF THE 33RD INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, HPDC 2024, 2024,
  • [32] Deep Separate Source-channel Coding for Semantic-aware Image Transmission
    Huang, Jianhao
    Li, Dongxu
    Huang, Chuan
    Qin, Xiaoqi
    Zhang, Wei
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 5626 - 5631
  • [33] Semantic-Aware Blocking for Entity Resolution
    Wang, Qing
    Cui, Mingyuan
    Liang, Huizhi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) : 166 - 180
  • [34] SADIH: Semantic-Aware DIscrete Hashing
    Zhang, Zheng
    Xie, Guo-sen
    Li, Yang
    Li, Sheng
    Huang, Zi
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5853 - 5860
  • [35] Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI
    Yang, Wanting
    Xiong, Zehui
    Quek, Tony Q. S.
    Shen, Xuemin
    IEEE NETWORK, 2024, 38 (06): : 29 - 38
  • [36] Semantic-aware coordinated transmission in cohesive clustered satellites: utility of information perspective
    Xu, Liang
    Jiao, Jian
    Jiang, Shiyao
    Wang, Ye
    Zhang, Qinyu
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (09)
  • [37] Semantic-Aware Superpixel for Weakly Supervised Semantic Segmentation
    Kim, Sangtae
    Park, Daeyoung
    Shim, Byonghyo
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1142 - 1150
  • [38] Semantic-aware Transformer for shadow detection
    Zhou, Kai
    Fang, Jing-Long
    Wu, Wen
    Shao, Yan-Li
    Wang, Xing-Qi
    Wei, Dan
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 240
  • [39] SemIndex: Semantic-aware inverted index
    University of Pau and Adour Countries, Anglet, France
    不详
    不详
    不详
    不详
    Tekli, Joe (joe.tekli@lau.edu.lb), 1600, Springer Verlag (8716):
  • [40] Semantic MIMO Systems for Speech-to-Text Transmission
    Weng, Zhenzi
    Qin, Zhijin
    Xie, Huiqiang
    Tao, Xiaoming
    Letaief, Khaled B.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (12) : 18697 - 18710