Semantic-aware Speech to Text Transmission with Redundancy Removal

被引:0
|
作者
Han, Tianxiao [1 ]
Yang, Qianqian
Shi, Zhiguo
He, Shibo
Zhang, Zhaoyang
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
关键词
D O I
10.1109/ICCWORKSHOPS53468.2022.9814492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.
引用
收藏
页码:717 / 722
页数:6
相关论文
共 50 条
  • [11] Semantic-aware Iot platforms
    Ben Alaya, Mahdi
    Drira, Khalil
    Gharbi, Ghada
    2017 IEEE 6TH INTERNATIONAL CONFERENCE ON AI & MOBILE SERVICES (AIMS), 2017, : 8 - 13
  • [12] Semantic-Aware Expert Partitioning
    Boeva, Veselka
    Boneva, Lilyana
    Tsiporkova, Elena
    ARTIFICIAL INTELLIGENCE: METHODOLOGY, SYSTEMS, AND APPLICATIONS, 2014, 8722 : 13 - 24
  • [13] Semantic-Aware Vulnerability Detection
    Huang, Zhen
    White, Marc
    2022 IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND RESILIENCE (IEEE CSR), 2022, : 68 - 75
  • [14] Semantic-aware scene recognition
    Lopez-Cifuentes, Alejandro
    Escudero-Vinolo, Marcos
    Bescos, Jesus
    Garcia-Martin, Alvaro
    PATTERN RECOGNITION, 2020, 102
  • [15] SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal
    Sun, Zhaoyang
    Chen, Yaxiong
    Xiong, Shengwu
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2325 - 2334
  • [16] A Semantic-Aware Transmission With Adaptive Control Scheme for Volumetric Video Service
    Zhu, Yuanwei
    Huang, Yakun
    Qiao, Xiuquan
    Tan, Zhijie
    Bai, Boyuan
    Ma, Huadong
    Dustdar, Schahram
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7160 - 7172
  • [17] Semantic-Aware Sensing Information Transmission for Metaverse: A Contest Theoretic Approach
    Wang, Jiacheng
    Du, Hongyang
    Tian, Zengshan
    Niyato, Dusit
    Kang, Jiawen
    Shen, Xuemin
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (08) : 5214 - 5228
  • [18] Semantic similarity-aware feature selection and redundancy removal for text classification using joint mutual information
    Lazhar, Farek
    Amira, Benaidja
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (10) : 6187 - 6212
  • [19] SemIndex: Semantic-Aware Inverted Index
    Chbeir, Richard
    Luo, Yi
    Tekli, Joe
    Yetongnon, Kokou
    Raymundo Ibanez, Carlos
    Traina, Agma J. M.
    Traina, Caetano, Jr.
    Al Assad, Marc
    ADVANCES IN DATABASES AND INFORMATION SYSTEMS (ADBIS 2014), 2014, 8716 : 290 - 307
  • [20] Semantic-Aware Partitioning on RDF Graphs
    Xu, Qiang
    Wang, Xin
    Wang, Junhu
    Yang, Yajun
    Feng, Zhiyong
    WEB AND BIG DATA, APWEB-WAIM 2017, PT I, 2017, 10366 : 149 - 157