Semantic-aware Speech to Text Transmission with Redundancy Removal

被引:0
|
作者
Han, Tianxiao [1 ]
Yang, Qianqian
Shi, Zhiguo
He, Shibo
Zhang, Zhaoyang
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
关键词
D O I
10.1109/ICCWORKSHOPS53468.2022.9814492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.
引用
收藏
页码:717 / 722
页数:6
相关论文
共 50 条
  • [1] Semantic-Aware Speech-to-Text Transmission Over MIMO Channels
    Weng, Zhenzi
    Qin, Zhijin
    Tao, Xiaoming
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 1362 - 1367
  • [2] Semantic-Aware Video Text Detection
    Feng, Wei
    Yin, Fei
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1695 - 1705
  • [3] A Spatial Text Query Scheme Based On Semantic-Aware
    Li, Hongbo
    Zhu, Hong
    Cui, Zongmin
    2019 THE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPILATION, COMPUTING AND COMMUNICATIONS (HP3C 2019), 2019, : 55 - 58
  • [4] A Semantic-Aware Profile Updating Model for Text Recommendation
    Zagheli, Hossein Rahmatizadeh
    Zamani, Hamed
    Shakery, Azadeh
    PROCEEDINGS OF THE ELEVENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS'17), 2017, : 316 - 320
  • [5] Semantic-aware Resource Allocation for Wireless Image Transmission
    Han, Xue
    Feng, Biqian
    Shi, Yuxuan
    Wu, Yongpeng
    Zhang, Wenjun
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [6] Semantic-aware Transmission for Robust Point Cloud Classification
    Han, Tianxiao
    Chi, Kaiyi
    Yang, Qianqian
    Shi, Zhiguo
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 7617 - 7622
  • [7] Semantic-Aware Data Augmentation for Text-to-Image Synthesis
    Tan, Zhaorui
    Yang, Xi
    Huang, Kaizhu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 5098 - 5107
  • [8] LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
    Zhi, Yihao
    Cun, Xiaodong
    Chen, Xuelin
    Shen, Xi
    Guo, Wen
    Huang, Shaoli
    Gao, Shenghua
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20750 - 20760
  • [9] Semantic-aware expert partitioning
    1600, Springer Verlag (8722):
  • [10] Semantic-Aware Makeup Cleanser
    Li, Yi
    Huang, Huaibo
    Yu, Junchi
    He, Ran
    Tan, Tieniu
    2019 IEEE 10TH INTERNATIONAL CONFERENCE ON BIOMETRICS THEORY, APPLICATIONS AND SYSTEMS (BTAS), 2019,