Semantic-aware Speech to Text Transmission with Redundancy Removal

被引:0
|
作者
Han, Tianxiao [1 ]
Yang, Qianqian
Shi, Zhiguo
He, Shibo
Zhang, Zhaoyang
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
关键词
D O I
10.1109/ICCWORKSHOPS53468.2022.9814492
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech to text transmission. We propose a novel end-to-end DL-based transceiver, which includes an attention-based soft alignment module and a redundancy removal module to compress the transmitted data. In particular, the former extracts only the text-related semantic features, and the latter further drops the semantically redundant content, greatly reducing the amount of semantic redundancy compared to existing methods. We also propose a two-stage training scheme, which speeds up the training of the proposed DL model. The simulation results indicate that our proposed method outperforms current methods in terms of the accuracy of the received text and transmission efficiency. Moreover, the proposed method also has a smaller model size and shorter end-to-end runtime.
引用
收藏
页码:717 / 722
页数:6
相关论文
共 50 条
  • [41] DeSeal: Semantic-Aware Seal2Clear Attention for Document Seal Removal
    Liu, Yifan
    Huang, Jiancheng
    Chen, Shifeng
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1702 - 1706
  • [42] Semantic-Aware Transmission Scheduling: A Monotonicity-Driven Deep Reinforcement Learning Approach
    Chen, Jiazheng
    Liu, Wanchun
    Quevedo, Daniel E.
    Li, Yonghui
    Vucetic, Branka
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (12) : 3260 - 3264
  • [43] Task-Driven Semantic-Aware Green Cooperative Transmission Strategy for Vehicular Networks
    Yang, Wanting
    Chi, Xuefen
    Zhao, Linlin
    Xiong, Zehui
    Jiang, Wenchao
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (10) : 5783 - 5798
  • [44] Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy
    Fu, Yu
    Xiong, Deyi
    Dong, Yue
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 18003 - 18011
  • [45] TSA-SCC: Text Semantic-Aware Screen Content Coding With Ultra Low Bitrate
    Tang, Tong
    Li, Ling
    Wu, Xiaoyu
    Chen, Ruizhi
    Li, Haochen
    Lu, Guo
    Cheng, Limin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2463 - 2477
  • [46] Location Privacy Preserving for Semantic-Aware Applications
    Zhang, Lefeng
    Xiong, Ping
    Zhu, Tianqing
    APPLICATIONS AND TECHNIQUES IN INFORMATION SECURITY, ATIS 2014, 2014, 490 : 135 - 146
  • [47] Semantic-Aware Online Workload Characterization and Consolidation
    Bhattacharyya, Arnamoy
    Jandaghi, Seyed Ali Jokar
    Amza, Cristiana
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 210 - 219
  • [48] On querying and mining semantic-aware mobility timelines
    Sideridis S.
    Pelekis N.
    Theodoridis Y.
    International Journal of Data Science and Analytics, 2016, 2 (1-2) : 29 - 44
  • [49] TOWARDS A SEMANTIC-AWARE COLLABORATIVE WORKING ENVIRONMENT
    Martinez Carreras, Maria A.
    Marin Perez, Juan M.
    Bernal Bernabe, Jorge
    Alcaraz Calero, Jose M.
    Martinez Perez, Gregorio
    Gomez Skarmeta, Antonio F.
    COMPUTING AND INFORMATICS, 2011, 30 (01) : 7 - 30
  • [50] Location privacy preserving for semantic-aware applications
    Zhang, Lefeng
    Xiong, Ping
    Zhu, Tianqing
    Communications in Computer and Information Science, 2014, 490 : 135 - 146