Information Recovery Technology for Cross-Modal Communications

被引：0
|
作者：
Xu J.-B. [1 ,2 ]
Wei X. [1 ,2 ]
Zhou L. [1 ,2 ]
机构：
[1] School of Telecommunications & Information Engineering, Nanjing University of Posts and Telecommunications, Jiangsu, Nanjing
[2] Key Laboratory of Broadband Wireless Communication and Sensor Network Technology（Ministry of Education）, Nanjing University of Posts and Telecommunications, Jiangsu, Nanjing
来源：
Tien Tzu Hsueh Pao/Acta Electronica Sinica | 2022年 / 50卷 / 07期
关键词：
cross-modal communications; information recovery; multi-modal services; semantic fusion;
D O I：
10.12263/DZXB.20210945
中图分类号：
学科分类号：
摘要：
Aiming at the issues of multi-modal data loss and data pollution by noise of wireless channel during the transmission, which seriously affect the cross-modal communication quality, an information recovery technology for cross-modal communications is proposed. In this scheme, by making full use of the existing data at the receiving end, the information is recovered at the receiving end by means of one-to-one intra-modal retrieval, one-to-one cross-modal retrieval, one-to-many cross-modal retrieval, etc. Moreover, the proposed scheme is validated on an open data set and the practical cross-modal communication platform. Experimental results show that the scheme can achieve accurate multi-modal information recovery and effectively improve the quality of cross-modal communications. © 2022 Chinese Institute of Electronics. All rights reserved.
引用
收藏
页码：1631 / 1642
页数：11
相关论文
共 31 条
  • [1] CHEN S Z, LIANG Y C, SUN S H, Et al., Vision, requirements, and technology trend of 6G: How to tackle the challenges of system coverage, capacity, user data-rate and movement speed, IEEE Wireless Communications, 27, 2, pp. 218-228, (2020)
  • [2] ZHANG H K, FENG B H, QUAN W., Fundamental research on smart integration identifier networking, Acta Electronica Sinica, 47, 5, pp. 977-982, (2019)
  • [3] CARLTON B., Nissan partners with HaptX to bring realistic touch to vehicle design
  • [4] ZHOU L, WU D, CHEN J X, Et al., Cross-modal collaborative communications, IEEE Wireless Communications, 27, 2, pp. 112-117, (2020)
  • [5] MOSKVITCH K., Tactile Internet: 5G and the cloud on steroids, Engineering & Technology, 10, 4, pp. 48-53, (2015)
  • [6] YUAN Z, WEI X, CHEN J X, Et al., Ultra-reliability connectivity with redundant D2D transmission scheme for tactile Internet, 2019 IEEE Globecom Workshops, pp. 1-6, (2019)
  • [7] ZHOU L., On data-driven delay estimation for media cloud, IEEE Transactions on Multimedia, 18, 5, pp. 905-915, (2016)
  • [8] JANKOWSKI M, GUNDUZ D, MIKOLAJCZYK K, Et al., Wireless image retrieval at the edge, IEEE Journal on Selected Areas in Communications, 39, 1, pp. 89-100, (2021)
  • [9] JANKOWSKI M, GUNDUZ D, MIKOLAJCZYK K., Deep joint source-channel coding for wireless image retrieval, 2020 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 5070-5074, (2020)
  • [10] ZHOU L, WU D, WEI X, Et al., Cross-modal stream scheduling for eHealth, IEEE Journal on Selected Areas in Communications, 39, 2, pp. 426-437, (2021)
1234