Exploration on multimodal data recognition method for Internet of Things based on deep learning

被引:0
|
作者
Zheng, Xuan [1 ,2 ]
Sun, Zheng [1 ]
机构
[1] Gannan Med Univ, Coll Med Informat Engn, Ganzhou 314000, Jiangxi, Peoples R China
[2] Zhejiang Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Multimodal data recognition method; deep learning; internet of things; long short term memory network technology; data recognition and optimization processing;
D O I
10.3233/IDT-230267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of Internet of Things (IoT) technology, a large amount of sensor data, images, voice, and other data are being widely used, bringing new opportunities for intelligent and cross-domain information fusion. Effective feature extraction and accurate recognition remain urgent issues to be addressed. This article explores the application of deep learning (DL) in multimodal data recognition methods of the IoT and proposes path optimization for multimodal data recognition methods of the IoT under DL. This article also provides in-depth analysis and discussion on the optimization of multimodal data recognition models based on DL, as well as specific measures for optimizing the path of multimodal data recognition based on DL. In this paper, the long short-term memory (LSTM) technology is introduced, and the LSTM technology is used to optimize the multi-modal data recognition method. It can be seen from the comparison that the processing efficiency of data analysis, information fusion, speech recognition, and emotion analysis of the multimodal data recognition method optimized by LSTM technology is 0.29, 0.35, 0.31, and 0.24 higher, respectively, than that of data analysis, information fusion, speech recognition, and emotion analysis before optimization. Introducing DL methods in multimodal data recognition of the IoT can effectively improve the effectiveness of data recognition and fusion and achieve higher levels of recognition for speech recognition and sentiment analysis.
引用
收藏
页码:759 / 767
页数:9
相关论文
共 50 条
  • [31] Deep-Learning-Enhanced Human Activity Recognition for Internet of Healthcare Things
    Zhou, Xiaokang
    Liang, Wei
    Wang, Kevin I-K
    Wang, Hao
    Yang, Laurence T.
    Jin, Qun
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6429 - 6438
  • [32] Toward Mathematical Representation of Emotion: A Deep Multitask Learning Method Based On Multimodal Recognition
    Harata, Seiichi
    Sakuma, Takuto
    Kato, Shohei
    COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 47 - 51
  • [33] Deep Learning in Security of Internet of Things
    Li, Yuxi
    Zuo, Yue
    Song, Houbing
    Lv, Zhihan
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22) : 22133 - 22146
  • [34] Design of Optimal Deep Learning Based Human Activity Recognition on Sensor Enabled Internet of Things Environment
    Al-Wesabi, Fahd N.
    Albraikan, Amani Abdulrahman
    Hilal, Anwer Mustafa
    Al-Shargabi, Asma Abdulghani
    Alhazbi, Saleh
    Al Duhayyim, Mesfer
    Rizwanullah, Mohammed
    Hamza, Manar Ahmed
    IEEE ACCESS, 2021, 9 : 143988 - 143996
  • [35] Intrusion detection for Industrial Internet of Things based on deep learning
    Lu, Yaoyao
    Chai, Senchun
    Suo, Yuhan
    Yao, Fenxi
    Zhang, Chen
    NEUROCOMPUTING, 2024, 564
  • [36] Intrusion Detection Model of Internet of Things Based on Deep Learning
    Wang, Yan
    Han, Dezhi
    Cui, Mingming
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2023, 20 (04) : 1519 - 1540
  • [37] Tensor Deep Learning Model for Heterogeneous Data Fusion in Internet of Things
    Wang, Wei
    Zhang, Min
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (01): : 32 - 41
  • [38] Caching Transient Data for Internet of Things: A Deep Reinforcement Learning Approach
    Zhu, Hao
    Cao, Yang
    Wei, Xiao
    Wang, Wei
    Jiang, Tao
    Jin, Shi
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02): : 2074 - 2083
  • [39] A Novel Learning Method to Classify Data Streams in the Internet of Things
    Khan, Muhammad Aamir
    Khan, Aunsia
    Khan, Muhammad Nasir
    Anwar, Sajid
    2014 NATIONAL SOFTWARE ENGINEERING CONFERENCE (NSEC - 2014), 2014, : 61 - 66
  • [40] Big data analysis of the Internet of Things in the digital twins of smart city based on deep learning
    Li, Xiaoming
    Liu, Hao
    Wang, Weixi
    Zheng, Ye
    Lv, Haibin
    Lv, Zhihan
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 128 : 167 - 177