Emotion Intensity Detection in Online Media: An Attention Mechanism Based Multimodal Deep Learning Approach

被引:0
|
作者
Chai, Yuanchen [1 ]
机构
[1] Sunshine Ruizhi Secur Consulting Beijing Co LTD, Beijing 100081, Peoples R China
来源
TEHNICKI VJESNIK-TECHNICAL GAZETTE | 2024年 / 31卷 / 02期
关键词
attention mechanism; emotion detection; multimodal; online media; NETWORK;
D O I
10.17559/TV-20230628001154
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the increasing influence of online public opinion, mining opinions and trend analysis from massive data of online media is important for understanding user sentiment, managing brand reputation, analyzing public opinion and optimizing marketing strategies. By combining data from multiple perceptual modalities, more comprehensive and accurate sentiment analysis results can be obtained. However, using multimodal data for sentiment analysis may face challenges such as data fusion, modal imbalance and inter -modal correlation. To overcome these challenges, the paper introduces an attention mechanism to multimodal sentiment analysis by constructing text, image, and audio feature extractors and using a custom cross -modal attention layer to compute the attention weights between different modalities, and finally fusing the attention -weighted features for sentiment classification. Through the cross -modal attention mechanism, the model can automatically learn the correlation between different modalities, dynamically adjust the modal weights, and selectively fuse features from different modalities, thus improving the accuracy and expressiveness of sentiment analysis.
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [31] Emotion Recognition Using Multimodal Deep Learning
    Liu, Wei
    Zheng, Wei-Long
    Lu, Bao-Liang
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT II, 2016, 9948 : 521 - 529
  • [32] A hybrid deep learning approach for online learners' recognition using screen name, and learners' emotion detection
    Rao, K. Purushottama
    Janet, B.
    INTERNATIONAL JOURNAL OF TECHNOLOGY ENHANCED LEARNING, 2024, 16 (03) : 235 - 252
  • [33] Multimodal False News Detection Based on Fusion Attention Mechanism
    Liu, Hualing
    Chen, Shanghui
    Qiao, Liang
    Liu, Yaxin
    Computer Engineering and Applications, 2023, 59 (09) : 95 - 103
  • [34] Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism
    Yan, Yuhan
    Fu, Haiyan
    Wu, Fan
    ELECTRONICS, 2024, 13 (18)
  • [35] Deep-Learning-Based Multimodal Emotion Classification for Music Videos
    Pandeya, Yagya Raj
    Bhattarai, Bhuwan
    Lee, Joonwhoan
    SENSORS, 2021, 21 (14)
  • [36] Sarcasm detection in hotel reviews: a multimodal deep learning approach
    Liu, Yang
    Chi, Maomao
    Sun, Qiong
    JOURNAL OF HOSPITALITY AND TOURISM TECHNOLOGY, 2024, 15 (04) : 519 - 533
  • [37] Deep Feature Extraction and Attention Fusion for Multimodal Emotion Recognition
    Yang, Zhiyi
    Li, Dahua
    Hou, Fazheng
    Song, Yu
    Gao, Qiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (03) : 1526 - 1530
  • [38] An Ensemble Deep Learning Approach for Emotion Detection in Arabic Tweets
    Mansy, Alaa
    Rady, Sherine
    Gharib, Tarek
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (04) : 980 - 990
  • [39] A happiness emotion detection method based on deep learning
    Wu, Rongteng
    Xie, Xiaohong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VII, 2020, 11550
  • [40] Improving Deep Learning-Based Cloud Detection for Satellite Images With Attention Mechanism
    Zhang, Li
    Sun, Jiahui
    Yang, Xubing
    Jiang, Rui
    Ye, Qiaolin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19