Emotion Intensity Detection in Online Media: An Attention Mechanism Based Multimodal Deep Learning Approach

被引:0
|
作者
Chai, Yuanchen [1 ]
机构
[1] Sunshine Ruizhi Secur Consulting Beijing Co LTD, Beijing 100081, Peoples R China
来源
TEHNICKI VJESNIK-TECHNICAL GAZETTE | 2024年 / 31卷 / 02期
关键词
attention mechanism; emotion detection; multimodal; online media; NETWORK;
D O I
10.17559/TV-20230628001154
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the increasing influence of online public opinion, mining opinions and trend analysis from massive data of online media is important for understanding user sentiment, managing brand reputation, analyzing public opinion and optimizing marketing strategies. By combining data from multiple perceptual modalities, more comprehensive and accurate sentiment analysis results can be obtained. However, using multimodal data for sentiment analysis may face challenges such as data fusion, modal imbalance and inter -modal correlation. To overcome these challenges, the paper introduces an attention mechanism to multimodal sentiment analysis by constructing text, image, and audio feature extractors and using a custom cross -modal attention layer to compute the attention weights between different modalities, and finally fusing the attention -weighted features for sentiment classification. Through the cross -modal attention mechanism, the model can automatically learn the correlation between different modalities, dynamically adjust the modal weights, and selectively fuse features from different modalities, thus improving the accuracy and expressiveness of sentiment analysis.
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [41] Emotion recognition of social media users based on deep learning
    Li C.
    Li F.
    PeerJ Computer Science, 2023, 9
  • [42] Emotion recognition of social media users based on deep learning
    Li, Chen
    Li, Fanfan
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [43] A Dynamic Interference Detection Method of Underwater Scenes Based on Deep Learning and Attention Mechanism
    Shang, Shuo
    Cao, Jianrong
    Wang, Yuanchang
    Wang, Ming
    Zhao, Qianchuan
    Song, Yuanyuan
    Gao, He
    BIOMIMETICS, 2024, 9 (11)
  • [44] Identification of cyberbullying: A deep learning based multimodal approach
    Sayanta Paul
    Sriparna Saha
    Mohammed Hasanuzzaman
    Multimedia Tools and Applications, 2022, 81 : 26989 - 27008
  • [45] Identification of cyberbullying: A deep learning based multimodal approach
    Paul, Sayanta
    Saha, Sriparna
    Hasanuzzaman, Mohammed
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (19) : 26989 - 27008
  • [46] A study on the application of multidimensional feature fusion attention mechanism based on sight detection and emotion recognition in online teaching
    Huang, Yurong
    Yang, Guang
    JOURNAL OF INTELLIGENT SYSTEMS, 2024, 33 (01)
  • [47] Emotion Recognition of College Students' Online Learning Engagement Based on Deep Learning
    Wang, Chunyan
    INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2022, 17 (06) : 110 - 122
  • [48] Deep multimodal emotion recognition using modality-aware attention and proxy-based multimodal loss
    Woo, Sungpil
    Zubair, Muhammad
    Lim, Sunhwan
    Kim, Daeyoung
    INTERNET OF THINGS, 2025, 31
  • [49] Expression EEG Multimodal Emotion Recognition Method Based on the Bidirectional LSTM and Attention Mechanism
    Zhao, Yifeng
    Chen, Deyun
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
  • [50] Multimodal Data Processing Framework for Smart City: A Positional-Attention Based Deep Learning Approach
    Ma, Qianxia
    Nie, Yongfang
    Song, Jingyan
    Zhang, Tao
    IEEE ACCESS, 2020, 8 : 215505 - 215515