Guiding Graph Learning with Denoised Modality for Multi-modal Recommendation

被引:0
|
作者
Wang, Yuexian [1 ]
Ma, Wenze [1 ]
Zhu, Yanmin [1 ]
Wang, Chunyang [1 ]
Wang, Zhaobo [1 ]
Tang, Feilong [1 ]
Yu, Jiadi [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai 201109, Peoples R China
基金
美国国家科学基金会;
关键词
Multi-modal Recommendation; Graph Structure Learning; Self-supervised Learning;
D O I
10.1007/978-981-97-5572-1_14
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-modal recommendation improves the recommendation accuracy by leveraging various modalities (e.g., visual, textual, and acoustic) of rich item content. However, most existing studies overlook that modality features can be noisy for recommendation. Recently, several graph-based methods have attempted to alleviate the noise issue via graph structure learning, but they roughly focus on edge denoising while neglecting node denoising. This will lead to the following circumstances: 1) noisy factors at the node level and 2) insufficient edge-level denoising. To address the limitations, we propose a Denoised Modality-guided Graph Learning paradigm (DMGL), which could jointly and iteratively eliminate both the node-level and edge-level noise for multi-modal recommendation. Meanwhile, masked feature autoencoder and contrastive learning mechanism are introduced to handle intra- and inter-modality node-level noise, respectively. Extensive experiments on real-world datasets demonstrate the superior performance of our proposed model. The codes are available here.
引用
收藏
页码:220 / 235
页数:16
相关论文
共 50 条
  • [1] Collaborative denoised graph contrastive learning for multi-modal recommendation
    Xu, Fuyong
    Zhu, Zhenfang
    Fu, Yixin
    Wang, Ru
    Liu, Peiyu
    INFORMATION SCIENCES, 2024, 679
  • [2] Multi-modal Graph and Sequence Fusion Learning for Recommendation
    Wang, Zejun
    Wu, Xinglong
    Yang, Hongwei
    He, Hui
    Tai, Yu
    Zhang, Weizhe
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT I, 2024, 14425 : 357 - 369
  • [3] Multi-modal Graph Contrastive Learning for Micro-video Recommendation
    Yi, Zixuan
    Wang, Xi
    Ounis, Iadh
    Macdonald, Craig
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1807 - 1811
  • [4] Graph neural networks with deep mutual learning for designing multi-modal recommendation systems
    Li, Jianing
    Yang, Chaoqun
    Ye, Guanhua
    Nguyen, Quoc Viet Hung
    INFORMATION SCIENCES, 2024, 654
  • [5] Enhancing Adversarial Robustness of Multi-modal Recommendation via Modality Balancing
    Shang, Yu
    Gao, Chen
    Chen, Jiansheng
    Jin, Depeng
    Ma, Huimin
    Li, Yong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6274 - 6282
  • [6] Multi-Modal Transportation Recommendation Based on Graph Embedding and CaGBDT
    Sun Q.-M.
    Chang L.
    Ma C.
    Qu Z.-J.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2021, 44 (05): : 81 - 87and106
  • [7] A Unified Graph Transformer for Overcoming Isolations in Multi-modal Recommendation
    Yi, Zixuan
    Ounis, Iadh
    PROCEEDINGS OF THE EIGHTEENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2024, 2024, : 518 - 527
  • [8] Multi-Modal Graph Learning for Disease Prediction
    Zheng, Shuai
    Zhu, Zhenfeng
    Liu, Zhizhe
    Guo, Zhenyu
    Liu, Yang
    Yang, Yuchen
    Zhao, Yao
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (09) : 2207 - 2216
  • [9] Multi-modal graph learning for disease prediction
    Zheng, Shuai
    Zhu, Zhenfeng
    Liu, Zhizhe
    Guo, Zhenyu
    Liu, Yang
    Zhao, Yao
    arXiv, 2021,
  • [10] Preserving Modality Structure Improves Multi-Modal Learning
    Swetha, Sirnam
    Rizve, Mamshad Nayeem
    Shvetsova, Nina
    Kuehne, Hilde
    Shah, Mubarak
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21936 - 21946