Guiding Graph Learning with Denoised Modality for Multi-modal Recommendation

被引:0
|
作者
Wang, Yuexian [1 ]
Ma, Wenze [1 ]
Zhu, Yanmin [1 ]
Wang, Chunyang [1 ]
Wang, Zhaobo [1 ]
Tang, Feilong [1 ]
Yu, Jiadi [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai 201109, Peoples R China
基金
美国国家科学基金会;
关键词
Multi-modal Recommendation; Graph Structure Learning; Self-supervised Learning;
D O I
10.1007/978-981-97-5572-1_14
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-modal recommendation improves the recommendation accuracy by leveraging various modalities (e.g., visual, textual, and acoustic) of rich item content. However, most existing studies overlook that modality features can be noisy for recommendation. Recently, several graph-based methods have attempted to alleviate the noise issue via graph structure learning, but they roughly focus on edge denoising while neglecting node denoising. This will lead to the following circumstances: 1) noisy factors at the node level and 2) insufficient edge-level denoising. To address the limitations, we propose a Denoised Modality-guided Graph Learning paradigm (DMGL), which could jointly and iteratively eliminate both the node-level and edge-level noise for multi-modal recommendation. Meanwhile, masked feature autoencoder and contrastive learning mechanism are introduced to handle intra- and inter-modality node-level noise, respectively. Extensive experiments on real-world datasets demonstrate the superior performance of our proposed model. The codes are available here.
引用
收藏
页码:220 / 235
页数:16
相关论文
共 50 条
  • [41] Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment
    Li, Qian
    Ji, Cheng
    Guo, Shu
    Liang, Zhaoji
    Wang, Lihong
    Li, Jianxin
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 987 - 999
  • [42] Multi-modal anchor adaptation learning for multi-modal summarization
    Chen, Zhongfeng
    Lu, Zhenyu
    Rong, Huan
    Zhao, Chuanjun
    Xu, Fan
    NEUROCOMPUTING, 2024, 570
  • [43] DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency
    Yao, Wenfang
    Yin, Kejing
    Cheung, William K.
    Liu, Jia
    Qin, Jing
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16416 - 16424
  • [44] Modality Mixer for Multi-modal Action Recognition
    Lee, Sumin
    Woo, Sangmin
    Park, Yeonju
    Nugroho, Muhammad Adi
    Kim, Changick
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 3297 - 3306
  • [45] Multi-modal Navigation Interaction Recommendation with a Driver Demand-Based Knowledge Graph
    Chen, Keqi
    Ma, Jun
    Zhang, Qianwen
    Bai, Yue
    PROCEEDINGS OF THE 10TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE GRAPHS (IJCKG 2021), 2021, : 195 - 199
  • [46] MMGCN: Multi-modal Graph Convolution Network for Personalized Recommendation of Micro-video
    Wei, Yinwei
    Wang, Xiang
    Nie, Liqiang
    He, Xiangnan
    Hong, Richang
    Chua, Tat-Seng
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1437 - 1445
  • [47] On Graph Calculi for Multi-modal Logics
    Veloso, Paulo A. S.
    Veloso, Sheila R. M.
    Benevides, Mario R. F.
    ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2015, 312 : 231 - 252
  • [48] Multi-modal Subspace Learning with Joint Graph Regularization for Cross-modal Retrieval
    Wang, Kaiye
    Wang, Wei
    He, Ran
    Wang, Liang
    Tan, Tieniu
    2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013), 2013, : 236 - 240
  • [49] Modality-Aware Mutual Learning for Multi-modal Medical Image Segmentation
    Zhang, Yao
    Yang, Jiawei
    Tian, Jiang
    Shi, Zhongchao
    Zhong, Cheng
    Zhang, Yang
    He, Zhiqiang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 589 - 599
  • [50] Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
    Liang, Weixin
    Zhang, Yuhui
    Kwon, Yongchan
    Yeung, Serena
    Zou, James
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,