Reliable Data Augmented Contrastive Learning for Sequential Recommendation

被引:0
|
作者
Zhao, Mankun [1 ,2 ,3 ]
Sun, Aitong [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Li, Xuewei [1 ,2 ,3 ]
He, Dongxiao [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
Yu, Mei [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Adv Networking TANKLab, Tianjin 300350, Peoples R China
[3] Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300350, Peoples R China
关键词
Reliability; Data augmentation; Contrastive learning; Generators; Training; Transformers; Correlation; Sequential recommendation; contrastive learning; attention mechanism; data augmentation; MATRIX FACTORIZATION;
D O I
10.1109/TBDATA.2024.3453752
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sequential recommendation aims to capture users' dynamic preferences. Due to the limited information in the sequence and the uncertain user behavior, data sparsity has always been a key problem. Although data augmentation methods can alleviate this issue, unreliable data can affect the performance of such models. To solve the above problems, we propose a new framework, namely <bold>R</bold>eliable <bold>D</bold>ata Augmented <bold>C</bold>ontrastive Learning <bold>Rec</bold>ommender (RDCRec). Specifically, in order to generate more high-quality reliable items for data augmentation, we design a multi-attributes oriented sequence generator. It moves auxiliary information from the input layer to the attention layer for learning a better attention distribution. Then, we replace a percentage of items in the original sequence with reliable items generated by the generator as the augmented sequence, for creating a high-quality view for contrastive learning. In this way, RDCRec can extract more meaningful user patterns by using the self-supervised signals of the reliable items, thereby improving recommendation performance. Finally, we train a discriminator to identify unreplaced items in the augmented sequence thus we can update item embeddings selectively in order to increase the exposure of more reliable items and improve the accuracy of recommendation results. The discriminator, as an auxiliary model, is jointly trained with the generative task and the contrastive learning task. Large experiments on four popular datasets that are commonly used demonstrate the effectiveness of our new method for sequential recommendation.
引用
收藏
页码:694 / 705
页数:12
相关论文
共 50 条
  • [11] Self-guided Contrastive Learning for Sequential Recommendation
    Shi, Hui
    Du, Hanwen
    Hao, Yongjing
    Sheng, Victor S.
    Cui, Zhiming
    Zhao, Pengpeng
    WEB AND BIG DATA, PT III, APWEB-WAIM 2022, 2023, 13423 : 72 - 86
  • [12] Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation
    Qiu, Ruihong
    Huang, Zi
    Yin, Hongzhi
    Wang, Zijian
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 813 - 823
  • [13] Meta-optimized Contrastive Learning for Sequential Recommendation
    Qin, Xiuyuan
    Yuan, Huanhuan
    Zhao, Pengpeng
    Fang, Junhua
    Zhuang, Fuzhen
    Liu, Guanfeng
    Liu, Yanchi
    Sheng, Victor
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 89 - 98
  • [14] Intent Contrastive Learning with Cross Subsequences for Sequential Recommendation
    Qin, Xiuyuan
    Yuan, Huanhuan
    Zhao, Pengpeng
    Liu, Guanfeng
    Zhuang, Fuzhen
    Sheng, Victor S.
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 548 - 556
  • [15] HICL: Hierarchical Intent Contrastive Learning for sequential recommendation
    Kang, Yan
    Yuan, Yancong
    Pu, Bin
    Yang, Yun
    Zhao, Lei
    Guo, Jing
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [16] Learnable Model Augmentation Contrastive Learning for Sequential Recommendation
    Hao, Yongjing
    Zhao, Pengpeng
    Xian, Xuefeng
    Liu, Guanfeng
    Zhao, Lei
    Liu, Yanchi
    Sheng, Victor S.
    Zhou, Xiaofang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (08) : 3963 - 3976
  • [17] Counterfactual Data-Augmented Sequential Recommendation
    Wang, Zhenlei
    Zhang, Jingsen
    Xu, Hongteng
    Chen, Xu
    Zhang, Yongfeng
    Zhao, Wayne Xin
    Wen, Ji-Rong
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 347 - 356
  • [18] Long-Tail Augmented Graph Contrastive Learning for Recommendation
    Zhao, Qian
    Wu, Zhengwei
    Zhang, Zhiqiang
    Zhou, Jun
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT IV, 2023, 14172 : 387 - 403
  • [19] Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation
    Qiu, Ruihong
    Huang, Zi
    Yin, Hongzhi
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 519 - 528
  • [20] Soft Contrastive Sequential Recommendation
    Zhang, Yabin
    Wang, Zhenlei
    Yu, Wenhui
    Hu, Lantao
    Jiang, Peng
    Gai, Kung
    Chen, Xu
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (06)