Learnable Model Augmentation Contrastive Learning for Sequential Recommendation

被引:0
|
作者
Hao, Yongjing [1 ]
Zhao, Pengpeng [1 ]
Xian, Xuefeng [2 ]
Liu, Guanfeng [3 ]
Zhao, Lei [1 ]
Liu, Yanchi [4 ]
Sheng, Victor S. [5 ]
Zhou, Xiaofang [6 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Soochow Vocat Univ, Suzhou 215123, Peoples R China
[3] Macquarie Univ, Sydney, NSW 2109, Australia
[4] Rutgers State Univ, New Brunswick, NJ 08901 USA
[5] Texas Tech Univ, Dept Comp Sci, Lubbock, TX 79409 USA
[6] Hong Kong Univ Sci & Technol, Hong Kong 999077, Peoples R China
关键词
Task analysis; Electronic mail; Data augmentation; Semantics; Markov processes; Data models; Neurons; Contrastive learning; learnable dropout; model augmentation; multi-positive pairs; sequential recommendation;
D O I
10.1109/TKDE.2023.3330426
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sequential Recommendation (SR) methods play a crucial role in recommender systems, which aims to capture users' dynamic interest from their historical interactions. Recently, Contrastive Learning (CL), which has emerged as a successful method for sequential recommendation, utilizes various data augmentations to generate contrastive views to mine supervised signals from data to alleviate data sparsity issues. However, most existing sequential data augmentation methods may destroy semantic sequential interaction characteristics. Meanwhile, they often adopt random operations when generating contrastive views leading to suboptimal performance. To this end, in this paper, we propose a Learnable Model Augmentation Contrastive learning for sequential Recommendation (LMA4Rec). Specifically, LMA4Rec first takes the model-based augmentation method to generate constructive views. Then, LMA4Rec uses Learnable Bernoulli Dropout (LBD) to implement learnable model augmentation operations. Next, contrastive learning is used between the contrastive views to extract supervised signals. Furthermore, a novel multi-positive contrastive learning loss alleviates the supervised sparsity issue. Finally, experiments on public datasets show that our LMA4Rec method effectively improved sequential recommendation performance compared with the state-of-the-art baseline methods.
引用
收藏
页码:3963 / 3976
页数:14
相关论文
共 50 条
  • [21] Graph Similarity Learning Based on Learnable Augmentation and Multi-Level Contrastive Learning
    Feng, Jian
    Guo, Yifan
    Du, Cailing
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 5135 - 5151
  • [22] Multi-pair Contrastive Learning Based on Same-Timestamp Data Augmentation for Sequential Recommendation
    Zheng, Shun
    Wang, Shaoqing
    Zhang, Lijie
    Zhang, Yao
    Sun, Fuzhen
    WEB AND BIG DATA, PT III, APWEB-WAIM 2023, 2024, 14333 : 174 - 187
  • [23] Self-guided Contrastive Learning for Sequential Recommendation
    Shi, Hui
    Du, Hanwen
    Hao, Yongjing
    Sheng, Victor S.
    Cui, Zhiming
    Zhao, Pengpeng
    WEB AND BIG DATA, PT III, APWEB-WAIM 2022, 2023, 13423 : 72 - 86
  • [24] Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation
    Qiu, Ruihong
    Huang, Zi
    Yin, Hongzhi
    Wang, Zijian
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 813 - 823
  • [25] Reliable Data Augmented Contrastive Learning for Sequential Recommendation
    Zhao, Mankun
    Sun, Aitong
    Yu, Jian
    Li, Xuewei
    He, Dongxiao
    Yu, Ruiguo
    Yu, Mei
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (06) : 694 - 705
  • [26] Meta-optimized Contrastive Learning for Sequential Recommendation
    Qin, Xiuyuan
    Yuan, Huanhuan
    Zhao, Pengpeng
    Fang, Junhua
    Zhuang, Fuzhen
    Liu, Guanfeng
    Liu, Yanchi
    Sheng, Victor
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 89 - 98
  • [27] Intent Contrastive Learning with Cross Subsequences for Sequential Recommendation
    Qin, Xiuyuan
    Yuan, Huanhuan
    Zhao, Pengpeng
    Liu, Guanfeng
    Zhuang, Fuzhen
    Sheng, Victor S.
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 548 - 556
  • [28] HICL: Hierarchical Intent Contrastive Learning for sequential recommendation
    Kang, Yan
    Yuan, Yancong
    Pu, Bin
    Yang, Yun
    Zhao, Lei
    Guo, Jing
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [29] Soft Contrastive Sequential Recommendation
    Zhang, Yabin
    Wang, Zhenlei
    Yu, Wenhui
    Hu, Lantao
    Jiang, Peng
    Gai, Kung
    Chen, Xu
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (06)
  • [30] Periodicity May Be Emanative: Hierarchical Contrastive Learning for Sequential Recommendation
    Tian, Changxin
    Hu, Binbin
    Zhao, Wayne Xin
    Zhang, Zhiqiang
    Zhou, Jun
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2442 - 2451