RecGPT: Generative Pre-training for Text-based Recommendation

被引:0
|
作者
Mang Ngo [1 ]
Dat Quoc Nguyen [1 ]
机构
[1] VinAI Res, Ho Chi Minh City, Vietnam
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present the first domain-adapted and fully-trained large language model, RecGPT-7B, and its instruction-following variant, RecGPT-7B-Instruct, for text-based recommendation. Experimental results on rating prediction and sequential recommendation tasks show that our model, RecGPT-7B-Instruct, outperforms previous strong baselines. We are releasing our RecGPT models as well as their pretraining and fine-tuning datasets to facilitate future research and downstream applications in text-based recommendation. Public "hugging-face" links to our RecGPT models and datasets are available at: https://github.com/VinAIResearch/RecGPT.
引用
收藏
页码:302 / 313
页数:12
相关论文
共 50 条
  • [21] PreSTU: Pre-Training for Scene-Text Understanding
    Kil, Jihyung
    Changpinyo, Soravit
    Chen, Xi
    Hu, Hexiang
    Goodman, Sebastian
    Chao, Wei-Lun
    Soricut, Radu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 15224 - 15234
  • [22] Generative Table Pre-training Empowers Models for Tabular Prediction
    Zhang, Tianping
    Wang, Shaowen
    Yale, Shuicheng
    Liu, Jian
    Liu, Qian
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 14836 - 14854
  • [23] Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect
    Zeng, Zheni
    Xiao, Chaojun
    Yao, Yuan
    Xie, Ruobing
    Liu, Zhiyuan
    Lin, Fen
    Lin, Leyu
    Sun, Maosong
    FRONTIERS IN BIG DATA, 2021, 4
  • [24] Bootstrapped Pre-training with Dynamic Identifier Prediction for Generative Retrieval
    Tang, Yubao
    Zhang, Ruqing
    Guo, Jiafeng
    de Rijke, Maarten
    Fan, Yixing
    Cheng, Xueqi
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 10303 - 10317
  • [25] Pre-Training Across Different Cities for Next POI Recommendation
    Sun, Ke
    Qian, Tieyun
    Li, Chenliang
    Ma, Xuan
    Li, Qing
    Zhong, Ming
    Zhu, Yuanyuan
    Liu, Mengchi
    ACM TRANSACTIONS ON THE WEB, 2023, 17 (04)
  • [26] GBERT: Pre-training User representations for Ephemeral Group Recommendation
    Zhang, Song
    Zheng, Nan
    Wang, Danli
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2631 - 2639
  • [27] HG-News: News Headline Generation Based on a Generative Pre-Training Model
    Li, Ping
    Yu, Jiong
    Chen, Jiaying
    Guo, Binglei
    IEEE ACCESS, 2021, 9 : 110039 - 110046
  • [28] Pre-training the deep generative models with adaptive hyperparameter optimization
    Yao, Chengwei
    Cai, Deng
    Bu, Jiajun
    Chen, Gencai
    NEUROCOMPUTING, 2017, 247 : 144 - 155
  • [29] Towards more effective encoders in pre-training for sequential recommendation
    Sun, Ke
    Qian, Tieyun
    Zhong, Ming
    Li, Xuhui
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 2801 - 2832
  • [30] Pre-training Graph Transformer with Multimodal Side Information for Recommendation
    Liu, Yong
    Yang, Susen
    Lei, Chenyi
    Wang, Guoxin
    Tang, Haihong
    Zhang, Juyong
    Sun, Aixin
    Miao, Chunyan
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2853 - 2861