RecGPT: Generative Pre-training for Text-based Recommendation

被引:0
|
作者
Mang Ngo [1 ]
Dat Quoc Nguyen [1 ]
机构
[1] VinAI Res, Ho Chi Minh City, Vietnam
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present the first domain-adapted and fully-trained large language model, RecGPT-7B, and its instruction-following variant, RecGPT-7B-Instruct, for text-based recommendation. Experimental results on rating prediction and sequential recommendation tasks show that our model, RecGPT-7B-Instruct, outperforms previous strong baselines. We are releasing our RecGPT models as well as their pretraining and fine-tuning datasets to facilitate future research and downstream applications in text-based recommendation. Public "hugging-face" links to our RecGPT models and datasets are available at: https://github.com/VinAIResearch/RecGPT.
引用
收藏
页码:302 / 313
页数:12
相关论文
共 50 条
  • [41] Clustering swap prediction for image-text pre-training
    Sun, Fayou
    Ngo, Hea Choon
    Sek, Yong Wee
    Meng, Zuqiang
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [42] LocVTP: Video-Text Pre-training for Temporal Localization
    Cao, Meng
    Yang, Tianyu
    Weng, Junwu
    Zhang, Can
    Wang, Jue
    Zou, Yuexian
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 38 - 56
  • [43] DeviceGPT: A Generative Pre-Training Transformer on the Heterogenous Graph for Internet of Things
    Ren, Yimo
    Wang, Jinfa
    Li, Hong
    Zhu, Hongsong
    Sun, Limin
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1929 - 1933
  • [44] Conditional Variational Autoencoder with Balanced Pre-training for Generative Adversarial Networks
    Yao, Yuchong
    Wang, Xiaohui
    Ma, Yuanbang
    Fang, Han
    Wei, Jiaying
    Chen, Liyuan
    Anaissi, Ali
    Braytee, Ali
    2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 156 - 165
  • [45] Research on Pre-Training Models for Tibetan Text with Character Awareness
    Gadeng, Luosang
    Nyima, Tashi
    Computer Engineering and Applications, 2024, 60 (21) : 127 - 133
  • [46] GPT-GNN: Generative Pre-Training of Graph Neural Networks
    Hu, Ziniu
    Dong, Yuxiao
    Wang, Kuansan
    Chang, Kai-Wei
    Sun, Yizhou
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1857 - 1867
  • [47] Predicting City Origin-Destination Flow with Generative Pre-training
    Zhang, Mingwei
    Gao, Lizhong
    Wang, Qiao
    Gao, Weihao
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT IX, 2024, 15024 : 233 - 245
  • [48] Generative Pre-training for Paraphrase Generation by Representing and Predicting Spans in Exemplars
    Bui, Tien-Cuong
    Le, Van-Duc
    To, Hai-Thien
    Cha, Sang Kyun
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2021), 2021, : 83 - 90
  • [49] Video-Text Pre-training with Learned Regions for Retrieval
    Yan, Rui
    Shou, Mike Zheng
    Ge, Yixiao
    Wang, Jinpeng
    Lin, Xudong
    Cai, Guanyu
    Tang, Jinhui
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3100 - 3108
  • [50] Medical text classification based on the discriminative pre-training model and prompt-tuning
    Wang, Yu
    Wang, Yuan
    Peng, Zhenwan
    Zhang, Feifan
    Zhou, Luyao
    Yang, Fei
    DIGITAL HEALTH, 2023, 9