Adapted transformer network for news recommendation

被引:23
|
作者
Huang, Jinsheng [1 ]
Han, Zhuobing [2 ]
Xu, Hongyan [1 ]
Liu, Hongtao [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
News Recommendation; Transformer; Attention;
D O I
10.1016/j.neucom.2021.10.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online news recommendation aims to provide personalized news for users according to their interests. Existing methods usually learn user preference from their historical reading records in a static and inde-pendent way, which ignore the dynamic interaction with the target candidate news. In fact, it is impor-tant to fully capture the semantic interaction between user?s historical news and candidate news since the user?s interests would be different in terms of different candidate news. In this paper, we propose a novel news recommendation model with an adapted transformer network. There are three parts in our approach, i.e., a news encoder to learn the semantic features of news, a user encoder to learn the initial representations of users, an adapted transformer module to learn the deep interaction between users and candidate news. The core is that we effectively integrate the historical clicked news and the candidate news into the transformer framework to capture their inherent relatedness. Besides, an additive attention layer is proposed to learn different informativeness of words since different words are differently useful for news or users? representation. We conduct extensive experiments on a real-world dataset from MSN news and the results indicates the effectiveness of our proposed approach. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:119 / 129
页数:11
相关论文
共 50 条
  • [31] User Profiling based Deep Neural Network for Temporal News Recommendation
    Kumar, Vaibhav
    Khattar, Dhruv
    Gupta, Shashank
    Gupta, Manish
    Varma, Vasudeva
    2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2017), 2017, : 765 - 772
  • [32] DeepVT: Deep View-Temporal Interaction Network for News Recommendation
    Zhang, Xuanyu
    Yang, Qing
    Xu, Dongliang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2640 - 2650
  • [33] Research on News Recommendation System Based on Deep Network and Personalized Needs
    Zhang, Weijia
    Ling, Feng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [34] Heterogeneous Graph Neural Network with Personalized and Adaptive Diversity for News Recommendation
    Zhang, Guangping
    Li, Dongsheng
    Gu, Hansu
    Lu, Tun
    Gu, Ning
    ACM TRANSACTIONS ON THE WEB, 2024, 18 (03)
  • [35] DCAN: Deep Co-Attention Network by Modeling User Preference and News Lifecycle for News Recommendation
    Meng, Lingkang
    Shi, Chongyang
    Hao, Shufeng
    Su, Xiangrui
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT III, 2021, 12683 : 100 - 114
  • [36] Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network
    Xia, Lianghao
    Huang, Chao
    Xu, Yong
    Dai, Peng
    Zhang, Bo
    Bo, Liefeng
    PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 2397 - 2406
  • [37] Personalized multi-head self-attention network for news recommendation
    Zheng, Cong
    Song, Yixuan
    NEURAL NETWORKS, 2025, 181
  • [38] RMBERT: News Recommendation via Recurrent Reasoning Memory Network over BERT
    Jia, Qinglin
    Li, Jingjie
    Zhang, Qi
    He, Xiuqiang
    Zhu, Jieming
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 1773 - 1777
  • [39] Personalized Transformer for Explainable Recommendation
    Li, Lei
    Zhang, Yongfeng
    Chen, Li
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 4947 - 4957
  • [40] RCENR: A Reinforced and Contrastive Heterogeneous Network Reasoning Model for Explainable News Recommendation
    Jiang, Hao
    Li, Chuanzhen
    Cai, Juanjuan
    Wang, Jingling
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1710 - 1720