Adapted transformer network for news recommendation

被引:23
|
作者
Huang, Jinsheng [1 ]
Han, Zhuobing [2 ]
Xu, Hongyan [1 ]
Liu, Hongtao [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
News Recommendation; Transformer; Attention;
D O I
10.1016/j.neucom.2021.10.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online news recommendation aims to provide personalized news for users according to their interests. Existing methods usually learn user preference from their historical reading records in a static and inde-pendent way, which ignore the dynamic interaction with the target candidate news. In fact, it is impor-tant to fully capture the semantic interaction between user?s historical news and candidate news since the user?s interests would be different in terms of different candidate news. In this paper, we propose a novel news recommendation model with an adapted transformer network. There are three parts in our approach, i.e., a news encoder to learn the semantic features of news, a user encoder to learn the initial representations of users, an adapted transformer module to learn the deep interaction between users and candidate news. The core is that we effectively integrate the historical clicked news and the candidate news into the transformer framework to capture their inherent relatedness. Besides, an additive attention layer is proposed to learn different informativeness of words since different words are differently useful for news or users? representation. We conduct extensive experiments on a real-world dataset from MSN news and the results indicates the effectiveness of our proposed approach. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:119 / 129
页数:11
相关论文
共 50 条
  • [1] News Recommendation Model Based on Transformer and Heterogenous Graph Neural Network
    Zhang, Yupeng
    Li, Xiangju
    Li, Chao
    Zhao, Zhongying
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2022, 35 (09): : 839 - 848
  • [2] New method for news recommendation based on Transformer and knowledge graph
    Feng L.-Z.
    Yang Y.
    Wang Y.-W.
    Yang G.-J.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (01): : 133 - 143
  • [3] iSoNTRE: the Social Network Transformer into Recommendation Engine
    Chamsi Abu Quba, Rana
    Hassas, Salima
    Fayyad, Usama
    Alshomary, Milad
    Gertosio, Christine
    2014 IEEE/ACS 11TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2014, : 169 - 175
  • [4] Personalized Dual Transformer Network for sequential recommendation
    Ge, Meiling
    Wang, Chengduan
    Qin, Xueyang
    Dai, Jiangyan
    Huang, Lei
    Qin, Qibing
    Zhang, Wenfeng
    NEUROCOMPUTING, 2025, 622
  • [5] Interaction Graph Neural Network for News Recommendation
    Qia, Yongye
    Zhao, Pengpeng
    Li, Zhixu
    Fang, Junhua
    Zhao, Lei
    Sheng, Victor S.
    Cui, Zhiming
    WEB INFORMATION SYSTEMS ENGINEERING - WISE 2019, 2019, 11881 : 599 - 614
  • [6] Dynamic Hierarchical Attention Network for news recommendation
    Zhao, Qinghua
    Chen, Xu
    Zhang, Hui
    Li, Xinlu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255
  • [7] Hierarchical Preference Hash Network for News Recommendation
    Duan, Jianyong
    Li, Liangcai
    Zhang, Mei
    Wang, Hao
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (02) : 355 - 363
  • [8] Dynamic News Recommendation with Hierarchical Attention Network
    Zhang, Hui
    Chen, Xu
    Ma, Shuai
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1456 - 1461
  • [9] Personalized News Recommendation Algorithm for Event Network
    Han, Yufan
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [10] TNOD: Transformer Network with Object Detection for Tag Recommendation
    Feng, Kai
    Liu, Tao
    Zhang, Heng
    Meng, Zihao
    Miao, Zemin
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 617 - 621