Adapted transformer network for news recommendation

被引:23
|
作者
Huang, Jinsheng [1 ]
Han, Zhuobing [2 ]
Xu, Hongyan [1 ]
Liu, Hongtao [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
News Recommendation; Transformer; Attention;
D O I
10.1016/j.neucom.2021.10.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online news recommendation aims to provide personalized news for users according to their interests. Existing methods usually learn user preference from their historical reading records in a static and inde-pendent way, which ignore the dynamic interaction with the target candidate news. In fact, it is impor-tant to fully capture the semantic interaction between user?s historical news and candidate news since the user?s interests would be different in terms of different candidate news. In this paper, we propose a novel news recommendation model with an adapted transformer network. There are three parts in our approach, i.e., a news encoder to learn the semantic features of news, a user encoder to learn the initial representations of users, an adapted transformer module to learn the deep interaction between users and candidate news. The core is that we effectively integrate the historical clicked news and the candidate news into the transformer framework to capture their inherent relatedness. Besides, an additive attention layer is proposed to learn different informativeness of words since different words are differently useful for news or users? representation. We conduct extensive experiments on a real-world dataset from MSN news and the results indicates the effectiveness of our proposed approach. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:119 / 129
页数:11
相关论文
共 50 条
  • [21] KEAN: Knowledge-Enhanced and Attention Network for News Recommendation
    Wang, Yuting
    Gao, Qian
    Fan, Jun
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2022, 13368 : 437 - 449
  • [22] DACNN: Dynamic Attentive Convolution Neural Network for News Recommendation
    Pang, Yitong
    Tong, Jianing
    Zhang, Yiming
    Wei, Zhihua
    2020 5TH INTERNATIONAL CONFERENCE ON MATHEMATICS AND ARTIFICIAL INTELLIGENCE (ICMAI 2020), 2020, : 161 - 166
  • [23] Attention-Based Graph Neural Network for News Recommendation
    Ji, Zhenyan
    Wu, Mengdan
    Liu, Jirui
    Armendariz Inigo, Jose Enrique
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [24] DKN: Deep Knowledge-Aware Network for News Recommendation
    Wang, Hongwei
    Zhang, Fuzheng
    Xie, Xing
    Guo, Minyi
    WEB CONFERENCE 2018: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW2018), 2018, : 1835 - 1844
  • [25] Indonesia's Fake News Detection using Transformer Network
    Awalina, Aisyah
    Fawaid, Jibran
    Krisnabayu, Rifky Yunus
    Yudistira, Novanto
    PROCEEDINGS OF 2021 INTERNATIONAL CONFERENCE ON SUSTAINABLE INFORMATION ENGINEERING AND TECHNOLOGY, SIET 2021, 2021, : 247 - 251
  • [26] Is News Recommendation a Sequential Recommendation Task?
    Wu, Chuhan
    Wu, Fangzhao
    Qi, Tao
    Li, Chenliang
    Huang, Yongfeng
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2382 - 2386
  • [27] A Graph Convolutional Network for Session Recommendation Model Based on Improved Transformer
    Zhang, Xiaoyan
    Wang, Teng
    IEEE ACCESS, 2023, 11 : 77729 - 77736
  • [28] Session-aware Item-combination Recommendation with Transformer Network
    Lin, Tzu-Heng
    Gao, Chen
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 5708 - 5713
  • [29] Graph Transformer for Recommendation
    Li, Chaoliu
    Xia, Lianghao
    Ren, Xubin
    Ye, Yaowen
    Xu, Yong
    Huang, Chao
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1680 - 1689
  • [30] Session-based news recommendation via graph neutral network
    Zhang, Shuying
    Fan, Long
    Wang, Xuteng
    Pang, Yilin
    Huang, Xuling
    Wang, Quan
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2021, 128 : 148 - 148