Interpretable disease prediction using heterogeneous patient records with self-attentive fusion encoder

被引:3
|
作者
Kwak, Heeyoung [1 ]
Chang, Jooyoung [2 ]
Choe, Byeongjin [1 ]
Park, Sangmin [2 ,3 ]
Jung, Kyomin [1 ]
机构
[1] Seoul Natl Univ, Dept Elect Engn, 1 Gwanak Ro, Seoul 08826, South Korea
[2] Seoul Natl Univ, Dept Biomed Sci, Seoul, South Korea
[3] Seoul Natl Univ Hosp, Dept Family Med, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
disease prediction; cardiovascular disease; deep learning; recurrent neural network; attention;
D O I
10.1093/jamia/ocab109
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective: We propose an interpretable disease prediction model that efficiently fuses multiple types of patient records using a self-attentive fusion encoder. We assessed the model performance in predicting cardiovascular disease events, given the records of a general patient population. Materials and Methods: We extracted 7981 1 1 ses and 67 623 controls from the sample cohort database and nationwide healthcare claims data of South Korea. Among the information provided, our model used the sequential records of medical codes and patient characteristics, such as demographic profiles and the most recent health examination results. These two types of patient records were combined in our self-attentive fusion module, whereas previously dominant methods aggregated them using a simple concatenation. The prediction performance was compared to state-of-the-art recurrent neural network-based approaches and other widely used machine learning approaches. Results: Our model outperformed all the other compared methods in predicting cardiovascular disease events. It achieved an area under the curve of 0.839, while the other compared methods achieved between 0.74111 d 0.830. Moreover, our model consistently outperformed the other methods in a more challenging setting in which we tested the model's ability to draw an inference from more nonobvious, diverse factors. Discussion: We also interpreted the attention weights provided by our model as the relative importance of each time step in the sequence. We showed that our model reveals the informative parts of the patients' history by measuring the attention weights. Conclusion: We suggest an interpretable disease prediction model that efficiently fuses heterogeneous patient records and demonstrates superior disease prediction performance.
引用
收藏
页码:2155 / 2164
页数:10
相关论文
共 50 条
  • [41] DeFuseDTI: Interpretable drug target interaction prediction model with dual-branch encoder and multiview fusion
    Feng, Bao-Ming
    Zhang, Yuan-Yuan
    Niu, Niu-Wang-Jie
    Zheng, Hao-Yu
    Wang, Jin-Long
    Feng, Wen-Feng
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 239 - 247
  • [42] BP-GAN: Interpretable Human Branchpoint Prediction Using Attentive Generative Adversarial Networks
    Lee, Hyeonseok
    Yeom, Sangwoo
    Kim, Sungchan
    IEEE ACCESS, 2020, 8 (08): : 97851 - 97862
  • [43] Health Condition Assessment for Pumped Storage Units Using Multihead Self-Attentive Mechanism and Improved Radar Chart
    Zhang, Xiaoyuan
    Jiang, Yajun
    Wang, Xian-Bo
    Li, Chaoshun
    Zhang, Jinhao
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (11) : 8087 - 8097
  • [44] Deep-Learning Temporal Predictor via Bidirectional Self-Attentive Encoder-Decoder Framework for IOT-Based Environmental Sensing in Intelligent Greenhouse
    Jin, Xue-Bo
    Zheng, Wei-Zhen
    Kong, Jian-Lei
    Wang, Xiao-Yi
    Zuo, Min
    Zhang, Qing-Chuan
    Lin, Seng
    AGRICULTURE-BASEL, 2021, 11 (08):
  • [45] A multitype software buffer overflow vulnerability prediction method based on a software graph structure and a self-attentive graph neural network
    Zheng, Zhangqi
    Liu, Yongshan
    Zhang, Bing
    Liu, Xinqian
    He, Hongyan
    Gong, Xiang
    INFORMATION AND SOFTWARE TECHNOLOGY, 2023, 160
  • [46] Privacy-Aware Federated Learning Framework for IoT Security Using Chameleon Swarm Optimization and Self-Attentive Variational Autoencoder
    Alahmari, Saad
    Alkharashi, Abdulwhab
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2025,
  • [47] Fault Detection and Diagnosis Using Self-Attentive Convolutional Neural Networks for Variable-Length Sensor Data in Semiconductor Manufacturing
    Kim, Eunji
    Cho, Sungzoon
    Lee, Byeongeon
    Cho, Myoungsu
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2019, 32 (03) : 302 - 309
  • [48] Reconciling predictive and interpretable performance in repeat buyer prediction via model distillation and heterogeneous classifiers fusion
    Shen, Yaohan
    Xu, Xianhao
    Cao, Jingjing
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (13): : 9495 - 9508
  • [49] Reconciling predictive and interpretable performance in repeat buyer prediction via model distillation and heterogeneous classifiers fusion
    Yaohan Shen
    Xianhao Xu
    Jingjing Cao
    Neural Computing and Applications, 2020, 32 : 9495 - 9508
  • [50] Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion
    Zheng, Meng
    Planche, Benjamin
    Gong, Xuan
    Yang, Fan
    Chen, Terrence
    Wu, Ziyan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VII, 2022, 13437 : 115 - 125