Effect of missing data on multitask prediction methods

被引:26
|
作者
de Leon, Antonio de la Vega [1 ]
Chen, Beining [2 ]
Gillet, Valerie J. [1 ]
机构
[1] Univ Sheffield, Informat Sch, Regent Court, 211 Portobello, Sheffield S1 4DP, S Yorkshire, England
[2] Univ Sheffield, Dept Chem, Dainton Bldg,Brook Hill, Sheffield S3 7HF, S Yorkshire, England
来源
关键词
Multitask prediction; Sparse data sets; Missing data; Deep neural networks; Macau; DEEP; OPPORTUNITIES; CHALLENGES;
D O I
10.1186/s13321-018-0281-z
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
There has been a growing interest in multitask prediction in chemoinformatics, helped by the increasing use of deep neural networks in this field. This technique is applied to multitarget data sets, where compounds have been tested against different targets, with the aim of developing models to predict a profile of biological activities for a given compound. However, multitarget data sets tend to be sparse; i.e., not all compound-target combinations have experimental values. There has been little research on the effect of missing data on the performance of multitask methods. We have used two complete data sets to simulate sparseness by removing data from the training set. Different models to remove the data were compared. These sparse sets were used to train two different multitask methods, deep neural networks and Macau, which is a Bayesian probabilistic matrix factorization technique. Results from both methods were remarkably similar and showed that the performance decrease because of missing data is at first small before accelerating after large amounts of data are removed. This work provides a first approximation to assess how much data is required to produce good performance in multitask prediction exercises.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Improved methods for the imputation of missing data by nearest neighbor methods
    Tutz, Gerhard
    Ramzan, Shahla
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2015, 90 : 84 - 99
  • [42] Methods for Handling Missing Variables in Risk Prediction Models
    Held, Ulrike
    Kessels, Alfons
    Aymerich, Judith Garcia
    Basagana, Xavier
    ter Riet, Gerben
    Moons, Karel G. M.
    Puhan, Milo A.
    AMERICAN JOURNAL OF EPIDEMIOLOGY, 2016, 184 (07) : 545 - 551
  • [43] Reducing missing data in surveys: An overview of methods
    de Leeuw, ED
    QUALITY & QUANTITY, 2001, 35 (02) : 147 - 160
  • [44] ROBUST PCA METHODS FOR COMPLETE AND MISSING DATA
    Karhunen, Juha
    NEURAL NETWORK WORLD, 2011, 21 (05) : 357 - 392
  • [45] Missing data and imputation methods in partition of variables
    da Silva, AL
    Saporta, G
    Bacelar-Nicolau, H
    CLASSIFICATION, CLUSTERING, AND DATA MINING APPLICATIONS, 2004, : 631 - 637
  • [46] Methods to impute missing genotypes for population data
    Yu, Zhaoxia
    Schaid, Daniel J.
    HUMAN GENETICS, 2007, 122 (05) : 495 - 504
  • [47] Bayesian methods for dealing with missing data problems
    Zhihua Ma
    Guanghui Chen
    Journal of the Korean Statistical Society, 2018, 47 : 297 - 313
  • [48] Bayesian methods for dealing with missing data problems
    Ma, Zhihua
    Chen, Guanghui
    JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2018, 47 (03) : 297 - 313
  • [49] Missing Data in Clinical Studies: Issues and Methods
    Ibrahim, Joseph G.
    Chu, Haitao
    Chen, Ming-Hui
    JOURNAL OF CLINICAL ONCOLOGY, 2012, 30 (26) : 3297 - 3303
  • [50] Methods for Handling Missing Secondary Respondent Data
    Young, Rebekah
    Johnson, David
    JOURNAL OF MARRIAGE AND FAMILY, 2013, 75 (01) : 221 - 234