Effect of missing data on multitask prediction methods

被引:26
|
作者
de Leon, Antonio de la Vega [1 ]
Chen, Beining [2 ]
Gillet, Valerie J. [1 ]
机构
[1] Univ Sheffield, Informat Sch, Regent Court, 211 Portobello, Sheffield S1 4DP, S Yorkshire, England
[2] Univ Sheffield, Dept Chem, Dainton Bldg,Brook Hill, Sheffield S3 7HF, S Yorkshire, England
来源
关键词
Multitask prediction; Sparse data sets; Missing data; Deep neural networks; Macau; DEEP; OPPORTUNITIES; CHALLENGES;
D O I
10.1186/s13321-018-0281-z
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
There has been a growing interest in multitask prediction in chemoinformatics, helped by the increasing use of deep neural networks in this field. This technique is applied to multitarget data sets, where compounds have been tested against different targets, with the aim of developing models to predict a profile of biological activities for a given compound. However, multitarget data sets tend to be sparse; i.e., not all compound-target combinations have experimental values. There has been little research on the effect of missing data on the performance of multitask methods. We have used two complete data sets to simulate sparseness by removing data from the training set. Different models to remove the data were compared. These sparse sets were used to train two different multitask methods, deep neural networks and Macau, which is a Bayesian probabilistic matrix factorization technique. Results from both methods were remarkably similar and showed that the performance decrease because of missing data is at first small before accelerating after large amounts of data are removed. This work provides a first approximation to assess how much data is required to produce good performance in multitask prediction exercises.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Effect of Missing Data Types and Imputation Methods on Supervised Classifiers: An Evaluation Study
    Gabr, Menna Ibrahim
    Helmy, Yehia Mostafa
    Elzanfaly, Doaa Saad
    BIG DATA AND COGNITIVE COMPUTING, 2023, 7 (01)
  • [32] FILLING MISSING DATA USING INTERPOLATION METHODS: STUDY ON THE EFFECT OF FITTING DISTRIBUTION
    Noor, M. N.
    Yahaya, A. S.
    Ramli, N. A.
    Al Bakri, A. M. Mustafa
    ADVANCED MATERIALS ENGINEERING AND TECHNOLOGY II, 2014, 594-595 : 889 - +
  • [33] Missing data imputation using machine learning based methods to improve HCC survival prediction
    Yumus, Mehmethan
    Apaydin, Merve
    Degirmenci, Ali
    Karal, Omer
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [34] Filter-based feature selection methods in the presence of missing data for medical prediction models
    Zeliha Ergul Aydin
    Zehra Kamisli Ozturk
    Multimedia Tools and Applications, 2024, 83 : 24187 - 24216
  • [35] Impact of missing data on the prediction of random fields
    Hamaz, Abdelghani
    Arezki, Ouerdia
    Achemine, Farida
    JOURNAL OF APPLIED STATISTICS, 2020, 47 (01) : 132 - 149
  • [36] Septic Shock Prediction for Patients with Missing Data
    Ho, Joyce C.
    Lee, Cheng H.
    Ghosh, Joydeep
    ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS, 2014, 5 (01)
  • [37] A Prediction Method for the RUL of Equipment for Missing Data
    Chen Wenbai
    Liu Chang
    Chen Weizhao
    Liu Huixiang
    Chen Qili
    Wu Peiliang
    COMPLEXITY, 2021, 2021
  • [38] Online Time Series Prediction with Missing Data
    Anava, Oren
    Hazan, Elad
    Zeevi, Assaf
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 2191 - 2199
  • [39] Tensor as Predictor: Channel Prediction with Missing Data
    Xiao, Zheng
    Sun, Jun
    Liu, Yingzhuang
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [40] Using missing data methods in genetic studies with missing mutation status
    Leong, T
    Lipsitz, SR
    Ibrahim, JG
    STATISTICS IN MEDICINE, 1999, 18 (04) : 473 - 485