A Bayesian Deep Learning RUL Framework Integrating Epistemic and Aleatoric Uncertainties

被引:69
|
作者
Li, Gaoyang [1 ,2 ]
Yang, Li [3 ]
Lee, Chi-Guhn [4 ]
Wang, Xiaohua [1 ]
Rong, Mingzhe [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect Engn, State Key Lab Elect Insulat & Power Equipment, Xian 710049, Peoples R China
[2] State Grid Corp China, Big Date Ctr, Beijing 100052, Peoples R China
[3] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[4] Univ Toronto, Dept Mech & Ind Engn, Toronto, ON M5S 3G8, Canada
基金
中国国家自然科学基金;
关键词
Uncertainty; Bayes methods; Prognostics and health management; Probabilistic logic; Machine learning; Modeling; Prediction algorithms; Aleatoric uncertainty; Bayesian neural network; epistemic uncertainty; remaining useful life; USEFUL LIFE PREDICTION; PROGNOSTICS; DROPOUT;
D O I
10.1109/TIE.2020.3009593
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent years have witnessed the prominent advancements of deep learning (DL) in the arsenal of prognostics and health management. However, the prognostic uncertainty problem extensively existed in industrial devices is not addressed by most DL approaches. This article formulates a novel Bayesian Deep Learning (BDL) framework to characterize the prognostic uncertainties. A distinguished advantage of the framework is its capacity of capturing the comprehensive effects of two critical uncertainties: 1) epistemic uncertainty, accounting for the uncertainty in the model, and 2) aleatoric uncertainty, representing the impact of random disturbance, such as measurement errors. The former arises from the variability of the model weights, and the latter is characterized by selected lifetime distributions. We integrate both uncertainties by defining BDL as priors of lifetime parameters. A sequential Bayesian boosting algorithm is executed to improve the estimation accuracy and compress the credible intervals. The superior prediction performance of our framework is validated by a real-world dataset collected from hydraulic mechanisms of circuit breakers.
引用
收藏
页码:8829 / 8841
页数:13
相关论文
共 50 条
  • [11] A Bayesian Data-Driven Framework for Aleatoric and Epistemic Uncertainty Quantification in Remaining Useful Life Predictions
    Jiang, Mudi
    Xing, Tianyang
    Zio, Enrico
    Zhu, Xiaoliang
    IEEE SENSORS JOURNAL, 2024, 24 (24) : 42255 - 42267
  • [12] Distributional reinforcement learning with epistemic and aleatoric uncertainty estimation
    Liu, Qi
    Li, Yanjie
    Chen, Shiyu
    Lin, Ke
    Shi, Xiongtao
    Lou, Yunjiang
    INFORMATION SCIENCES, 2023, 644
  • [13] Aleatoric and Epistemic Uncertainty Quantification in Bayesian Dirichlet Cost Rules of Thumb
    Fleischer, Sam
    Hooke, Melissa
    2023 IEEE AEROSPACE CONFERENCE, 2023,
  • [14] Epistemic and aleatoric uncertainties reduction with rotation variation for medical image segmentation with ConvNets
    Zhang, Ge
    Dang, Hao
    Xu, Yulong
    SN APPLIED SCIENCES, 2022, 4 (02):
  • [15] Epistemic and aleatoric uncertainties reduction with rotation variation for medical image segmentation with ConvNets
    Ge Zhang
    Hao Dang
    Yulong Xu
    SN Applied Sciences, 2022, 4
  • [16] Separation of Aleatoric and Epistemic Uncertainty in Deterministic Deep Neural Networks
    Huseljic, Denis
    Sick, Bernhard
    Herde, Marek
    Kottke, Daniel
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9172 - 9179
  • [17] A New Framework for Winter Wheat Yield Prediction Integrating Deep Learning and Bayesian Optimization
    Di, Yan
    Gao, Maofang
    Feng, Fukang
    Li, Qiang
    Zhang, Huijie
    AGRONOMY-BASEL, 2022, 12 (12):
  • [18] Fuel performance uncertainty quantification and sensitivity analysis in the presence of epistemic and aleatoric sources of uncertainties
    Faure, Quentin
    Delipei, Gregory
    Petruzzi, Alessandro
    Avramova, Maria
    Ivanov, Kostadin
    FRONTIERS IN ENERGY RESEARCH, 2023, 11
  • [19] Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
    Eyke Hüllermeier
    Willem Waegeman
    Machine Learning, 2021, 110 : 457 - 506
  • [20] Reliable classification: Learning classifiers that distinguish aleatoric and epistemic uncertainty
    Senge, Robin
    Boesner, Stefan
    Dembczynski, Krzysztof
    Haasenritter, Joerg
    Hirsch, Oliver
    Donner-Banzhoff, Norbert
    Huellermeier, Eyke
    INFORMATION SCIENCES, 2014, 255 : 16 - 29