A Bayesian Deep Learning RUL Framework Integrating Epistemic and Aleatoric Uncertainties

被引:69
|
作者
Li, Gaoyang [1 ,2 ]
Yang, Li [3 ]
Lee, Chi-Guhn [4 ]
Wang, Xiaohua [1 ]
Rong, Mingzhe [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect Engn, State Key Lab Elect Insulat & Power Equipment, Xian 710049, Peoples R China
[2] State Grid Corp China, Big Date Ctr, Beijing 100052, Peoples R China
[3] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[4] Univ Toronto, Dept Mech & Ind Engn, Toronto, ON M5S 3G8, Canada
基金
中国国家自然科学基金;
关键词
Uncertainty; Bayes methods; Prognostics and health management; Probabilistic logic; Machine learning; Modeling; Prediction algorithms; Aleatoric uncertainty; Bayesian neural network; epistemic uncertainty; remaining useful life; USEFUL LIFE PREDICTION; PROGNOSTICS; DROPOUT;
D O I
10.1109/TIE.2020.3009593
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent years have witnessed the prominent advancements of deep learning (DL) in the arsenal of prognostics and health management. However, the prognostic uncertainty problem extensively existed in industrial devices is not addressed by most DL approaches. This article formulates a novel Bayesian Deep Learning (BDL) framework to characterize the prognostic uncertainties. A distinguished advantage of the framework is its capacity of capturing the comprehensive effects of two critical uncertainties: 1) epistemic uncertainty, accounting for the uncertainty in the model, and 2) aleatoric uncertainty, representing the impact of random disturbance, such as measurement errors. The former arises from the variability of the model weights, and the latter is characterized by selected lifetime distributions. We integrate both uncertainties by defining BDL as priors of lifetime parameters. A sequential Bayesian boosting algorithm is executed to improve the estimation accuracy and compress the credible intervals. The superior prediction performance of our framework is validated by a real-world dataset collected from hydraulic mechanisms of circuit breakers.
引用
收藏
页码:8829 / 8841
页数:13
相关论文
共 50 条
  • [31] Asteroid Deflection Campaign Design Integrating Epistemic Uncertainties
    Paek, Sung Wook
    de Weck, Olivier
    Polany, Rany
    Egger, Patricia
    2016 IEEE AEROSPACE CONFERENCE, 2016,
  • [32] Epistemic and aleatoric uncertainty quantification for crack detection using a Bayesian Boundary Aware Convolutional Network
    Rathnakumar, Rahul
    Pang, Yutian
    Liu, Yongming
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 240
  • [33] Aleatoric and epistemic uncertainty extraction of patient-specific deep learning-based dose predictions in LDR prostate brachytherapy
    Berumen, Francisco
    Ouellet, Samuel
    Enger, Shirin
    Beaulieu, Luc
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (08):
  • [34] A Bayesian framework for geometric uncertainties handling
    Mekhnacha, K
    Bessière, P
    Mazer, E
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, PT 2, 2001, 568 : 579 - 592
  • [35] Approximate Bayesian Uncertainties on Deep Learning Dynamical Mass Estimates of Galaxy Clusters
    Ho, Matthew
    Farahi, Arya
    Rau, Markus Michael
    Trac, Hy
    ASTROPHYSICAL JOURNAL, 2021, 908 (02):
  • [36] What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
    Kendall, Alex
    Gal, Yarin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [37] Towards Bayesian Deep Learning: A Framework and Some Existing Methods
    Wang, Hao
    Yeung, Dit-Yan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (12) : 3395 - 3408
  • [38] A BAYESIAN MULTISCALE DEEP LEARNING FRAMEWORK FOR FLOWS IN RANDOM MEDIA
    Padmanabha, Govinda Anantha
    Zabaras, Nicholas
    FOUNDATIONS OF DATA SCIENCE, 2021, 3 (02): : 251 - 303
  • [39] DNB: A Joint Learning Framework for Deep Bayesian Nonparametric Clustering
    Wang, Zeya
    Ni, Yang
    Jing, Baoyu
    Wang, Deqing
    Zhang, Hao
    Xing, Eric
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) : 7610 - 7620
  • [40] Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?
    Wimmer, Lisa
    Sale, Yusuf
    Hofman, Paul
    Bischl, Bernd
    Huellermeier, Eyke
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 2282 - 2292