Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks

被引:32
|
作者
Barraza, Joaquin Figueroa [1 ]
Droguett, Enrique Lopez [2 ,3 ]
Martins, Marcelo Ramos [1 ]
机构
[1] Univ Sao Paulo, Dept Naval Architecture & Ocean Engn, LabRisco Anal Evaluat & Risk Management Lab, BR-05508030 Sao Paulo, Brazil
[2] Univ Calif Los Angeles, Dept Civil & Environm Engn, Los Angeles, CA 90095 USA
[3] Univ Calif Los Angeles, Garrick Inst Risk Sci, Los Angeles, CA 90095 USA
关键词
feature selection; deep learning; deep neural networks; prognostics and health management; interpretable AI; RIDGE REGRESSION; PREDICTION; REPRESENTATIONS; CLASSIFICATION; ENSEMBLE; MODEL;
D O I
10.3390/s21175888
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features' importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer.
引用
收藏
页数:30
相关论文
共 50 条
  • [1] Feature Selection using Deep Neural Networks
    Roy, Debaditya
    Murty, K. Sri Rama
    Mohan, C. Krishna
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [2] Integrated Learning and Feature Selection for Deep Neural Networks in Multispectral Images
    Ortiz, Anthony
    Granados, Alonso
    Fuentes, Olac
    Kiekintyeld, Christopher
    Rosario, Dalton
    Bell, Zachary
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1277 - 1286
  • [3] Application of deep learning in equipment prognostics and health management
    Chen Z.
    Chen X.
    De Olivira J.V.
    Li C.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2019, 40 (09): : 206 - 226
  • [4] A Review on Deep Learning Applications in Prognostics and Health Management
    Zhang, Liangwei
    Lin, Jing
    Liu, Bin
    Zhang, Zhicong
    Yan, Xiaohui
    Wei, Muheng
    IEEE ACCESS, 2019, 7 : 162415 - 162438
  • [5] Algorithm Selection Framework for Legalization Using Deep Convolutional Neural Networks and Transfer Learning
    Netto, Renan
    Fabre, Sheiny
    Fontana, Tiago Augusto
    Livramento, Vinicius
    Pilla, Laercio L.
    Behjat, Laleh
    Guntzel, Jose Luis
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (05) : 1481 - 1494
  • [6] Sparse Neural Additive Model: Interpretable Deep Learning with Feature Selection via Group Sparsity
    Xu, Shiyun
    Bu, Zhiqi
    Chaudhari, Pratik
    Barnett, Ian J.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT III, 2023, 14171 : 343 - 359
  • [7] Deep learning for machine health prognostics using Kernel-based feature transformation
    Pillai, Shanmugasivam
    Vadakkepat, Prahlad
    JOURNAL OF INTELLIGENT MANUFACTURING, 2022, 33 (06) : 1665 - 1680
  • [8] Deep learning for machine health prognostics using Kernel-based feature transformation
    Shanmugasivam Pillai
    Prahlad Vadakkepat
    Journal of Intelligent Manufacturing, 2022, 33 : 1665 - 1680
  • [9] An interpretable framework of data-driven turbulence modeling using deep neural networks
    Jiang, Chao
    Vinuesa, Ricardo
    Chen, Ruilin
    Mi, Junyi
    Laima, Shujin
    Li, Hui
    PHYSICS OF FLUIDS, 2021, 33 (05)
  • [10] DeepPINK: reproducible feature selection in deep neural networks
    Lu, Yang Young
    Fan, Yingying
    Lv, Jinchi
    Noble, William Stafford
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31