Imbalanced Sample Selection with Deep Reinforcement Learning for Fault Diagnosis

An imbalanced number of faulty and normal samples causes serious damage to the performance of the conventional diagnosis methods. To settle the data-imbalance fault diagnosis problem, this article presents a novel general imbalanced sample selection strategy (DiagSelect) based on deep reinforcement learning. In DiagSelect, the problem of imbalanced sample selection from the training set is formulated as a multiarmed bandit problem of deep reinforcement learning. The nondifferentiable optimization problem of imbalanced sample selection can be solved by the Markov decision process. The parameters of DiagSelect can be optimized by REINFORCE with the feedback of the validation set. DiagSelect performs intelligent imbalanced sample selection to obtain better diagnosis performance autonomously. As a data-level technique, DiagSelect can be easily used in conjunction with the conventional diagnosis models. DiagSelect is validated in a synthetic dataset and an industrial process dataset. The results have shown the effectiveness, stability, and transferability of DiagSelect. © 2005-2012 IEEE.