Enhancing accident diagnosis in nuclear power plants through knowledge Distillation: Bridging the gap between simulation and Real-World scenarios

Accident diagnosis is critical for ensuring the safety and reliability of nuclear power plants (NPPs). However, the scarcity of real-world data poses a significant challenge in the development of accurate, and robust, artificial intelligence (AI)-based diagnostic systems. This paper presents a novel approach for addressing this domain issue by leveraging knowledge-distillation techniques. We propose training a lightweight-student model that uses distilled knowledge from multiple teacher models, each of which captures different aspects of the problem, such as noise and time trends. Teacher models and student models were trained on CNS simulation data, and both models were evaluated on real-world proxy data(PCTRAN Simulation data). Through a series of experiments, we demonstrated the effectiveness of our approach in enhancing the performance and robustness of student models. The student model showed improvements in untrained target domain, when knowledge obtained from noisy, time-trend-information containing, and naive teacher models was used instead of a single teacher model. The incorporation of diverse knowledge from different teacher models aids the student model in handling noisy data, capturing temporal dependencies, and generalizing unseen scenarios better. Moreover, our analysis of the relative training time highlighted the computational benefits of using a lighter student model. The student model required significantly less training time than the teacher model, making it more efficient for deployment and online updation in real-world scenarios. This computational efficiency is particularly valuable in the context of NPPs where timely decision making and resource constraints are critical factors. Our findings will contribute to the development of effective, robust, and computationally efficient accident- diagnosis systems for NPPs. By bridging the gap between simulations and real-world scenarios through knowledge distillation, this study paves the way for further advancements in enhancing the safety, reliability, and efficiency of the nuclear power industry.