ThermoPore: Predicting part porosity based on thermal images using deep learning

被引:1
|
作者
Pak, Peter [1 ]
Ogoke, Francis [1 ]
Polonsky, Andrew [2 ]
Garland, Anthony [2 ]
Bolintineanu, Dan S. [2 ]
Moser, Dan R. [2 ]
Arnhart, Mary [2 ]
Madison, Jonathan [2 ]
Ivanoff, Thomas [2 ]
Mitchell, John [2 ]
Jared, Bradley [3 ]
Salzbrenner, Brad [2 ]
Heiden, Michael J. [2 ]
Farimani, Amir Barati [1 ,4 ]
机构
[1] Carnegie Mellon Univ, Dept Mech Engn, Pittsburgh, PA 15213 USA
[2] Sandia Natl Labs, Albuquerque, NM USA
[3] Univ Tennessee, Knoxville, TN USA
[4] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
关键词
Laser powder bed fusion; Deep learning; Digital twin; Thermal imaging; Video vision transformer; TECHNOLOGY;
D O I
10.1016/j.addma.2024.104503
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity "Digital Twins"based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post- inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Deep Learning-Based Models for Porosity Measurement in Thermal Barrier Coating Images
    Lu, Yongjin
    Chen, Wei-Bang
    Wang, Xiaoliang
    Ailsworth, Zanyah
    Tsui, Melissa
    Al-Ghaib, Huda
    Zimmerman, Ben
    INTERNATIONAL JOURNAL OF MULTIMEDIA DATA ENGINEERING & MANAGEMENT, 2020, 11 (03): : 20 - 35
  • [2] Body Part Detection from Neonatal Thermal Images Using Deep Learning
    Beppu, Fumika
    Yoshikawa, Hiroki
    Uchiyama, Akira
    Higashino, Teruo
    Hamada, Keisuke
    Hirakawa, Eiji
    MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES, 2022, 419 : 438 - 450
  • [3] Predicting porosity, permeability, and tortuosity of porous media from images by deep learning
    Krzysztof M. Graczyk
    Maciej Matyka
    Scientific Reports, 10
  • [4] Predicting porosity, permeability, and tortuosity of porous media from images by deep learning
    Graczyk, Krzysztof M.
    Matyka, Maciej
    SCIENTIFIC REPORTS, 2020, 10 (01)
  • [5] DLAM: Deep Learning Based Real-Time Porosity Prediction for Additive Manufacturing Using Thermal Images of the Melt Pool
    Ho, Samson
    Zhang, Wenlu
    Young, Wesley
    Buchholz, Matthew
    Al Jufout, Saleh
    Dajani, Khalil
    Bian, Linkan
    Mozumdar, Mohammad
    IEEE ACCESS, 2021, 9 : 115100 - 115114
  • [6] Predicting the microstructure of composite plates using deep learning based on thermal expansion
    Zhang, Faling
    Wang, Ziping
    AIP ADVANCES, 2024, 14 (10)
  • [7] Predicting laterality in external eye images using deep learning
    Lee, Gary
    Callan, Thomas
    Wu, Charles
    Tamhankar, Ashwini
    Covita, Angelina
    Durbin, Mary
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (11)
  • [8] Predicting the effective thermal conductivity of composites from cross sections images using deep learning methods
    Rong, Qingyuan
    Wei, Han
    Huang, Xingyi
    Bao, Hua
    COMPOSITES SCIENCE AND TECHNOLOGY, 2019, 184
  • [9] Predicting the recurrence and overall survival of patients with glioma based on histopathological images using deep learning
    Luo, Chenhua
    Yang, Jiyan
    Liu, Zhengzheng
    Jing, Di
    FRONTIERS IN NEUROLOGY, 2023, 14
  • [10] Facial emotion detection using thermal and visual images based on deep learning techniques
    Rashmi R.
    Snekhalatha U.
    Salvador A.L.
    Raj A.N.J.
    Imaging Science Journal, 2024, 72 (02): : 153 - 166