ThermoPore: Predicting part porosity based on thermal images using deep learning

被引:1
|
作者
Pak, Peter [1 ]
Ogoke, Francis [1 ]
Polonsky, Andrew [2 ]
Garland, Anthony [2 ]
Bolintineanu, Dan S. [2 ]
Moser, Dan R. [2 ]
Arnhart, Mary [2 ]
Madison, Jonathan [2 ]
Ivanoff, Thomas [2 ]
Mitchell, John [2 ]
Jared, Bradley [3 ]
Salzbrenner, Brad [2 ]
Heiden, Michael J. [2 ]
Farimani, Amir Barati [1 ,4 ]
机构
[1] Carnegie Mellon Univ, Dept Mech Engn, Pittsburgh, PA 15213 USA
[2] Sandia Natl Labs, Albuquerque, NM USA
[3] Univ Tennessee, Knoxville, TN USA
[4] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
关键词
Laser powder bed fusion; Deep learning; Digital twin; Thermal imaging; Video vision transformer; TECHNOLOGY;
D O I
10.1016/j.addma.2024.104503
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity "Digital Twins"based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post- inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Super Resolution with Deep Learning in Thermal Images
    Oz, Mehmet Can
    Navruz, Tugba Selcen
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [42] Deep Learning Based Person Identification Using Facial Images
    Rahman, Hamidur
    Ahmed, Mobyen Uddin
    Begum, Shahina
    INTERNET OF THINGS (IOT) TECHNOLOGIES FOR HEALTHCARE, HEALTHYIOT 2017, 2018, 225 : 115 - 119
  • [43] Deep Learning Based Gender Identification Using Ear Images
    Kilic, Safak
    Dogan, Yahya
    TRAITEMENT DU SIGNAL, 2023, 40 (04) : 1629 - 1639
  • [44] Deep learning based melanoma diagnosis using dermoscopic images
    Wall, Conor
    Young, Fraser
    Zhang, Li
    Phillips, Emma-Jane
    Jiang, Richard
    Yu, Yonghong
    DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 907 - 914
  • [45] Using Deep Learning for Exploration and Recognition of Objects based on Images
    Contreras, Stevenson
    De la Rosa, Fernando
    PROCEEDINGS OF 13TH LATIN AMERICAN ROBOTICS SYMPOSIUM AND 4TH BRAZILIAN SYMPOSIUM ON ROBOTICS - LARS/SBR 2016, 2016, : 1 - 6
  • [46] Identifying Epilepsy Based on Deep Learning Using DKI Images
    Huang, Jianjun
    Xu, Jiahui
    Kang, Li
    Zhang, Tijiang
    FRONTIERS IN HUMAN NEUROSCIENCE, 2020, 14
  • [47] Predicting Agriculture Yields Based on Machine Learning Using Regression and Deep Learning
    Sharma, Priyanka
    Dadheech, Pankaj
    Aneja, Nagender
    Aneja, Sandhya
    IEEE ACCESS, 2023, 11 : 111255 - 111264
  • [48] Predicting lung cancer treatment response from CT images using deep learning
    Tyagi, Shweta
    Talbar, Sanjay N. N.
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2023, 33 (05) : 1577 - 1592
  • [49] Predicting tumour mutational burden from histopathological images using multiscale deep learning
    Mika S. Jain
    Tarik F. Massoud
    Nature Machine Intelligence, 2020, 2 : 356 - 362
  • [50] PREDICTING THE ATTRACTIVENESS OF REAL-ESTATE IMAGES BY PAIRWISE COMPARISON USING DEEP LEARNING
    Wang, Xueting
    Takada, Yuki
    Kado, Youiti
    Yamasaki, Toshihiko
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 84 - 89