Multi-fidelity surrogate modeling using long short-term memory networks

被引:35
|
作者
Conti, Paolo [1 ]
Guo, Mengwu [2 ]
Manzoni, Andrea [3 ]
Hesthaven, Jan S. [4 ]
机构
[1] Politecn Milan, Dept Civil Engn, Milan, Italy
[2] Univ Twente, Dept Appl Math, Enschede, Netherlands
[3] Politecn Milan, Dept Math, MOX, Milan, Italy
[4] Ecole Polytech Fed Lausanne, Inst Math, Lausanne, Switzerland
关键词
Machine learning; Multi-fidelity regression; LSTM network; Parametrized PDE; Time-dependent problem; APPROXIMATION;
D O I
10.1016/j.cma.2022.115811
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
When evaluating quantities of interest that depend on the solutions to differential equations, we inevitably face the trade-off between accuracy and efficiency. Especially for parametrized, time-dependent problems in engineering computations, it is often the case that acceptable computational budgets limit the availability of high-fidelity, accurate simulation data. Multi-fidelity surrogate modeling has emerged as an effective strategy to overcome this difficulty. Its key idea is to leverage many low-fidelity simulation data, less accurate but much faster to compute, to improve the approximations with limited high-fidelity data. In this work, we introduce a novel data-driven framework of multi-fidelity surrogate modeling for parametrized, time-dependent problems using long short-term memory (LSTM) networks, to enhance output predictions both for unseen parameter values and forward in time simultaneously - a task known to be particularly challenging for data-driven models. We demonstrate the wide applicability of the proposed approaches in a variety of engineering problems with high-and low-fidelity data generated through fine versus coarse meshes, small versus large time steps, or finite element full order versus deep learning reduced-order models. Numerical results show that the proposed multi-fidelity LSTM networks not only improve single-fidelity regression significantly, but also outperform the multi-fidelity models based on feed-forward neural networks.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Multi-fidelity surrogate modeling for structural acoustics applications
    Bonomo, Anthony L.
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2023, 153 (03):
  • [2] Short-Term Traffic Prediction Using Long Short-Term Memory Neural Networks
    Abbas, Zainab
    Al-Shishtawy, Ahmad
    Girdzijauskas, Sarunas
    Vlassov, Vladimir
    2018 IEEE INTERNATIONAL CONGRESS ON BIG DATA (IEEE BIGDATA CONGRESS), 2018, : 57 - 65
  • [3] A Single-Fidelity Surrogate Modeling Method Based on Nonlinearity Integrated Multi-Fidelity Surrogate
    Li, Kunpeng
    He, Xiwang
    Lv, Liye
    Zhu, Jiaxiang
    Hao, Guangbo
    Li, Haiyang
    Song, Xueguan
    JOURNAL OF MECHANICAL DESIGN, 2023, 145 (09)
  • [4] SCGAN: stacking-based generative adversarial networks for multi-fidelity surrogate modeling
    Chao Zhang
    Lixue Liu
    Hao Wang
    Xueguan Song
    Dacheng Tao
    Structural and Multidisciplinary Optimization, 2022, 65
  • [5] SCGAN: stacking-based generative adversarial networks for multi-fidelity surrogate modeling
    Zhang, Chao
    Liu, Lixue
    Wang, Hao
    Song, Xueguan
    Tao, Dacheng
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2022, 65 (06)
  • [6] Language Modeling Using Part-of-speech and Long Short-Term Memory Networks
    Norouzi, Sanaz Saki
    Akbari, Ahmad
    Nasersharif, Babak
    2019 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE 2019), 2019, : 182 - 187
  • [7] Behavioral Modeling of GaN Power Amplifiers Using Long Short-Term Memory Networks
    Chen, Peng
    Alsahali, Sattam
    Alt, Alexander
    Lees, Jonathan
    Tasker, Paul J.
    INTERNATIONAL WORKSHOP ON INTEGRATED NONLINEAR MICROWAVE AND MILLIMETRE-WAVE CIRCUITS (INMMIC), 2018,
  • [8] Modeling Speaker Variability Using Long Short-Term Memory Networks for Speech Recognition
    Li, Xiangang
    Wu, Xihong
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 1086 - 1090
  • [9] A BAYESIAN NEURAL NETWORK APPROACH TO MULTI-FIDELITY SURROGATE MODELING
    Kerleguer, Baptiste
    Cannamela, Claire
    Garnier, Josselin
    INTERNATIONAL JOURNAL FOR UNCERTAINTY QUANTIFICATION, 2024, 14 (01) : 43 - 60
  • [10] Stochastic multi-fidelity surrogate modeling of dendritic crystal growth
    Winter, J. M.
    Kaiser, J. W. J.
    Adami, S.
    Akhatov, I. S.
    Adams, N. A.
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2022, 393