Non-Linear Dimensionality Reduction With a Variational Encoder Decoder to Understand Convective Processes in Climate Models

被引:10
|
作者
Behrens, Gunnar [1 ,2 ]
Beucler, Tom [3 ]
Gentine, Pierre [2 ,4 ,5 ]
Iglesias-Suarez, Fernando [1 ]
Pritchard, Michael [6 ]
Eyring, Veronika [1 ,7 ]
机构
[1] Deutsch Zentrum Luft & Raumfahrt DLR, Inst Phys Atmosphare, Oberpfaffenhofen, Germany
[2] Columbia Univ, Dept Earth & Environm Engn, New York, NY 10027 USA
[3] Univ Lausanne, Inst Earth Surface Dynam, Lausanne, Switzerland
[4] Columbia Univ, Earth Inst, New York, NY USA
[5] Columbia Univ, Data Sci Inst, New York, NY USA
[6] Univ Calif Irvine, Dept Earth Syst Sci, Irvine, CA USA
[7] Univ Bremen, Inst Environm Phys IUP, Bremen, Germany
基金
美国国家科学基金会; 欧洲研究理事会;
关键词
machine learning; generative deep learning; convection; parameterization; explainable artificial intelligence; dimensionality reduction; CLOUD-RESOLVING MODEL; PARAMETERIZATION; CIRCULATION; ATMOSPHERE;
D O I
10.1029/2022MS003130
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
Deep learning can accurately represent sub-grid-scale convective processes in climate models, learning from high resolution simulations. However, deep learning methods usually lack interpretability due to large internal dimensionality, resulting in reduced trustworthiness in these methods. Here, we use Variational Encoder Decoder structures (VED), a non-linear dimensionality reduction technique, to learn and understand convective processes in an aquaplanet superparameterized climate model simulation, where deep convective processes are simulated explicitly. We show that similar to previous deep learning studies based on feed-forward neural nets, the VED is capable of learning and accurately reproducing convective processes. In contrast to past work, we show this can be achieved by compressing the original information into only five latent nodes. As a result, the VED can be used to understand convective processes and delineate modes of convection through the exploration of its latent dimensions. A close investigation of the latent space enables the identification of different convective regimes: (a) stable conditions are clearly distinguished from deep convection with low outgoing longwave radiation and strong precipitation; (b) high optically thin cirrus-like clouds are separated from low optically thick cumulus clouds; and (c) shallow convective processes are associated with large-scale moisture content and surface diabatic heating. Our results demonstrate that VEDs can accurately represent convective processes in climate models, while enabling interpretability and better understanding of sub-grid-scale physical processes, paving the way to increasingly interpretable machine learning parameterizations with promising generative properties.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Non-linear Dimensionality Reduction for Privacy-Preserving Data Classification
    Alotaibi, Khaled
    Rayward-Smith, V. J.
    Wang, Wenjia
    de la Iglesia, Beatriz
    PROCEEDINGS OF 2012 ASE/IEEE INTERNATIONAL CONFERENCE ON PRIVACY, SECURITY, RISK AND TRUST AND 2012 ASE/IEEE INTERNATIONAL CONFERENCE ON SOCIAL COMPUTING (SOCIALCOM/PASSAT 2012), 2012, : 694 - 701
  • [22] Comparison of graph-based methods for non-linear dimensionality reduction
    Gupta, Rashmi
    Kapoor, Rajiv
    INTERNATIONAL JOURNAL OF SIGNAL AND IMAGING SYSTEMS ENGINEERING, 2012, 5 (02) : 101 - 109
  • [23] A New Approach to Improve the Topological Stability in Non-Linear Dimensionality Reduction
    Elhenawy, Mohammed
    Masoud, Mahmoud
    Glaser, Sebastien
    Rakotonirainy, Andry
    IEEE Access, 2020, 8 : 33898 - 33908
  • [24] Performance Comparison of Tumor Classification Based on Linear and Non-linear Dimensionality Reduction Methods
    Wang, Shu-Lin
    You, Hong-Zhu
    Lei, Ying-Ke
    Li, Xue-Ling
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, 2010, 6215 : 291 - 300
  • [25] Piecewise-linear manifold learning: A heuristic approach to non-linear dimensionality reduction
    Strange, Harry
    Zwiggelaar, Reyer
    INTELLIGENT DATA ANALYSIS, 2015, 19 (06) : 1213 - 1232
  • [26] Gradient-based explanation for non-linear non-parametric dimensionality reduction
    Corbugy, Sacha
    Marion, Rebecca
    Frenay, Benoit
    DATA MINING AND KNOWLEDGE DISCOVERY, 2024, 38 (06) : 3690 - 3718
  • [27] A novel method for the determination of redshifts of normal galaxies by non-linear dimensionality reduction
    Xu, X
    Wu, FC
    Hu, ZY
    Luo, AL
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2006, 26 (01) : 182 - 186
  • [28] Optimal manifold neighborhood and kernel width for robust non-linear dimensionality reduction
    Abhishek
    Verma, Shekhar
    KNOWLEDGE-BASED SYSTEMS, 2019, 185
  • [29] Improvement of non-linear mapping computation for dimensionality reduction in data visualization and classification
    Iswandy, K
    König, A
    HIS'04: Fourth International Conference on Hybrid Intelligent Systems, Proceedings, 2005, : 260 - 265
  • [30] Ensemble HMM learning for motion retrieval with non-linear PCA dimensionality reduction
    Xiang, Jian
    Zhu, HongLi
    2007 THIRD INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING, VOL 1, PROCEEDINGS, 2007, : 604 - +