ResoNet:Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks

被引:0
|
作者
Pumeng LYU [1 ]
Tao TANG [2 ]
Fenghua LING [3 ]
JingJia LUO [3 ]
Niklas BOERS [4 ]
Wanli OUYANG [1 ]
Lei BAI [1 ]
机构
[1] Shanghai Artificial Intelligence Laboratory
[2] Zhejiang Meteorological Observatory
[3] Institute for Climate and Application Research (ICAR), Nanjing University of Information Science and Technology
[4] Technical University of Munich, Potsdam Institute for Climate Impact
关键词
D O I
暂无
中图分类号
P732.4 [海洋天气预报]; P714.2 [];
学科分类号
0706 ; 070601 ;
摘要
Recent studies have shown that deep learning(DL) models can skillfully forecast El Ni?o–Southern Oscillation(ENSO) events more than 1.5 years in advance. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines CNN(convolutional neural network) and transformer architectures. This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ENSO at lead times of 19 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Ni?o and La Ni?a from 1-to 18-month leads, we find that it predicts the Ni?o-3.4 index based on multiple physically reasonable mechanisms, such as the recharge oscillator concept, seasonal footprint mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate for the first time that the asymmetry between El Ni?o and La Ni?a development can be captured by ResoNet. Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.
引用
收藏
页码:1289 / 1298
页数:10
相关论文
共 50 条
  • [1] ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks
    Lyu, Pumeng
    Tang, Tao
    Ling, Fenghua
    Luo, Jing-Jia
    Boers, Niklas
    Ouyang, Wanli
    Bai, Lei
    ADVANCES IN ATMOSPHERIC SCIENCES, 2024, 41 (07) : 1289 - 1298
  • [2] ENSO Forecasts With Spatiotemporal Fusion Transformer Network
    Zhao, Anming
    Qin, Mengjiao
    Wu, Sensen
    Liu, Renyi
    Du, Zhenhong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 17066 - 17074
  • [3] Explainable Survival Analysis with Convolution-Involved Vision Transformer
    Shen, Yifan
    Liu, Li
    Tang, Zhihao
    Chen, Zongyi
    Ma, Guixiang
    Dong, Jiyan
    Zhang, Xi
    Yang, Lin
    Zheng, Qingfeng
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2207 - 2215
  • [4] Explainable physics-guided attention network for long-lead ENSO forecasts
    Wu, Song
    Li, Xiaoyong
    Dong, Wei
    Bao, Senliang
    Wang, Senzhang
    Zhu, Junxing
    Ren, Xiaoli
    Shao, Chengcheng
    INFORMATION SCIENCES, 2025, 709
  • [5] Robust Blind Watermarking Framework for Hybrid Networks Combining CNN and Transformer
    Wang, Baowei
    Song, Ziwei
    Wu, Yufeng
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [6] Hybrid Transformer and Convolution for Image Compressed Sensing
    Nan, Ruili
    Sun, Guiling
    Zheng, Bowen
    Zhang, Pengchen
    ELECTRONICS, 2024, 13 (17)
  • [7] Hybrid Transformer and Convolution for Medical Image Segmentation
    Wang, Fan
    Wang, Bo
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 156 - 159
  • [8] A hybrid convolution transformer for hyperspectral image classification
    Arshad, Tahir
    Zhang, Junping
    Ullah, Inam
    EUROPEAN JOURNAL OF REMOTE SENSING, 2024, 57 (01)
  • [9] Explainable survival analysis with uncertainty using convolution-involved vision transformer
    Tang, Zhihao
    Liu, Li
    Shen, Yifan
    Chen, Zongyi
    Ma, Guixiang
    Dong, Jiyan
    Sun, Xujie
    Zhang, Xi
    Li, Chaozhuo
    Zheng, Qingfeng
    Yang, Lin
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 110
  • [10] Kernel Transformer Networks for Compact Spherical Convolution
    Su, Yu-Chuan
    Grauman, Kristen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9434 - 9443