A transformer-based framework for predicting geomagnetic indices with uncertainty quantification

被引:1
|
作者
Abduallah, Yasser [1 ]
Wang, Jason T. L. [1 ]
Wang, Haimin [2 ]
Jing, Ju [2 ]
机构
[1] New Jersey Inst Technol, Dept Comp Sci, Univ Hts, Newark, NJ 07102 USA
[2] New Jersey Inst Technol, Inst Space Weather Sci, Univ Hts, Newark, NJ 07102 USA
基金
美国国家科学基金会;
关键词
Bayesian inference; Deep learning; Geomagnetic index; Uncertainty quantification; DROPOUT;
D O I
10.1007/s10844-023-00828-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Geomagnetic activities have a crucial impact on Earth, which can affect spacecraft and electrical power grids. Geospace scientists use a geomagnetic index, called the Kp index, to describe the overall level of geomagnetic activity. This index is an important indicator of disturbances in the Earth's magnetic field and is used by the U.S. Space Weather Prediction Center as an alert and warning service for users who may be affected by the disturbances. Another commonly used index, called the ap index, is converted from the Kp index. Early and accurate prediction of the Kp and ap indices is essential for preparedness and disaster risk management. In this paper, we present a deep learning framework, named GNet, to perform short-term forecasting of the Kp and ap indices. Specifically, GNet takes as input time series of solar wind parameters' values, provided by NASA's Space Science Data Coordinated Archive, and predicts as output the Kp and ap indices respectively at time point t + w hours for a given time point t where w ranges from ranges from 1 to 9. GNet combines transformer encoder blocks with Bayesian inference, which is capable of quantifying both aleatoric uncertainty (data uncertainty) and epistemic uncertainty (model uncertainty) in making predictions. Experimental results show that GNet outperforms closely related machine learning methods in terms of the root mean square error and R-squared score. Furthermore, GNet can provide both data and model uncertainty quantification results, which the existing methods cannot offer. To our knowledge, this is the first time that Bayesian transformers have been used for geomagnetic activity prediction.
引用
收藏
页码:887 / 903
页数:17
相关论文
共 50 条
  • [21] A Transformer-based Framework for Multivariate Time Series Representation Learning
    Zerveas, George
    Jayaraman, Srideepika
    Patel, Dhaval
    Bhamidipaty, Anuradha
    Eickhoff, Carsten
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 2114 - 2124
  • [22] A transformer-based deep learning framework to predict employee attrition
    Li, Wenhui
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [23] Transformer-based contrastive learning framework for image anomaly detection
    Fan, Wentao
    Shangguan, Weimin
    Chen, Yewang
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (10) : 3413 - 3426
  • [24] An enhanced transformer-based framework for interpretable code clone detection
    Nashaat, Mona
    Amin, Reem
    Eid, Ahmad Hosny
    Abdel-Kader, Rabab F.
    JOURNAL OF SYSTEMS AND SOFTWARE, 2025, 222
  • [25] ERTNet: an interpretable transformer-based framework for EEG emotion recognition
    Liu, Ruixiang
    Chao, Yihu
    Ma, Xuerui
    Sha, Xianzheng
    Sun, Limin
    Li, Shuo
    Chang, Shijie
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [26] Transformer-Based Autoencoder Framework for Nonlinear Hyperspectral Anomaly Detection
    Wu, Ziyu
    Wang, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [27] A Tiny Transformer-Based Anomaly Detection Framework for IoT Solutions
    Barbieri, Luca
    Brambilla, Mattia
    Stefanutti, Mario
    Romano, Ciro
    De Carlo, Niccolo
    Roveri, Manuel
    IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2023, 4 : 462 - 478
  • [28] SpotFormer: A Transformer-based Framework for Precise Soccer Action Spotting
    Cao, Mengqi
    Yang, Min
    Zhang, Guozhen
    Li, Xiaotian
    Wu, Yilu
    Wu, Gangshan
    Wang, Limin
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [29] InferBERT: A Transformer-Based Causal Inference Framework for Enhancing Pharmacovigilance
    Wang, Xingqiao
    Xu, Xiaowei
    Tong, Weida
    Roberts, Ruth
    Liu, Zhichao
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2021, 4
  • [30] Operational prediction of solar flares using a transformer-based framework
    Yasser Abduallah
    Jason T. L. Wang
    Haimin Wang
    Yan Xu
    Scientific Reports, 13