A transformer-based framework for predicting geomagnetic indices with uncertainty quantification

被引:1
|
作者
Abduallah, Yasser [1 ]
Wang, Jason T. L. [1 ]
Wang, Haimin [2 ]
Jing, Ju [2 ]
机构
[1] New Jersey Inst Technol, Dept Comp Sci, Univ Hts, Newark, NJ 07102 USA
[2] New Jersey Inst Technol, Inst Space Weather Sci, Univ Hts, Newark, NJ 07102 USA
基金
美国国家科学基金会;
关键词
Bayesian inference; Deep learning; Geomagnetic index; Uncertainty quantification; DROPOUT;
D O I
10.1007/s10844-023-00828-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Geomagnetic activities have a crucial impact on Earth, which can affect spacecraft and electrical power grids. Geospace scientists use a geomagnetic index, called the Kp index, to describe the overall level of geomagnetic activity. This index is an important indicator of disturbances in the Earth's magnetic field and is used by the U.S. Space Weather Prediction Center as an alert and warning service for users who may be affected by the disturbances. Another commonly used index, called the ap index, is converted from the Kp index. Early and accurate prediction of the Kp and ap indices is essential for preparedness and disaster risk management. In this paper, we present a deep learning framework, named GNet, to perform short-term forecasting of the Kp and ap indices. Specifically, GNet takes as input time series of solar wind parameters' values, provided by NASA's Space Science Data Coordinated Archive, and predicts as output the Kp and ap indices respectively at time point t + w hours for a given time point t where w ranges from ranges from 1 to 9. GNet combines transformer encoder blocks with Bayesian inference, which is capable of quantifying both aleatoric uncertainty (data uncertainty) and epistemic uncertainty (model uncertainty) in making predictions. Experimental results show that GNet outperforms closely related machine learning methods in terms of the root mean square error and R-squared score. Furthermore, GNet can provide both data and model uncertainty quantification results, which the existing methods cannot offer. To our knowledge, this is the first time that Bayesian transformers have been used for geomagnetic activity prediction.
引用
收藏
页码:887 / 903
页数:17
相关论文
共 50 条
  • [31] A Temporal Transformer-Based Fusion Framework for Morphological Arrhythmia Classification
    Anjum, Nafisa
    Sathi, Khaleda Akhter
    Hossain, Md. Azad
    Dewan, M. Ali Akber
    COMPUTERS, 2023, 12 (03)
  • [32] Development of a Text Classification Framework using Transformer-based Embeddings
    Yeasmin, Sumona
    Afrin, Nazia
    Saif, Kashfia
    Huq, Mohammad Rezwanul
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON DATA SCIENCE, TECHNOLOGY AND APPLICATIONS (DATA), 2022, : 74 - 82
  • [33] Transformer-based contrastive learning framework for image anomaly detection
    Wentao Fan
    Weimin Shangguan
    Yewang Chen
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3413 - 3426
  • [34] Operational prediction of solar flares using a transformer-based framework
    Abduallah, Yasser
    Wang, Jason T. L.
    Wang, Haimin
    Xu, Yan
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [35] Transformer-based sensor failure prediction and classification framework for UAVs
    Ahmad, Muhammad Waqas
    Akram, Muhammad Usman
    Mohsan, Mashood Mohammad
    Saghar, Kashif
    Ahmad, Rashid
    Butt, Wasi Haider
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 248
  • [36] TFTN: A Transformer-Based Fusion Tracking Framework of Hyperspectral and RGB
    Zhao, Chunhui
    Liu, Hongjiao
    Su, Nan
    Yan, Yiming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [37] Transformer-Based Sequence Modeling Short Answer Assessment Framework
    Sharmila, P.
    Anbananthen, Kalaiarasi Sonai Muthu
    Chelliah, Deisy
    Parthasarathy, S.
    Balasubramaniam, Baarathi
    Lurudusamy, Saravanan Nathan
    HighTech and Innovation Journal, 2024, 5 (03): : 627 - 639
  • [38] KRASFormer: a fully vision transformer-based framework for predicting KRAS gene mutations in histopathological images of colorectal cancer
    Singh, Vivek Kumar
    Makhlouf, Yasmine
    Sarker, M. Mostafa Kamal
    Craig, Stephanie
    Baena, Juvenal
    Greene, Christine
    Mason, Lee
    James, Jacqueline A.
    Salto-Tellez, Manuel
    O'Reilly, Paul
    Maxwell, Perry
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2024, 10 (05):
  • [39] Transformer-based deep learning models for predicting permeability of porous media
    Meng, Yinquan
    Jiang, Jianguo
    Wu, Jichun
    Wang, Dong
    ADVANCES IN WATER RESOURCES, 2023, 179
  • [40] Transformer-based deep learning for predicting protein properties in the life sciences
    Chandra, Abel
    Tunnermann, Laura
    Lofstedt, Tommy
    Gratz, Regina
    ELIFE, 2023, 12