A transformer-based framework for predicting geomagnetic indices with uncertainty quantification

被引:1
|
作者
Abduallah, Yasser [1 ]
Wang, Jason T. L. [1 ]
Wang, Haimin [2 ]
Jing, Ju [2 ]
机构
[1] New Jersey Inst Technol, Dept Comp Sci, Univ Hts, Newark, NJ 07102 USA
[2] New Jersey Inst Technol, Inst Space Weather Sci, Univ Hts, Newark, NJ 07102 USA
基金
美国国家科学基金会;
关键词
Bayesian inference; Deep learning; Geomagnetic index; Uncertainty quantification; DROPOUT;
D O I
10.1007/s10844-023-00828-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Geomagnetic activities have a crucial impact on Earth, which can affect spacecraft and electrical power grids. Geospace scientists use a geomagnetic index, called the Kp index, to describe the overall level of geomagnetic activity. This index is an important indicator of disturbances in the Earth's magnetic field and is used by the U.S. Space Weather Prediction Center as an alert and warning service for users who may be affected by the disturbances. Another commonly used index, called the ap index, is converted from the Kp index. Early and accurate prediction of the Kp and ap indices is essential for preparedness and disaster risk management. In this paper, we present a deep learning framework, named GNet, to perform short-term forecasting of the Kp and ap indices. Specifically, GNet takes as input time series of solar wind parameters' values, provided by NASA's Space Science Data Coordinated Archive, and predicts as output the Kp and ap indices respectively at time point t + w hours for a given time point t where w ranges from ranges from 1 to 9. GNet combines transformer encoder blocks with Bayesian inference, which is capable of quantifying both aleatoric uncertainty (data uncertainty) and epistemic uncertainty (model uncertainty) in making predictions. Experimental results show that GNet outperforms closely related machine learning methods in terms of the root mean square error and R-squared score. Furthermore, GNet can provide both data and model uncertainty quantification results, which the existing methods cannot offer. To our knowledge, this is the first time that Bayesian transformers have been used for geomagnetic activity prediction.
引用
收藏
页码:887 / 903
页数:17
相关论文
共 50 条
  • [1] A Transformer-Based Framework for Geomagnetic Activity Prediction
    Abduallah, Yasser
    Wang, Jason T. L.
    Xu, Chunhui
    Wang, Haimin
    FOUNDATIONS OF INTELLIGENT SYSTEMS (ISMIS 2022), 2022, 13515 : 325 - 335
  • [2] A Transformer-Based Framework for Tiny Object Detection
    Liao, Yi-Kai
    Lin, Gong-Si
    Yeh, Mei-Chen
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 373 - 377
  • [3] A transformer-based adversarial network framework for steganography
    Xiao, Chaoen
    Peng, Sirui
    Zhang, Lei
    Wang, Jianxin
    Ding, Ding
    Zhang, Jianyi
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 269
  • [4] A transformer-based framework for enterprise sales forecasting
    Sun, Yupeng
    Li, Tian
    PEERJ COMPUTER SCIENCE, 2024, 10 : 1 - 14
  • [5] A Transformer-Based Framework for Scene Text Recognition
    Selvam, Prabu
    Koilraj, Joseph Abraham Sundar
    Tavera Romero, Carlos Andres
    Alharbi, Meshal
    Mehbodniya, Abolfazl
    Webber, Julian L.
    Sengan, Sudhakar
    IEEE ACCESS, 2022, 10 : 100895 - 100910
  • [6] Fastformer: Transformer-Based Fast Reasoning Framework
    Zhu, Wenjuan
    Guo, Ling
    Zhang, Tianxiang
    Han, Feng
    Wei, Yi
    Gong, Xiaoqing
    Xu, Pengfei
    Guo, Jing
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [7] Transformer-based Approach for Predicting Chemical Compound Structures
    Omote, Yutaro
    Matsushita, Kyoumoto
    Iwakura, Tomoya
    Tamura, Akihiro
    Ninomiya, Takashi
    1ST CONFERENCE OF THE ASIA-PACIFIC CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 10TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (AACL-IJCNLP 2020), 2020, : 154 - 162
  • [8] Predicting the formation of NADES using a transformer-based model
    Ayres, Lucas B.
    Gomez, Federico J. V.
    Silva, Maria Fernanda
    Linton, Jeb R.
    Garcia, Carlos D.
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [9] Traffic Transformer: Transformer-based framework for temporal traffic accident prediction
    Al-Thani, Mansoor G.
    Sheng, Ziyu
    Cao, Yuting
    Yang, Yin
    AIMS MATHEMATICS, 2024, 9 (05): : 12610 - 12629
  • [10] Transformer-Based Approach for Predicting Transactive Energy in Neurorehabilitation
    Khan, Naveed Ahmad
    Goyal, Tanishka
    Hussain, Fahad
    Jamwal, Prashant K.
    Hussain, Shahid
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2025, 33 : 46 - 57