A transformer-based framework for predicting geomagnetic indices with uncertainty quantification

被引:1
|
作者
Abduallah, Yasser [1 ]
Wang, Jason T. L. [1 ]
Wang, Haimin [2 ]
Jing, Ju [2 ]
机构
[1] New Jersey Inst Technol, Dept Comp Sci, Univ Hts, Newark, NJ 07102 USA
[2] New Jersey Inst Technol, Inst Space Weather Sci, Univ Hts, Newark, NJ 07102 USA
基金
美国国家科学基金会;
关键词
Bayesian inference; Deep learning; Geomagnetic index; Uncertainty quantification; DROPOUT;
D O I
10.1007/s10844-023-00828-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Geomagnetic activities have a crucial impact on Earth, which can affect spacecraft and electrical power grids. Geospace scientists use a geomagnetic index, called the Kp index, to describe the overall level of geomagnetic activity. This index is an important indicator of disturbances in the Earth's magnetic field and is used by the U.S. Space Weather Prediction Center as an alert and warning service for users who may be affected by the disturbances. Another commonly used index, called the ap index, is converted from the Kp index. Early and accurate prediction of the Kp and ap indices is essential for preparedness and disaster risk management. In this paper, we present a deep learning framework, named GNet, to perform short-term forecasting of the Kp and ap indices. Specifically, GNet takes as input time series of solar wind parameters' values, provided by NASA's Space Science Data Coordinated Archive, and predicts as output the Kp and ap indices respectively at time point t + w hours for a given time point t where w ranges from ranges from 1 to 9. GNet combines transformer encoder blocks with Bayesian inference, which is capable of quantifying both aleatoric uncertainty (data uncertainty) and epistemic uncertainty (model uncertainty) in making predictions. Experimental results show that GNet outperforms closely related machine learning methods in terms of the root mean square error and R-squared score. Furthermore, GNet can provide both data and model uncertainty quantification results, which the existing methods cannot offer. To our knowledge, this is the first time that Bayesian transformers have been used for geomagnetic activity prediction.
引用
收藏
页码:887 / 903
页数:17
相关论文
共 50 条
  • [41] Transformer-Based Radiomics for Predicting Breast Tumor Malignancy Score in Ultrasonography
    Hassanien, Mohamed A.
    Singh, Vivek Kumar
    Puig, Domenec
    Abdel-Nasser, Mohamed
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2022, 356 : 298 - 307
  • [42] A Framework for Accelerating Transformer-Based Language Model on ReRAM-Based Architecture
    Kang, Myeonggu
    Shin, Hyein
    Kim, Lee-Sup
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (09) : 3026 - 3039
  • [43] LOMIA-T: A Transformer-Based LOngitudinal Medical Image Analysis Framework for Predicting Treatment Response of Esophageal Cancer
    Sun, Yuchen
    Li, Kunwei
    Chen, Duanduan
    Hu, Yi
    Zhang, Shuaitong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT V, 2024, 15005 : 426 - 436
  • [44] LTransformer: A Transformer-Based Framework for Task Offloading in Vehicular Edge Computing
    Yang, Yichi
    Yan, Ruibin
    Gu, Yijun
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [45] A transformer-based hierarchical registration framework for multimodality deformable image registration
    Zhao, Yao
    Chen, Xinru
    Mcdonald, Brigid
    Yu, Cenji
    Mohamed, Abdalah S. R.
    Fuller, Clifton D.
    Court, Laurence E.
    Pan, Tinsu
    Wang, He
    Wang, Xin
    Phan, Jack
    Yang, Jinzhong
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 108
  • [46] Foreformer: an enhanced transformer-based framework for multivariate time series forecasting
    Ye Yang
    Jiangang Lu
    Applied Intelligence, 2023, 53 : 12521 - 12540
  • [47] Foreformer: an enhanced transformer-based framework for multivariate time series forecasting
    Yang, Ye
    Lu, Jiangang
    APPLIED INTELLIGENCE, 2023, 53 (10) : 12521 - 12540
  • [48] A Transformer-Based Framework for POI-Level Social Post Geolocation
    Li, Menglin
    Lim, Kwan Hui
    Guo, Teng
    Liu, Junhua
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT I, 2023, 13980 : 588 - 604
  • [49] A transformer-based unified multimodal framework for Alzheimer's disease assessment
    Department of Big Data in Health Science, School of Public Health and Center of Clinical Big Data and Analytics of The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang, Hangzhou, China
    不详
    130024, China
    Comput. Biol. Med.,
  • [50] A Transformer-based Framework for Neutralizing and Reversing the Political Polarity of News Articles
    Liu R.
    Jia C.
    Vosoughi S.
    Proceedings of the ACM on Human-Computer Interaction, 2021, 5 (CSCW1)