Aurora Classification in All-Sky Images via CNN-Transformer

被引:8
|
作者
Lian, Jian [1 ]
Liu, Tianyu [2 ]
Zhou, Yanan [3 ]
机构
[1] Shandong Management Univ, Sch Intelligence Engn, Jinan 250357, Peoples R China
[2] Shandong Management Univ, Sch Business Adm, Jinan 250357, Peoples R China
[3] Beijing Foreign Studies Univ, Sch Arts, Beijing 100089, Peoples R China
关键词
auroral image classification; machine vision; deep learning;
D O I
10.3390/universe9050230
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
An aurora is a unique geophysical phenomenon with polar characteristics that can be directly observed with the naked eye. It is the most concentrated manifestation of solar-terrestrial physical processes (especially magnetospheric-ionospheric interactions) in polar regions and is also the best window for studying solar storms. Due to the rich morphological information in aurora images, people are paying more and more attention to studying aurora phenomena from the perspective of images. Recently, some machine learning and deep learning methods have been applied to this field and have achieved preliminary results. However, due to the limitations of these learning models, they still need to meet the requirements for the classification and prediction of auroral images regarding recognition accuracy. In order to solve this problem, this study introduces a convolutional neural network transformer solution based on vision transformers. Comparative experiments show that the proposed method can effectively improve the accuracy of aurora image classification, and its performance has exceeded that of state-of-the-art deep learning methods. The experimental results show that the algorithm presented in this study is an effective instrument for classifying auroral images and can provide practical assistance for related research.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Cloud Cover Measurement from All-Sky Nighttime Images
    Yin, Jia
    Yao, Yongqiang
    Liu, Liyong
    Qian, Xuan
    Wang, Hongshuai
    ADAPTING TO THE ATMOSPHERE CONFERENCE 2014, 2015, 595
  • [32] CNN-Transformer based emotion classification from facial expressions and body gestures
    Karatay, Busra
    Bestepe, Deniz
    Sailunaz, Kashfia
    oezyer, Tansel
    Alhajj, Reda
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 23129 - 23171
  • [33] Rethinking Image Deblurring via CNN-Transformer Multiscale Hybrid Architecture
    Zhao, Qian
    Yang, Hao
    Zhou, Dongming
    Cao, Jinde
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [34] Rethinking Image Deblurring via CNN-Transformer Multiscale Hybrid Architecture
    Zhao, Qian
    Yang, Hao
    Zhou, Dongming
    Cao, Jinde
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [35] Assessing Cloud Segmentation in the Chromacity Diagram of All-Sky Images
    Krauz, Lukas
    Janout, Petr
    Blazek, Martin
    Pata, Petr
    REMOTE SENSING, 2020, 12 (11)
  • [36] Automatic Auroral Detection in Color All-Sky Camera Images
    Rao, Jayasimha
    Partamies, Noora
    Amariutei, Olga
    Syrjasuo, Mikko
    van de Sande, Koen E. A.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (12) : 4717 - 4725
  • [37] A CNN-transformer fusion network for COVID-19 CXR image classification
    Cao, Kai
    Deng, Tao
    Zhang, Chuanlin
    Lu, Limeng
    Li, Lin
    PLOS ONE, 2022, 17 (10):
  • [38] Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network
    Shareef, Bryar
    Xian, Min
    Vakanski, Aleksandar
    Wang, Haotian
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 : 344 - 353
  • [39] A synergistic CNN-transformer network with pooling attention fusion for hyperspectral image classification
    Chen, Peng
    He, Wenxuan
    Qian, Feng
    Shi, Guangyao
    Yan, Jingwen
    DIGITAL SIGNAL PROCESSING, 2025, 160
  • [40] DACTransNet: A Hybrid CNN-Transformer Network for Histopathological Image Classification of Pancreatic Cancer
    Kou, Yongqing
    Xia, Cong
    Jiao, Yiping
    Zhang, Daoqiang
    Ge, Rongjun
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT II, 2024, 14474 : 422 - 434