Research on ground-based cloud image classification combining local and global features

被引:0
|
作者
Zhang, Xin [1 ,2 ]
Zheng, Wanting [2 ]
Zhang, Jianwei [1 ]
Chen, Weibin [3 ,4 ]
Chen, Liangliang [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Math & Stat, Nanjing, Peoples R China
[2] Wenzhou Med Univ, Sch Biomed Engn, Natl Engn Res Ctr Ophthalmol & Optometry, Wenzhou, Peoples R China
[3] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou, Peoples R China
[4] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Z, Wenzhou, Peoples R China
关键词
ground-based cloud; classification; attention mechanism; Swin Transformer; local and global features;
D O I
10.1117/1.JEI.33.4.043030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Clouds are an important factor in predicting future weather changes. Cloud image classification is one of the basic issues in the field of ground-based cloud meteorological observation. Deep CNN mainly focuses on the local receptive field, and the processing of global information may be relatively weak. In ground-based cloud image classification, if there is a complex background, it will help to better model the long-range dependence of the image if the relationship between different locations in the image can be globally captured. A ground-based cloud image classification method is proposed based on the fusion of local features and global features (LG_CloudNet). The ground-based cloud image classification method integrates the global feature extraction module (GF_M) and the local feature extraction module (LF_M), using the attention mechanism to weight and merge features, respectively. The LG_CloudNet model enables richer and comprehensive feature representation at lower computational complexity. In order to ensure the learning and generalization capabilities of the model during training, AdamW (Adam weight decay) is combined with learning rate warm-up and stochastic gradient descent with warm restarts methods to adjust the learning rate. The experimental results demonstrate that the proposed method achieves favorable ground-based cloud image classification outcomes and exhibits robust performance in classifying cloud images. In the datasets of GCD, CCSN, and ZNCL, the classification accuracy is 94.94%, 95.77%, and 98.87%, respectively. (c) 2024 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Ground-based observations of cloud features on Uranus
    Sromovsky, LA
    Spencer, JR
    Baines, KH
    Fry, PM
    ICARUS, 2000, 146 (01) : 307 - 311
  • [22] MMST: A Multi-Modal Ground-Based Cloud Image Classification Method
    Wei, Liang
    Zhu, Tingting
    Guo, Yiren
    Ni, Chao
    SENSORS, 2023, 23 (09)
  • [23] DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features
    Ye, Liang
    Cao, Zhiguo
    Xiao, Yang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (10): : 5729 - 5740
  • [24] Ground-based measurements of local cloud cover
    Abel Antônio Silva
    Mariza Pereira de Souza Echer
    Meteorology and Atmospheric Physics, 2013, 120 : 201 - 212
  • [25] Ground-based measurements of local cloud cover
    Silva, Abel Antonio
    de Souza Echer, Mariza Pereira
    METEOROLOGY AND ATMOSPHERIC PHYSICS, 2013, 120 (3-4) : 201 - 212
  • [26] Learning Discriminative Features for Ground-Based Cloud Classification via Mutual Information Maximization
    Liu, Shuang
    Zhang, Zhong
    Xiao, Baihua
    Cao, Xiaozhong
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2015, E98D (07): : 1422 - 1425
  • [27] ANNOR: Efficient image annotation based on combining local and global features
    Kuric, Eduard
    Bielikova, Maria
    COMPUTERS & GRAPHICS-UK, 2015, 47 : 1 - 15
  • [28] Investigation on Ground-Based Cloud Image Classification and Its Application in Photovoltaic Power Forecasting
    Nie, Bing
    Lu, Zhiying
    Han, Jun
    Chen, Wenpeng
    Cai, Chao
    Pan, Wenjie
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [29] Compact Sparse Coding for Ground-Based Cloud Classification
    Liu, Shuang
    Zhang, Zhong
    Cao, Xiaozhong
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2015, E98D (11): : 2003 - 2007
  • [30] Combining local and global features for image segmentation using iterative classification and region merging
    Yu, QY
    Clausi, DA
    2ND CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, PROCEEDINGS, 2005, : 579 - 586