Research on ground-based cloud image classification combining local and global features

被引:0
|
作者
Zhang, Xin [1 ,2 ]
Zheng, Wanting [2 ]
Zhang, Jianwei [1 ]
Chen, Weibin [3 ,4 ]
Chen, Liangliang [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Math & Stat, Nanjing, Peoples R China
[2] Wenzhou Med Univ, Sch Biomed Engn, Natl Engn Res Ctr Ophthalmol & Optometry, Wenzhou, Peoples R China
[3] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou, Peoples R China
[4] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Z, Wenzhou, Peoples R China
关键词
ground-based cloud; classification; attention mechanism; Swin Transformer; local and global features;
D O I
10.1117/1.JEI.33.4.043030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Clouds are an important factor in predicting future weather changes. Cloud image classification is one of the basic issues in the field of ground-based cloud meteorological observation. Deep CNN mainly focuses on the local receptive field, and the processing of global information may be relatively weak. In ground-based cloud image classification, if there is a complex background, it will help to better model the long-range dependence of the image if the relationship between different locations in the image can be globally captured. A ground-based cloud image classification method is proposed based on the fusion of local features and global features (LG_CloudNet). The ground-based cloud image classification method integrates the global feature extraction module (GF_M) and the local feature extraction module (LF_M), using the attention mechanism to weight and merge features, respectively. The LG_CloudNet model enables richer and comprehensive feature representation at lower computational complexity. In order to ensure the learning and generalization capabilities of the model during training, AdamW (Adam weight decay) is combined with learning rate warm-up and stochastic gradient descent with warm restarts methods to adjust the learning rate. The experimental results demonstrate that the proposed method achieves favorable ground-based cloud image classification outcomes and exhibits robust performance in classifying cloud images. In the datasets of GCD, CCSN, and ZNCL, the classification accuracy is 94.94%, 95.77%, and 98.87%, respectively. (c) 2024 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Cloud classification of ground-based infrared images combining manifold and texture features
    Luo, Qixiang
    Meng, Yong
    Liu, Lei
    Zhao, Xiaofeng
    Zhou, Zeming
    ATMOSPHERIC MEASUREMENT TECHNIQUES, 2018, 11 (09) : 5351 - 5361
  • [2] Image classification by combining local and global features
    Leila Kabbai
    Mehrez Abdellaoui
    Ali Douik
    The Visual Computer, 2019, 35 : 679 - 693
  • [3] Image classification by combining local and global features
    Kabbai, Leila
    Abdellaoui, Mehrez
    Douik, Ali
    VISUAL COMPUTER, 2019, 35 (05): : 679 - 693
  • [4] Evaluation Embedding Features for Ground-Based Cloud Classification
    Zhang, Zhong
    Li, Donghong
    Liu, Shuang
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING, 2020, 516 : 916 - 922
  • [5] Salient local binary pattern for ground-based cloud classification
    Liu Shuang
    Wang Chunheng
    Xiao Baihua
    Zhang Zhong
    Shao Yunxue
    ACTA METEOROLOGICA SINICA, 2013, 27 (02): : 211 - 220
  • [6] Salient Local Binary Pattern for Ground-Based Cloud Classification
    刘爽
    王春恒
    肖柏华
    张重
    邵允学
    ActaMeteorologicaSinica, 2013, 27 (02) : 211 - 220
  • [7] Salient Local Binary Pattern for Ground-Based Cloud Classification
    刘爽
    王春恒
    肖柏华
    张重
    邵允学
    Journal of Meteorological Research, 2013, (02) : 211 - 220
  • [8] Salient local binary pattern for ground-based cloud classification
    Shuang Liu
    Chunheng Wang
    Baihua Xiao
    Zhong Zhang
    Yunxue Shao
    Acta Meteorologica Sinica, 2013, 27 : 211 - 220
  • [9] Image retrieval based on combining local and global features
    Wang, Hua-Zhang
    He, Xiao-Hai
    Zai, Wen-Jiao
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2008, 16 (06): : 1098 - 1104
  • [10] Cross-Domain Ground-Based Cloud Classification Based on Transfer of Local Features and Discriminative Metric Learning
    Zhang, Zhong
    Li, Donghong
    Liu, Shuang
    Xiao, Baihua
    Cao, Xiaozhong
    REMOTE SENSING, 2018, 10 (01):