Research on ground-based cloud image classification combining local and global features

被引:0
|
作者
Zhang, Xin [1 ,2 ]
Zheng, Wanting [2 ]
Zhang, Jianwei [1 ]
Chen, Weibin [3 ,4 ]
Chen, Liangliang [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Math & Stat, Nanjing, Peoples R China
[2] Wenzhou Med Univ, Sch Biomed Engn, Natl Engn Res Ctr Ophthalmol & Optometry, Wenzhou, Peoples R China
[3] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou, Peoples R China
[4] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Z, Wenzhou, Peoples R China
关键词
ground-based cloud; classification; attention mechanism; Swin Transformer; local and global features;
D O I
10.1117/1.JEI.33.4.043030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Clouds are an important factor in predicting future weather changes. Cloud image classification is one of the basic issues in the field of ground-based cloud meteorological observation. Deep CNN mainly focuses on the local receptive field, and the processing of global information may be relatively weak. In ground-based cloud image classification, if there is a complex background, it will help to better model the long-range dependence of the image if the relationship between different locations in the image can be globally captured. A ground-based cloud image classification method is proposed based on the fusion of local features and global features (LG_CloudNet). The ground-based cloud image classification method integrates the global feature extraction module (GF_M) and the local feature extraction module (LF_M), using the attention mechanism to weight and merge features, respectively. The LG_CloudNet model enables richer and comprehensive feature representation at lower computational complexity. In order to ensure the learning and generalization capabilities of the model during training, AdamW (Adam weight decay) is combined with learning rate warm-up and stochastic gradient descent with warm restarts methods to adjust the learning rate. The experimental results demonstrate that the proposed method achieves favorable ground-based cloud image classification outcomes and exhibits robust performance in classifying cloud images. In the datasets of GCD, CCSN, and ZNCL, the classification accuracy is 94.94%, 95.77%, and 98.87%, respectively. (c) 2024 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Feature extraction techniques for ground-based cloud type classification
    Kliangsuwan, Thitinan
    Heednacram, Apichat
    EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (21) : 8294 - 8303
  • [42] Ground-Based Cloud Classification Using Pyramid Salient LBP
    Zhang, Zhong
    Zhang, Yue
    Liu, Shuang
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2016, 386 : 595 - 601
  • [43] Local and Global Spectral Features for Hyperspectral Image Classification
    Xu, Zeyu
    Su, Cheng
    Wang, Shirou
    Zhang, Xiaocan
    REMOTE SENSING, 2023, 15 (07)
  • [44] Scene image classification based on visual words concatenation of local and global features
    Multimedia Tools and Applications, 2022, 81 : 1237 - 1256
  • [45] Scene image classification based on visual words concatenation of local and global features
    Shrinivasa, S. R.
    Prabhakar, C. J.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (01) : 1237 - 1256
  • [46] Combining Image Features for Image Classification
    Baharudin, B.
    Qahwaji, R.
    Jiang, J.
    Rahman, P.
    ICIAS 2007: INTERNATIONAL CONFERENCE ON INTELLIGENT & ADVANCED SYSTEMS, VOLS 1-3, PROCEEDINGS, 2007, : 268 - +
  • [47] A hybrid method based on extreme learning machine and k-nearest neighbor for cloud classification of ground-based visible cloud image
    Xia, Min
    Lu, Weitao
    Yang, Jun
    Ma, Ying
    Yao, Wen
    Zheng, Zichen
    NEUROCOMPUTING, 2015, 160 : 238 - 249
  • [48] Image classification based on enhanced learning of global and local features with structural priors
    Cao, Yuan
    Jiang, Di
    Yang, Qiang
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [49] Shape-based Image Retrieval Using Combining Global and Local Shape Features
    Wu, Yanyan
    Wu, Yiquan
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 1195 - 1199
  • [50] Contrast preserving image decolorization combining global features and local semantic features
    Xiaoli Zhang
    Shiguang Liu
    The Visual Computer, 2018, 34 : 1099 - 1108