Research on ground-based cloud image classification combining local and global features

被引:0
|
作者
Zhang, Xin [1 ,2 ]
Zheng, Wanting [2 ]
Zhang, Jianwei [1 ]
Chen, Weibin [3 ,4 ]
Chen, Liangliang [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Coll Math & Stat, Nanjing, Peoples R China
[2] Wenzhou Med Univ, Sch Biomed Engn, Natl Engn Res Ctr Ophthalmol & Optometry, Wenzhou, Peoples R China
[3] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou, Peoples R China
[4] Wenzhou Univ, Key Lab Intelligent Informat Safety & Emergency Z, Wenzhou, Peoples R China
关键词
ground-based cloud; classification; attention mechanism; Swin Transformer; local and global features;
D O I
10.1117/1.JEI.33.4.043030
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Clouds are an important factor in predicting future weather changes. Cloud image classification is one of the basic issues in the field of ground-based cloud meteorological observation. Deep CNN mainly focuses on the local receptive field, and the processing of global information may be relatively weak. In ground-based cloud image classification, if there is a complex background, it will help to better model the long-range dependence of the image if the relationship between different locations in the image can be globally captured. A ground-based cloud image classification method is proposed based on the fusion of local features and global features (LG_CloudNet). The ground-based cloud image classification method integrates the global feature extraction module (GF_M) and the local feature extraction module (LF_M), using the attention mechanism to weight and merge features, respectively. The LG_CloudNet model enables richer and comprehensive feature representation at lower computational complexity. In order to ensure the learning and generalization capabilities of the model during training, AdamW (Adam weight decay) is combined with learning rate warm-up and stochastic gradient descent with warm restarts methods to adjust the learning rate. The experimental results demonstrate that the proposed method achieves favorable ground-based cloud image classification outcomes and exhibits robust performance in classifying cloud images. In the datasets of GCD, CCSN, and ZNCL, the classification accuracy is 94.94%, 95.77%, and 98.87%, respectively. (c) 2024 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 50 条
  • [31] CLOUD CLASSIFICATION OF GROUND-BASED CLOUD IMAGES BASED ON DAR-CapsNet
    Wei L.
    Zhu T.
    Guo Y.
    Ni C.
    Teng G.
    Li Y.
    Taiyangneng Xuebao/Acta Energiae Solaris Sinica, 2023, 44 (11): : 189 - 195
  • [32] Integration Transformer for Ground-Based Cloud Image Segmentation
    Liu, Shuang
    Zhang, Jiafeng
    Zhang, Zhong
    Cao, Xiaozhong
    Durrani, Tariq S.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [33] TransCloudSeg: Ground-Based Cloud Image Segmentation With Transformer
    Liu, Shuang
    Zhang, Jiafeng
    Zhang, Zhong
    Cao, Xiaozhong
    Durrani, Tariq S.
    IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15 : 6121 - 6132
  • [34] TransCloudSeg: Ground-Based Cloud Image Segmentation With Transformer
    Liu, Shuang
    Zhang, Jiafeng
    Zhang, Zhong
    Cao, Xiaozhong
    Durrani, Tariq S.
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 6121 - 6132
  • [35] A Local Threshold Algorithm for Cloud Detection on Ground-based Cloud Images
    Zhu Tingting
    Wei Haikun
    Zhang Chi
    Zhang Kanjian
    Liu Tianhong
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 3702 - 3706
  • [36] Global and Local Features for Char Image Classification
    Chaves, Deisy
    Trujillo, Maria
    Barraza, Juan
    ARTIFICIAL COMPUTATION IN BIOLOGY AND MEDICINE, PT I (IWINAC 2015), 2015, 9107 : 98 - 107
  • [37] Bloody Image Classification with Global and Local Features
    Chen, Song-Lu
    Yang, Chun
    Zhu, Chao
    Yin, Xu-Cheng
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 379 - 391
  • [38] An Automated Cirrus Cloud Detection Method for a Ground-Based Cloud Image
    Yang, Jun
    Lu, Weitao
    Ma, Ying
    Yao, Wen
    JOURNAL OF ATMOSPHERIC AND OCEANIC TECHNOLOGY, 2012, 29 (04) : 527 - 537
  • [39] Multimodal Ground-Based Remote Sensing Cloud Classification via Learning Heterogeneous Deep Features
    Liu, Shuang
    Duan, Linlin
    Zhang, Zhong
    Cao, Xiaozhong
    Durrani, Tariq S.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (11): : 7790 - 7800
  • [40] Voting in Transfer Learning System for Ground-Based Cloud Classification
    Manzo, Mario
    Pellino, Simone
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2021, 3 (03): : 542 - 553