Self-supervised learning based multi-modal intra-hour irradiance forecast

被引:0
|
作者
Shan, Shuo [1 ]
Dou, Weijin [1 ]
Zhang, Kanjian [1 ]
Wei, Haikun [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Short-term Irradiance Forecast; Ground-based Cloud Images; Multi-modal; Self-supervised learning;
D O I
10.1109/CCDC58219.2023.10327408
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-modal short-term irradiance forecast models usually fuse multi-source heterogeneous variables to predict future irrdiance and ground-based cloud images is one of the important modal. The dynamic information of clouds is shown to improve the models performance. However, such methods usually use original images directly for prediction, which decreases the efficiency and practicality of the training process. Therefore, a self-supervised learning method is proposed to learn the features of ground-based cloud images and meteorological factors. The obtained representations of exogenous variables are then used as the input for multi-modal short-term irradiance forecast. This method is validated on an open access dataset, and the results demonstrate that the self-supervised based approach outperforms other classical forecast models. Meanwhile, the images are compressed into vectors, which not only saves storage space but also reduces the training time of the prediction model significantly. In addition, the model achieves good transferability for ground-based cloud images with different qualities.
引用
收藏
页码:2549 / 2553
页数:5
相关论文
共 50 条
  • [21] Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis
    Li, Xiaomeng
    Jia, Mengyu
    Islam, Md Tauhidul
    Yu, Lequan
    Xing, Lei
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (12) : 4023 - 4033
  • [22] Multi-Modal Perception Attention Network with Self-Supervised Learning for Audio-Visual Speaker Tracking
    Li, Yidi
    Liu, Hong
    Tang, Hao
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1456 - 1463
  • [23] MULTI-MODAL SELF-SUPERVISED LEARNING FOR BOOSTING CROP CLASSIFICATION USING SENTINEL2 AND PLANETSCOPE
    Patnala, Ankit
    Stadtler, Scarlet
    Schultz, Martin G.
    Gall, Juergen
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 2223 - 2226
  • [24] TS-DENet: a transferable self-supervised learning method for multi-modal fluorescence image denoising
    Huang, Liangliang
    Wen, Zhong
    Wang, Zhaokai
    Li, Quanzhi
    Deng, Qilin
    Liu, Xu
    Yang, Qing
    Applied Optics, 2025, 64 (10) : 2534 - 2544
  • [25] Self-Supervised Multi-Modal Knowledge Graph Contrastive Hashing for Cross-Modal Search
    Liang, Meiyu
    Du, Junping
    Liang, Zhengyang
    Xing, Yongwang
    Huang, Wei
    Xue, Zhe
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13744 - 13753
  • [26] Deep Self-Supervised t-SNE for Multi-modal Subspace Clustering
    Wang, Qianqian
    Xia, Wei
    Tao, Zhiqiang
    Gao, Quanxue
    Cao, Xiaochun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1748 - 1755
  • [27] Self-Supervised Multi-Modal Hybrid Fusion Network for Brain Tumor Segmentation
    Fang, Feiyi
    Yao, Yazhou
    Zhou, Tao
    Xie, Guosen
    Lu, Jianfeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (11) : 5310 - 5320
  • [28] The Effectiveness of Self-supervised Pre-training for Multi-modal Endometriosis Classification
    Butler, David
    Wang, Hu
    Zhang, Yuan
    To, Minh-Son
    Condous, George
    Leonardi, Mathew
    Knox, Steven
    Avery, Jodie
    Hull, M. Louise
    Carneiro, Gustavo
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [29] Self-Supervised Training of Speaker Encoder With Multi-Modal Diverse Positive Pairs
    Tao, Ruijie
    Lee, Kong Aik
    Das, Rohan Kumar
    Hautamaki, Ville
    Li, Haizhou
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1706 - 1719
  • [30] Multi-label remote sensing classification with self-supervised gated multi-modal transformers
    Liu, Na
    Yuan, Ye
    Wu, Guodong
    Zhang, Sai
    Leng, Jie
    Wan, Lihong
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18