Self-supervised learning based multi-modal intra-hour irradiance forecast

被引:0
|
作者
Shan, Shuo [1 ]
Dou, Weijin [1 ]
Zhang, Kanjian [1 ]
Wei, Haikun [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Short-term Irradiance Forecast; Ground-based Cloud Images; Multi-modal; Self-supervised learning;
D O I
10.1109/CCDC58219.2023.10327408
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-modal short-term irradiance forecast models usually fuse multi-source heterogeneous variables to predict future irrdiance and ground-based cloud images is one of the important modal. The dynamic information of clouds is shown to improve the models performance. However, such methods usually use original images directly for prediction, which decreases the efficiency and practicality of the training process. Therefore, a self-supervised learning method is proposed to learn the features of ground-based cloud images and meteorological factors. The obtained representations of exogenous variables are then used as the input for multi-modal short-term irradiance forecast. This method is validated on an open access dataset, and the results demonstrate that the self-supervised based approach outperforms other classical forecast models. Meanwhile, the images are compressed into vectors, which not only saves storage space but also reduces the training time of the prediction model significantly. In addition, the model achieves good transferability for ground-based cloud images with different qualities.
引用
收藏
页码:2549 / 2553
页数:5
相关论文
共 50 条
  • [31] Integrating remote sensing with OpenStreetMap data for comprehensive scene understanding through multi-modal self-supervised learning
    Bai, Lubin
    Zhang, Xiuyuan
    Wang, Haoyu
    Du, Shihong
    REMOTE SENSING OF ENVIRONMENT, 2025, 318
  • [32] Multi-Modal Self-Supervised Learning for Cross-Domain One-Shot Bearing Fault Diagnosis
    Chen, Xiaohan
    Xue, Yihao
    Huang, Mengjie
    Yang, Rui
    IFAC PAPERSONLINE, 2024, 58 (04): : 746 - 751
  • [33] Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion
    Zheng, Meng
    Planche, Benjamin
    Gong, Xuan
    Yang, Fan
    Chen, Terrence
    Wu, Ziyan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VII, 2022, 13437 : 115 - 125
  • [34] Self-supervised multi-modal feature fusion for predicting early recurrence of hepatocellular carcinoma
    Wang, Sen
    Zhao, Ying
    Li, Jiayi
    Yi, Zongmin
    Li, Jun
    Zuo, Can
    Yao, Yu
    Liu, Ailian
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 118
  • [35] Self-Supervised Intra-Modal and Cross-Modal Contrastive Learning for Point Cloud Understanding
    Wu, Yue
    Liu, Jiaming
    Gong, Maoguo
    Gong, Peiran
    Fan, Xiaolong
    Qin, A. K.
    Miao, Qiguang
    Ma, Wenping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1626 - 1638
  • [36] Fuzzy inference systems based on multi-type features fusion for intra-hour solar irradiance forecasts
    Zhao, Xin
    Xie, Liping
    Wei, Haikun
    Wang, Hai
    Zhang, Kanjian
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2021, 45
  • [37] Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking
    Wang, Rui
    Zhu, Jiawei
    Wang, Shoujin
    Wang, Tao
    Huang, Jingze
    Zhu, Xianxun
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (04)
  • [38] Exploring Self-Supervised Learning for Multi-Modal Remote Sensing Pre-Training via Asymmetric Attention Fusion
    Xu, Guozheng
    Jiang, Xue
    Li, Xiangtai
    Zhang, Ze
    Liu, Xingzhao
    REMOTE SENSING, 2023, 15 (24)
  • [39] Heterogeneous self-supervised interest point matching for multi-modal remote sensing image registration
    Zhao, Ming
    Zhang, Guixiang
    Ding, Min
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (03) : 915 - 931
  • [40] AUDIO-VISUAL SPEECH ENHANCEMENT AND SEPARATION BY UTILIZING MULTI-MODAL SELF-SUPERVISED EMBEDDINGS
    Chern, I-Chun
    Hung, Kuo-Hsuan
    Chen, Yi-Ting
    Hussain, Tassadaq
    Gogate, Mandar
    Hussain, Amir
    Tsao, Yu
    Hou, Jen-Cheng
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,