Self-supervised learning based multi-modal intra-hour irradiance forecast

被引:0
|
作者
Shan, Shuo [1 ]
Dou, Weijin [1 ]
Zhang, Kanjian [1 ]
Wei, Haikun [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Short-term Irradiance Forecast; Ground-based Cloud Images; Multi-modal; Self-supervised learning;
D O I
10.1109/CCDC58219.2023.10327408
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-modal short-term irradiance forecast models usually fuse multi-source heterogeneous variables to predict future irrdiance and ground-based cloud images is one of the important modal. The dynamic information of clouds is shown to improve the models performance. However, such methods usually use original images directly for prediction, which decreases the efficiency and practicality of the training process. Therefore, a self-supervised learning method is proposed to learn the features of ground-based cloud images and meteorological factors. The obtained representations of exogenous variables are then used as the input for multi-modal short-term irradiance forecast. This method is validated on an open access dataset, and the results demonstrate that the self-supervised based approach outperforms other classical forecast models. Meanwhile, the images are compressed into vectors, which not only saves storage space but also reduces the training time of the prediction model significantly. In addition, the model achieves good transferability for ground-based cloud images with different qualities.
引用
收藏
页码:2549 / 2553
页数:5
相关论文
共 50 条
  • [1] Ensemble learning based multi-modal intra-hour irradiance forecasting
    Shan, Shuo
    Li, Chenxi
    Ding, Zhetong
    Wang, Yiye
    Zhang, Kanjian
    Wei, Haikun
    ENERGY CONVERSION AND MANAGEMENT, 2022, 270
  • [2] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Bo Liu
    Ruoyi Song
    Yuejia Xiang
    Junbo Du
    Weijian Ruan
    Jinhui Hu
    IEEE/CAA Journal of Automatica Sinica, 2022, 9 (11) : 2031 - 2033
  • [3] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Liu, Bo
    Song, Ruoyi
    Xiang, Yuejia
    Du, Junbo
    Ruan, Weijian
    Hu, Jinhui
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (11) : 2031 - 2033
  • [4] Self-Supervised Distilled Learning for Multi-modal Misinformation Identification
    Mu, Michael
    Das Bhattacharjee, Sreyasee
    Yuan, Junsong
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2818 - 2827
  • [5] SELF-SUPERVISED LEARNING OF MULTI-MODAL COOPERATION FOR SAR DESPECKLING
    Gaya, Victor
    Dalsasso, Emanuele
    Denis, Loic
    Tupin, Florence
    Pinel-Puyssegur, Beatrice
    Guerin, Cyrielle
    IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024, 2024, : 2180 - 2183
  • [6] Multi-modal Food Recommendation Using Clustering and Self-supervised Learning
    Zhang, Yixin
    Zhou, Xin
    Meng, Qianwen
    Zhu, Fanglin
    Xu, Yonghui
    Shen, Zhiqi
    Cui, Lizhen
    PRICAI 2024: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2025, 15281 : 269 - 281
  • [7] Highly Interactive Self-Supervised Learning for Multi-Modal Trajectory Prediction
    Xie, Wenda
    Liu, Yahui
    Zhao, Hongxia
    Guo, Chao
    Dai, Xingyuan
    Lv, Yisheng
    IFAC PAPERSONLINE, 2024, 58 (10): : 231 - 236
  • [8] Self-Supervised Multi-Modal Learning for Collaborative Robotic Grasp-Throw
    Hou, Yanxu
    Fang, Zihan
    Li, Jun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (05) : 4250 - 4256
  • [9] Self-supervised multi-modal fusion network for multi-modal thyroid ultrasound image diagnosis
    Xiang, Zhuo
    Zhuo, Qiuluan
    Zhao, Cheng
    Deng, Xiaofei
    Zhu, Ting
    Wang, Tianfu
    Jiang, Wei
    Lei, Baiying
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 150
  • [10] Self-supervised Multi-Modal Video Forgery Attack Detection
    Zhao, Chenhui
    Li, Xiang
    Younes, Rabih
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,