MULTI-MODAL SELF-SUPERVISED LEARNING FOR BOOSTING CROP CLASSIFICATION USING SENTINEL2 AND PLANETSCOPE

被引:1
|
作者
Patnala, Ankit [1 ]
Stadtler, Scarlet [1 ]
Schultz, Martin G. [1 ]
Gall, Juergen [2 ]
机构
[1] Forschungszentrum Juelich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Bonn, Dept Informat Syst Artificial Intelligence, Bonn, Germany
关键词
Optical remote sensing; crop classification; contrastive learning; multi-modal contrastive learning; time-series; self-supervised learning;
D O I
10.1109/IGARSS52108.2023.10282665
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Remote sensing has enabled large-scale crop classification to understand agricultural ecosystems and estimate production yields. Since few years, machine learning is increasingly used for automated crop classification. However, most approaches apply novel algorithms to custom datasets containing information of few crop fields covering a small region and this often leads to poor models that lack generalization capability. Therefore in this work, inspired from the self-supervised learning approaches, we devised and compared different approaches for contrastive self-supervised learning using Sentinel2 and Planetscope data for crop classification. In addition, based on the dataset DENETHOR, we assembled our own dataset for the experiments.
引用
收藏
页码:2223 / 2226
页数:4
相关论文
共 50 条
  • [1] Multi-modal Food Recommendation Using Clustering and Self-supervised Learning
    Zhang, Yixin
    Zhou, Xin
    Meng, Qianwen
    Zhu, Fanglin
    Xu, Yonghui
    Shen, Zhiqi
    Cui, Lizhen
    PRICAI 2024: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2025, 15281 : 269 - 281
  • [2] Bi-modal contrastive learning for crop classification using Sentinel-2 and Planetscope
    Patnala, Ankit
    Stadtler, Scarlet
    Schultz, Martin G.
    Gall, Juergen
    FRONTIERS IN REMOTE SENSING, 2024, 5
  • [3] Self-Supervised Distilled Learning for Multi-modal Misinformation Identification
    Mu, Michael
    Das Bhattacharjee, Sreyasee
    Yuan, Junsong
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2818 - 2827
  • [4] SELF-SUPERVISED LEARNING OF MULTI-MODAL COOPERATION FOR SAR DESPECKLING
    Gaya, Victor
    Dalsasso, Emanuele
    Denis, Loic
    Tupin, Florence
    Pinel-Puyssegur, Beatrice
    Guerin, Cyrielle
    IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024, 2024, : 2180 - 2183
  • [5] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Bo Liu
    Ruoyi Song
    Yuejia Xiang
    Junbo Du
    Weijian Ruan
    Jinhui Hu
    IEEE/CAA Journal of Automatica Sinica, 2022, 9 (11) : 2031 - 2033
  • [6] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Liu, Bo
    Song, Ruoyi
    Xiang, Yuejia
    Du, Junbo
    Ruan, Weijian
    Hu, Jinhui
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (11) : 2031 - 2033
  • [7] Highly Interactive Self-Supervised Learning for Multi-Modal Trajectory Prediction
    Xie, Wenda
    Liu, Yahui
    Zhao, Hongxia
    Guo, Chao
    Dai, Xingyuan
    Lv, Yisheng
    IFAC PAPERSONLINE, 2024, 58 (10): : 231 - 236
  • [8] The Effectiveness of Self-supervised Pre-training for Multi-modal Endometriosis Classification
    Butler, David
    Wang, Hu
    Zhang, Yuan
    To, Minh-Son
    Condous, George
    Leonardi, Mathew
    Knox, Steven
    Avery, Jodie
    Hull, M. Louise
    Carneiro, Gustavo
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [9] Multi-modal representation learning in retinal imaging using self-supervised learning for enhanced clinical predictions
    Suekei, Emese
    Rumetshofer, Elisabeth
    Schmidinger, Niklas
    Mayr, Andreas
    Schmidt-Erfurth, Ursula
    Klambauer, Guenter
    Bogunovic, Hrvoje
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [10] SELF-SUPERVISED LEARNING FOR CROP CLASSIFICATION USING PLANET FUSIONCaglar
    Senaras, Caglar
    Holden, Piers
    Davis, Timothy
    Rana, Akhil Singh
    Grady, Maddie
    Wania, Annett
    de Jeu, Richard
    39TH INTERNATIONAL SYMPOSIUM ON REMOTE SENSING OF ENVIRONMENT ISRSE-39 FROM HUMAN NEEDS TO SDGS, VOL. 48-M-1, 2023, : 309 - 315