MULTI-MODAL SELF-SUPERVISED LEARNING FOR BOOSTING CROP CLASSIFICATION USING SENTINEL2 AND PLANETSCOPE

被引:1
|
作者
Patnala, Ankit [1 ]
Stadtler, Scarlet [1 ]
Schultz, Martin G. [1 ]
Gall, Juergen [2 ]
机构
[1] Forschungszentrum Juelich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Bonn, Dept Informat Syst Artificial Intelligence, Bonn, Germany
关键词
Optical remote sensing; crop classification; contrastive learning; multi-modal contrastive learning; time-series; self-supervised learning;
D O I
10.1109/IGARSS52108.2023.10282665
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Remote sensing has enabled large-scale crop classification to understand agricultural ecosystems and estimate production yields. Since few years, machine learning is increasingly used for automated crop classification. However, most approaches apply novel algorithms to custom datasets containing information of few crop fields covering a small region and this often leads to poor models that lack generalization capability. Therefore in this work, inspired from the self-supervised learning approaches, we devised and compared different approaches for contrastive self-supervised learning using Sentinel2 and Planetscope data for crop classification. In addition, based on the dataset DENETHOR, we assembled our own dataset for the experiments.
引用
收藏
页码:2223 / 2226
页数:4
相关论文
共 50 条
  • [21] Self-supervised Multi-modal Alignment for Whole Body Medical Imaging
    Windsor, Rhydian
    Jamaludin, Amir
    Kadir, Timor
    Zisserman, Andrew
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 90 - 101
  • [22] Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning
    Chen, Kaiqi
    Lee, Yong
    Soh, Harold
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 4274 - 4280
  • [23] Self-Supervised Feature Learning via Exploiting Multi-Modal Data for Retinal Disease Diagnosis
    Li, Xiaomeng
    Jia, Mengyu
    Islam, Md Tauhidul
    Yu, Lequan
    Xing, Lei
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (12) : 4023 - 4033
  • [24] Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking
    Wang, Rui
    Zhu, Jiawei
    Wang, Shoujin
    Wang, Tao
    Huang, Jingze
    Zhu, Xianxun
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (04)
  • [25] Multi-Modal Perception Attention Network with Self-Supervised Learning for Audio-Visual Speaker Tracking
    Li, Yidi
    Liu, Hong
    Tang, Hao
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1456 - 1463
  • [26] Respiratory sound classification using supervised and self-supervised learning
    Lee, Sunju
    Ha, Taeyoung
    Hyon, YunKyong
    Chung, Chaeuk
    Kim, Yoonjoo
    Woo, Seong-Dae
    Lee, Song-I
    RESPIROLOGY, 2023, 28 : 160 - 161
  • [27] TS-DENet: a transferable self-supervised learning method for multi-modal fluorescence image denoising
    Huang, Liangliang
    Wen, Zhong
    Wang, Zhaokai
    Li, Quanzhi
    Deng, Qilin
    Liu, Xu
    Yang, Qing
    Applied Optics, 2025, 64 (10) : 2534 - 2544
  • [28] Self-Supervised Multi-Modal Knowledge Graph Contrastive Hashing for Cross-Modal Search
    Liang, Meiyu
    Du, Junping
    Liang, Zhengyang
    Xing, Yongwang
    Huang, Wei
    Xue, Zhe
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13744 - 13753
  • [29] A lightning augmented recurrent nowcasting model based on self-supervised learning and multi-modal fusion method
    Zhang, Liang
    Li, Qian
    Zhou, Zeming
    Yang, Kangquan
    ATMOSPHERIC RESEARCH, 2025, 321
  • [30] Deep Self-Supervised t-SNE for Multi-modal Subspace Clustering
    Wang, Qianqian
    Xia, Wei
    Tao, Zhiqiang
    Gao, Quanxue
    Cao, Xiaochun
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1748 - 1755