Self-Supervised Learning for Electroencephalography

被引:171
|
作者
Rafiei, Mohammad H. [1 ]
Gauthier, Lynne V. [2 ]
Adeli, Hojjat [3 ,4 ]
Takabi, Daniel [1 ]
机构
[1] Georgia State Univ, Dept Comp Sci, Atlanta, GA 30303 USA
[2] Univ Massachusetts Lowell, Dept Phys Therapy & Kinesiol, Lowell, MA 01854 USA
[3] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[4] Ohio State Univ, Dept Neurosci, Columbus, OH 43210 USA
关键词
Electroencephalography; Brain modeling; Data models; Task analysis; Machine learning; Training; Heuristic algorithms; Electroencephalography (EEG); machine learning; self-supervised learning (SSL); BRAIN-COMPUTER INTERFACE; EMOTION RECOGNITION; NEURAL-NETWORK; EEG; SYSTEM; CLASSIFICATION; SLEEP; FEATURES; FRAMEWORK; ALGORITHM;
D O I
10.1109/TNNLS.2022.3190448
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decades of research have shown machine learning superiority in discovering highly nonlinear patterns embedded in electroencephalography (EEG) records compared with conventional statistical techniques. However, even the most advanced machine learning techniques require relatively large, labeled EEG repositories. EEG data collection and labeling are costly. Moreover, combining available datasets to achieve a large data volume is usually infeasible due to inconsistent experimental paradigms across trials. Self-supervised learning (SSL) solves these challenges because it enables learning from EEG records across trials with variable experimental paradigms, even when the trials explore different phenomena. It aggregates multiple EEG repositories to increase accuracy, reduce bias, and mitigate overfitting in machine learning training. In addition, SSL could be employed in situations where there is limited labeled training data, and manual labeling is costly. This article: 1) provides a brief introduction to SSL; 2) describes some SSL techniques employed in recent studies, including EEG; 3) proposes current and potential SSL techniques for future investigations in EEG studies; 4) discusses the cons and pros of different SSL techniques; and 5) proposes holistic implementation tips and potential future directions for EEG SSL practices.
引用
收藏
页码:1457 / 1471
页数:15
相关论文
共 50 条
  • [1] Anomaly Detection on Electroencephalography with Self-supervised Learning
    Xu, Junjie
    Zheng, Yaojia
    Mao, Yifan
    Wang, Ruixuan
    Zheng, Wei-Shi
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 363 - 368
  • [2] SELF-SUPERVISED REPRESENTATION LEARNING FROM ELECTROENCEPHALOGRAPHY SIGNALS
    Banville, Hubert
    Albuquerque, Isabela
    Hyvarinen, Aapo
    Moffat, Graeme
    Engemann, Denis-Alexander
    Gramfort, Alexandre
    2019 IEEE 29TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2019,
  • [3] Task-Oriented Self-supervised Learning for Anomaly Detection in Electroencephalography
    Zheng, Yaojia
    Liu, Zhouwu
    Mo, Rong
    Chen, Ziyi
    Zheng, Wei-Shi
    Wang, Ruixuan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 193 - 203
  • [4] Modeling Cognitive Load as a Self-Supervised Brain Rate with Electroencephalography and Deep Learning
    Longo, Luca
    BRAIN SCIENCES, 2022, 12 (10)
  • [5] Gated Self-supervised Learning for Improving Supervised Learning
    Fuadi, Erland Hillman
    Ruslim, Aristo Renaldo
    Wardhana, Putu Wahyu Kusuma
    Yudistira, Novanto
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 611 - 615
  • [6] Self-Supervised Dialogue Learning
    Wu, Jiawei
    Wang, Xin
    Wang, William Yang
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 3857 - 3867
  • [7] Self-supervised learning model
    Saga, Kazushie
    Sugasaka, Tamami
    Sekiguchi, Minoru
    Fujitsu Scientific and Technical Journal, 1993, 29 (03): : 209 - 216
  • [8] Longitudinal self-supervised learning
    Zhao, Qingyu
    Liu, Zixuan
    Adeli, Ehsan
    Pohl, Kilian M.
    MEDICAL IMAGE ANALYSIS, 2021, 71
  • [9] Credal Self-Supervised Learning
    Lienen, Julian
    Huellermeier, Eyke
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [10] Self-Supervised Learning for Recommendation
    Huang, Chao
    Xia, Lianghao
    Wang, Xiang
    He, Xiangnan
    Yin, Dawei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 5136 - 5139