Self-Supervised Learning for Near-Wild Cognitive Workload Estimation

被引:16
|
作者
Rafiei, Mohammad H. [1 ]
Gauthier, Lynne V. [2 ]
Adeli, Hojjat [3 ]
Takabi, Daniel [4 ]
机构
[1] Johns Hopkins Univ, Whiting Sch Engn, Baltimore, MD 21218 USA
[2] Univ Massachusetts Lowell, Dept Phys Therapy & Kinesiol, Lowell, MA 01854 USA
[3] Ohio State Univ, Dept Biomed Informat & Neurosci, Columbus, OH 43210 USA
[4] Old Dominion Univ, Sch Cybersecur, Norfolk, VA 23529 USA
关键词
Self-supervised learning; SimCLR; Cognitive workload; Machine learning; ALGORITHM;
D O I
10.1007/s10916-024-02122-7
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Feedback on cognitive workload may reduce decision-making mistakes. Machine learning-based models can produce feedback from physiological data such as electroencephalography (EEG) and electrocardiography (ECG). Supervised machine learning requires large training data sets that are (1) relevant and decontaminated and (2) carefully labeled for accurate approximation, a costly and tedious procedure. Commercial over-the-counter devices are low-cost resolutions for the real-time collection of physiological modalities. However, they produce significant artifacts when employed outside of laboratory settings, compromising machine learning accuracies. Additionally, the physiological modalities that most successfully machine-approximate cognitive workload in everyday settings are unknown. To address these challenges, a first-ever hybrid implementation of feature selection and self-supervised machine learning techniques is introduced. This model is employed on data collected outside controlled laboratory settings to (1) identify relevant physiological modalities to machine approximate six levels of cognitive-physical workloads from a seven-modality repository and (2) postulate limited labeling experiments and machine approximate mental-physical workloads using self-supervised learning techniques.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Spatiotemporal Self-supervised Learning for Point Clouds in the Wild
    Wu, Yanhao
    Zhang, Tong
    Ke, Wei
    Susstrunk, Sabine
    Salzmann, Mathieu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5251 - 5260
  • [2] SELF-SUPERVISED LEARNING FOR INSAR PHASE AND COHERENCE ESTIMATION
    Sica, Francescopaolo
    Sanjeevamurthy, Pavan Muguda
    Schmitt, Michael
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 722 - 725
  • [3] SELF-SUPERVISED LEARNING FOR HUMAN POSE ESTIMATION IN SPORTS
    Ludwig, Katja
    Scherer, Sebastian
    Einfalt, Moritz
    Lienhart, Rainer
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [4] Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
    Amrani, Elad
    Ben-Ari, Rami
    Rotman, Daniel
    Bronstein, Alex
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 6644 - 6652
  • [5] Learning by Distillation: A Self-Supervised Learning Framework for Optical Flow Estimation
    Liu, Pengpeng
    Lyu, Michael R.
    King, Irwin
    Xu, Jia
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5026 - 5041
  • [6] Structural Equivariance Self-Supervised Learning for Facial Pose Estimation
    Wang, Yaoxing
    Zhou, Heng
    Li, Zhendong
    Mo, Xian
    Liu, Hao
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2651 - 2656
  • [7] Exploring self-supervised learning techniques for hand pose estimation
    Dahiya, Aneesh
    Spurr, Adrian
    Hilliges, Otmar
    NEURIPS 2020 WORKSHOP ON PRE-REGISTRATION IN MACHINE LEARNING, VOL 148, 2020, 148 : 255 - 271
  • [8] Self-Supervised Learning of Point Clouds via Orientation Estimation
    Poursaeed, Omid
    Jiang, Tianxing
    Qiao, Han
    Xu, Nayun
    Kim, Vladimir G.
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 1018 - 1028
  • [9] Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning
    Denize, Julien
    Rabarisoa, Jaonary
    Orcesi, Astrid
    Herault, Romain
    Canu, Stephane
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2705 - 2715
  • [10] Self-supervised monocular image depth learning and confidence estimation
    Chen, Long
    Tang, Wen
    Wan, Tao Ruan
    John, Nigel W.
    NEUROCOMPUTING, 2020, 381 : 272 - 281