Self-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection

被引:0
|
作者
Song, Yingjian [1 ]
Pitafi, Zaid Farooq [1 ]
Dou, Fei [1 ]
Sun, Jin [1 ]
Zhang, Xiang [2 ]
Phillips, Bradley G. [1 ]
Song, Wenzhan [1 ]
机构
[1] Univ Georgia, Athens, GA 30602 USA
[2] Univ North Carolina, Athens, GA USA
关键词
Bed Occupancy; Self-Supervised Learning; Spectrum-temporal feature fusion;
D O I
10.1145/3678514
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] IPCL: ITERATIVE PSEUDO-SUPERVISED CONTRASTIVE LEARNING TO IMPROVE SELF-SUPERVISED FEATURE REPRESENTATION
    Kumar, Sonal
    Phukan, Anirudh
    Sur, Arijit
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6270 - 6274
  • [22] Joint data and feature augmentation for self-supervised representation learning on point clouds
    Lu, Zhuheng
    Dai, Yuewei
    Li, Weiqing
    Su, Zhiyong
    GRAPHICAL MODELS, 2023, 129
  • [23] Self-supervised dynamic and static feature representation learning method for flotation monitoring
    Ai, Mingxi
    Xie, Yongfang
    Tang, Zhaohui
    Wu, Jiande
    Li, Peng
    Zhang, Jin
    POWDER TECHNOLOGY, 2024, 442
  • [24] Semantics-Consistent Feature Search for Self-Supervised Visual Representation Learning
    Song, Kaiyou
    Zhang, Shan
    Luo, Zimeng
    Wang, Tong
    Xie, Jin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16053 - 16062
  • [25] Self-Supervised Graph Representation Learning Method Based on Data and Feature Augmentation
    Xu, Yunfeng
    Fan, Hexun
    Computer Engineering and Applications, 2024, 60 (17) : 148 - 157
  • [26] Feature selection and cascade dimensionality reduction for self-supervised visual representation learning
    Qu, Peixin
    Jin, Songlin
    Tian, Yongqin
    Zhou, Ling
    Zheng, Ying
    Zhang, Weidong
    Xu, Yibo
    Pan, Xipeng
    Zhao, Wenyi
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 106
  • [27] Deep learning on temporal-spectral data for anomaly detection
    Ma, King
    Leung, Henry
    Jalilian, Ehsan
    Huang, Daniel
    GROUND/AIR MULTISENSOR INTEROPERABILITY, INTEGRATION, AND NETWORKING FOR PERSISTENT ISR VIII, 2017, 10190
  • [28] Multiple representation contrastive self-supervised learning for pulmonary nodule detection
    Torki, Asghar
    Adibi, Peyman
    Kashani, Hamidreza Baradaran
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [29] Self-Supervised Video Representation Learning by Uncovering Spatio-Temporal Statistics
    Wang, Jiangliu
    Jiao, Jianbo
    Bao, Linchao
    He, Shengfeng
    Liu, Wei
    Liu, Yun-hui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3791 - 3806
  • [30] Self-Supervised Feature Learning Based on Spectral Masking for Hyperspectral Image Classification
    Liu, Weiwei
    Liu, Kai
    Sun, Weiwei
    Yang, Gang
    Ren, Kai
    Meng, Xiangchao
    Peng, Jiangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61