TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging

被引:24
|
作者
Phyo, Jaeun [1 ]
Ko, Wonjun [1 ]
Jeon, Eunjin [1 ]
Suk, Heung-Il [1 ,2 ]
机构
[1] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
[2] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
关键词
Sleep; Feature extraction; Electroencephalography; Task analysis; Deep learning; Hidden Markov models; Brain modeling; Attention mechanism; auxiliary task; deep learning; electroencephalography (EEG); sleep staging; REM-SLEEP; POWER; TIME; FORM;
D O I
10.1109/TCYB.2022.3198997
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine/deep learning methods for sleep staging. However, two key challenges hinder the practical use of those methods: 1) effectively capturing salient waveforms in sleep signals and 2) correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural-network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep captures salient waveforms in sleep signals by an attention-based multiscale feature extractor and correctly classifies confusing stages in transitioning epochs, while modeling contextual relationships with two auxiliary tasks. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets: 1) Sleep-EDF and 2) MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep-learning-based sleep staging.
引用
收藏
页码:4500 / 4510
页数:11
相关论文
共 50 条
  • [21] Computer generated hologram compression with attention-based deep convolutional neural network
    Shen, Zhelun
    Yang, Guanglin
    Xie, Haiyan
    HOLOGRAPHY, DIFFRACTIVE OPTICS, AND APPLICATIONS XI, 2021, 11898
  • [22] Underwater acoustic target recognition using attention-based deep neural network
    Xiao, Xu
    Wang, Wenbo
    Ren, Qunyan
    Gerstoft, Peter
    Ma, Li
    JASA EXPRESS LETTERS, 2021, 1 (10):
  • [23] An Attention-based Deep Network for CTR Prediction
    Zhang, Hailong
    Yan, Jinyao
    Zhang, Yuan
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 1 - 5
  • [24] CAttSleepNet: Automatic End-to-End Sleep Staging Using Attention-Based Deep Neural Networks on Single-Channel EEG
    Li, Tingting
    Zhang, Bofeng
    Lv, Hehe
    Hu, Shengxiang
    Xu, Zhikang
    Tuergong, Yierxiati
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (09)
  • [25] Analyzing sleep thermal comfort with an attention-based gated recurrent unit neural network
    Tang, Jishen
    Li, Jilei
    Wang, Jiang
    Li, Yunhao
    Yang, Yimin
    Song, Zuoting
    Ma, Meirong
    Deng, Bin
    BUILDING AND ENVIRONMENT, 2024, 262
  • [26] A Volume-Aware Positional Attention-Based Recurrent Neural Network for Stock Index Prediction
    Yu X.
    Li D.
    Shen Y.
    International Journal of Software Engineering and Knowledge Engineering, 2021, 31 (11-12) : 1783 - 1801
  • [27] Attention-based convolutional neural network deep learning approach for robust malware classification
    Ravi, Vinayakumar
    Alazab, Mamoun
    COMPUTATIONAL INTELLIGENCE, 2023, 39 (01) : 145 - 168
  • [28] Automatic Generation and Evaluation of Chinese Classical Poetry with Attention-Based Deep Neural Network
    Zhao, Jianli
    Lee, Hyo Jong
    APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [29] Attention-based deep convolutional neural network for classification of generalized and focal epileptic seizures
    Gill, Taimur Shahzad
    Zaidi, Syed Sajjad Haider
    Shirazi, Muhammad Ayaz
    EPILEPSY & BEHAVIOR, 2024, 155
  • [30] Multi-Scale Attention-Based Deep Neural Network for Brain Disease Diagnosis
    Liang, Yin
    Xu, Gaoxu
    Rehman, Sadaqat Ur
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 72 (03): : 4645 - 4661