TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging

被引:24
|
作者
Phyo, Jaeun [1 ]
Ko, Wonjun [1 ]
Jeon, Eunjin [1 ]
Suk, Heung-Il [1 ,2 ]
机构
[1] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
[2] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
关键词
Sleep; Feature extraction; Electroencephalography; Task analysis; Deep learning; Hidden Markov models; Brain modeling; Attention mechanism; auxiliary task; deep learning; electroencephalography (EEG); sleep staging; REM-SLEEP; POWER; TIME; FORM;
D O I
10.1109/TCYB.2022.3198997
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine/deep learning methods for sleep staging. However, two key challenges hinder the practical use of those methods: 1) effectively capturing salient waveforms in sleep signals and 2) correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural-network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep captures salient waveforms in sleep signals by an attention-based multiscale feature extractor and correctly classifies confusing stages in transitioning epochs, while modeling contextual relationships with two auxiliary tasks. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets: 1) Sleep-EDF and 2) MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep-learning-based sleep staging.
引用
收藏
页码:4500 / 4510
页数:11
相关论文
共 50 条
  • [31] Spatiotemporal estimation of PM2.5 using attention-based deep neural network
    Chen, Binjie
    Ye, Yang
    Lin, Yi
    You, Shixue
    Deng, Jinsong
    Yang, Wu
    Wang, Ke
    National Remote Sensing Bulletin, 2022, 26 (05) : 1027 - 1038
  • [32] Attention-based deep convolutional neural network for spectral efficiency optimization in MIMO systems
    Sun, Danfeng
    Yaqot, Abdullah
    Qiu, Jiachen
    Rauchhaupt, Lutz
    Jumar, Ulrich
    Wu, Huifeng
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (18): : 12967 - 12978
  • [33] Attention-based deep convolutional neural network for spectral efficiency optimization in MIMO systems
    Danfeng Sun
    Abdullah Yaqot
    Jiachen Qiu
    Lutz Rauchhaupt
    Ulrich Jumar
    Huifeng Wu
    Neural Computing and Applications, 2023, 35 : 12967 - 12978
  • [34] An Attention-based Wide and Deep Neural Network for Reentrancy Vulnerability Detection in Smart Contracts
    Osei, Samuel Banning
    Huang, Rubing
    Ma, Zhongchen
    JOURNAL OF SYSTEMS AND SOFTWARE, 2025, 223
  • [35] A Deep Spatio-temporal Attention-based Neural Network for Passenger Flow Prediction
    Cui, Yanling
    Jin, Beihong
    Zhang, Fusang
    Sun, Xingwu
    PROCEEDINGS OF THE 16TH EAI INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES (MOBIQUITOUS'19), 2019, : 20 - 30
  • [36] A feature-level attention-based deep neural network model for sentence embedding
    Bouraoui A.
    Jamoussi S.
    Hamadou A.B.
    International Journal of Intelligent Systems Technologies and Applications, 2022, 20 (05) : 414 - 435
  • [37] Electrical Impedance Tomography Image Reconstruction With Attention-Based Deep Convolutional Neural Network
    Wang, Zichen
    Zhang, Xinyu
    Fu, Rong
    Wang, Di
    Chen, Xiaoyan
    Wang, Huaxiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [38] Attention-Based Deep Neural Network Behavioral Model for Wideband Wireless Power Amplifiers
    Liu, Zhijun
    Hu, Xin
    Liu, Ting
    Li, Xiuhua
    Wang, Weidong
    Ghannouchi, Fadhel M.
    IEEE MICROWAVE AND WIRELESS COMPONENTS LETTERS, 2020, 30 (01) : 82 - 85
  • [39] An attention-based deep convolutional neural network for classification and grading of interferents in serum specimens
    Wang, Hairui
    Huang, Helin
    Wu, Xiaomei
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2022, 231
  • [40] Multi-Scale Attention-Based Deep Neural Network for Brain Disease Diagnosis
    Liang, Yin
    Xu, Gaoxu
    ur Rehman, Sadaqat
    Computers, Materials and Continua, 2022, 72 (03): : 4545 - 4661