TransSleep: Transitioning-Aware Attention-Based Deep Neural Network for Sleep Staging

被引:24
|
作者
Phyo, Jaeun [1 ]
Ko, Wonjun [1 ]
Jeon, Eunjin [1 ]
Suk, Heung-Il [1 ,2 ]
机构
[1] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
[2] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
关键词
Sleep; Feature extraction; Electroencephalography; Task analysis; Deep learning; Hidden Markov models; Brain modeling; Attention mechanism; auxiliary task; deep learning; electroencephalography (EEG); sleep staging; REM-SLEEP; POWER; TIME; FORM;
D O I
10.1109/TCYB.2022.3198997
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine/deep learning methods for sleep staging. However, two key challenges hinder the practical use of those methods: 1) effectively capturing salient waveforms in sleep signals and 2) correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural-network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks. In particular, TransSleep captures salient waveforms in sleep signals by an attention-based multiscale feature extractor and correctly classifies confusing stages in transitioning epochs, while modeling contextual relationships with two auxiliary tasks. Results show that TransSleep achieves promising performance in automatic sleep staging. The validity of TransSleep is demonstrated by its state-of-the-art performance on two publicly available datasets: 1) Sleep-EDF and 2) MASS. Furthermore, we performed ablations to analyze our results from different perspectives. Based on our overall results, we believe that TransSleep has immense potential to provide new insights into deep-learning-based sleep staging.
引用
收藏
页码:4500 / 4510
页数:11
相关论文
共 50 条
  • [1] MCASleepNet: Multimodal Channel Attention-Based Deep Neural Network for Automatic Sleep Staging
    Yu, Yangzuyi
    Chen, Shuyu
    Pan, Jiahui
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 308 - 319
  • [2] MFASleepNet: Multi-view fusion attention-based deep neural network for automatic sleep staging
    Hou, Zhoujie
    Pan, Jiahui
    Li, Yuanqing
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [3] Retweet Prediction with Attention-based Deep Neural Network
    Zhang, Qi
    Gong, Yeyun
    Wu, Jindou
    Huang, Haoran
    Huang, Xuanjing
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 75 - 84
  • [4] Attention-based deep neural network for driver behavior recognition
    Xiao, Weichu
    Liu, Hongli
    Ma, Ziji
    Chen, Weihong
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 132 : 152 - 161
  • [5] Attention-based convolutional neural network for deep face recognition
    Hefei Ling
    Jiyang Wu
    Junrui Huang
    Jiazhong Chen
    Ping Li
    Multimedia Tools and Applications, 2020, 79 : 5595 - 5616
  • [6] Deep Attention-based Neural Network for Electricity Theft Detection
    Zhang, Yufan
    Ji, Yugang
    Xiao, Ding
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 154 - 157
  • [7] ASTGSleep: Attention-Based Spatial-Temporal Graph Network for Sleep Staging
    Chen, Xiaoyu
    Zhang, Yiyuan
    Chen, Qiangqiang
    Zhou, Ligang
    Chen, Hongyu
    Wu, Huijuan
    Xu, Yunxia
    Chen, Kun
    Yin, Bin
    Chen, Wei
    Chen, Chen
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [8] Attention-based convolutional neural network for deep face recognition
    Ling, Hefei
    Wu, Jiyang
    Huang, Junrui
    Chen, Jiazhong
    Li, Ping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (9-10) : 5595 - 5616
  • [9] A novel syntax-aware automatic graphics code generation with attention-based deep neural network
    Pang, Xiongwen
    Zhou, Yanqiang
    Li, Pengcheng
    Lin, Weiwei
    Wu, Wentai
    Wang, James Z.
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2020, 161
  • [10] LWSleepNet: A lightweight attention-based deep learning model for sleep staging with singlechannel EEG
    Yang, Chenguang
    Li, Baozhu
    Li, Yamei
    He, Yixuan
    Zhang, Yuan
    DIGITAL HEALTH, 2023, 9