Biosignals Monitoring for Driver Drowsiness Detection Using Deep Neural Networks

被引:3
|
作者
Alguindigue, Jose [1 ]
Singh, Amandeep [1 ]
Narayan, Apurva [2 ]
Samuel, Siby [1 ]
机构
[1] Univ Waterloo, Dept Syst Design Engn, Waterloo, ON N2L 3G1, Canada
[2] Western Univ, Dept Comp Sci, London, ON N6A 3K7, Canada
来源
IEEE ACCESS | 2024年 / 12卷
基金
加拿大自然科学与工程研究理事会;
关键词
Fatigue; Heart rate variability; Sleep; Accuracy; Measurement; Feature extraction; Road safety; Simulation; Gaze tracking; Deep learning; Vehicle driving; Vehicle safety; drowsiness; simulated driving; heart rate variability; electrodermal activity; eye tracking; deep learning algorithms; SLEEPINESS;
D O I
10.1109/ACCESS.2024.3423723
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Drowsy driving poses a significant risk to road safety, necessitating the development of reliable drowsiness detection systems. In particular, the advancement of Artificial Intelligence based neuroadaptive systems is imperative to effectively mitigate this risk. Towards reaching this goal, the present research focuses on investigating the efficacy of physiological indicators, including heart rate variability (HRV), percentage of eyelid closure over the pupil over time (PERCLOS), blink rate, blink percentage, and electrodermal activity (EDA) signals, in predicting driver drowsiness. The study was conducted with a cohort of 30 participants in controlled simulated driving scenarios, with half driving in a non-monotonous environment and the other half in a monotonous environment. Three deep learning algorithms were employed: sequential neural network (SNN) for HRV, 1D-convolutional neural network (1D-CNN) for EDA, and convolutional recurrent neural network (CRNN) for eye tracking. The HRV-Based Model and EDA-Based Model exhibited strong performance in drowsiness classification, with the HRV model achieving precision, recall, and F1-score of 98.28%, 98%, and 98%, respectively, and the EDA model achieving 96.32%, 96%, and 96% for the same metrics. The confusion matrix further illustrates the model's performance and highlights high accuracy in both HRV and EDA models, affirming their efficiency in detecting driver drowsiness. However, the Eye-Based Model faced difficulties in identifying drowsiness instances, potentially attributable to dataset imbalances and underrepresentation of specific fatigue states. Despite the challenges, this work significantly contributes to ongoing efforts to improve road safety by laying the foundation for effective real-time neuro-adaptive systems for drowsiness detection and mitigation.
引用
收藏
页码:93075 / 93086
页数:12
相关论文
共 50 条
  • [1] Driver Drowsiness Monitoring using Convolutional Neural Networks
    Victoria, D. Rosy Salomi
    Mary, D. Glory Ratna
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, AND INTELLIGENT SYSTEMS (ICCCIS), 2021, : 1055 - 1059
  • [2] Driver Drowsiness Detection Using Convolutional Neural Networks
    Kepesiova, Zuzana
    Ciganek, Jan
    Kozak, Stefan
    PROCEEDINGS OF THE 2020 30TH INTERNATIONAL CONFERENCE CYBERNETICS & INFORMATICS (K&I '20), 2020,
  • [3] Hierarchical deep neural networks to detect driver drowsiness
    Samaneh Jamshidi
    Reza Azmi
    Mehran Sharghi
    Mohsen Soryani
    Multimedia Tools and Applications, 2021, 80 : 16045 - 16058
  • [4] Hierarchical deep neural networks to detect driver drowsiness
    Jamshidi, Samaneh
    Azmi, Reza
    Sharghi, Mehran
    Soryani, Mohsen
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (10) : 16045 - 16058
  • [5] Driver Drowsiness Detection via PPG Biosignals by Using Multimodal Head Support
    Koh, Sukgyu
    Cho, Bo Ram
    Lee, Jong-il
    Kwon, Soon-O
    Lee, Suwoong
    Lim, Joon Beom
    Lee, Soo Beom
    Kweon, Hyeok-Dong
    2017 4TH INTERNATIONAL CONFERENCE ON CONTROL, DECISION AND INFORMATION TECHNOLOGIES (CODIT), 2017, : 383 - 388
  • [6] Real-time Driver Drowsiness Detection for Android Application Using Deep Neural Networks Techniques
    Jabbar, Rateb
    Al-Khalifa, Khalifa
    Kharbeche, Mohamed
    Alhajyaseen, Wael
    Jafari, Mohsen
    Jiang, Shan
    9TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT 2018) / THE 8TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY (SEIT-2018) / AFFILIATED WORKSHOPS, 2018, 130 : 400 - 407
  • [7] Real time detection system of driver drowsiness based on representation learning using deep neural networks
    Vijayan, Vineetha
    Sherly, Elizabeth
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (03) : 1977 - 1985
  • [8] The detection of drowsiness using a driver monitoring system
    Schwarz, Chris
    Gaspar, John
    Miller, Thomas
    Yousefian, Reza
    TRAFFIC INJURY PREVENTION, 2019, 20 : S157 - S161
  • [9] Robust Drowsiness Detection for Vehicle Driver using Deep Convolutional Neural Network
    Saif, A. F. M. Saifuddin
    Mahayuddin, Zainal Rasyid
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (10) : 343 - 350
  • [10] A smart analysis of driver fatigue and drowsiness detection using convolutional neural networks
    Abid Ali Minhas
    Sohail Jabbar
    Muhammad Farhan
    Muhammad Najam ul Islam
    Multimedia Tools and Applications, 2022, 81 : 26969 - 26986