Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network

被引:15
|
作者
Chattopadhyay, Soham [1 ]
Zary, Laila [2 ]
Quek, Chai [2 ]
Prasad, Dilip K. [3 ]
机构
[1] Jadavpur Univ, Dept Elect Engn, 12 CIT Rd, Kolkata 700054, India
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, 50 Nanyang Ave, Singapore 639798, Singapore
[3] UiT Arctic Univ Norway, Dept Comp Sci, Hansine Hansens Veg 18, N-9019 Tromso, Norway
关键词
EEG; Motivation; Deep learning; ASYMMETRY; EMOTION; SYSTEM;
D O I
10.1016/j.eswa.2021.115548
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While we know that motivated students learn better than non-motivated students but detecting motivation is challenging. Here we present a game-based motivation detection approach from the EEG signals. We take an original approach of using EEG-based brain computer interface to assess if motivation state is manifest in physiological EEG signals as well, and what are suitable conditions in order to achieve the goal? To the best of our knowledge, detection of motivation level from brain signals is proposed for the first time in this paper. In order to resolve the central obstacle of small EEG datasets containing deep features, we propose a novel and unique 'residual-in-residual architecture of convolutional neural network (RRCNN)' that is capable of reducing the problem of over-fitting on small datasets and vanishing gradient. Having accomplished this, several aspects of using EEG signals for motivation detection are considered, including channel selection and accuracy obtained using alpha or beta waves of EEG signals. We also include a detailed validation of the different aspects of our methodology, including detailed comparison with other works as relevant. Our approach achieves 89% accuracy in using EEG signals to detect motivation state while learning, where alpha wave signals of frontal asymmetry channels are employed. A more robust (less sensitive to learning conditions) 88% accuracy is achieved using beta waves signals of frontal asymmetry channels. The results clearly indicate the potential of detecting motivation states using EEG signals, provided suitable methodologies such as proposed in this paper, are employed.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Single channel eeg signal for automatic detection of absence seizure using convolutional neural network
    Basha N.K.
    Wahab A.B.
    Recent Advances in Computer Science and Communications, 2021, 14 (06) : 1781 - 1787
  • [22] Convolutional Neural Network for Target Face Detection using Single-trial EEG Signal
    Wang, Haofei
    Shi, Bertram E.
    Wang, Yiwen
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 2008 - 2011
  • [23] Antipodal Robotic Grasping using Generative Residual Convolutional Neural Network
    Kumra, Sulabh
    Joshi, Shirin
    Sahin, Ferat
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 9626 - 9633
  • [24] Scene text recognition using residual convolutional recurrent neural network
    Lei, Zhengchao
    Zhao, Sanyuan
    Song, Hongmei
    Shen, Jianbing
    MACHINE VISION AND APPLICATIONS, 2018, 29 (05) : 861 - 871
  • [25] Scene text recognition using residual convolutional recurrent neural network
    Zhengchao Lei
    Sanyuan Zhao
    Hongmei Song
    Jianbing Shen
    Machine Vision and Applications, 2018, 29 : 861 - 871
  • [26] Video Segmentation Learning Using Cascade Residual Convolutional Neural Network
    Santos, Daniel F. S.
    Pires, Rafael G.
    Colombo, Danilo
    Papa, Joao P.
    2019 32ND SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2019, : 1 - 7
  • [27] Image Super-Resolution Using Residual Convolutional Neural Network
    Lee, Pei-Ying
    Tseng, Chien-Cheng
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [28] Atrial fibrillation detection with signal decomposition and dilated residual neural network
    Li, Yicheng
    Xia, Yong
    PHYSIOLOGICAL MEASUREMENT, 2023, 44 (10)
  • [29] Categorizing License Plates Using Convolutional Neural Network with Residual Learning
    Jose, John Anthony C.
    Maningo, Jose Martin Z.
    Rogelio, Jayson P.
    Bandala, Argel A.
    Rhay Vicerra, Ryan
    Sybingco, Edwin
    Ching, Phoebe Mae L.
    Dadios, Elmer P.
    2019 4TH ASIA-PACIFIC CONFERENCE ON INTELLIGENT ROBOT SYSTEMS (ACIRS 2019), 2019, : 231 - 234
  • [30] Convolutional Neural Network for Drowsiness Detection Using EEG Signals
    Chaabene, Siwar
    Bouaziz, Bassem
    Boudaya, Amal
    Hoekelmann, Anita
    Ammar, Achraf
    Chaari, Lotfi
    SENSORS, 2021, 21 (05) : 1 - 19