Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

被引:0
|
作者
Tang Z.-C. [1 ]
Zhang K.-J. [1 ]
Li C. [1 ]
Sun S.-Q. [1 ]
Huang Q. [1 ]
Zhang S.-Y. [1 ]
机构
[1] College of Computer Science and Technology, Zhejiang University, Hangzhou
来源
Zhang, Ke-Jun (zhangkejun@zju.edu.cn) | 2017年 / Science Press卷 / 40期
关键词
Artificial intelligence; BCI; CNN; Deep learning; Motor imagery; Rehabilitation exoskeleton;
D O I
10.11897/SP.J.1016.2017.01367
中图分类号
学科分类号
摘要
Brain-Computer Interface (BCI) based on motor imagery (MI) has been applied in the rehabilitation exoskeleton widely. In the practical use, the low signal-noise ratio of electroencephalogram (EEG) signal results in the low classification accuracy in BCI. Therefore, many studies have focused on the improvement of feature extraction and classification algorithms. In this paper, we proposed an original method based on the deep convolutional neural network (CNN) to perform feature extraction and classification for single-trial MI EEG signal. Firstly, according to the EEG signal's characteristic that combining time and space information, we constructed a 5-layer CNN model to classify the MI; secondly, MI experimental paradigm was designed based on imagining left hand movement and foot movement, and the experimental data of MI were collected; thirdly, the proposed method was used in the public data set and experimental data set to build classification model, compared with the other three methods (power+SVM, CSP+SVM and MRA+LDA); finally, the classification model which achieved the best classification performance was applied in real-time control of upper-limb exoskeleton to verify the effectiveness of our proposed method. The results demonstrate that CNN can further improve classification performance: the average accuracies of public data set (90.75%±2.47%) and experimental data set (89.51%±2.95%) using CNN are both higher than that using the other three methods. Furthermore, in real-time control of upper-limb exoskeleton, the average accuracy of all subjects reaches to 88.75%±3.42%, which verifies the effectiveness of the CNN method. The proposed method can recognize MI, and provides theoretical basis and technical support for BCI applications in the field of rehabilitation exoskeleton. © 2017, Science Press. All right reserved.
引用
收藏
页码:1367 / 1378
页数:11
相关论文
共 44 条
  • [1] Lo H.S., Xie S.Q., Exoskeleton robots for upper-limb rehabilitation: State of the art and future prospects, Medical Engineering & Physics, 34, 3, pp. 261-268, (2012)
  • [2] Kiguchi K., Hayashi Y., An EMG-based control for an upper-limb power-assist exoskeleton robot, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 42, 4, pp. 1064-1071, (2012)
  • [3] Wang D.-Y., Li Q.-L., Du Z.-J., Et al., Study on exoskeletal rehabilitation robot for upper limb and its control method, Journal of Harbin Engineering University, 28, 9, pp. 1008-1013, (2007)
  • [4] Rahman M.H., Rahman M.J., Cristobal O.L., Et al., Development of a whole arm wearable robotic exoskeleton for rehabilitation and to assist upper limb movements, Robotica, 33, 1, pp. 19-39, (2015)
  • [5] Tang J.-Y., Multi-Degree-of-Freedom Artificial Hand Based on sEMG and EEG, (2009)
  • [6] Noda T., Sugimoto N., Furukawa J., Et al., Brain-controlled exoskeleton robot for BMI rehabilitation, Proceedings of the 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012), pp. 21-27, (2012)
  • [7] Contreras-Vidal J.L., Grossman R.G., NeuroRex: A clinical neural interface roadmap for EEG-based brain machine interfaces to a lower body robotic exoskeleton, Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'13), pp. 1579-1582, (2013)
  • [8] Dobkin B.H., Brain-Computer interface technology as a tool to augment plasticity and outcomes for neurological rehabilitation, The Journal of Physiology, 579, 3, pp. 637-642, (2007)
  • [9] Rosen J., Brand M., Fuchs M.B., Et al., A myosignal-based powered exoskeleton system, IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 31, 3, pp. 210-222, (2001)
  • [10] Mulas M., Folgheraiter M., Gini G., An EMG-controlled exoskeleton for hand rehabilitation, Proceedings of the 2005 IEEE 9th International Conference on Rehabilitation Robotics (ICORR), pp. 371-374, (2005)