Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

被引:0
|
作者
Tang Z.-C. [1 ]
Zhang K.-J. [1 ]
Li C. [1 ]
Sun S.-Q. [1 ]
Huang Q. [1 ]
Zhang S.-Y. [1 ]
机构
[1] College of Computer Science and Technology, Zhejiang University, Hangzhou
来源
Zhang, Ke-Jun (zhangkejun@zju.edu.cn) | 2017年 / Science Press卷 / 40期
关键词
Artificial intelligence; BCI; CNN; Deep learning; Motor imagery; Rehabilitation exoskeleton;
D O I
10.11897/SP.J.1016.2017.01367
中图分类号
学科分类号
摘要
Brain-Computer Interface (BCI) based on motor imagery (MI) has been applied in the rehabilitation exoskeleton widely. In the practical use, the low signal-noise ratio of electroencephalogram (EEG) signal results in the low classification accuracy in BCI. Therefore, many studies have focused on the improvement of feature extraction and classification algorithms. In this paper, we proposed an original method based on the deep convolutional neural network (CNN) to perform feature extraction and classification for single-trial MI EEG signal. Firstly, according to the EEG signal's characteristic that combining time and space information, we constructed a 5-layer CNN model to classify the MI; secondly, MI experimental paradigm was designed based on imagining left hand movement and foot movement, and the experimental data of MI were collected; thirdly, the proposed method was used in the public data set and experimental data set to build classification model, compared with the other three methods (power+SVM, CSP+SVM and MRA+LDA); finally, the classification model which achieved the best classification performance was applied in real-time control of upper-limb exoskeleton to verify the effectiveness of our proposed method. The results demonstrate that CNN can further improve classification performance: the average accuracies of public data set (90.75%±2.47%) and experimental data set (89.51%±2.95%) using CNN are both higher than that using the other three methods. Furthermore, in real-time control of upper-limb exoskeleton, the average accuracy of all subjects reaches to 88.75%±3.42%, which verifies the effectiveness of the CNN method. The proposed method can recognize MI, and provides theoretical basis and technical support for BCI applications in the field of rehabilitation exoskeleton. © 2017, Science Press. All right reserved.
引用
收藏
页码:1367 / 1378
页数:11
相关论文
共 44 条
  • [21] Zhao Z.-H., Yang S.-P., Ma Z.-Q., Research on vehicle license plate character recognition based on CNN LeNet-5, Journal of System Simulation, 22, 3, pp. 638-641, (2010)
  • [22] Lotte F., Congedo M., Lecuyer A., Et al., A review of classification algorithms for EEG-based brain-computer interfaces, Journal of Neural Engineering, 4, 2, pp. 1-24, (2007)
  • [23] Huang D., Lin P., Fei D.Y., Et al., Decoding human motor activity from EEG single trials for a discrete two-dimensional cursor control, Journal of Neural Engineering, 6, 4, pp. 1-12, (2009)
  • [24] Lemm S., Blankertz B., Curio G., Et al., Spatio-spectral filters for improving the classification of single trial EEG, IEEE Transactions on Biomedical Engineering, 52, 9, pp. 1541-1548, (2005)
  • [25] Bai O., Lin P., Vorbach S., Et al., A high performance sensorimotor beta rhythm-based brain-computer interface associated with human natural motor behavior, Journal of Neural Engineering, 5, 1, (2007)
  • [26] Pfurtscheller G., Neuper C., Flotzinger D., Et al., EEG-based discrimination between imagination of right and left hand movement, Electroencephalography and Clinical Neurophy-siology, 103, 6, pp. 642-651, (1997)
  • [27] LeCun Y., Bottou L., Bengio Y., Et al., Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86, 11, pp. 2278-2324, (1998)
  • [28] Tivive F.H.C., Bouzerdoum A., A new class of convolutional neural networks (SICoNNets) and their application of face detection, Proceedings of the 2003 IEEE International Joint Conference on Neural Networks, 3, pp. 2157-2162, (2003)
  • [29] Ciresan D., Meier U., Masci J., Et al., Multi-column deep neural network for traffic sign classification, Neural Networks, 32, pp. 333-338, (2012)
  • [30] Swietojanski P., Ghoshal A., Renals S., Convolutional neural networks for distant speech recognition, IEEE Signal Processing Letters, 21, 9, pp. 1120-1124, (2014)