Brain-machine interface based on deep learning to control asynchronously a lower-limb robotic exoskeleton: a case-of-study

被引:5
|
作者
Ferrero, Laura [1 ,2 ,3 ,4 ,6 ]
Soriano-Segura, Paula [1 ,2 ,3 ]
Navarro, Jacobo [4 ,5 ,6 ]
Jones, Oscar [4 ,6 ]
Ortiz, Mario [1 ,2 ,3 ]
Ianez, Eduardo [1 ,2 ,3 ]
Azorin, Jose M. [1 ,2 ,3 ,7 ,8 ]
Contreras-Vidal, Jose L. [4 ,6 ]
机构
[1] Miguel Hernandez Univ Elche, Brain Machine Interface Syst Lab, Elche, Spain
[2] Miguel Hernandez Univ Elche, Inst Invest Ingn Elche I3E, Elche, Spain
[3] Miguel Hernandez Univ Elche, Int Affiliate NSF IUCRC BRAIN Site, Elche, Spain
[4] Univ Houston, NSF IUCRC BRAIN, Houston, TX 77204 USA
[5] Tecnol Monterrey, Int Affiliate NSF IUCRC BRAIN Site, Monterrey, Mexico
[6] Univ Houston, Noninvas Brain Machine Interface Syst, Houston, TX 77204 USA
[7] Valencian Grad Sch, Valencia, Spain
[8] Res Network Artificial Intelligence ValgrAI, Valencia, Spain
关键词
Brain-machine interface; EEG; Exoskeleton; Deep learning; Transfer learning; IMAGERY; BCI;
D O I
10.1186/s12984-024-01342-9
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background This research focused on the development of a motor imagery (MI) based brain-machine interface (BMI) using deep learning algorithms to control a lower-limb robotic exoskeleton. The study aimed to overcome the limitations of traditional BMI approaches by leveraging the advantages of deep learning, such as automated feature extraction and transfer learning. The experimental protocol to evaluate the BMI was designed as asynchronous, allowing subjects to perform mental tasks at their own will.Methods A total of five healthy able-bodied subjects were enrolled in this study to participate in a series of experimental sessions. The brain signals from two of these sessions were used to develop a generic deep learning model through transfer learning. Subsequently, this model was fine-tuned during the remaining sessions and subjected to evaluation. Three distinct deep learning approaches were compared: one that did not undergo fine-tuning, another that fine-tuned all layers of the model, and a third one that fine-tuned only the last three layers. The evaluation phase involved the exclusive closed-loop control of the exoskeleton device by the participants' neural activity using the second deep learning approach for the decoding.Results The three deep learning approaches were assessed in comparison to an approach based on spatial features that was trained for each subject and experimental session, demonstrating their superior performance. Interestingly, the deep learning approach without fine-tuning achieved comparable performance to the features-based approach, indicating that a generic model trained on data from different individuals and previous sessions can yield similar efficacy. Among the three deep learning approaches compared, fine-tuning all layer weights demonstrated the highest performance.Conclusion This research represents an initial stride toward future calibration-free methods. Despite the efforts to diminish calibration time by leveraging data from other subjects, complete elimination proved unattainable. The study's discoveries hold notable significance for advancing calibration-free approaches, offering the promise of minimizing the need for training trials. Furthermore, the experimental evaluation protocol employed in this study aimed to replicate real-life scenarios, granting participants a higher degree of autonomy in decision-making regarding actions such as walking or stopping gait.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Optimal phase-based gait guidance control on a lower-limb exoskeleton
    Laubscher, Curt A.
    Goo, Anthony C.
    Sawicki, Jerzy T.
    CONTROL ENGINEERING PRACTICE, 2023, 139
  • [42] Neural Network-Based Optimal Control of a Lower-limb Exoskeleton Robot
    Huang, Pengbo
    Yuan, Wang
    Li, Qinjian
    Feng, Ying
    2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 154 - 159
  • [43] Reinforcement Learning-based Kalman Filter for Adaptive Brain Control in Brain-Machine Interface
    Zhang, Xiang
    Song, Zhiwei
    Wang, Yiwen
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 6619 - 6622
  • [44] Deep Learning Approach for EEG Classification in Lower-Limb Movement Phases: Towards Enhanced Brain-Computer Interface Control
    Blanco-Diaz, Cristian Felipe
    Guerrero-Mendez, Cristian David
    Furtado, Guilherme Rangel
    Bastos-Filho, Teodiano
    de Andrade, Rafhael Milanezi
    2024 20TH IEEE/ASME INTERNATIONAL CONFERENCE ON MECHATRONIC AND EMBEDDED SYSTEMS AND APPLICATIONS, MESA 2024, 2024,
  • [45] Momentum-Based Balance Control of a Lower-Limb Exoskeleton During Stance
    Vallinas, Ander
    Keemink, Arvid
    Bayon, Cristina
    van Asseldonk, Edwin
    van der Kooij, Herman
    2023 INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS, ICORR, 2023,
  • [46] End-to-End High-Level Control of Lower-Limb Exoskeleton for Human Performance Augmentation Based on Deep Reinforcement Learning
    Zheng, Ranran
    Yu, Zhiyuan
    Liu, Hongwei
    Chen, Jing
    Zhao, Zhe
    Jia, Longfei
    IEEE ACCESS, 2023, 11 : 102340 - 102351
  • [47] Continuous Teleoperation of a Robotic Manipulator via Brain-Machine Interface with Shared Control
    Tortora, Stefano
    Gottardi, Alberto
    Menegatti, Emanuele
    Tonin, Luca
    2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [48] A Low-Cost Lower-Limb Brain-Machine Interface Triggered by Pedaling Motor Imagery for Post-Stroke Patients Rehabilitation
    Romero-Laiseca, Maria Alejandra
    Delisle-Rodriguez, Denis
    Cardoso, Vivianne
    Gurve, Dharmendra
    Loterio, Flavia
    Nascimento, Jorge Henrique Posses
    Krishnan, Sridhar
    Frizera-Neto, Anselmo
    Bastos-Filho, Teodiano
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (04) : 988 - 996
  • [49] Machine-learned Adaptive Switching in Voluntary Lower-limb Exoskeleton Control: Preliminary Results
    Faridi, Pouria
    Mehr, Javad K.
    Wilson, Don
    Sharifi, Mojtaba
    Tavakoli, Mahdi
    Pilarski, Patrick M.
    Mushahwar, Vivian K.
    2022 INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS (ICORR), 2022,
  • [50] An EEG-Based Brain-Machine Interface to Control a 7-Degrees of Freedom Exoskeleton for Stroke Rehabilitation
    Sarasola-Sanz, A.
    Lopez-Larraz, E.
    Irastorza-Landa, N.
    Klein, J.
    Valencia, D.
    Belloso, A.
    Morin, F. O.
    Spuler, M.
    Birbaumer, N.
    Ramos-Murguialday, A.
    CONVERGING CLINICAL AND ENGINEERING RESEARCH ON NEUROREHABILITATION II, VOLS 1 AND 2, 2017, 15 : 1127 - 1131