Frontiers in Neuroscience (Apr 2023)

A sequential learning model with GNN for EEG-EMG-based stroke rehabilitation BCI

  • Haoyang Li,
  • Hongfei Ji,
  • Jian Yu,
  • Jie Li,
  • Lingjing Jin,
  • Lingjing Jin,
  • Lingyu Liu,
  • Zhongfei Bai,
  • Chen Ye

DOI
https://doi.org/10.3389/fnins.2023.1125230
Journal volume & issue
Vol. 17

Abstract

Read online

IntroductionBrain-computer interfaces (BCIs) have the potential in providing neurofeedback for stroke patients to improve motor rehabilitation. However, current BCIs often only detect general motor intentions and lack the precise information needed for complex movement execution, mainly due to insufficient movement execution features in EEG signals.MethodsThis paper presents a sequential learning model incorporating a Graph Isomorphic Network (GIN) that processes a sequence of graph-structured data derived from EEG and EMG signals. Movement data are divided into sub-actions and predicted separately by the model, generating a sequential motor encoding that reflects the sequential features of the movements. Through time-based ensemble learning, the proposed method achieves more accurate prediction results and execution quality scores for each movement.ResultsA classification accuracy of 88.89% is achieved on an EEG-EMG synchronized dataset for push and pull movements, significantly outperforming the benchmark method's performance of 73.23%.DiscussionThis approach can be used to develop a hybrid EEG-EMG brain-computer interface to provide patients with more accurate neural feedback to aid their recovery.

Keywords