1
|
Blanco-Diaz CF, Guerrero-Mendez CD, de Andrade RM, Badue C, De Souza AF, Delisle-Rodriguez D, Bastos-Filho T. Decoding lower-limb kinematic parameters during pedaling tasks using deep learning approaches and EEG. Med Biol Eng Comput 2024:10.1007/s11517-024-03147-3. [PMID: 39028484 DOI: 10.1007/s11517-024-03147-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 05/29/2024] [Indexed: 07/20/2024]
Abstract
Stroke is a neurological condition that usually results in the loss of voluntary control of body movements, making it difficult for individuals to perform activities of daily living (ADLs). Brain-computer interfaces (BCIs) integrated into robotic systems, such as motorized mini exercise bikes (MMEBs), have been demonstrated to be suitable for restoring gait-related functions. However, kinematic estimation of continuous motion in BCI systems based on electroencephalography (EEG) remains a challenge for the scientific community. This study proposes a comparative analysis to evaluate two artificial neural network (ANN)-based decoders to estimate three lower-limb kinematic parameters: x- and y-axis position of the ankle and knee joint angle during pedaling tasks. Long short-term memory (LSTM) was used as a recurrent neural network (RNN), which reached Pearson correlation coefficient (PCC) scores close to 0.58 by reconstructing kinematic parameters from the EEG features on the delta band using a time window of 250 ms. These estimates were evaluated through kinematic variance analysis, where our proposed algorithm showed promising results for identifying pedaling and rest periods, which could increase the usability of classification tasks. Additionally, negative linear correlations were found between pedaling speed and decoder performance, thereby indicating that kinematic parameters between slower speeds may be easier to estimate. The results allow concluding that the use of deep learning (DL)-based methods is feasible for the estimation of lower-limb kinematic parameters during pedaling tasks using EEG signals. This study opens new possibilities for implementing controllers most robust for MMEBs and BCIs based on continuous decoding, which may allow for maximizing the degrees of freedom and personalized rehabilitation.
Collapse
Affiliation(s)
| | | | | | - Claudine Badue
- Department of Informatics, Federal University of Espirito Santo, Vitoria, Brazil
| | | | - Denis Delisle-Rodriguez
- Edmond and Lily Safra International Institute of Neurosciences, Santos Dumont Institute, Macaiba, RN, Brazil
| | - Teodiano Bastos-Filho
- Postgraduate Program in Electrical Engineering, Federal University of Espirito Santo, Vitoria, Brazil
| |
Collapse
|
2
|
Wang A, Tian X, Jiang D, Yang C, Xu Q, Zhang Y, Zhao S, Zhang X, Jing J, Wei N, Wu Y, Lv W, Yang B, Zang D, Wang Y, Zhang Y, Wang Y, Meng X. Rehabilitation with brain-computer interface and upper limb motor function in ischemic stroke: A randomized controlled trial. MED 2024; 5:559-569.e4. [PMID: 38642555 DOI: 10.1016/j.medj.2024.02.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 02/01/2024] [Accepted: 02/28/2024] [Indexed: 04/22/2024]
Abstract
BACKGROUND Upper limb motor dysfunction is a major problem in the rehabilitation of patients with stroke. Brain-computer interface (BCI) is a kind of communication system that converts the "ideas" in the brain into instructions and has been used in stroke rehabilitation. This study aimed to investigate the efficacy and safety of BCI in rehabilitation training on upper limb motor function among patients with ischemic stroke. METHODS This was an investigator-initiated, multicenter, randomized, open-label, blank-controlled clinical trial with blinded outcome assessment conducted at 17 centers in China. Patients were assigned in a 1:1 ratio to the BCI group or the control group based on traditional rehabilitation training. The primary efficacy outcome is the difference in improvement of the Fugl-Meyer Assessment upper extremity (FMA-UE) score between two groups at month 1 after randomization. The safety outcomes were any adverse events within 3 months. FINDINGS A total of 296 patients with ischemic stroke were enrolled and randomly allocated to the BCI group (n = 150) and the control group (n = 146). The primary efficacy outcomes of FMA-UE score change from baseline to 1 month were 13.17 (95% confidence interval [CI], 11.56-14.79) in the BCI group and 9.83 (95% CI, 8.19-11.47) in the control group (mean difference between groups was 3.35; 95% CI, 1.05-5.65; p = 0.0045). Adverse events occurred in 33 patients (22.00%) in the BCI group and in 31 patients (21.23%) in the control group. CONCLUSIONS BCI rehabilitation training can further improve upper limb motor function based on traditional rehabilitation training in patients with ischemic stroke. This study was registered at ClinicalTrials.gov: NCT04387474. FUNDING This work was supported by the National Key R&D Program of China (2018YFC1312903), the National Key Research and Development Program of China (2022YFC3600600), the Training Fund for Open Projects at Clinical Institutes and Departments of Capital Medical University (CCMU2022ZKYXZ009), the Beijing Natural Science Foundation Haidian original innovation joint fund (L222123), the Fund for Young Talents of Beijing Medical Management Center (QML20230505), and the high-level public health talents (xuekegugan-02-47).
Collapse
Affiliation(s)
- Anxin Wang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; Beijing Municipal Key Laboratory of Clinical Epidemiology, Beijing, China
| | - Xue Tian
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; Beijing Municipal Key Laboratory of Clinical Epidemiology, Beijing, China; Department of Epidemiology and Health Statistics, School of Public Health, Capital Medical University, Beijing, China
| | - Di Jiang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Chengyuan Yang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Qin Xu
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yifei Zhang
- Research and Development Center, Shandong Haitian Intelligent Engineering Co., Ltd., Shandong, China
| | - Shaoqing Zhao
- School of Informatics, University of Edinburgh, Edinburgh, UK
| | - Xiaoli Zhang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Jing Jing
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Ning Wei
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yuqian Wu
- Department of Rehabilitation Medicine, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Wei Lv
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Banghua Yang
- School of Mechatronic Engineering and Automation, Research Center of Brain Computer Engineering, Shanghai University, Shanghai, China
| | - Dawei Zang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yilong Wang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yumei Zhang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; Department of Rehabilitation Medicine, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Yongjun Wang
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China
| | - Xia Meng
- Department of Neurology, Beijing Tiantan Hospital, Capital Medical University, Beijing, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Capital Medical University, Beijing, China.
| |
Collapse
|
3
|
Ma ZZ, Wu JJ, Cao Z, Hua XY, Zheng MX, Xing XX, Ma J, Xu JG. Motor imagery-based brain-computer interface rehabilitation programs enhance upper extremity performance and cortical activation in stroke patients. J Neuroeng Rehabil 2024; 21:91. [PMID: 38812014 PMCID: PMC11134735 DOI: 10.1186/s12984-024-01387-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 05/18/2024] [Indexed: 05/31/2024] Open
Abstract
BACKGROUND The most challenging aspect of rehabilitation is the repurposing of residual functional plasticity in stroke patients. To achieve this, numerous plasticity-based clinical rehabilitation programs have been developed. This study aimed to investigate the effects of motor imagery (MI)-based brain-computer interface (BCI) rehabilitation programs on upper extremity hand function in patients with chronic hemiplegia. DESIGN A 2010 Consolidated Standards for Test Reports (CONSORT)-compliant randomized controlled trial. METHODS Forty-six eligible stroke patients with upper limb motor dysfunction participated in the study, six of whom dropped out. The patients were randomly divided into a BCI group and a control group. The BCI group received BCI therapy and conventional rehabilitation therapy, while the control group received conventional rehabilitation only. The Fugl-Meyer Assessment of the Upper Extremity (FMA-UE) score was used as the primary outcome to evaluate upper extremity motor function. Additionally, functional magnetic resonance imaging (fMRI) scans were performed on all patients before and after treatment, in both the resting and task states. We measured the amplitude of low-frequency fluctuation (ALFF), regional homogeneity (ReHo), z conversion of ALFF (zALFF), and z conversion of ReHo (ReHo) in the resting state. The task state was divided into four tasks: left-hand grasping, right-hand grasping, imagining left-hand grasping, and imagining right-hand grasping. Finally, meaningful differences were assessed using correlation analysis of the clinical assessments and functional measures. RESULTS A total of 40 patients completed the study, 20 in the BCI group and 20 in the control group. Task-related blood-oxygen-level-dependent (BOLD) analysis showed that when performing the motor grasping task with the affected hand, the BCI group exhibited significant activation in the ipsilateral middle cingulate gyrus, precuneus, inferior parietal gyrus, postcentral gyrus, middle frontal gyrus, superior temporal gyrus, and contralateral middle cingulate gyrus. When imagining a grasping task with the affected hand, the BCI group exhibited greater activation in the ipsilateral superior frontal gyrus (medial) and middle frontal gyrus after treatment. However, the activation of the contralateral superior frontal gyrus decreased in the BCI group relative to the control group. Resting-state fMRI revealed increased zALFF in multiple cerebral regions, including the contralateral precentral gyrus and calcarine and the ipsilateral middle occipital gyrus and cuneus, and decreased zALFF in the ipsilateral superior temporal gyrus in the BCI group relative to the control group. Increased zReHo in the ipsilateral cuneus and contralateral calcarine and decreased zReHo in the contralateral middle temporal gyrus, temporal pole, and superior temporal gyrus were observed post-intervention. According to the subsequent correlation analysis, the increase in the FMA-UE score showed a positive correlation with the mean zALFF of the contralateral precentral gyrus (r = 0.425, P < 0.05), the mean zReHo of the right cuneus (r = 0.399, P < 0.05). CONCLUSION In conclusion, BCI therapy is effective and safe for arm rehabilitation after severe poststroke hemiparesis. The correlation of the zALFF of the contralateral precentral gyrus and the zReHo of the ipsilateral cuneus with motor improvements suggested that these values can be used as prognostic measures for BCI-based stroke rehabilitation. We found that motor function was related to visual and spatial processing, suggesting potential avenues for refining treatment strategies for stroke patients. TRIAL REGISTRATION The trial is registered in the Chinese Clinical Trial Registry (number ChiCTR2000034848, registered July 21, 2020).
Collapse
Affiliation(s)
- Zhen-Zhen Ma
- Department of Rehabilitation Medicine, Shuguang Hospital, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
| | - Jia-Jia Wu
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
| | - Zhi Cao
- Department of Tuina, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Xu-Yun Hua
- Department of Trauma and Orthopedics, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
| | - Mou-Xiong Zheng
- Department of Trauma and Orthopedics, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
| | - Xiang-Xin Xing
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
- Rehabilitation Center, Qilu Hospital of Shandong University, Jinan, China
| | - Jie Ma
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China
| | - Jian-Guang Xu
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China.
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China.
- Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China.
| |
Collapse
|
4
|
Sieghartsleitner S, Sebastián-Romagosa M, Cho W, Grünwald J, Ortner R, Scharinger J, Kamada K, Guger C. Upper extremity training followed by lower extremity training with a brain-computer interface rehabilitation system. Front Neurosci 2024; 18:1346607. [PMID: 38500488 PMCID: PMC10944934 DOI: 10.3389/fnins.2024.1346607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 02/08/2024] [Indexed: 03/20/2024] Open
Abstract
Introduction Brain-computer interfaces (BCIs) based on functional electrical stimulation have been used for upper extremity motor rehabilitation after stroke. However, little is known about their efficacy for multiple BCI treatments. In this study, 19 stroke patients participated in 25 upper extremity followed by 25 lower extremity BCI training sessions. Methods Patients' functional state was assessed using two sets of clinical scales for the two BCI treatments. The Upper Extremity Fugl-Meyer Assessment (FMA-UE) and the 10-Meter Walk Test (10MWT) were the primary outcome measures for the upper and lower extremity BCI treatments, respectively. Results Patients' motor function as assessed by the FMA-UE improved by an average of 4.2 points (p < 0.001) following upper extremity BCI treatment. In addition, improvements in activities of daily living and clinically relevant improvements in hand and finger spasticity were observed. Patients showed further improvements after the lower extremity BCI treatment, with walking speed as measured by the 10MWT increasing by 0.15 m/s (p = 0.001), reflecting a substantial meaningful change. Furthermore, a clinically relevant improvement in ankle spasticity and balance and mobility were observed. Discussion The results of the current study provide evidence that both upper and lower extremity BCI treatments, as well as their combination, are effective in facilitating functional improvements after stroke. In addition, and most importantly improvements did not stop after the first 25 upper extremity BCI sessions.
Collapse
Affiliation(s)
- Sebastian Sieghartsleitner
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | | | - Woosang Cho
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
| | - Johannes Grünwald
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Rupert Ortner
- g.tec Medical Engineering Spain S.L., Barcelona, Spain
| | - Josef Scharinger
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | | | - Christoph Guger
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- g.tec Medical Engineering Spain S.L., Barcelona, Spain
| |
Collapse
|
5
|
Rosanne O, Alves de Oliveira A, Falk TH. EEG Amplitude Modulation Analysis across Mental Tasks: Towards Improved Active BCIs. SENSORS (BASEL, SWITZERLAND) 2023; 23:9352. [PMID: 38067725 PMCID: PMC10708818 DOI: 10.3390/s23239352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 11/15/2023] [Accepted: 11/20/2023] [Indexed: 12/18/2023]
Abstract
Brain-computer interface (BCI) technology has emerged as an influential communication tool with extensive applications across numerous fields, including entertainment, marketing, mental state monitoring, and particularly medical neurorehabilitation. Despite its immense potential, the reliability of BCI systems is challenged by the intricacies of data collection, environmental factors, and noisy interferences, making the interpretation of high-dimensional electroencephalogram (EEG) data a pressing issue. While the current trends in research have leant towards improving classification using deep learning-based models, our study proposes the use of new features based on EEG amplitude modulation (AM) dynamics. Experiments on an active BCI dataset comprised seven mental tasks to show the importance of the proposed features, as well as their complementarity to conventional power spectral features. Through combining the seven mental tasks, 21 binary classification tests were explored. In 17 of these 21 tests, the addition of the proposed features significantly improved classifier performance relative to using power spectral density (PSD) features only. Specifically, the average kappa score for these classifications increased from 0.57 to 0.62 using the combined feature set. An examination of the top-selected features showed the predominance of the AM-based measures, comprising over 77% of the top-ranked features. We conclude this paper with an in-depth analysis of these top-ranked features and discuss their potential for use in neurophysiology.
Collapse
Affiliation(s)
- Olivier Rosanne
- Institut National de la Recherche Scientifique, University of Quebec, Montreal, QC H5A 1K6, Canada;
| | - Alcyr Alves de Oliveira
- Graduate Program in Psychology and Health, Federal University of Health Sciences of Porto Alegre, Porto Alegre 90050-170, Brazil;
| | - Tiago H. Falk
- Institut National de la Recherche Scientifique, University of Quebec, Montreal, QC H5A 1K6, Canada;
| |
Collapse
|