1
|
Li M, Qi E, Xu G, Jin J, Zhao Q, Guo M, Liao W. A delayed matching task-based study on action sequence of motor imagery. Cogn Neurodyn 2024; 18:1593-1607. [PMID: 39104677 PMCID: PMC11297855 DOI: 10.1007/s11571-023-10030-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 09/28/2023] [Accepted: 10/23/2023] [Indexed: 08/07/2024] Open
Abstract
The way people imagine greatly affects performance of brain-computer interface (BCI) based on motion imagery (MI). Action sequence is a basic unit of imitation, learning, and memory for motor behavior. Whether it influences the MI-BCI is unknown, and how to manifest this influence is difficult since the MI is a spontaneous brain activity. To investigate the influence of the action sequence, this study proposes a novel paradigm named action sequences observing and delayed matching task to use images and videos to guide people to observe, match and reinforce the memory of sequence. Seven subjects' ERPs and MI performance are analyzed under four different levels of complexities or orders of the sequence. Results demonstrated that the action sequence in terms of complexity and sequence order significantly affects the MI. The complex action in positive order obtains stronger ERD/ERS and more pronounced MI feature distributions, and yields an MI classification accuracy that is 12.3% higher than complex action in negative order (p < 0.05). In addition, the ERP amplitudes derived from the supplementary motor area show a positive correlation to the MI. This study demonstrates a new perspective of improving imagery in the MI-BCI by considering the complexity and order of the action sequences, and provides a novel index for manifesting the MI performance by ERP.
Collapse
Affiliation(s)
- Mengfan Li
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Enming Qi
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Guizhi Xu
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Jing Jin
- Key Laboratory of Advanced Control and Optimization for Chemical Processes, East China, University of Science and Technology, Shanghai, 518063 China
- Shenzhen Research Institute of East China, University of Science and Technology, Shenzhen, 518063 China
| | - Qi Zhao
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Miaomiao Guo
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, 300132 China
- Hebei Key Laboratory of Bioelectromagnetics and Neuroengineering, Tianjin, 300132 China
- Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin, 300132 China
| | - Wenzhe Liao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin, 300132 China
| |
Collapse
|
2
|
Jia T, Sun J, McGeady C, Ji L, Li C. Enhancing Brain-Computer Interface Performance by Incorporating Brain-to-Brain Coupling. CYBORG AND BIONIC SYSTEMS 2024; 5:0116. [PMID: 38680535 PMCID: PMC11052607 DOI: 10.34133/cbsystems.0116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 03/24/2024] [Indexed: 05/01/2024] Open
Abstract
Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.
Collapse
Affiliation(s)
- Tianyu Jia
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- Department of Bioengineering,
Imperial College London, London, UK
| | - Jingyao Sun
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Ciarán McGeady
- Department of Bioengineering,
Imperial College London, London, UK
| | - Linhong Ji
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Chong Li
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- School of Clinical Medicine,
Tsinghua University, Beijing, China
- Beijing Tsinghua Changgung Hospital,
Tsinghua University, Beijing, China
| |
Collapse
|
3
|
Demarest P, Rustamov N, Swift J, Xie T, Adamek M, Cho H, Wilson E, Han Z, Belsten A, Luczak N, Brunner P, Haroutounian S, Leuthardt EC. A novel theta-controlled vibrotactile brain-computer interface to treat chronic pain: a pilot study. Sci Rep 2024; 14:3433. [PMID: 38341457 PMCID: PMC10858946 DOI: 10.1038/s41598-024-53261-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 01/30/2024] [Indexed: 02/12/2024] Open
Abstract
Limitations in chronic pain therapies necessitate novel interventions that are effective, accessible, and safe. Brain-computer interfaces (BCIs) provide a promising modality for targeting neuropathology underlying chronic pain by converting recorded neural activity into perceivable outputs. Recent evidence suggests that increased frontal theta power (4-7 Hz) reflects pain relief from chronic and acute pain. Further studies have suggested that vibrotactile stimulation decreases pain intensity in experimental and clinical models. This longitudinal, non-randomized, open-label pilot study's objective was to reinforce frontal theta activity in six patients with chronic upper extremity pain using a novel vibrotactile neurofeedback BCI system. Patients increased their BCI performance, reflecting thought-driven control of neurofeedback, and showed a significant decrease in pain severity (1.29 ± 0.25 MAD, p = 0.03, q = 0.05) and pain interference (1.79 ± 1.10 MAD p = 0.03, q = 0.05) scores without any adverse events. Pain relief significantly correlated with frontal theta modulation. These findings highlight the potential of BCI-mediated cortico-sensory coupling of frontal theta with vibrotactile stimulation for alleviating chronic pain.
Collapse
Affiliation(s)
- Phillip Demarest
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Biomedical Engineering, McKelvey School of Engineering, Washington University in St. Louis, St Louis, MO, 63130, USA
| | - Nabi Rustamov
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - James Swift
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Tao Xie
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Markus Adamek
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Hohyun Cho
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Elizabeth Wilson
- Division of Clinical and Translational Research, Department of Anesthesiology, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Washington University Pain Center, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Zhuangyu Han
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Biomedical Engineering, McKelvey School of Engineering, Washington University in St. Louis, St Louis, MO, 63130, USA
| | - Alexander Belsten
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Nicholas Luczak
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Peter Brunner
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Department of Biomedical Engineering, McKelvey School of Engineering, Washington University in St. Louis, St Louis, MO, 63130, USA
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Simon Haroutounian
- Division of Clinical and Translational Research, Department of Anesthesiology, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
- Washington University Pain Center, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA
| | - Eric C Leuthardt
- Division of Neurotechnology, Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA.
- Department of Biomedical Engineering, McKelvey School of Engineering, Washington University in St. Louis, St Louis, MO, 63130, USA.
- Department of Neurosurgery, Washington University in St. Louis School of Medicine, St Louis, MO, 63110, USA.
| |
Collapse
|
4
|
Chen Z, Yan T, Wu J, Liu Y, Zhang C, Cui T. Sensorimotor rhythm and muscle activity in patients with stroke using mobile serious games to assist upper extremity rehabilitation. FRONTIERS IN REHABILITATION SCIENCES 2023; 4:1234216. [PMID: 38046523 PMCID: PMC10690953 DOI: 10.3389/fresc.2023.1234216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 10/30/2023] [Indexed: 12/05/2023]
Abstract
Introduction Exercise rehabilitation is crucial for neurological recovery in hemiplegia-induced upper limb dysfunction. Technology-assisted cortical activation in sensorimotor areas has shown potential for restoring motor function. This study assessed the feasibility of mobile serious games for stroke patients' motor rehabilitation. Methods A dedicated mobile application targeted shoulder, elbow, and wrist training. Twelve stroke survivors attempted a motor task under two conditions: serious mobile game-assisted and conventional rehabilitation. Electroencephalography and electromyography measured the therapy effects. Results Patients undergoing game-assisted rehabilitation showed stronger event-related desynchronization (ERD) in the contralateral hemisphere's motor perception areas compared to conventional rehabilitation (p < 0.05). RMS was notably higher in game-assisted rehabilitation, particularly in shoulder training (p < 0.05). Discussion Serious mobile game rehabilitation activated the motor cortex without directly improving muscle activity. This suggests its potential in neurological recovery for stroke patients.
Collapse
Affiliation(s)
- Zihe Chen
- School of Art, Southeast University, Nanjing, China
| | - Tingmin Yan
- School of Art, Southeast University, Nanjing, China
| | - Jinchun Wu
- School of Mechanical Engineering, Southeast University, Nanjing, China
| | - Yixuan Liu
- School of Mechanical Engineering, Southeast University, Nanjing, China
| | - Chunyun Zhang
- Department of Neurosurgery, First Hospital of Jilin University, Changchun, China
| | - Tianjian Cui
- School of Art, Southeast University, Nanjing, China
| |
Collapse
|
5
|
Azadi Moghadam M, Maleki A. Fatigue factors and fatigue indices in SSVEP-based brain-computer interfaces: a systematic review and meta-analysis. Front Hum Neurosci 2023; 17:1248474. [PMID: 38053651 PMCID: PMC10694510 DOI: 10.3389/fnhum.2023.1248474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 10/16/2023] [Indexed: 12/07/2023] Open
Abstract
Background Fatigue is a serious challenge when applying a steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) in the real world. Many researchers have used quantitative indices to study the effect of visual stimuli on fatigue. According to a wide range of studies in fatigue analysis, there are contradictions and inconsistencies in the behavior of fatigue indicators. New method In this study, for the first time, a systematic review and meta-analysis were performed on fatigue indices and fatigue caused by stimulation paradigm. We queried three scientific search engines for studies published between 2000 and 2022. The inclusion criteria were papers investigating mental and visual fatigue from performing a visual task using electroencephalogram (EEG) signals. Results Attractiveness and variation are the most effective ways to reduce BCI fatigue. Therefore, zoom motion, Newton's ring motion, and cue patterns reduce fatigue. While the color of the cue could effectively reduce fatigue, its shape and background had no effect on fatigue. Additionally, the questionnaire and quantitative indicators such as frequency indices, signal-to-noise ratio (SNR), SSVEP amplitude, and multiscale entropy were utilized to assess fatigue. Meta-analysis indicated that when a person is fatigued, the spectrum amplitude of alpha, theta, and α + θ / β increase significantly, while SNR and SSVEP amplitude decrease significantly. Conclusion The outcomes of this study can be used to design more optimal stimulation protocols that cause less fatigue. Moreover, the level of fatigue can be quantitatively assessed with indicators without the participant's self-reports.
Collapse
Affiliation(s)
- Maedeh Azadi Moghadam
- Department of Biotechnology, Faculty of New Sciences and Technologies, Semnan University, Semnan, Iran
| | - Ali Maleki
- Department of Biomedical Engineering, Semnan University, Semnan, Iran
| |
Collapse
|
6
|
Zhong Y, Yao L, Wang Y. Enhanced Motor Imagery Decoding by Calibration Model-Assisted With Tactile ERD. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4295-4305. [PMID: 37883287 DOI: 10.1109/tnsre.2023.3327788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2023]
Abstract
OBJECTIVE In this study, we propose a tactile-assisted calibration method for a motor imagery (MI) based Brain-Computer Interface (BCI) system. METHOD In the proposed calibration, tactile stimulation was applied to the hand wrist to assist the subjects in the MI task, which is named SA-MI task. Then, classifier training in the SA-MI Calibration was performed using the SA-MI data, while the Conventional Calibration employed the MI data. After the classifiers were trained, the performance was evaluated on a common MI dataset. RESULTS Our study demonstrated that the SA-MI Calibration significantly improved the performance as compared with the Conventional Calibration, with a decoding accuracy of (78.3% vs. 71.3%). Moreover, the average calibration time could be reduced by 40%. This benefit of the SA-MI Calibration effect was further validated by an independent control group, which showed no improvement when tactile stimulation was not applied during the calibration phase. Further analysis showed that when compared with MI, greater motor-related cortical activation and higher R 2 value in the alpha-beta frequency band were induced in SA-MI. CONCLUSION Indeed, the SA-MI Calibration could significantly improve the performance and reduce the calibration time as compared with the Conventional Calibration. SIGNIFICANCE The proposed tactile stimulation-assisted MI Calibration method holds great potential for a faster and more accurate system setup at the beginning of BCI usage.
Collapse
|
7
|
Vidaurre C, Irastorza-Landa N, Sarasola-Sanz A, Insausti-Delgado A, Ray AM, Bibián C, Helmhold F, Mahmoud WJ, Ortego-Isasa I, López-Larraz E, Lozano Peiteado H, Ramos-Murguialday A. Challenges of neural interfaces for stroke motor rehabilitation. Front Hum Neurosci 2023; 17:1070404. [PMID: 37789905 PMCID: PMC10543821 DOI: 10.3389/fnhum.2023.1070404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 08/28/2023] [Indexed: 10/05/2023] Open
Abstract
More than 85% of stroke survivors suffer from different degrees of disability for the rest of their lives. They will require support that can vary from occasional to full time assistance. These conditions are also associated to an enormous economic impact for their families and health care systems. Current rehabilitation treatments have limited efficacy and their long-term effect is controversial. Here we review different challenges related to the design and development of neural interfaces for rehabilitative purposes. We analyze current bibliographic evidence of the effect of neuro-feedback in functional motor rehabilitation of stroke patients. We highlight the potential of these systems to reconnect brain and muscles. We also describe all aspects that should be taken into account to restore motor control. Our aim with this work is to help researchers designing interfaces that demonstrate and validate neuromodulation strategies to enforce a contingent and functional neural linkage between the central and the peripheral nervous system. We thus give clues to design systems that can improve or/and re-activate neuroplastic mechanisms and open a new recovery window for stroke patients.
Collapse
Affiliation(s)
- Carmen Vidaurre
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Ikerbasque Science Foundation, Bilbao, Spain
| | | | | | | | - Andreas M. Ray
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Carlos Bibián
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Florian Helmhold
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Wala J. Mahmoud
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Iñaki Ortego-Isasa
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
| | - Eduardo López-Larraz
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Bitbrain, Zaragoza, Spain
| | | | - Ander Ramos-Murguialday
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
8
|
Wang W, Shi B, Wang D, Wang J, Liu G. Enhanced lower-limb motor imagery by kinesthetic illusion. Front Neurosci 2023; 17:1077479. [PMID: 37409102 PMCID: PMC10319417 DOI: 10.3389/fnins.2023.1077479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Accepted: 05/30/2023] [Indexed: 07/07/2023] Open
Abstract
Brain-computer interface (BCI) based on lower-limb motor imagery (LMI) enables hemiplegic patients to stand and walk independently. However, LMI ability is usually poor for BCI-illiterate (e.g., some stroke patients), limiting BCI performance. This study proposed a novel LMI-BCI paradigm with kinesthetic illusion(KI) induced by vibratory stimulation on Achilles tendon to enhance LMI ability. Sixteen healthy subjects were recruited to carry out two research contents: (1) To verify the feasibility of induced KI by vibrating Achilles tendon and analyze the EEG features produced by KI, research 1 compared the subjective feeling and brain activity of participants during rest task with and without vibratory stimulation (V-rest, rest). (2) Research 2 compared the LMI-BCI performance with and without KI (KI-LMI, no-LMI) to explore whether KI enhances LMI ability. The analysis methods of both experiments included classification accuracy (V-rest vs. rest, no-LMI vs. rest, KI-LMI vs. rest, KI-LMI vs. V-rest), time-domain features, oral questionnaire, statistic analysis and brain functional connectivity analysis. Research 1 verified that induced KI by vibrating Achilles tendon might be feasible, and provided a theoretical basis for applying KI to LMI-BCI paradigm, evidenced by oral questionnaire (Q1) and the independent effect of vibratory stimulation during rest task. The results of research 2 that KI enhanced mesial cortex activation and induced more intensive EEG features, evidenced by ERD power, topographical distribution, oral questionnaire (Q2 and Q3), and brain functional connectivity map. Additionally, the KI increased the offline accuracy of no-LMI/rest task by 6.88 to 82.19% (p < 0.001). The simulated online accuracy was also improved for most subjects (average accuracy for all subjects: 77.23% > 75.31%, and average F1_score for all subjects: 76.4% > 74.3%). The LMI-BCI paradigm of this study provides a novel approach to enhance LMI ability and accelerates the practical applications of the LMI-BCI system.
Collapse
Affiliation(s)
- Weizhen Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Bin Shi
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Dong Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Gang Liu
- Henan Key Laboratory of Brain Science and Brain-Computer Interface Technology, School of Electrical Engineering, Zhengzhou University, Zhengzhou, China
| |
Collapse
|
9
|
Won K, Kim H, Gwon D, Ahn M, Nam CS, Jun SC. Can vibrotactile stimulation and tDCS help inefficient BCI users? J Neuroeng Rehabil 2023; 20:60. [PMID: 37143057 PMCID: PMC10157902 DOI: 10.1186/s12984-023-01181-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 04/19/2023] [Indexed: 05/06/2023] Open
Abstract
Brain-computer interface (BCI) has helped people by allowing them to control a computer or machine through brain activity without actual body movement. Despite this advantage, BCI cannot be used widely because some people cannot achieve controllable performance. To solve this problem, researchers have proposed stimulation methods to modulate relevant brain activity to improve BCI performance. However, multiple studies have reported mixed results following stimulation, and the comparative study of different stimulation modalities has been overlooked. Accordingly, this study was designed to compare vibrotactile stimulation and transcranial direct current stimulation's (tDCS) effects on brain activity modulation and motor imagery BCI performance among inefficient BCI users. We recruited 44 subjects and divided them into sham, vibrotactile stimulation, and tDCS groups, and low performers were selected from each stimulation group. We found that the latter's BCI performance in the vibrotactile stimulation group increased significantly by 9.13% (p < 0.01), and while the tDCS group subjects' performance increased by 5.13%, it was not significant. In contrast, sham group subjects showed no increased performance. In addition to BCI performance, pre-stimulus alpha band power and the phase locking values (PLVs) averaged over sensory motor areas showed significant increases in low performers following stimulation in the vibrotactile stimulation and tDCS groups, while sham stimulation group subjects and high performers showed no significant stimulation effects across all groups. Our findings suggest that stimulation effects may differ depending upon BCI efficiency, and inefficient BCI users have greater plasticity than efficient BCI users.
Collapse
Affiliation(s)
- Kyungho Won
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Heegyu Kim
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Daeun Gwon
- Department of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Minkyu Ahn
- Department of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
- School of Computer Science and Electrical Engineering, Handong Global University, Pohang, South Korea
| | - Chang S Nam
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, North Carolina, USA
| | - Sung Chan Jun
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea.
- Artificial Intelligence Graduate School, Gwangju Institute of Science and Technology, Gwangju, South Korea.
| |
Collapse
|
10
|
Jia T, Li C, Mo L, Qian C, Li W, Xu Q, Pan Y, Liu A, Ji L. Tailoring brain-machine interface rehabilitation training based on neural reorganization: towards personalized treatment for stroke patients. Cereb Cortex 2023; 33:3043-3052. [PMID: 35788284 PMCID: PMC10016036 DOI: 10.1093/cercor/bhac259] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 06/04/2022] [Accepted: 06/06/2022] [Indexed: 11/14/2022] Open
Abstract
Electroencephalogram (EEG)-based brain-machine interface (BMI) has the potential to enhance rehabilitation training efficiency, but it still remains elusive regarding how to design BMI training for heterogeneous stroke patients with varied neural reorganization. Here, we hypothesize that tailoring BMI training according to different patterns of neural reorganization can contribute to a personalized rehabilitation trajectory. Thirteen stroke patients were recruited in a 2-week personalized BMI training experiment. Clinical and behavioral measurements, as well as cortical and muscular activities, were assessed before and after training. Following treatment, significant improvements were found in motor function assessment. Three types of brain activation patterns were identified during BMI tasks, namely, bilateral widespread activation, ipsilesional focusing activation, and contralesional recruitment activation. Patients with either ipsilesional dominance or contralesional dominance can achieve recovery through personalized BMI training. Results indicate that personalized BMI training tends to connect the potentially reorganized brain areas with event-contingent proprioceptive feedback. It can also be inferred that personalization plays an important role in establishing the sensorimotor loop in BMI training. With further understanding of neural rehabilitation mechanisms, personalized treatment strategy is a promising way to improve the rehabilitation efficacy and promote the clinical use of rehabilitation robots and other neurotechnologies.
Collapse
Affiliation(s)
| | - Chong Li
- Corresponding authors: Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China. ; Beijing Rehabilitation Hospital of Capital Medical University, Capital Medical University, Beijing 100144, China. ; Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China.
| | - Linhong Mo
- Beijing Rehabilitation Hospital of Capital Medical University, Capital Medical University, Beijing 100144, China
| | - Chao Qian
- Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| | - Wei Li
- Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
| | - Quan Xu
- Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China
- Department of Physical Medicine and Rehabilitation, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing 102218, China
| | - Yu Pan
- Department of Physical Medicine and Rehabilitation, Beijing Tsinghua Changgung Hospital, Tsinghua University, Beijing 102218, China
| | - Aixian Liu
- Corresponding authors: Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China. ; Beijing Rehabilitation Hospital of Capital Medical University, Capital Medical University, Beijing 100144, China. ; Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China.
| | - Linhong Ji
- Corresponding authors: Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China. ; Beijing Rehabilitation Hospital of Capital Medical University, Capital Medical University, Beijing 100144, China. ; Division of Intelligent and Bio-mimetic Machinery, The State Key Laboratory of Tribology, Tsinghua University, Beijing 100084, China.
| |
Collapse
|
11
|
Hossain SR, Karem H, Jafari Z, Kolb BE, Mohajerani MH. Tactile stimulation improves cognition, motor, and anxiety-like behaviors and attenuates the Alzheimer's disease pathology in adult APP NL-G-F/NL-G-F mice. Synapse 2023; 77:e22257. [PMID: 36255152 DOI: 10.1002/syn.22257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 09/05/2022] [Accepted: 09/28/2022] [Indexed: 01/29/2023]
Abstract
Alzheimer's disease (AD) is one of the largest health crises in the world. There are limited pharmaceutical interventions to treat AD, however, and most of the treatment options are not for cure or prevention, but rather to slow down the progression of the disease. The aim of this study was to examine the effect of tactile stimulation (TS) on AD-like symptoms and pathology in APPNL-G-F/NL-G-F mice, a mouse model of AD. The results show that TS reduces the AD-like symptoms on tests of cognition, motor, and anxiety-like behaviors and these improvements in behavior are associated with reduced AD pathology in APP mice. Thus, TS appears to be a promising noninvasive strategy for slowing the onset of dementia in aging animals.
Collapse
Affiliation(s)
- Shakhawat R Hossain
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| | - Hadil Karem
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| | - Zahra Jafari
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| | - Bryan E Kolb
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| | - Majid H Mohajerani
- Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Alberta, Canada
| |
Collapse
|
12
|
Zhang L, Chen L, Wang Z, Zhang X, Liu X, Ming D. Enhancing Visual-Guided Motor Imagery Performance via Sensory Threshold Somatosensory Electrical Stimulation Training. IEEE Trans Biomed Eng 2023; 70:756-765. [PMID: 36037456 DOI: 10.1109/tbme.2022.3202189] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Motor imagery (MI) based brain- computer interface (BCI) has been widely studied as an effective way to enhance motor learning and promote motor recovery. However, the accuracy of MI-BCI heavily depends on whether subjects can perform MI tasks correctly, which largely limits the general application of MI-BCI. To overcome this limitation, a training strategy based on the combination of MI and sensory threshold somatosensory electrical stimulation (MI+st-SES) is proposed in this study. METHODS Thirty healthy subjects were recruited and randomly divided into SES group and control group. Both groups performed left-hand and right-hand MI tasks in three consecutive blocks. The main difference between two groups lies in the second block, where subjects in SES group received the st-SES during MI tasks whereas the control group performed MI tasks only. RESULTS The results showed that the SES group had a significant improvement in event-related desynchronization (ERD) of alpha rhythm after the training session of MI+st-SES (left-hand: F(2,27) = 9.98, p<0.01; right-hand: F(2, 27) = 10.43, p<0.01). The classification accuracy between left- and right-hand MI in the SES group was also significantly improved following MI+st-SES training (F(2,27) = 6.46, p<0.01). In contrary, there was no significant difference between the first and third blocks in the control group (F(2,27) = 0.18, p = 0.84). The functional connectivity based on weighted pairwise phase consistency (wPPC) over the sensorimotor area also showed an increase after the MI+st-SES training. CONCLUSION AND SIGNIFICANCE Our findings indicate that training based on MI+st-SES is a promising way to foster MI performance and assist subjects in achieving efficient BCI control.
Collapse
|
13
|
Malešević J, Kostić M, Jure FA, Spaich EG, Došen S, Ilić V, Bijelić G, Štrbac M. Electrotactile Communication via Matrix Electrode Placed on the Torso Using Fast Calibration, and Static vs. Dynamic Encoding. SENSORS (BASEL, SWITZERLAND) 2022; 22:7658. [PMID: 36236758 PMCID: PMC9572222 DOI: 10.3390/s22197658] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 10/05/2022] [Accepted: 10/07/2022] [Indexed: 06/16/2023]
Abstract
Electrotactile stimulation is a technology that reproducibly elicits tactile sensations and can be used as an alternative channel to communicate information to the user. The presented work is a part of an effort to develop this technology into an unobtrusive communication tool for first responders. In this study, the aim was to compare the success rate (SR) between discriminating stimulation at six spatial locations (static encoding) and recognizing six spatio-temporal patterns where pads are activated sequentially in a predetermined order (dynamic encoding). Additionally, a procedure for a fast amplitude calibration, that includes a semi-automated initialization and an optional manual adjustment, was employed and evaluated. Twenty subjects, including twelve first responders, participated in the study. The electrode comprising the 3 × 2 matrix of pads was placed on the lateral torso. The results showed that high SRs could be achieved for both types of message encoding after a short learning phase; however, the dynamic approach led to a statistically significant improvement in messages recognition (SR of 93.3%), compared to static stimulation (SR of 83.3%). The proposed calibration procedure was also effective since in 83.8% of the cases the subjects did not need to adjust the stimulation amplitude manually.
Collapse
Affiliation(s)
| | | | - Fabricio A. Jure
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9220 Aalborg, Denmark
| | - Erika G. Spaich
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9220 Aalborg, Denmark
| | - Strahinja Došen
- Neurorehabilitation Systems, Department of Health Science and Technology, Faculty of Medicine, Aalborg University, 9220 Aalborg, Denmark
| | - Vojin Ilić
- Department of Computing and Control Engineering, Faculty of Technical Sciences, University of Novi Sad, 21102 Novi Sad, Serbia
| | - Goran Bijelić
- Tecnalia, Basque Research and Technology Alliance (BRTA), 20009 Donostia-San Sebastian, Spain
| | | |
Collapse
|
14
|
Jia J. Exploration on neurobiological mechanisms of the central–peripheral–central closed-loop rehabilitation. Front Cell Neurosci 2022; 16:982881. [PMID: 36119128 PMCID: PMC9479450 DOI: 10.3389/fncel.2022.982881] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 08/12/2022] [Indexed: 11/13/2022] Open
Abstract
Central and peripheral interventions for brain injury rehabilitation have been widely employed. However, as patients’ requirements and expectations for stroke rehabilitation have gradually increased, the limitations of simple central intervention or peripheral intervention in the rehabilitation application of stroke patients’ function have gradually emerged. Studies have suggested that central intervention promotes the activation of functional brain regions and improves neural plasticity, whereas peripheral intervention enhances the positive feedback and input of sensory and motor control modes to the central nervous system, thereby promoting the remodeling of brain function. Based on the model of a central–peripheral–central (CPC) closed loop, the integration of center and peripheral interventions was effectively completed to form “closed-loop” information feedback, which could be applied to specific brain areas or function-related brain regions of patients. Notably, the closed loop can also be extended to central and peripheral immune systems as well as central and peripheral organs such as the brain–gut axis and lung–brain axis. In this review article, the model of CPC closed-loop rehabilitation and the potential neuroimmunological mechanisms of a closed-loop approach will be discussed. Further, we highlight critical questions about the neuroimmunological aspects of the closed-loop technique that merit future research attention.
Collapse
Affiliation(s)
- Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Center for Neurological Disorders, Shanghai, China
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Regional Medical Center, Fujian, China
- The First Affiliated Hospital of Fujian Medical University, Fujian, China
- *Correspondence: Jie Jia,
| |
Collapse
|
15
|
Chen L, Zhang L, Wang Z, Gu B, Zhang X, Ming D. The Effects of Sensory Threshold Somatosensory Electrical Stimulation on Users With Different MI-BCI Performance. Front Neurosci 2022; 16:909434. [PMID: 35784856 PMCID: PMC9247255 DOI: 10.3389/fnins.2022.909434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/23/2022] [Indexed: 11/13/2022] Open
Abstract
Motor imagery-based brain-computer interface (MI-BCI) has been largely studied to improve motor learning and promote motor recovery. However, the difficulty in performing MI limits the widespread application of MI-BCI. It has been suggested that the usage of sensory threshold somatosensory electrical stimulation (st-SES) is a promising way to guide participants on MI tasks, but it is still unclear whether st-SES is effective for all users. In the present study, we aimed to examine the effects of st-SES on the MI-BCI performance in two BCI groups (High Performers and Low Performers). Twenty healthy participants were recruited to perform MI and resting tasks with EEG recordings. These tasks were modulated with or without st-SES. We demonstrated that st-SES improved the performance of MI-BCI in the Low Performers, but led to a decrease in the accuracy of MI-BCI in the High Performers. Furthermore, for the Low Performers, the combination of st-SES and MI resulted in significantly greater event-related desynchronization (ERD) and sample entropy of sensorimotor rhythm than MI alone. However, the ERD and sample entropy values of MI did not change significantly during the st-SES intervention in the High Performers. Moreover, we found that st-SES had an effect on the functional connectivity of the fronto-parietal network in the alpha band of Low Performers and the beta band of High Performers, respectively. Our results demonstrated that somatosensory input based on st-SES was only beneficial for sensorimotor cortical activation and MI-BCI performance in the Low Performers, but not in the High Performers. These findings help to optimize guidance strategies to adapt to different categories of users in the practical application of MI-BCI.
Collapse
Affiliation(s)
- Long Chen
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Lei Zhang
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Zhongpeng Wang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Bin Gu
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Xin Zhang
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Dong Ming
- Department of Biomedical Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments & Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
16
|
Huang X, Liang S, Li Z, Lai CYY, Choi KS. EEG-based vibrotactile evoked brain-computer interfaces system: A systematic review. PLoS One 2022; 17:e0269001. [PMID: 35657949 PMCID: PMC9165854 DOI: 10.1371/journal.pone.0269001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Accepted: 05/12/2022] [Indexed: 11/18/2022] Open
Abstract
Recently, a novel electroencephalogram-based brain-computer interface (EVE-BCI) using the vibrotactile stimulus shows great potential for an alternative to other typical motor imagery and visual-based ones. (i) Objective: in this review, crucial aspects of EVE-BCI are extracted from the literature to summarize its key factors, investigate the synthetic evidence of feasibility, and generate recommendations for further studies. (ii) Method: five major databases were searched for relevant publications. Multiple key concepts of EVE-BCI, including data collection, stimulation paradigm, vibrotactile control, EEG signal processing, and reported performance, were derived from each eligible article. We then analyzed these concepts to reach our objective. (iii) Results: (a) seventy-nine studies are eligible for inclusion; (b) EEG data are mostly collected among healthy people with an embodiment of EEG cap in EVE-BCI development; (c) P300 and Steady-State Somatosensory Evoked Potential are the two most popular paradigms; (d) only locations of vibration are heavily explored by previous researchers, while other vibrating factors draw little interest. (e) temporal features of EEG signal are usually extracted and used as the input to linear predictive models for EVE-BCI setup; (f) subject-dependent and offline evaluations remain popular assessments of EVE-BCI performance; (g) accuracies of EVE-BCI are significantly higher than chance levels among different populations. (iv) Significance: we summarize trends and gaps in the current EVE-BCI by identifying influential factors. A comprehensive overview of EVE-BCI can be quickly gained by reading this review. We also provide recommendations for the EVE-BCI design and formulate a checklist for a clear presentation of the research work. They are useful references for researchers to develop a more sophisticated and practical EVE-BCI in future studies.
Collapse
Affiliation(s)
- Xiuyu Huang
- Centre for Smart Health, School of Nursing, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Shuang Liang
- School of Geographic and Biologic Information, Nanjing University of Posts and Telecommunications, Nanjing, China
| | - Zengguang Li
- School of Computer Science and Technology, Nanjing Tech University, Nanjing, China
| | - Cynthia Yuen Yi Lai
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Kup-Sze Choi
- Centre for Smart Health, School of Nursing, The Hong Kong Polytechnic University, Hong Kong SAR, China
| |
Collapse
|
17
|
Li X, Wang L, Miao S, Yue Z, Tang Z, Su L, Zheng Y, Wu X, Wang S, Wang J, Dou Z. Sensorimotor Rhythm-Brain Computer Interface With Audio-Cue, Motor Observation and Multisensory Feedback for Upper-Limb Stroke Rehabilitation: A Controlled Study. Front Neurosci 2022; 16:808830. [PMID: 35360158 PMCID: PMC8962957 DOI: 10.3389/fnins.2022.808830] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 01/27/2022] [Indexed: 12/02/2022] Open
Abstract
Several studies have shown the positive clinical effect of brain computer interface (BCI) training for stroke rehabilitation. This study investigated the efficacy of the sensorimotor rhythm (SMR)-based BCI with audio-cue, motor observation and multisensory feedback for post-stroke rehabilitation. Furthermore, we discussed the interaction between training intensity and training duration in BCI training. Twenty-four stroke patients with severe upper limb (UL) motor deficits were randomly assigned to two groups: 2-week SMR-BCI training combined with conventional treatment (BCI Group, BG, n = 12) and 2-week conventional treatment without SMR-BCI intervention (Control Group, CG, n = 12). Motor function was measured using clinical measurement scales, including Fugl-Meyer Assessment-Upper Extremities (FMA-UE; primary outcome measure), Wolf Motor Functional Test (WMFT), and Modified Barthel Index (MBI), at baseline (Week 0), post-intervention (Week 2), and follow-up week (Week 4). EEG data from patients allocated to the BG was recorded at Week 0 and Week 2 and quantified by mu suppression means event-related desynchronization (ERD) in mu rhythm (8–12 Hz). All functional assessment scores (FMA-UE, WMFT, and MBI) significantly improved at Week 2 for both groups (p < 0.05). The BG had significantly higher FMA-UE and WMFT improvement at Week 4 compared to the CG. The mu suppression of bilateral hemisphere both had a positive trend with the motor function scores at Week 2. This study proposes a new effective SMR-BCI system and demonstrates that the SMR-BCI training with audio-cue, motor observation and multisensory feedback, together with conventional therapy may promote long-lasting UL motor improvement. Clinical Trial Registration: [http://www.chictr.org.cn], identifier [ChiCTR2000041119].
Collapse
Affiliation(s)
- Xin Li
- Department of Rehabilitation Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Lu Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Si Miao
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Zan Yue
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Zhiming Tang
- Department of Rehabilitation Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Liujie Su
- Department of Rehabilitation Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yadan Zheng
- Department of Rehabilitation Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiangzhen Wu
- Department of Rehabilitation Medicine, Shenzhen Hengsheng Hospital, Shenzhen, China
| | - Shan Wang
- Air Force Medical Center, PLA, Beijing, China
- *Correspondence: Shan Wang,
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
- Jing Wang,
| | - Zulin Dou
- Department of Rehabilitation Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
- Zulin Dou,
| |
Collapse
|
18
|
Chen S, Shu X, Wang H, Ding L, Fu J, Jia J. The Differences Between Motor Attempt and Motor Imagery in Brain-Computer Interface Accuracy and Event-Related Desynchronization of Patients With Hemiplegia. Front Neurorobot 2021; 15:706630. [PMID: 34803647 PMCID: PMC8602190 DOI: 10.3389/fnbot.2021.706630] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Accepted: 10/07/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Motor attempt and motor imagery (MI) are two common motor tasks used in brain-computer interface (BCI). They are widely researched for motor rehabilitation in patients with hemiplegia. The differences between the motor attempt (MA) and MI tasks of patients with hemiplegia can be used to promote BCI application. This study aimed to explore the accuracy of BCI and event-related desynchronization (ERD) between the two tasks. Materials and Methods: We recruited 13 patients with stroke and 3 patients with traumatic brain injury, to perform MA and MI tasks in a self-control design. The BCI accuracies from the bilateral, ipsilesional, and contralesional hemispheres were analyzed and compared between different tasks. The cortical activation patterns were evaluated with ERD and laterality index (LI). Results: The study showed that the BCI accuracies of MA were significantly (p < 0.05) higher than MI in the bilateral, ipsilesional, and contralesional hemispheres in the alpha-beta (8–30 Hz) frequency bands. There was no significant difference in ERD and LI between the MA and MI tasks in the 8–30 Hz frequency bands. However, in the MA task, there was a negative correlation between the ERD values in the channel CP1 and ipsilesional hemispheric BCI accuracies (r = −0.552, p = 0.041, n = 14) and a negative correlation between the ERD values in channel CP2 and bilateral hemispheric BCI accuracies (r = −0.543, p = 0.045, n = 14). While in the MI task, there were negative correlations between the ERD values in channel C4 and bilateral hemispheric BCI accuracies (r = −0.582, p = 0.029, n = 14) as well as the contralesional hemispheric BCI accuracies (r = −0.657, p = 0.011, n = 14). As for motor dysfunction, there was a significant positive correlation between the ipsilesional BCI accuracies and FMA scores of the hand part in 8–13 Hz (r = 0.565, p = 0.035, n = 14) in the MA task and a significant positive correlation between the ipsilesional BCI accuracies and FMA scores of the hand part in 13–30 Hz (r = 0.558, p = 0.038, n = 14) in the MI task. Conclusion: The MA task may achieve better BCI accuracy but have similar cortical activations with the MI task. Cortical activation (ERD) may influence the BCI accuracy, which should be carefully considered in the BCI motor rehabilitation of patients with hemiplegia.
Collapse
Affiliation(s)
- Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Hewei Wang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Li Ding
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China.,National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China.,National Center for Neurological Disorders, Shanghai, China
| |
Collapse
|
19
|
Jia T, Mo L, Li C, Liu A, Li Z, Ji L. 5 Hz rTMS improves motor-imagery based BCI classification performance. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6116-6120. [PMID: 34892512 DOI: 10.1109/embc46164.2021.9630102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Brain-computer interface (BCI) based rehabilitation has been proven a promising method facilitating motor recovery. Recognizing motor intention is crucial for realizing BCI rehabilitation training. Event-related desynchronization (ERD) is a kind of electroencephalogram (EEG) inherent characteristics associated with motor intention. However, due to brain deficits poststroke, some patients are not able to generate ERD, which discourages them to be involved in BCI rehabilitation training. To boost ERD during motor imagery (MI), this paper investigates the effects of high-frequency repetitive transcranial magnetic stimulation (rTMS) on BCI classification performance. Eleven subjects participated in this study. The experiment consisted of two conditions: rTMS + MI versus sham rTMS + MI, which were arranged on different days. MI tests with 64-channel EEG recording were arranged immediately before and after rTMS and sham rTMS. Time-frequency analysis were utilized to measure ERD changes. Common spatial pattern was used to extract features and linear discriminant analysis was used to calculate offline classification accuracies. Paired-sample t-test and Wilcoxon signed rank tests with post-hoc analysis were used to compare performance before and after stimulation. Statistically stronger ERD (-13.93±12.99%) was found after real rTMS compared with ERD (-5.71±21.25%) before real rTMS (p<0.05). Classification accuracy after real rTMS (70.71±10.32%) tended to be higher than that before real rTMS (66.50±8.48%) (p<0.1). However, no statistical differences were found after sham stimulation. This research provides an effective method in improving BCI performance by utilizing neural modulation.Clinical Relevance- This study offers a promising treatment for patients who cannot be recruited in BCI rehabilitation training due to poor BCI classification performance.
Collapse
|
20
|
Multi-Session Influence of Two Modalities of Feedback and Their Order of Presentation on MI-BCI User Training. MULTIMODAL TECHNOLOGIES AND INTERACTION 2021. [DOI: 10.3390/mti5030012] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
By performing motor-imagery tasks, for example, imagining hand movements, Motor-Imagery based Brain-Computer Interfaces (MI-BCIs) users can control digital technologies, for example, neuroprosthesis, using their brain activity only. MI-BCI users need to train, usually using a unimodal visual feedback, to produce brain activity patterns that are recognizable by the system. The literature indicates that multimodal vibrotactile and visual feedback is more effective than unimodal visual feedback, at least for short term training. However, the multi-session influence of such multimodal feedback on MI-BCI user training remained unknown, so did the influence of the order of presentation of the feedback modalities. In our experiment, 16 participants trained to control a MI-BCI during five sessions with a realistic visual feedback and five others with both a realistic visual feedback and a vibrotactile one. training benefits from a multimodal feedback, in terms of performances and self-reported mindfulness. There is also a significant influence of the order presentation of the modality. Participants who started training with a visual feedback had higher performances than those who started training with a multimodal feedback. We recommend taking into account the order of presentation for future experiments assessing the influence of several modalities of feedback.
Collapse
|
21
|
Cao L, Chen S, Jia J, Fan C, Wang H, Xu Z. An Inter- and Intra-Subject Transfer Calibration Scheme for Improving Feedback Performance of Sensorimotor Rhythm-Based BCI Rehabilitation. Front Neurosci 2021; 14:629572. [PMID: 33584182 PMCID: PMC7876404 DOI: 10.3389/fnins.2020.629572] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2020] [Accepted: 12/21/2020] [Indexed: 01/11/2023] Open
Abstract
The Brain Computer Interface (BCI) system is a typical neurophysiological application which helps paralyzed patients with human-machine communication. Stroke patients with motor disabilities are able to perform BCI tasks for clinical rehabilitation. This paper proposes an effective scheme of transfer calibration for BCI rehabilitation. The inter- and intra-subject transfer learning approaches can improve the low-precision classification performance for experimental feedback. The results imply that the systematical scheme is positive in increasing the confidence of voluntary training for stroke patients. In addition, it also reduces the time consumption of classifier calibration.
Collapse
Affiliation(s)
- Lei Cao
- Department of Artificial Intelligence, Shanghai Maritime University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | | | - Haoran Wang
- Department of Computer Science and Technology, Tongji University, Shanghai, China
| | - Zhixiong Xu
- Department of Artificial Intelligence, Shanghai Maritime University, Shanghai, China
| |
Collapse
|
22
|
Zhang W, Song A, Zeng H, Xu B, Miao M. Closed-Loop Phase-Dependent Vibration Stimulation Improves Motor Imagery-Based Brain-Computer Interface Performance. Front Neurosci 2021; 15:638638. [PMID: 33568973 PMCID: PMC7868341 DOI: 10.3389/fnins.2021.638638] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 01/06/2021] [Indexed: 11/13/2022] Open
Abstract
The motor imagery (MI) paradigm has been wildly used in brain-computer interface (BCI), but the difficulties in performing imagery tasks limit its application. Mechanical vibration stimulus has been increasingly used to enhance the MI performance, but its improvement consistence is still under debate. To develop more effective vibration stimulus methods for consistently enhancing MI, this study proposes an EEG phase-dependent closed-loop mechanical vibration stimulation method. The subject's index finger of the non-dominant hand was given 4 different vibration stimulation conditions (i.e., continuous open-loop vibration stimulus, two different phase-dependent closed-loop vibration stimuli and no stimulus) when performing two tasks of imagining movement and rest of the index finger from his/her dominant hand. We compared MI performance and brain oscillatory patterns under different conditions to verify the effectiveness of this method. The subjects performed 80 trials of each type in a random order, and the average phase-lock value of closed-loop stimulus conditions was 0.71. It was found that the closed-loop vibration stimulus applied in the falling phase helped the subjects to produce stronger event-related desynchronization (ERD) and sustain longer. Moreover, the classification accuracy was improved by about 9% compared with MI without any vibration stimulation (p = 0.012, paired t-test). This method helps to modulate the mu rhythm and make subjects more concentrated on the imagery and without negative enhancement during rest tasks, ultimately improves MI-based BCI performance. Participants reported that the tactile fatigue under closed-loop stimulation conditions was significantly less than continuous stimulation. This novel method is an improvement to the traditional vibration stimulation enhancement research and helps to make stimulation more precise and efficient.
Collapse
Affiliation(s)
- Wenbin Zhang
- The State Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Aiguo Song
- The State Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Hong Zeng
- The State Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Baoguo Xu
- The State Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Minmin Miao
- School of Information Engineering, Huzhou University, Huzhou, China
| |
Collapse
|
23
|
Jin J, Chen Z, Xu R, Miao Y, Wang X, Jung TP. Developing a Novel Tactile P300 Brain-Computer Interface With a Cheeks-Stim Paradigm. IEEE Trans Biomed Eng 2020; 67:2585-2593. [DOI: 10.1109/tbme.2020.2965178] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
24
|
Zhang X, Guo Y, Gao B, Long J. Alpha Frequency Intervention by Electrical Stimulation to Improve Performance in Mu-Based BCI. IEEE Trans Neural Syst Rehabil Eng 2020; 28:1262-1270. [PMID: 32305926 DOI: 10.1109/tnsre.2020.2987529] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The accuracy of brain-computer interfaces (BCIs) is important for effective communication and control. The mu-based BCI is one of the most widely used systems, of which the related methods to improve users' accuracy are still poorly studied, especially for the BCI illiteracy. Here, we examined a way to enhance mu-based BCI performance by electrically stimulating the ulnar nerve of the contralateral wrist at the alpha frequency (10 Hz) during left- and right-hand motor imagination in two BCI groups (literate and illiterate). We demonstrate that this alpha frequency intervention enhances the classification accuracy between left- and right-hand motor imagery from 66.41% to 81.57% immediately after intervention and to 75.28% two days after intervention in the BCI illiteracy group, while classification accuracy improves from 82.12% to 91.84% immediately after intervention and to 89.03% two days after intervention in the BCI literacy group. However, the classification accuracy did not change before and after the sham intervention (no electrical stimulation). Furthermore, the ERD on the primary sensorimotor cortex during left- or right-hand motor imagery tasks was more visible at the mu-rhythm (8-13 Hz) after alpha frequency intervention. Alpha frequency intervention increases the mu-rhythm power difference between left- and right-hand motor imagery tasks. These results provide evidence that alpha frequency intervention is an effective way to improve BCI performance by regulating the mu-rhythm which might provide a way to reduce BCI illiteracy.
Collapse
|