1
|
Tacca N, Dunlap C, Donegan SP, Hardin JO, Meyers E, Darrow MJ, Colachis Iv S, Gillman A, Friedenberg DA. Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation. Sci Rep 2024; 14:18564. [PMID: 39122791 PMCID: PMC11316006 DOI: 10.1038/s41598-024-64458-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 06/10/2024] [Indexed: 08/12/2024] Open
Abstract
High-density electromyography (HD-EMG) can provide a natural interface to enhance human-computer interaction (HCI). This study aims to demonstrate the capability of a novel HD-EMG forearm sleeve equipped with up to 150 electrodes to capture high-resolution muscle activity, decode complex hand gestures, and estimate continuous hand position via joint angle predictions. Ten able-bodied participants performed 37 hand movements and grasps while EMG was recorded using the HD-EMG sleeve. Simultaneously, an 18-sensor motion capture glove calculated 23 joint angles from the hand and fingers across all movements for training regression models. For classifying across the 37 gestures, our decoding algorithm was able to differentiate between sequential movements with 97.3 ± 0.3 % accuracy calculated on a 100 ms bin-by-bin basis. In a separate mixed dataset consisting of 19 movements randomly interspersed, decoding performance achieved an average bin-wise accuracy of 92.8 ± 0.8 % . When evaluating decoders for use in real-time scenarios, we found that decoders can reliably decode both movements and movement transitions, achieving an average accuracy of 93.3 ± 0.9 % on the sequential set and 88.5 ± 0.9 % on the mixed set. Furthermore, we estimated continuous joint angles from the EMG sleeve data, achieving a R 2 of 0.884 ± 0.003 in the sequential set and 0.750 ± 0.008 in the mixed set. Median absolute error (MAE) was kept below 10° across all joints, with a grand average MAE of 1.8 ± 0 . 04 ∘ and 3.4 ± 0 . 07 ∘ for the sequential and mixed datasets, respectively. We also assessed two algorithm modifications to address specific challenges for EMG-driven HCI applications. To minimize decoder latency, we used a method that accounts for reaction time by dynamically shifting cue labels in time. To reduce training requirements, we show that pretraining models with historical data provided an increase in decoding performance compared with models that were not pretrained when reducing the in-session training data to only one attempt of each movement. The HD-EMG sleeve, combined with sophisticated machine learning algorithms, can be a powerful tool for hand gesture recognition and joint angle estimation. This technology holds significant promise for applications in HCI, such as prosthetics, assistive technology, rehabilitation, and human-robot collaboration.
Collapse
Affiliation(s)
- Nicholas Tacca
- Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA.
| | - Collin Dunlap
- Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA
| | - Sean P Donegan
- Air Force Research Laboratory, Materials And Manufacturing Directorate, Wright-Patterson AFB, OH, USA
| | - James O Hardin
- Air Force Research Laboratory, Materials And Manufacturing Directorate, Wright-Patterson AFB, OH, USA
| | - Eric Meyers
- Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA
| | | | | | - Andrew Gillman
- Air Force Research Laboratory, Materials And Manufacturing Directorate, Wright-Patterson AFB, OH, USA
| | | |
Collapse
|
2
|
Eldawlatly S. On the role of generative artificial intelligence in the development of brain-computer interfaces. BMC Biomed Eng 2024; 6:4. [PMID: 38698495 PMCID: PMC11064240 DOI: 10.1186/s42490-024-00080-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Accepted: 04/24/2024] [Indexed: 05/05/2024] Open
Abstract
Since their inception more than 50 years ago, Brain-Computer Interfaces (BCIs) have held promise to compensate for functions lost by people with disabilities through allowing direct communication between the brain and external devices. While research throughout the past decades has demonstrated the feasibility of BCI to act as a successful assistive technology, the widespread use of BCI outside the lab is still beyond reach. This can be attributed to a number of challenges that need to be addressed for BCI to be of practical use including limited data availability, limited temporal and spatial resolutions of brain signals recorded non-invasively and inter-subject variability. In addition, for a very long time, BCI development has been mainly confined to specific simple brain patterns, while developing other BCI applications relying on complex brain patterns has been proven infeasible. Generative Artificial Intelligence (GAI) has recently emerged as an artificial intelligence domain in which trained models can be used to generate new data with properties resembling that of available data. Given the enhancements observed in other domains that possess similar challenges to BCI development, GAI has been recently employed in a multitude of BCI development applications to generate synthetic brain activity; thereby, augmenting the recorded brain activity. Here, a brief review of the recent adoption of GAI techniques to overcome the aforementioned BCI challenges is provided demonstrating the enhancements achieved using GAI techniques in augmenting limited EEG data, enhancing the spatiotemporal resolution of recorded EEG data, enhancing cross-subject performance of BCI systems and implementing end-to-end BCI applications. GAI could represent the means by which BCI would be transformed into a prevalent assistive technology, thereby improving the quality of life of people with disabilities, and helping in adopting BCI as an emerging human-computer interaction technology for general use.
Collapse
Affiliation(s)
- Seif Eldawlatly
- Computer and Systems Engineering Department, Faculty of Engineering, Ain Shams University, 1 El-Sarayat St., Abbassia, Cairo, Egypt.
- Computer Science and Engineering Department, The American University in Cairo, Cairo, Egypt.
| |
Collapse
|
3
|
Chen Y, Wang F, Li T, Zhao L, Gong A, Nan W, Ding P, Fu Y. Several inaccurate or erroneous conceptions and misleading propaganda about brain-computer interfaces. Front Hum Neurosci 2024; 18:1391550. [PMID: 38601800 PMCID: PMC11004276 DOI: 10.3389/fnhum.2024.1391550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 03/18/2024] [Indexed: 04/12/2024] Open
Abstract
Brain-computer interface (BCI) is a revolutionizing human-computer interaction, which has potential applications for specific individuals or groups in specific scenarios. Extensive research has been conducted on the principles and implementation methods of BCI, and efforts are currently being made to bridge the gap from research to real-world applications. However, there are inaccurate or erroneous conceptions about BCI among some members of the public, and certain media outlets, as well as some BCI researchers, developers, manufacturers, and regulators, propagate misleading or overhyped claims about BCI technology. Therefore, this article summarizes the several misconceptions and misleading propaganda about BCI, including BCI being capable of "mind-controlled," "controlling brain," "mind reading," and the ability to "download" or "upload" information from or to the brain using BCI, among others. Finally, the limitations (shortcomings) and limits (boundaries) of BCI, as well as the necessity of conducting research aimed at countering BCI systems are discussed, and several suggestions are offered to reduce misconceptions and misleading claims about BCI.
Collapse
Affiliation(s)
- Yanxiao Chen
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Fan Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Tianwen Li
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Lei Zhao
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Anmin Gong
- School of Information Engineering, Chinese People’s Armed Police Force Engineering University, Xi’an, China
| | - Wenya Nan
- Department of Psychology, School of Education, Shanghai Normal University, Shanghai, China
| | - Peng Ding
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| |
Collapse
|
4
|
Wang H, Ding Q, Luo Y, Wu Z, Yu J, Chen H, Zhou Y, Zhang H, Tao K, Chen X, Fu J, Wu J. High-Performance Hydrogel Sensors Enabled Multimodal and Accurate Human-Machine Interaction System for Active Rehabilitation. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2309868. [PMID: 38095146 DOI: 10.1002/adma.202309868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 12/03/2023] [Indexed: 12/22/2023]
Abstract
Human-machine interaction (HMI) technology shows an important application prospect in rehabilitation medicine, but it is greatly limited by the unsatisfactory recognition accuracy and wearing comfort. Here, this work develops a fully flexible, conformable, and functionalized multimodal HMI interface consisting of hydrogel-based sensors and a self-designed flexible printed circuit board. Thanks to the component regulation and structural design of the hydrogel, both electromyogram (EMG) and forcemyography (FMG) signals can be collected accurately and stably, so that they are later decoded with the assistance of artificial intelligence (AI). Compared with traditional multichannel EMG signals, the multimodal human-machine interaction method based on the combination of EMG and FMG signals significantly improves the efficiency of human-machine interaction by increasing the information entropy of the interaction signals. The decoding accuracy of the interaction signals from only two channels for different gestures reaches 91.28%. The resulting AI-powered active rehabilitation system can control a pneumatic robotic glove to assist stroke patients in completing movements according to the recognized human motion intention. Moreover, this HMI interface is further generalized and applied to other remote sensing platforms, such as manipulators, intelligent cars, and drones, paving the way for the design of future intelligent robot systems.
Collapse
Affiliation(s)
- Hao Wang
- State Key Laboratory of Optoelectronic Materials and Technologies and the Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, China
| | - Qiongling Ding
- State Key Laboratory of Optoelectronic Materials and Technologies and the Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, China
| | - Yibing Luo
- State Key Laboratory of Optoelectronic Materials and Technologies and the Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, China
| | - Zixuan Wu
- State Key Laboratory of Optoelectronic Materials and Technologies and the Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, China
| | - Jiahao Yu
- Ministry of Education Key Laboratory of Micro and Nano Systems for Aerospace, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Huizhi Chen
- Guangdong Provincial Key Laboratory of Research and Development of Natural Drugs and School of Pharmacy, Guangdong Medical University, Dongguan, 523808, P. R. China
- The First Dongguan Affiliated Hospital, Guangdong Medical University, Dongguan, 523808, P. R. China
| | - Yubin Zhou
- Guangdong Provincial Key Laboratory of Research and Development of Natural Drugs and School of Pharmacy, Guangdong Medical University, Dongguan, 523808, P. R. China
- The First Dongguan Affiliated Hospital, Guangdong Medical University, Dongguan, 523808, P. R. China
| | - He Zhang
- Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, National Engineering Research Center of Novel Equipment for Polymer Processing, Key Laboratory of Polymer Processing Engineering (SCUT) Ministry of Education, South China University of Technology, Guangzhou, 510641, P. R. China
| | - Kai Tao
- Ministry of Education Key Laboratory of Micro and Nano Systems for Aerospace, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Xiaoliang Chen
- Micro- and Nano-technology Research Center, State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Jun Fu
- School of Materials Science and Engineering, Sun Yat-sen University, Guangzhou, 510275, China
| | - Jin Wu
- State Key Laboratory of Optoelectronic Materials and Technologies and the Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, China
- Guangdong Provincial Key Laboratory of Technique and Equipment for Macromolecular Advanced Manufacturing, National Engineering Research Center of Novel Equipment for Polymer Processing, Key Laboratory of Polymer Processing Engineering (SCUT) Ministry of Education, South China University of Technology, Guangzhou, 510641, P. R. China
- State Key Laboratory of Polymer Materials Engineering, Sichuan University, Chengdu, 610065, People's Republic of China
| |
Collapse
|
5
|
Qin Y, Yang B, Ke S, Liu P, Rong F, Xia X. M-FANet: Multi-Feature Attention Convolutional Neural Network for Motor Imagery Decoding. IEEE Trans Neural Syst Rehabil Eng 2024; 32:401-411. [PMID: 38194394 DOI: 10.1109/tnsre.2024.3351863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2024]
Abstract
Motor imagery (MI) decoding methods are pivotal in advancing rehabilitation and motor control research. Effective extraction of spectral-spatial-temporal features is crucial for MI decoding from limited and low signal-to-noise ratio electroencephalogram (EEG) signal samples based on brain-computer interface (BCI). In this paper, we propose a lightweight Multi-Feature Attention Neural Network (M-FANet) for feature extraction and selection of multi-feature data. M-FANet employs several unique attention modules to eliminate redundant information in the frequency domain, enhance local spatial feature extraction and calibrate feature maps. We introduce a training method called Regularized Dropout (R-Drop) to address training-inference inconsistency caused by dropout and improve the model's generalization capability. We conduct extensive experiments on the BCI Competition IV 2a (BCIC-IV-2a) dataset and the 2019 World robot conference contest-BCI Robot Contest MI (WBCIC-MI) dataset. M-FANet achieves superior performance compared to state-of-the-art MI decoding methods, with 79.28% 4-class classification accuracy (kappa: 0.7259) on the BCIC-IV-2a dataset and 77.86% 3-class classification accuracy (kappa: 0.6650) on the WBCIC-MI dataset. The application of multi-feature attention modules and R-Drop in our lightweight model significantly enhances its performance, validated through comprehensive ablation experiments and visualizations.
Collapse
|
6
|
Papadopoulos S, Szul MJ, Congedo M, Bonaiuto JJ, Mattout J. Beta bursts question the ruling power for brain-computer interfaces. J Neural Eng 2024; 21:016010. [PMID: 38167234 DOI: 10.1088/1741-2552/ad19ea] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 01/02/2024] [Indexed: 01/05/2024]
Abstract
Objective: Current efforts to build reliable brain-computer interfaces (BCI) span multiple axes from hardware, to software, to more sophisticated experimental protocols, and personalized approaches. However, despite these abundant efforts, there is still room for significant improvement. We argue that a rather overlooked direction lies in linking BCI protocols with recent advances in fundamental neuroscience.Approach: In light of these advances, and particularly the characterization of the burst-like nature of beta frequency band activity and the diversity of beta bursts, we revisit the role of beta activity in 'left vs. right hand' motor imagery (MI) tasks. Current decoding approaches for such tasks take advantage of the fact that MI generates time-locked changes in induced power in the sensorimotor cortex and rely on band-passed power changes in single or multiple channels. Although little is known about the dynamics of beta burst activity during MI, we hypothesized that beta bursts should be modulated in a way analogous to their activity during performance of real upper limb movements.Main results and Significance: We show that classification features based on patterns of beta burst modulations yield decoding results that are equivalent to or better than typically used beta power across multiple open electroencephalography datasets, thus providing insights into the specificity of these bio-markers.
Collapse
Affiliation(s)
- Sotirios Papadopoulos
- University Lyon 1, Lyon, France
- Lyon Neuroscience Research Center, CRNL, INSERM U1028, CNRS, UMR5292, Lyon, France
- Institut de Sciences Cognitives Marc Jeannerod, CNRS, UMR5229, Lyon, France
| | - Maciej J Szul
- University Lyon 1, Lyon, France
- Institut de Sciences Cognitives Marc Jeannerod, CNRS, UMR5229, Lyon, France
| | - Marco Congedo
- GIPSA-lab, University Grenoble Alpes, CNRS, Grenoble-INP, Grenoble, France
| | - James J Bonaiuto
- University Lyon 1, Lyon, France
- Institut de Sciences Cognitives Marc Jeannerod, CNRS, UMR5229, Lyon, France
| | - Jérémie Mattout
- University Lyon 1, Lyon, France
- Lyon Neuroscience Research Center, CRNL, INSERM U1028, CNRS, UMR5292, Lyon, France
| |
Collapse
|
7
|
Moreno-Verdú M, Hamoline G, Van Caenegem EE, Waltzing BM, Forest S, Valappil AC, Khan AH, Chye S, Esselaar M, Campbell MJ, McAllister CJ, Kraeutner SN, Poliakoff E, Frank C, Eaves DL, Wakefield C, Boe SG, Holmes PS, Bruton AM, Vogt S, Wright DJ, Hardwick RM. Guidelines for reporting action simulation studies (GRASS): Proposals to improve reporting of research in motor imagery and action observation. Neuropsychologia 2024; 192:108733. [PMID: 37956956 DOI: 10.1016/j.neuropsychologia.2023.108733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 10/10/2023] [Accepted: 11/08/2023] [Indexed: 11/21/2023]
Abstract
Researchers from multiple disciplines have studied the simulation of actions through motor imagery, action observation, or their combination. Procedures used in these studies vary considerably between research groups, and no standardized approach to reporting experimental protocols has been proposed. This has led to under-reporting of critical details, impairing the assessment, replication, synthesis, and potential clinical translation of effects. We provide an overview of issues related to the reporting of information in action simulation studies, and discuss the benefits of standardized reporting. We propose a series of checklists that identify key details of research protocols to include when reporting action simulation studies. Each checklist comprises A) essential methodological details, B) essential details that are relevant to a specific mode of action simulation, and C) further points that may be useful on a case-by-case basis. We anticipate that the use of these guidelines will improve the understanding, reproduction, and synthesis of studies using action simulation, and enhance the translation of research using motor imagery and action observation to applied and clinical settings.
Collapse
Affiliation(s)
- Marcos Moreno-Verdú
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium; Department of Radiology, Rehabilitation and Physiotherapy, Complutense University of Madrid, Spain
| | - Gautier Hamoline
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium
| | - Elise E Van Caenegem
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium
| | - Baptiste M Waltzing
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium
| | - Sébastien Forest
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium
| | - Ashika C Valappil
- Simulating Movements to Improve Learning and Execution (SMILE) Research Group, School of Life and Health Sciences, University of Roehampton, UK
| | - Adam H Khan
- Simulating Movements to Improve Learning and Execution (SMILE) Research Group, School of Life and Health Sciences, University of Roehampton, UK
| | - Samantha Chye
- Simulating Movements to Improve Learning and Execution (SMILE) Research Group, School of Life and Health Sciences, University of Roehampton, UK
| | - Maaike Esselaar
- Research Centre for Musculoskeletal Science and Sports Medicine, Department of Sport and Exercise Sciences, Faculty of Science and Engineering, Manchester Metropolitan University, UK
| | - Mark J Campbell
- Lero Esports Science Research Lab, Physical Education & Sport Sciences Department & Lero the Science Foundation Ireland Centre for Software Research, University of Limerick, Ireland
| | - Craig J McAllister
- Centre for Human Brain Health, School of Sport Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | - Sarah N Kraeutner
- Neuroplasticity, Imagery, And Motor Behaviour Laboratory, Department of Psychology & Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Okanagan, Canada
| | - Ellen Poliakoff
- Body Eyes and Movement (BEAM) Laboratory, Faculty of Biology, Medicine and Health, University of Manchester, UK
| | - Cornelia Frank
- Cognition, Imagery and Learning in Action Laboratory, Department of Sports and Movement Science, School of Educational and Cultural Studies, Osnabrueck University, Germany
| | - Daniel L Eaves
- Biomedical, Nutritional and Sport Sciences, Faculty of Medical Sciences, Newcastle University, UK
| | | | - Shaun G Boe
- Laboratory for Brain Recovery and Function, School of Physiotherapy and Department of Psychology and Neuroscience, Dalhousie University, Canada
| | - Paul S Holmes
- Research Centre for Health, Psychology and Communities, Department of Psychology, Faculty of Health and Education, Manchester Metropolitan University, UK
| | - Adam M Bruton
- Simulating Movements to Improve Learning and Execution (SMILE) Research Group, School of Life and Health Sciences, University of Roehampton, UK; : Centre for Cognitive and Clinical Neuroscience, College of Health, Medicine and Life Sciences, Brunel University London, UK
| | - Stefan Vogt
- Perception and Action Group, Department of Psychology, Lancaster University, UK
| | - David J Wright
- Research Centre for Health, Psychology and Communities, Department of Psychology, Faculty of Health and Education, Manchester Metropolitan University, UK
| | - Robert M Hardwick
- Brain, Action, And Skill Laboratory, Institute of Neuroscience (Cognition and Systems Division), UC Louvain, Belgium.
| |
Collapse
|
8
|
Lorenz EA, Su X, Skjæret-Maroni N. A review of combined functional neuroimaging and motion capture for motor rehabilitation. J Neuroeng Rehabil 2024; 21:3. [PMID: 38172799 PMCID: PMC10765727 DOI: 10.1186/s12984-023-01294-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 12/11/2023] [Indexed: 01/05/2024] Open
Abstract
BACKGROUND Technological advancements in functional neuroimaging and motion capture have led to the development of novel methods that facilitate the diagnosis and rehabilitation of motor deficits. These advancements allow for the synchronous acquisition and analysis of complex signal streams of neurophysiological data (e.g., EEG, fNIRS) and behavioral data (e.g., motion capture). The fusion of those data streams has the potential to provide new insights into cortical mechanisms during movement, guide the development of rehabilitation practices, and become a tool for assessment and therapy in neurorehabilitation. RESEARCH OBJECTIVE This paper aims to review the existing literature on the combined use of motion capture and functional neuroimaging in motor rehabilitation. The objective is to understand the diversity and maturity of technological solutions employed and explore the clinical advantages of this multimodal approach. METHODS This paper reviews literature related to the combined use of functional neuroimaging and motion capture for motor rehabilitation following the PRISMA guidelines. Besides study and participant characteristics, technological aspects of the used systems, signal processing methods, and the nature of multimodal feature synchronization and fusion were extracted. RESULTS Out of 908 publications, 19 were included in the final review. Basic or translation studies were mainly represented and based predominantly on healthy participants or stroke patients. EEG and mechanical motion capture technologies were most used for biomechanical data acquisition, and their subsequent processing is based mainly on traditional methods. The system synchronization techniques at large were underreported. The fusion of multimodal features mainly supported the identification of movement-related cortical activity, and statistical methods were occasionally employed to examine cortico-kinematic relationships. CONCLUSION The fusion of motion capture and functional neuroimaging might offer advantages for motor rehabilitation in the future. Besides facilitating the assessment of cognitive processes in real-world settings, it could also improve rehabilitative devices' usability in clinical environments. Further, by better understanding cortico-peripheral coupling, new neuro-rehabilitation methods can be developed, such as personalized proprioceptive training. However, further research is needed to advance our knowledge of cortical-peripheral coupling, evaluate the validity and reliability of multimodal parameters, and enhance user-friendly technologies for clinical adaptation.
Collapse
Affiliation(s)
- Emanuel A Lorenz
- Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Xiaomeng Su
- Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway
| | - Nina Skjæret-Maroni
- Department of Neuromedicine and Movement Science, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
9
|
Qu H, Zeng F, Tang Y, Shi B, Wang Z, Chen X, Wang J. The clinical effects of brain-computer interface with robot on upper-limb function for post-stroke rehabilitation: a meta-analysis and systematic review. Disabil Rehabil Assist Technol 2024; 19:30-41. [PMID: 35450498 DOI: 10.1080/17483107.2022.2060354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 03/26/2022] [Indexed: 10/18/2022]
Abstract
PURPOSE Many recent clinical studies have suggested that the combination of brain-computer interfaces (BCIs) can induce neurological recovery and improvement in motor function. In this review, we performed a systematic review and meta-analysis to evaluate the clinical effects of BCI-robot systems. METHODS The articles published from January 2010 to December 2020 have been searched by using the databases (EMBASE, PubMed, CINAHL, EBSCO, Web of Science and manual search). The single-group studies were qualitatively described, and only the controlled-trial studies were included for the meta-analysis. The mean difference (MD) of Fugl-Meyer Assessment (FMA) scores were pooled and the random-effects model method was used to perform the meta-analysis. The PRISMA criteria were followed in current review. RESULTS A total of 897 records were identified, eight single-group studies and 11 controlled-trial studies were included in our review. The systematic analysis indicated that the BCI-robot systems had a significant improvement on motor function recovery. The meta-analysis showed there were no statistic differences between BCI-robot groups and robot groups, neither in the immediate effects nor long-term effects (p > 0.05). CONCLUSION The use of BCI-robot systems has significant improvement on the motor function recovery of hemiparetic upper-limb, and there is a sustaining effect. The meta-analysis showed no statistical difference between the experimental group (BCI-robot) and the control group (robot). However, there are a few shortcomings in the experimental design of existing studies, more clinical trials need to be conducted, and the experimental design needs to be more rigorous.Implications for RehabilitationIn this review, we evaluated the clinical effects of brain-computer interface with robot on upper-limb function for post-stroke rehabilitation. After we screened the databases, 19 articles were included in this review. These articles all clinical trial research, they all used non-invasive brain-computer interfaces and upper-limb robot.We conducted the systematic review with nine articles, the result indicated that the BCI-robot system had a significant improvement on motor function recovery. Eleven articles were included for the meta-analysis, the result showed there were no statistic differences between BCI-robot groups and robot groups, neither in the immediate effects nor long-term effects.We thought the result of meta-analysis which showed no statistic difference was probably caused by the heterogenicity of clinical trial designs of these articles.We thought the BCI-robot systems are promising strategies for post-stroke rehabilitation. And we gave several suggestions for further research: (1) The experimental design should be more rigorous, and describe the experimental designs in detail, especially the control group intervention, to make the experiment replicability. (2) New evaluation criteria need to be established, more objective assessment such as biomechanical assessment, fMRI should be utilised as the primary outcome. (3) More clinical studies with larger sample size, novel external devices, and BCI systems need to be conducted to investigate the differences between BCI-robot system and other interventions. (4) Further research could shift the focus to the patients who are in subacute stage, to explore if the early BCI training can make a positive impact on cerebral cortical recovery.
Collapse
Affiliation(s)
- Hao Qu
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Feixiang Zeng
- Department of Rehabilitation Medicine, HuiZhou Third People's Hospital, Huizhou, China
| | - Yongbin Tang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Bin Shi
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| | - Zhijun Wang
- Department of Rehabilitation Medicine, FoShan Fifth People's Hospital, Guangdong, China
| | - Xiaokai Chen
- Department of Rehabilitation Medicine, HuiZhou Third People's Hospital, Huizhou, China
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China
| |
Collapse
|
10
|
Xiong X, Wang Y, Song T, Huang J, Kang G. Improved motor imagery classification using adaptive spatial filters based on particle swarm optimization algorithm. Front Neurosci 2023; 17:1303648. [PMID: 38192510 PMCID: PMC10773845 DOI: 10.3389/fnins.2023.1303648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 11/17/2023] [Indexed: 01/10/2024] Open
Abstract
Background As a typical self-paced brain-computer interface (BCI) system, the motor imagery (MI) BCI has been widely applied in fields such as robot control, stroke rehabilitation, and assistance for patients with stroke or spinal cord injury. Many studies have focused on the traditional spatial filters obtained through the common spatial pattern (CSP) method. However, the CSP method can only obtain fixed spatial filters for specific input signals. In addition, the CSP method only focuses on the variance difference of two types of electroencephalogram (EEG) signals, so the decoding ability of EEG signals is limited. Methods To make up for these deficiencies, this study introduces a novel spatial filter-solving paradigm named adaptive spatial pattern (ASP), which aims to minimize the energy intra-class matrix and maximize the inter-class matrix of MI-EEG after spatial filtering. The filter bank adaptive and common spatial pattern (FBACSP), our proposed method for MI-EEG decoding, amalgamates ASP spatial filters with CSP features across multiple frequency bands. Through a dual-stage feature selection strategy, it employs the Particle Swarm Optimization algorithm for spatial filter optimization, surpassing traditional CSP approaches in MI classification. To streamline feature sets and enhance recognition efficiency, it first prunes CSP features in each frequency band using mutual information, followed by merging these with ASP features. Results Comparative experiments are conducted on two public datasets (2a and 2b) from BCI competition IV, which show the outstanding average recognition accuracy of FBACSP. The classification accuracy of the proposed method has reached 74.61 and 81.19% on datasets 2a and 2b, respectively. Compared with the baseline algorithm, filter bank common spatial pattern (FBCSP), the proposed algorithm improves by 11.44 and 7.11% on two datasets, respectively (p < 0.05). Conclusion It is demonstrated that FBACSP has a strong ability to decode MI-EEG. In addition, the analysis based on mutual information, t-SNE, and Shapley values further proves that ASP features have excellent decoding ability for MI-EEG signals and explains the improvement of classification performance by the introduction of ASP features. These findings may provide useful information to optimize EEG-based BCI systems and further improve the performance of non-invasive BCI.
Collapse
Affiliation(s)
- Xiong Xiong
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China
- Department of Neuroscience, University of Sheffield, Sheffield, United Kingdom
| | - Ying Wang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China
| | - Tianyuan Song
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China
| | - Jinguo Huang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China
- School of Automation, Beijing University of Posts and Telecommunications, Beijing, China
| | - Guixia Kang
- School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China
| |
Collapse
|
11
|
Yue Z, Xiao P, Wang J, Tong RKY. Brain oscillations in reflecting motor status and recovery induced by action observation-driven robotic hand intervention in chronic stroke. Front Neurosci 2023; 17:1241772. [PMID: 38146541 PMCID: PMC10749335 DOI: 10.3389/fnins.2023.1241772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Accepted: 11/14/2023] [Indexed: 12/27/2023] Open
Abstract
Hand rehabilitation in chronic stroke remains challenging, and finding markers that could reflect motor function would help to understand and evaluate the therapy and recovery. The present study explored whether brain oscillations in different electroencephalogram (EEG) bands could indicate the motor status and recovery induced by action observation-driven brain-computer interface (AO-BCI) robotic therapy in chronic stroke. The neurophysiological data of 16 chronic stroke patients who received 20-session BCI hand training is the basis of the study presented here. Resting-state EEG was recorded during the observation of non-biological movements, while task-stage EEG was recorded during the observation of biological movements in training. The motor performance was evaluated using the Action Research Arm Test (ARAT) and upper extremity Fugl-Meyer Assessment (FMA), and significant improvements (p < 0.05) on both scales were found in patients after the intervention. Averaged EEG band power in the affected hemisphere presented negative correlations with scales pre-training; however, no significant correlations (p > 0.01) were found both in the pre-training and post-training stages. After comparing the variation of oscillations over training, we found patients with good and poor recovery presented different trends in delta, low-beta, and high-beta variations, and only patients with good recovery presented significant changes in EEG band power after training (delta band, p < 0.01). Importantly, motor improvements in ARAT correlate significantly with task EEG power changes (low-beta, c.c = 0.71, p = 0.005; high-beta, c.c = 0.71, p = 0.004) and task/rest EEG power ratio changes (delta, c.c = -0.738, p = 0.003; low-beta, c.c = 0.67, p = 0.009; high-beta, c.c = 0.839, p = 0.000). These results suggest that, in chronic stroke, EEG band power may not be a good indicator of motor status. However, ipsilesional oscillation changes in the delta and beta bands provide potential biomarkers related to the therapeutic-induced improvement of motor function in effective BCI intervention, which may be useful in understanding the brain plasticity changes and contribute to evaluating therapy and recovery in chronic-stage motor rehabilitation.
Collapse
Affiliation(s)
- Zan Yue
- Institute of Robotics and Intelligent Systems, Xi’an Jiaotong University, Xi’an, China
- Neurorehabilitation Robotics Research Institute, Xi’an Jiaotong University, Xi’an, China
| | - Peng Xiao
- Institute of Robotics and Intelligent Systems, Xi’an Jiaotong University, Xi’an, China
- Neurorehabilitation Robotics Research Institute, Xi’an Jiaotong University, Xi’an, China
| | - Jing Wang
- Institute of Robotics and Intelligent Systems, Xi’an Jiaotong University, Xi’an, China
- Neurorehabilitation Robotics Research Institute, Xi’an Jiaotong University, Xi’an, China
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong SAR, China
| | - Raymond Kai-yu Tong
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong SAR, China
| |
Collapse
|
12
|
Tang Z, Wang H, Cui Z, Jin X, Zhang L, Peng Y, Xing B. An Upper-Limb Rehabilitation Exoskeleton System Controlled by MI Recognition Model With Deep Emphasized Informative Features in a VR Scene. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4390-4401. [PMID: 37910412 DOI: 10.1109/tnsre.2023.3329059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
The prevalence of stroke continues to increase with the global aging. Based on the motor imagery (MI) brain-computer interface (BCI) paradigm and virtual reality (VR) technology, we designed and developed an upper-limb rehabilitation exoskeleton system (VR-ULE) in the VR scenes for stroke patients. The VR-ULE system makes use of the MI electroencephalogram (EEG) recognition model with a convolutional neural network and squeeze-and-excitation (SE) blocks to obtain the patient's motion intentions and control the exoskeleton to move during rehabilitation training movement. Due to the individual differences in EEG, the frequency bands with optimal MI EEG features for each patient are different. Therefore, the weight of different feature channels is learned by combining SE blocks to emphasize the useful information frequency band features. The MI cues in the VR-based virtual scenes can improve the interhemispheric balance and the neuroplasticity of patients. It also makes up for the disadvantages of the current MI-BCIs, such as single usage scenarios, poor individual adaptability, and many interfering factors. We designed the offline training experiment to evaluate the feasibility of the EEG recognition strategy, and designed the online control experiment to verify the effectiveness of the VR-ULE system. The results showed that the MI classification method with MI cues in the VR scenes improved the accuracy of MI classification (86.49% ± 3.02%); all subjects performed two types of rehabilitation training tasks under their own models trained in the offline training experiment, with the highest average completion rates of 86.82% ± 4.66% and 88.48% ± 5.84%. The VR-ULE system can efficiently help stroke patients with hemiplegia complete upper-limb rehabilitation training tasks, and provide the new methods and strategies for BCI-based rehabilitation devices.
Collapse
|
13
|
Vidaurre C, Irastorza-Landa N, Sarasola-Sanz A, Insausti-Delgado A, Ray AM, Bibián C, Helmhold F, Mahmoud WJ, Ortego-Isasa I, López-Larraz E, Lozano Peiteado H, Ramos-Murguialday A. Challenges of neural interfaces for stroke motor rehabilitation. Front Hum Neurosci 2023; 17:1070404. [PMID: 37789905 PMCID: PMC10543821 DOI: 10.3389/fnhum.2023.1070404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 08/28/2023] [Indexed: 10/05/2023] Open
Abstract
More than 85% of stroke survivors suffer from different degrees of disability for the rest of their lives. They will require support that can vary from occasional to full time assistance. These conditions are also associated to an enormous economic impact for their families and health care systems. Current rehabilitation treatments have limited efficacy and their long-term effect is controversial. Here we review different challenges related to the design and development of neural interfaces for rehabilitative purposes. We analyze current bibliographic evidence of the effect of neuro-feedback in functional motor rehabilitation of stroke patients. We highlight the potential of these systems to reconnect brain and muscles. We also describe all aspects that should be taken into account to restore motor control. Our aim with this work is to help researchers designing interfaces that demonstrate and validate neuromodulation strategies to enforce a contingent and functional neural linkage between the central and the peripheral nervous system. We thus give clues to design systems that can improve or/and re-activate neuroplastic mechanisms and open a new recovery window for stroke patients.
Collapse
Affiliation(s)
- Carmen Vidaurre
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Ikerbasque Science Foundation, Bilbao, Spain
| | | | | | | | - Andreas M. Ray
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Carlos Bibián
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Florian Helmhold
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Wala J. Mahmoud
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| | - Iñaki Ortego-Isasa
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
| | - Eduardo López-Larraz
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
- Bitbrain, Zaragoza, Spain
| | | | - Ander Ramos-Murguialday
- TECNALIA, Basque Research and Technology Alliance (BRTA), San Sebastian, Spain
- Institute for Medical Psychology and Behavioral Neurobiology, University of Tübingen, Tübingen, Germany
| |
Collapse
|
14
|
Ge R, Liu Y, Yan Z, Cheng Q, Qiu S, Ming D. Design of a Self-Aligning Four-Finger Exoskeleton for Finger Abduction/Adduction and Flexion/Extension Motion. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941292 DOI: 10.1109/icorr58425.2023.10304720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
For wearable four-finger exoskeletons, it is still a challenge to design the metacarpophalangeal (MCP)joint abduction/adduction (a/a) kinematic chain and achieve axes self-aligning. This paper proposes a novel exoskeleton for four fingers that features a high degree of dexterity enabling MCP joint flexion/extension (f/e) and a/a motion. Other features of the exoskeleton include a self-aligning mechanism that absorbs misalignment between the exoskeleton and human joints, the ability to accommodate fingers of different sizes, and a compact design that allows simultaneous a/a motion without interference. This paper presents the exoskeleton's kinematic model, optimizes the range of motion (ROM), and length of the exoskeleton linkage using the Genetic Algorithm. We compare the four-finger MCP joint's ROM and fingertip workspace with and without the exoskeleton. Our experiments show that the proposed exoskeleton has no significant impact on the natural ROM of the four-finger MCP joint, enables the fingers to cover an average of 82.96% of the original workspace, and can reach a significant portion of the fingertip workspace.
Collapse
|
15
|
Bates M, Sunderam S. Hand-worn devices for assessment and rehabilitation of motor function and their potential use in BCI protocols: a review. Front Hum Neurosci 2023; 17:1121481. [PMID: 37484920 PMCID: PMC10357516 DOI: 10.3389/fnhum.2023.1121481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2022] [Accepted: 06/01/2023] [Indexed: 07/25/2023] Open
Abstract
Introduction Various neurological conditions can impair hand function. Affected individuals cannot fully participate in activities of daily living due to the lack of fine motor control. Neurorehabilitation emphasizes repetitive movement and subjective clinical assessments that require clinical experience to administer. Methods Here, we perform a review of literature focused on the use of hand-worn devices for rehabilitation and assessment of hand function. We paid particular attention to protocols that involve brain-computer interfaces (BCIs) since BCIs are gaining ground as a means for detecting volitional signals as the basis for interactive motor training protocols to augment recovery. All devices reviewed either monitor, assist, stimulate, or support hand and finger movement. Results A majority of studies reviewed here test or validate devices through clinical trials, especially for stroke. Even though sensor gloves are the most commonly employed type of device in this domain, they have certain limitations. Many such gloves use bend or inertial sensors to monitor the movement of individual digits, but few monitor both movement and applied pressure. The use of such devices in BCI protocols is also uncommon. Discussion We conclude that hand-worn devices that monitor both flexion and grip will benefit both clinical diagnostic assessment of function during treatment and closed-loop BCI protocols aimed at rehabilitation.
Collapse
|
16
|
Shou YZ, Wang XH, Yang GF. Verum versus Sham brain-computer interface on upper limb function recovery after stroke: A systematic review and meta-analysis of randomized controlled trials. Medicine (Baltimore) 2023; 102:e34148. [PMID: 37390271 PMCID: PMC10313240 DOI: 10.1097/md.0000000000034148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 06/08/2023] [Indexed: 07/02/2023] Open
Abstract
BACKGROUND Previous clinical trials have reported that the brain-computer interface (BCI) is a useful management tool for upper limb function recovery (ULFR) in stroke. However, there is insufficient evidence regarding this topic. Thus, this study aimed to investigate the effectiveness of verum versus sham BCI on the ULFR in stroke patients. METHODS We comprehensively searched the Cochrane Library, PUBMED, EMBASE, Web of Science, and China National Knowledge Infrastructure databases from their inception to January 1, 2023. Randomized clinical trials (RCTs) assessing the effectiveness and safety of BCI for ULFR after stroke were included. The outcomes were the Fugl-Meyer Assessment for Upper Extremity, Wolf Motor Function Test, Modified Barthel Index, motor activity log, and Action Research Arm Test. The methodological quality of all the included randomized controlled trials was evaluated using the Cochrane risk-of-bias tool. Statistical analysis was performed using RevMan 5.4 software. RESULTS Eleven eligible studies involving 334 patients were included. The results of the meta-analysis showed significant differences in the Fugl-Meyer Assessment for Upper Extremity (mean difference [MD] = 4.78, 95% confidence interval [CI] [1.90, 7.65], I2 = 0%, P = .001) and Modified Barthel Index (MD = 7.37, 95% CI [1.89, 12.84], I2 = 19%, P = .008). However, no significant differences were found on motor activity log (MD = -0.70, 95% CI [-3.17, 1.77]), Action Research Arm Test (MD = 3.05, 95% CI [-8.33, 14.44], I2 = 0%, P = .60), and Wolf Motor Function Test (MD = 4.23, 95% CI [-0.55, 9.01], P = .08). CONCLUSION BCI may be an effective management strategy for ULFR in stroke patients. Future studies with larger sample size and strict design are still needed to warrant the current findings.
Collapse
Affiliation(s)
- Yi-zhou Shou
- Department of Rehabilitation, Tongde Hospital of Zhejiang Province, Hangzhou, China
| | - Xin-hua Wang
- Department of Tuina, The Second Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Gui-fen Yang
- Department of Rehabilitation, Tongde Hospital of Zhejiang Province, Hangzhou, China
| |
Collapse
|
17
|
Arpaia P, Coyle D, Esposito A, Natalizio A, Parvis M, Pesola M, Vallefuoco E. Paving the Way for Motor Imagery-Based Tele-Rehabilitation through a Fully Wearable BCI System. SENSORS (BASEL, SWITZERLAND) 2023; 23:5836. [PMID: 37447686 DOI: 10.3390/s23135836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 06/08/2023] [Accepted: 06/20/2023] [Indexed: 07/15/2023]
Abstract
The present study introduces a brain-computer interface designed and prototyped to be wearable and usable in daily life. Eight dry electroencephalographic sensors were adopted to acquire the brain activity associated with motor imagery. Multimodal feedback in extended reality was exploited to improve the online detection of neurological phenomena. Twenty-seven healthy subjects used the proposed system in five sessions to investigate the effects of feedback on motor imagery. The sample was divided into two equal-sized groups: a "neurofeedback" group, which performed motor imagery while receiving feedback, and a "control" group, which performed motor imagery with no feedback. Questionnaires were administered to participants aiming to investigate the usability of the proposed system and an individual's ability to imagine movements. The highest mean classification accuracy across the subjects of the control group was about 62% with 3% associated type A uncertainty, and it was 69% with 3% uncertainty for the neurofeedback group. Moreover, the results in some cases were significantly higher for the neurofeedback group. The perceived usability by all participants was high. Overall, the study aimed at highlighting the advantages and the pitfalls of using a wearable brain-computer interface with dry sensors. Notably, this technology can be adopted for safe and economically viable tele-rehabilitation.
Collapse
Affiliation(s)
- Pasquale Arpaia
- Department of Electrical Engineering and Information Technology (DIETI), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
- Centro Interdipartimentale di Ricerca in Management Sanitario e Innovazione in Sanità (CIRMIS), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
| | - Damien Coyle
- Institute for the Augmented Human, University of Bath, Bath BA2 7AY, UK
- Intelligent Systems Research Centre, University of Ulster, Derry BT48 7JL, UK
| | - Antonio Esposito
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
| | - Angela Natalizio
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, 10129 Turin, Italy
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, 10129 Turin, Italy
| | - Marisa Pesola
- Department of Electrical Engineering and Information Technology (DIETI), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
| | - Ersilia Vallefuoco
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università Degli Studi di Napoli Federico II, 80125 Naples, Italy
- Department of Psychology and Cognitive Science, University of Trento, 38122 Rovereto, Italy
| |
Collapse
|
18
|
Ma ZZ, Wu JJ, Hua XY, Zheng MX, Xing XX, Ma J, Shan CL, Xu JG. Evidence of neuroplasticity with brain-computer interface in a randomized trial for post-stroke rehabilitation: a graph-theoretic study of subnetwork analysis. Front Neurol 2023; 14:1135466. [PMID: 37346164 PMCID: PMC10281191 DOI: 10.3389/fneur.2023.1135466] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 05/03/2023] [Indexed: 06/23/2023] Open
Abstract
Background Brain-computer interface (BCI) has been widely used for functional recovery after stroke. Understanding the brain mechanisms following BCI intervention to optimize BCI strategies is crucial for the benefit of stroke patients. Methods Forty-six patients with upper limb motor dysfunction after stroke were recruited and randomly divided into the control group or the BCI group. The primary outcome was measured by the assessment of Fugl-Meyer Assessment of Upper Extremity (FMA-UE). Meanwhile, we performed resting-state functional magnetic resonance imaging (rs-fMRI) in all patients, followed by independent component analysis (ICA) to identify functionally connected brain networks. Finally, we assessed the topological efficiency of both groups using graph-theoretic analysis in these brain subnetworks. Results The FMA-UE score of the BCI group was significantly higher than that of the control group after treatment (p = 0.035). From the network topology analysis, we first identified seven subnetworks from the rs-fMRI data. In the following analysis of subnetwork properties, small-world properties including γ (p = 0.035) and σ (p = 0.031) within the visual network (VN) decreased in the BCI group. For the analysis of the dorsal attention network (DAN), significant differences were found in assortativity (p = 0.045) between the groups. Additionally, the improvement in FMA-UE was positively correlated with the assortativity of the dorsal attention network (R = 0.498, p = 0.011). Conclusion Brain-computer interface can promote the recovery of upper limbs after stroke by regulating VN and DAN. The correlation trend of weak intensity proves that functional recovery in stroke patients is likely to be related to the brain's visuospatial processing ability, which can be used to optimize BCI strategies. Clinical Trial Registration The trial is registered in the Chinese Clinical Trial Registry, number ChiCTR2000034848. Registered 21 July 2020.
Collapse
Affiliation(s)
- Zhen-Zhen Ma
- Department of Rehabilitation Medicine, Longhua Hospital, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
| | - Jia-Jia Wu
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Xu-Yun Hua
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Trauma and Orthopedics, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Mou-Xiong Zheng
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Trauma and Orthopedics, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Xiang-Xin Xing
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Jie Ma
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Chun-Lei Shan
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Jian-Guang Xu
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China
- Engineering Research Center of Traditional Chinese Medicine Intelligent RehabilitationMinistry of Education, Shanghai, China
- Department of Rehabilitation Medicine, Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| |
Collapse
|
19
|
Wang P, Cao X, Zhou Y, Gong P, Yousefnezhad M, Shao W, Zhang D. A comprehensive review on motion trajectory reconstruction for EEG-based brain-computer interface. Front Neurosci 2023; 17:1086472. [PMID: 37332859 PMCID: PMC10272365 DOI: 10.3389/fnins.2023.1086472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 05/03/2023] [Indexed: 06/20/2023] Open
Abstract
The advance in neuroscience and computer technology over the past decades have made brain-computer interface (BCI) a most promising area of neurorehabilitation and neurophysiology research. Limb motion decoding has gradually become a hot topic in the field of BCI. Decoding neural activity related to limb movement trajectory is considered to be of great help to the development of assistive and rehabilitation strategies for motor-impaired users. Although a variety of decoding methods have been proposed for limb trajectory reconstruction, there does not yet exist a review that covers the performance evaluation of these decoding methods. To alleviate this vacancy, in this paper, we evaluate EEG-based limb trajectory decoding methods regarding their advantages and disadvantages from a variety of perspectives. Specifically, we first introduce the differences in motor execution and motor imagery in limb trajectory reconstruction with different spaces (2D and 3D). Then, we discuss the limb motion trajectory reconstruction methods including experiment paradigm, EEG pre-processing, feature extraction and selection, decoding methods, and result evaluation. Finally, we expound on the open problem and future outlooks.
Collapse
Affiliation(s)
| | | | | | | | | | - Wei Shao
- *Correspondence: Wei Shao, ; Daoqiang Zhang,
| | | |
Collapse
|
20
|
Li M, Chen J, He B, He G, Zhao CG, Yuan H, Xie J, Xu G, Li J. Stimulation enhancement effect of the combination of exoskeleton-assisted hand rehabilitation and fingertip haptic stimulation. Front Neurosci 2023; 17:1149265. [PMID: 37287795 PMCID: PMC10242052 DOI: 10.3389/fnins.2023.1149265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Accepted: 05/03/2023] [Indexed: 06/09/2023] Open
Abstract
Introduction Providing stimulation enhancements to existing hand rehabilitation training methods may help stroke survivors achieve better treatment outcomes. This paper presents a comparison study to explore the stimulation enhancement effects of the combination of exoskeleton-assisted hand rehabilitation and fingertip haptic stimulation by analyzing behavioral data and event-related potentials. Methods The stimulation effects of the touch sensations created by a water bottle and that created by cutaneous fingertip stimulation with pneumatic actuators are also investigated. Fingertip haptic stimulation was combined with exoskeleton-assisted hand rehabilitation while the haptic stimulation was synchronized with the motion of our hand exoskeleton. In the experiments, three experimental modes, including exoskeleton-assisted grasping motion without haptic stimulation (Mode 1), exoskeleton-assisted grasping motion with haptic stimulation (Mode 2), and exoskeleton-assisted grasping motion with a water bottle (Mode 3), were compared. Results The behavioral analysis results showed that the change of experimental modes had no significant effect on the recognition accuracy of stimulation levels (p = 0.658), while regarding the response time, exoskeleton-assisted grasping motion with haptic stimulation was the same as grasping a water bottle (p = 0.441) but significantly different from that without haptic stimulation (p = 0.006). The analysis of event-related potentials showed that the primary motor cortex, premotor cortex, and primary somatosensory areas of the brain were more activated when both the hand motion assistance and fingertip haptic feedback were provided using our proposed method (P300 amplitude 9.46 μV). Compared to only applying exoskeleton-assisted hand motion, the P300 amplitude was significantly improved by providing both exoskeleton-assisted hand motion and fingertip haptic stimulation (p = 0.006), but no significant differences were found between any other two modes (Mode 2 vs. Mode 3: p = 0.227, Mode 1 vs. Mode 3: p = 0.918). Different modes did not significantly affect the P300 latency (p = 0.102). Stimulation intensity had no effect on the P300 amplitude (p = 0.295, 0.414, 0.867) and latency (p = 0.417, 0.197, 0.607). Discussion Thus, we conclude that combining exoskeleton-assisted hand motion and fingertip haptic stimulation provided stronger stimulation on the motor cortex and somatosensory cortex of the brain simultaneously; the stimulation effects of the touch sensations created by a water bottle and that created by cutaneous fingertip stimulation with pneumatic actuators are similar.
Collapse
Affiliation(s)
- Min Li
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Jing Chen
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Bo He
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Guoying He
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Chen-Guang Zhao
- Department of Rehabilitation, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Hua Yuan
- Department of Rehabilitation, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Jun Xie
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Guanghua Xu
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Jichun Li
- School of Computing, Newcastle University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|
21
|
Fu J, Chen S, Shu X, Lin Y, Jiang Z, Wei D, Gao J, Jia J. Functional-oriented, portable brain-computer interface training for hand motor recovery after stroke: a randomized controlled study. Front Neurosci 2023; 17:1146146. [PMID: 37250399 PMCID: PMC10213744 DOI: 10.3389/fnins.2023.1146146] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 04/07/2023] [Indexed: 05/31/2023] Open
Abstract
Background Brain-computer interfaces (BCIs) have been proven to be effective for hand motor recovery after stroke. Facing kinds of dysfunction of the paretic hand, the motor task of BCIs for hand rehabilitation is relatively single, and the operation of many BCI devices is complex for clinical use. Therefore, we proposed a functional-oriented, portable BCI equipment and explored the efficiency of hand motor recovery after a stroke. Materials and methods Stroke patients were randomly assigned to the BCI group and the control group. The BCI group received BCI-based grasp/open motor training, while the control group received task-oriented guidance training. Both groups received 20 sessions of motor training in 4 weeks, and each session lasted for 30 min. The Fugl-Meyer assessment of the upper limb (FMA-UE) was applied for the assessment of rehabilitation outcomes, and the EEG signals were obtained for processing. Results The progress of FMA-UE between the BCI group [10.50 (5.75, 16.50)] and the control group [5.00 (4.00, 8.00)] was significantly different (Z = -2.834, P = 0.005). Meanwhile, the FMA-UE of both groups improved significantly (P < 0.001). A total of 24 patients in the BCI group achieved the minimal clinically important difference (MCID) of FMA-UE with an effective rate of 80%, and 16 in the control group achieved the MCID, with an effective rate of 51.6%. The lateral index of the open task in the BCI group was significantly decreased (Z = -2.704, P = 0.007). The average BCI accuracy for 24 stroke patients in 20 sessions was 70.7%, which was improved by 5.0% in the final session compared with the first session. Conclusion Targeted hand movement and two motor task modes, namely grasp and open, to be applied in a BCI design may be suitable in stroke patients with hand dysfunction. The functional-oriented, portable BCI training can promote hand recovery after a stroke, and it is expected to be widely used in clinical practice. The lateral index change of inter-hemispheric balance may be the mechanism of motor recovery. Trial registration number ChiCTR2100044492.
Collapse
Affiliation(s)
- Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yifang Lin
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Zewu Jiang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Dongshuai Wei
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
| | - Jiajia Gao
- Department of Rehabilitation Medicine, Shanghai No. 3 Rehabilitation Hospital, Shanghai, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China
- National Center for Neurological Disorders, Huashan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
22
|
Fu J, Jiang Z, Shu X, Chen S, Jia J. Correlation between the ERD in grasp/open tasks of BCIs and hand function of stroke patients: a cross-sectional study. Biomed Eng Online 2023; 22:36. [PMID: 37061673 PMCID: PMC10105926 DOI: 10.1186/s12938-023-01091-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 03/02/2023] [Indexed: 04/17/2023] Open
Abstract
BACKGROUND AND AIMS Brain-computer interfaces (BCIs) are emerging as a promising tool for upper limb recovery after stroke, and motor tasks are an essential part of BCIs for patient training and control of rehabilitative/assistive BCIs. However, the correlation between brain activation with different levels of motor impairment and motor tasks in BCIs is still not so clear. Thus, we aim to compare the brain activation of different levels of motor impairment in performing the hand grasping and opening tasks in BCIs. METHODS We instructed stroke patients to perform motor attempts (MA) to grasp and open the affected hand for 30 trials, respectively. During this period, they underwent EEG acquisition and BCIs accuracy recordings. They also received detailed history records and behavioral scale assessments (the Fugl-Meyer assessment of upper limb, FMA-UE). RESULTS The FMA-UE was negatively correlated with the event-related desynchronization (ERD) of the affected hemisphere during open MA (R = - 0.423, P = 0.009) but not with grasp MA (R = - 0.058, P = 0.733). Then we divided the stroke patients into group 1 (Brunnstrom recovery stages between I to II, n = 19) and group 2 (Brunnstrom recovery stages between III to VI, n = 23). No difference during the grasping task (t = 0.091, P = 0.928), but a significant difference during the open task (t = 2.156, P = 0.037) was found between the two groups on the affected hemisphere. No significant difference was found in the unaffected hemisphere. CONCLUSIONS The study indicated that brain activation is positively correlated with the hand function of stroke in open-hand tasks. In the grasping task, the patients in the different groups have a similar brain response, while in the open task, mildly injured patients have more brain activation in open the hand than the poor hand function patients.
Collapse
Affiliation(s)
- Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China
| | - ZeWu Jiang
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China
| | - Xiaokang Shu
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China.
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, 12 Mid-Wulumuqi Road, Jing'an District, Shanghai, 200040, China.
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai, China.
- National Center for Neurological Disorders, Shanghai, China.
| |
Collapse
|
23
|
Sheng B, Zhao J, Zhang Y, Xie S, Tao J. Commercial device-based hand rehabilitation systems for stroke patients: State of the art and future prospects. Heliyon 2023; 9:e13588. [PMID: 36873497 PMCID: PMC9982629 DOI: 10.1016/j.heliyon.2023.e13588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 01/26/2023] [Accepted: 02/03/2023] [Indexed: 02/12/2023] Open
Abstract
Various hand rehabilitation systems have recently been developed for stroke patients, particularly commercial devices. Articles from 10 electronic databases from 2010 to 2022 were extracted to conduct a systematic review to explore the existing commercial training systems (hardware and software) and evaluate their clinical effectiveness. This review divided the rehabilitation equipment into contact and non-contact types. Game-based training protocols were further classified into two types: immersion and non-immersion. The results of the review indicated that the majority of the devices included were effective in improving hand function. Users who underwent rehabilitation training with these devices reported improvements in their hand function. Game-based training protocols were particularly appealing as they helped reduce boredom during rehabilitation training sessions. However, the review also identified some common technical drawbacks in the devices, particularly in non-contact devices, such as their vulnerability to the effects of light. Additionally, it was found that currently, there is no commercially available game-based training protocol that specifically targets hand rehabilitation. Given the ongoing COVID-19 pandemic, there is a need to develop safer non-contact rehabilitation equipment and more engaging training protocols for community and home-based rehabilitation. Additionally, the review suggests the need for revisions or the development of new clinical scales for hand rehabilitation evaluation that consider the current scenario, where in-person interactions might be limited.
Collapse
Affiliation(s)
- Bo Sheng
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan, Shanghai, China
| | - Jianyu Zhao
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan, Shanghai, China
| | - Yanxin Zhang
- Department of Exercise Sciences, The University of Auckland, 4703906, Newmarket, Auckland, New Zealand
| | - Shengquan Xie
- School of Electronic and Electrical Engineering, University of Leeds, 3 LS2 9JT, Leeds, United Kingdom
| | - Jing Tao
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan, Shanghai, China
| |
Collapse
|
24
|
Upper Limb Function Recovery by Combined Repetitive Transcranial Magnetic Stimulation and Occupational Therapy in Patients with Chronic Stroke According to Paralysis Severity. Brain Sci 2023; 13:brainsci13020284. [PMID: 36831827 PMCID: PMC9953939 DOI: 10.3390/brainsci13020284] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 02/01/2023] [Accepted: 02/03/2023] [Indexed: 02/10/2023] Open
Abstract
Repetitive transcranial magnetic stimulation (rTMS) with intensive occupational therapy improves upper limb motor paralysis and activities of daily living after stroke; however, the degree of improvement according to paralysis severity remains unverified. Target activities of daily living using upper limb functions can be established by predicting the amount of change after treatment for each paralysis severity level to further aid practice planning. We estimated post-treatment score changes for each severity level of motor paralysis (no, poor, limited, notable, and full), stratified according to Action Research Arm Test (ARAT) scores before combined rTMS and intensive occupational therapy. Motor paralysis severity was the fixed factor for the analysis of covariance; the delta (post-pre) of the scores was the dependent variable. Ordinal logistic regression analysis was used to compare changes in ARAT subscores according to paralysis severity before treatment. We implemented a longitudinal, prospective, interventional, uncontrolled, and multicenter cohort design and analyzed a dataset of 907 patients with stroke hemiplegia. The largest treatment-related changes were observed in the Limited recovery group for upper limb motor paralysis and the Full recovery group for quality-of-life activities using the paralyzed upper limb. These results will help predict treatment effects and determine exercises and goal movements for occupational therapy after rTMS.
Collapse
|
25
|
Wen L, Xu J, Li D, Pei X, Wang J. Continuous estimation of upper limb joint angle from sEMG based on multiple decomposition feature and BiLSTM network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104303] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
26
|
Identifying Thematics in a Brain-Computer Interface Research. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:2793211. [PMID: 36643889 PMCID: PMC9833923 DOI: 10.1155/2023/2793211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/21/2022] [Accepted: 12/24/2022] [Indexed: 01/05/2023]
Abstract
This umbrella review is motivated to understand the shift in research themes on brain-computer interfacing (BCI) and it determined that a shift away from themes that focus on medical advancement and system development to applications that included education, marketing, gaming, safety, and security has occurred. The background of this review examined aspects of BCI categorisation, neuroimaging methods, brain control signal classification, applications, and ethics. The specific area of BCI software and hardware development was not examined. A search using One Search was undertaken and 92 BCI reviews were selected for inclusion. Publication demographics indicate the average number of authors on review papers considered was 4.2 ± 1.8. The results also indicate a rapid increase in the number of BCI reviews from 2003, with only three reviews before that period, two in 1972, and one in 1996. While BCI authors were predominantly Euro-American in early reviews, this shifted to a more global authorship, which China dominated by 2020-2022. The review revealed six disciplines associated with BCI systems: life sciences and biomedicine (n = 42), neurosciences and neurology (n = 35), and rehabilitation (n = 20); (2) the second domain centred on the theme of functionality: computer science (n = 20), engineering (n = 28) and technology (n = 38). There was a thematic shift from understanding brain function and modes of interfacing BCI systems to more applied research novel areas of research-identified surround artificial intelligence, including machine learning, pre-processing, and deep learning. As BCI systems become more invasive in the lives of "normal" individuals, it is expected that there will be a refocus and thematic shift towards increased research into ethical issues and the need for legal oversight in BCI application.
Collapse
|
27
|
Das T, Gohain L, Kakoty NM, Malarvili MB, Widiyanti P, Kumar G. Hierarchical Approach for Fusion of Electroencephalography and Electromyography for Predicting Finger Movements and Kinematics using Deep Learning. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2023.01.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
|
28
|
Penev YP, Beneke A, Root KT, Meisel E, Kwak S, Diaz MJ, Root JL, Hosseini MR, Lucke-Wold B. Therapeutic Effectiveness of Brain Computer Interfaces in Stroke Patients: A Systematic Review. JOURNAL OF EXPERIMENTAL NEUROLOGY 2023; 4:87-93. [PMID: 37799298 PMCID: PMC10552326 DOI: 10.33696/neurol.4.077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
Background Brain-computer interfaces (BCIs) are a rapidly advancing field which utilizes brain activity to control external devices for a myriad of functions, including the restoration of motor function. Clinically, BCIs have been especially impactful in patients who suffer from stroke-mediated damage. However, due to the rapid advancement in the field, there is a lack of accepted standards of practice. Therefore, the aim of this systematic review is to summarize the current literature published regarding the efficacy of BCI-based rehabilitation of motor dysfunction in stroke patients. Methodology This systematic review was performed in accordance with the guidelines set forth by the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) 2020 statement. PubMed, Embase, and Cochrane Library were queried for relevant articles and screened for inclusion criteria by two authors. All discrepancies were resolved by discussion among both reviewers and subsequent consensus. Results 11/12 (91.6%) of studies focused on upper extremity outcomes and reported larger initial improvements for participants in the treatment arm (using BCI) as compared to those in the control arm (no BCI). 2/2 studies focused on lower extremity outcomes reported improvements for the treatment arm compared to the control arm. Discussion/Conclusion This systematic review illustrates the utility BCI has for the restoration of upper extremity and lower extremity motor function in stroke patients and supports further investigation of BCI for other clinical indications.
Collapse
Affiliation(s)
- Yordan P. Penev
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Alice Beneke
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Kevin T. Root
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Emily Meisel
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Sean Kwak
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | - Michael J. Diaz
- ICollege of Medicine, University of Florida, Gainesville, Florida, USA
| | | | | | - Brandon Lucke-Wold
- Department of Neurosurgery, University of Florida, Gainesville, Florida, USA
| |
Collapse
|
29
|
Fu J, Chen S, Jia J. Sensorimotor Rhythm-Based Brain-Computer Interfaces for Motor Tasks Used in Hand Upper Extremity Rehabilitation after Stroke: A Systematic Review. Brain Sci 2022; 13:brainsci13010056. [PMID: 36672038 PMCID: PMC9856697 DOI: 10.3390/brainsci13010056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 12/05/2022] [Accepted: 12/25/2022] [Indexed: 12/29/2022] Open
Abstract
Brain-computer interfaces (BCIs) are becoming more popular in the neurological rehabilitation field, and sensorimotor rhythm (SMR) is a type of brain oscillation rhythm that can be captured and analyzed in BCIs. Previous reviews have testified to the efficacy of the BCIs, but seldom have they discussed the motor task adopted in BCIs experiments in detail, as well as whether the feedback is suitable for them. We focused on the motor tasks adopted in SMR-based BCIs, as well as the corresponding feedback, and searched articles in PubMed, Embase, Cochrane library, Web of Science, and Scopus and found 442 articles. After a series of screenings, 15 randomized controlled studies were eligible for analysis. We found motor imagery (MI) or motor attempt (MA) are common experimental paradigms in EEG-based BCIs trials. Imagining/attempting to grasp and extend the fingers is the most common, and there were multi-joint movements, including wrist, elbow, and shoulder. There were various types of feedback in MI or MA tasks for hand grasping and extension. Proprioception was used more frequently in a variety of forms. Orthosis, robot, exoskeleton, and functional electrical stimulation can assist the paretic limb movement, and visual feedback can be used as primary feedback or combined forms. However, during the recovery process, there are many bottleneck problems for hand recovery, such as flaccid paralysis or opening the fingers. In practice, we should mainly focus on patients' difficulties, and design one or more motor tasks for patients, with the assistance of the robot, FES, or other combined feedback, to help them to complete a grasp, finger extension, thumb opposition, or other motion. Future research should focus on neurophysiological changes and functional improvements and further elaboration on the changes in neurophysiology during the recovery of motor function.
Collapse
Affiliation(s)
- Jianghong Fu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Shugeng Chen
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Jie Jia
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, Shanghai 200040, China
- National Clinical Research Center for Aging and Medicine, Huashan Hospital, Fudan University, Shanghai 200040, China
- National Center for Neurological Disorders, Shanghai 200040, China
- Correspondence: ; Tel./Fax: +86-021-5288-7820
| |
Collapse
|
30
|
Van Caenegem EE, Hamoline G, Waltzing BM, Hardwick RM. Consistent under-reporting of task details in motor imagery research. Neuropsychologia 2022; 177:108425. [PMID: 36400244 DOI: 10.1016/j.neuropsychologia.2022.108425] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 11/15/2022] [Accepted: 11/15/2022] [Indexed: 11/17/2022]
Abstract
Motor Imagery is a subject of longstanding scientific interest. However, critical details of motor imagery protocols are not always reported in full, hampering direct replication and translation of this work. The present review provides a quantitative assessment of the prevalence of under-reporting in the recent motor imagery literature. Publications from the years 2018-2020 were examined, with 695 meeting the inclusion criteria for further examination. Of these studies, 64% (445/695) did not provide information about the modality of motor imagery (i.e., kinesthetic, visual, or a mixture of both) used in the study. When visual or mixed imagery was specified, the details of the visual perspective to be used (i.e., first person, third person, or combinations of both) were not reported in 24% (25/103) of studies. Further analysis indicated that studies using questionnaires to assess motor imagery reported more information than those that did not. We conclude that studies using motor imagery consistently under-report key details of their protocols, which poses a significant problem for understanding, replicating, and translating motor imagery effects.
Collapse
Affiliation(s)
- Elise E Van Caenegem
- Institute of Neurosciences, UC Louvain, Belgium Avenue Mounier 54, 1200, Bruxelles, Belgium.
| | - Gautier Hamoline
- Institute of Neurosciences, UC Louvain, Belgium Avenue Mounier 54, 1200, Bruxelles, Belgium
| | - Baptiste M Waltzing
- Institute of Neurosciences, UC Louvain, Belgium Avenue Mounier 54, 1200, Bruxelles, Belgium
| | - Robert M Hardwick
- Institute of Neurosciences, UC Louvain, Belgium Avenue Mounier 54, 1200, Bruxelles, Belgium
| |
Collapse
|
31
|
Saichoo T, Boonbrahm P, Punsawad Y. Investigating User Proficiency of Motor Imagery for EEG-Based BCI System to Control Simulated Wheelchair. SENSORS (BASEL, SWITZERLAND) 2022; 22:9788. [PMID: 36560158 PMCID: PMC9781917 DOI: 10.3390/s22249788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 12/01/2022] [Accepted: 12/12/2022] [Indexed: 06/17/2023]
Abstract
The research on the electroencephalography (EEG)-based brain-computer interface (BCI) is widely utilized for wheelchair control. The ability of the user is one factor of BCI efficiency. Therefore, we focused on BCI tasks and protocols to yield high efficiency from the robust EEG features of individual users. This study proposes a task-based brain activity to gain the power of the alpha band, which included eyes closed for alpha response at the occipital area, attention to an upward arrow for alpha response at the frontal area, and an imagined left/right motor for alpha event-related desynchronization at the left/right motor cortex. An EPOC X neuroheadset was used to acquire the EEG signals. We also proposed user proficiency in motor imagery sessions with limb movement paradigms by recommending motor imagination tasks. Using the proposed system, we verified the feature extraction algorithms and command translation. Twelve volunteers participated in the experiment, and the conventional paradigm of motor imagery was used to compare the efficiencies. With utilized user proficiency in motor imagery, an average accuracy of 83.7% across the left and right commands was achieved. The recommended MI paradigm via user proficiency achieved an approximately 4% higher accuracy than the conventional MI paradigm. Moreover, the real-time control results of a simulated wheelchair revealed a high efficiency based on the time condition. The time results for the same task as the joystick-based control were still approximately three times longer. We suggest that user proficiency be used to recommend an individual MI paradigm for beginners. Furthermore, the proposed BCI system can be used for electric wheelchair control by people with severe disabilities.
Collapse
Affiliation(s)
- Theerat Saichoo
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
| | - Poonpong Boonbrahm
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
| | - Yunyong Punsawad
- School of Informatics, Walailak University, Nakhon Si Thammarat 80160, Thailand
- Informatics Innovative Center of Excellence, Walailak University, Nakhon Si Thammarat 80160, Thailand
| |
Collapse
|
32
|
A Review of Brain Activity and EEG-Based Brain-Computer Interfaces for Rehabilitation Application. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 9:bioengineering9120768. [PMID: 36550974 PMCID: PMC9774292 DOI: 10.3390/bioengineering9120768] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/12/2022]
Abstract
Patients with severe CNS injuries struggle primarily with their sensorimotor function and communication with the outside world. There is an urgent need for advanced neural rehabilitation and intelligent interaction technology to provide help for patients with nerve injuries. Recent studies have established the brain-computer interface (BCI) in order to provide patients with appropriate interaction methods or more intelligent rehabilitation training. This paper reviews the most recent research on brain-computer-interface-based non-invasive rehabilitation systems. Various endogenous and exogenous methods, advantages, limitations, and challenges are discussed and proposed. In addition, the paper discusses the communication between the various brain-computer interface modes used between severely paralyzed and locked patients and the surrounding environment, particularly the brain-computer interaction system utilizing exogenous (induced) EEG signals (such as P300 and SSVEP). This discussion reveals with an examination of the interface for collecting EEG signals, EEG components, and signal postprocessing. Furthermore, the paper describes the development of natural interaction strategies, with a focus on signal acquisition, data processing, pattern recognition algorithms, and control techniques.
Collapse
|
33
|
Bibliometric analysis on Brain-computer interfaces in a 30-year period. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04226-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
34
|
Behboodi A, Lee WA, Hinchberger VS, Damiano DL. Determining optimal mobile neurofeedback methods for motor neurorehabilitation in children and adults with non-progressive neurological disorders: a scoping review. J Neuroeng Rehabil 2022; 19:104. [PMID: 36171602 PMCID: PMC9516814 DOI: 10.1186/s12984-022-01081-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Accepted: 09/08/2022] [Indexed: 11/22/2022] Open
Abstract
Background Brain–computer interfaces (BCI), initially designed to bypass the peripheral motor system to externally control movement using brain signals, are additionally being utilized for motor rehabilitation in stroke and other neurological disorders. Also called neurofeedback training, multiple approaches have been developed to link motor-related cortical signals to assistive robotic or electrical stimulation devices during active motor training with variable, but mostly positive, functional outcomes reported. Our specific research question for this scoping review was: for persons with non-progressive neurological injuries who have the potential to improve voluntary motor control, which mobile BCI-based neurofeedback methods demonstrate or are associated with improved motor outcomes for Neurorehabilitation applications? Methods We searched PubMed, Web of Science, and Scopus databases with all steps from study selection to data extraction performed independently by at least 2 individuals. Search terms included: brain machine or computer interfaces, neurofeedback and motor; however, only studies requiring a motor attempt, versus motor imagery, were retained. Data extraction included participant characteristics, study design details and motor outcomes. Results From 5109 papers, 139 full texts were reviewed with 23 unique studies identified. All utilized EEG and, except for one, were on the stroke population. The most commonly reported functional outcomes were the Fugl-Meyer Assessment (FMA; n = 13) and the Action Research Arm Test (ARAT; n = 6) which were then utilized to assess effectiveness, evaluate design features, and correlate with training doses. Statistically and functionally significant pre-to post training changes were seen in FMA, but not ARAT. Results did not differ between robotic and electrical stimulation feedback paradigms. Notably, FMA outcomes were positively correlated with training dose. Conclusion This review on BCI-based neurofeedback training confirms previous findings of effectiveness in improving motor outcomes with some evidence of enhanced neuroplasticity in adults with stroke. Associative learning paradigms have emerged more recently which may be particularly feasible and effective methods for Neurorehabilitation. More clinical trials in pediatric and adult neurorehabilitation to refine methods and doses and to compare to other evidence-based training strategies are warranted.
Collapse
Affiliation(s)
- Ahad Behboodi
- Rehabilitation Medicine Department, National Institutes of Health, Bethesda, MD, USA
| | - Walker A Lee
- Rehabilitation Medicine Department, National Institutes of Health, Bethesda, MD, USA
| | | | - Diane L Damiano
- Rehabilitation Medicine Department, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
35
|
Zhang Y, Liu X, Qiao X, Fan Y. Characteristics and Emerging Trends in Research on rehabilitation robots (2001-2020): A Bibliometric Study (Preprint). J Med Internet Res 2022; 25:e42901. [DOI: 10.2196/42901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 02/19/2023] [Accepted: 02/25/2023] [Indexed: 02/27/2023] Open
|
36
|
Wei Y, Li J, Ji H, Jin L, Liu L, Bai Z, Ye C. A Semi-Supervised Progressive Learning Algorithm for Brain-Computer Interface. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2067-2076. [PMID: 35853068 DOI: 10.1109/tnsre.2022.3192448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Brain-computer interface (BCI) usually suffers from the problem of low recognition accuracy and large calibration time, especially when identifying motor imagery tasks for subjects with indistinct features and classifying fine grained motion control tasks by electroencephalogram (EEG)-electromyogram (EMG) fusion analysis. To fill the research gap, this paper presents an end-to-end semi-supervised learning framework for EEG classification and EEG-EMG fusion analysis. Benefiting from the proposed metric learning based label estimation strategy, sampling criterion and progressive learning scheme, the proposed framework efficiently extracts distinctive feature embedding from the unlabeled EEG samples and achieves a 5.40% improvement on BCI Competition IV Dataset IIa with 80% unlabeled samples and an average 3.35% improvement on two public BCI datasets. By employing synchronous EMG features as pseudo labels for the unlabeled EEG samples, the proposed framework further extracts deep level features of the synergistic complementarity between the EEG signals and EMG features based on the deep encoders, which improves the performance of hybrid BCI (with a 5.53% improvement for the Upper Limb Motion Dataset and an average 4.34% improvement on two hybrid datasets). Moreover, the ablation experiments show that the proposed framework can substantially improve the performance of the deep encoders (with an average 5.53% improvement). The proposed framework not only largely improves the performance of deep networks in the BCI system, but also significantly reduces the calibration time for EEG-EMG fusion analysis, which shows great potential for building an efficient and high-performance hybrid BCI for the motor rehabilitation process.
Collapse
|
37
|
Le Franc S, Herrera Altamira G, Guillen M, Butet S, Fleck S, Lécuyer A, Bougrain L, Bonan I. Toward an Adapted Neurofeedback for Post-stroke Motor Rehabilitation: State of the Art and Perspectives. Front Hum Neurosci 2022; 16:917909. [PMID: 35911589 PMCID: PMC9332194 DOI: 10.3389/fnhum.2022.917909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 06/20/2022] [Indexed: 11/28/2022] Open
Abstract
Stroke is a severe health issue, and motor recovery after stroke remains an important challenge in the rehabilitation field. Neurofeedback (NFB), as part of a brain–computer interface, is a technique for modulating brain activity using on-line feedback that has proved to be useful in motor rehabilitation for the chronic stroke population in addition to traditional therapies. Nevertheless, its use and applications in the field still leave unresolved questions. The brain pathophysiological mechanisms after stroke remain partly unknown, and the possibilities for intervention on these mechanisms to promote cerebral plasticity are limited in clinical practice. In NFB motor rehabilitation, the aim is to adapt the therapy to the patient’s clinical context using brain imaging, considering the time after stroke, the localization of brain lesions, and their clinical impact, while taking into account currently used biomarkers and technical limitations. These modern techniques also allow a better understanding of the physiopathology and neuroplasticity of the brain after stroke. We conducted a narrative literature review of studies using NFB for post-stroke motor rehabilitation. The main goal was to decompose all the elements that can be modified in NFB therapies, which can lead to their adaptation according to the patient’s context and according to the current technological limits. Adaptation and individualization of care could derive from this analysis to better meet the patients’ needs. We focused on and highlighted the various clinical and technological components considering the most recent experiments. The second goal was to propose general recommendations and enhance the limits and perspectives to improve our general knowledge in the field and allow clinical applications. We highlighted the multidisciplinary approach of this work by combining engineering abilities and medical experience. Engineering development is essential for the available technological tools and aims to increase neuroscience knowledge in the NFB topic. This technological development was born out of the real clinical need to provide complementary therapeutic solutions to a public health problem, considering the actual clinical context of the post-stroke patient and the practical limits resulting from it.
Collapse
Affiliation(s)
- Salomé Le Franc
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
- *Correspondence: Salomé Le Franc,
| | | | - Maud Guillen
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
- Neurology Unit, University Hospital of Rennes, Rennes, France
| | - Simon Butet
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | - Stéphanie Fleck
- Université de Lorraine, CNRS, LORIA, Nancy, France
- EA7312 Laboratoire de Psychologie Ergonomique et Sociale pour l’Expérience Utilisateurs (PERSEUS), Metz, France
| | - Anatole Lécuyer
- Hybrid Team, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| | | | - Isabelle Bonan
- Rehabilitation Medicine Unit, University Hospital of Rennes, Rennes, France
- Empenn Unit U1228, Inserm, Inria, University of Rennes, Irisa, UMR CNRS 6074, Rennes, France
| |
Collapse
|
38
|
Remsik AB, van Kan PLE, Gloe S, Gjini K, Williams L, Nair V, Caldera K, Williams JC, Prabhakaran V. BCI-FES With Multimodal Feedback for Motor Recovery Poststroke. Front Hum Neurosci 2022; 16:725715. [PMID: 35874158 PMCID: PMC9296822 DOI: 10.3389/fnhum.2022.725715] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 05/26/2022] [Indexed: 01/31/2023] Open
Abstract
An increasing number of research teams are investigating the efficacy of brain-computer interface (BCI)-mediated interventions for promoting motor recovery following stroke. A growing body of evidence suggests that of the various BCI designs, most effective are those that deliver functional electrical stimulation (FES) of upper extremity (UE) muscles contingent on movement intent. More specifically, BCI-FES interventions utilize algorithms that isolate motor signals-user-generated intent-to-move neural activity recorded from cerebral cortical motor areas-to drive electrical stimulation of individual muscles or muscle synergies. BCI-FES interventions aim to recover sensorimotor function of an impaired extremity by facilitating and/or inducing long-term motor learning-related neuroplastic changes in appropriate control circuitry. We developed a non-invasive, electroencephalogram (EEG)-based BCI-FES system that delivers closed-loop neural activity-triggered electrical stimulation of targeted distal muscles while providing the user with multimodal sensory feedback. This BCI-FES system consists of three components: (1) EEG acquisition and signal processing to extract real-time volitional and task-dependent neural command signals from cerebral cortical motor areas, (2) FES of muscles of the impaired hand contingent on the motor cortical neural command signals, and (3) multimodal sensory feedback associated with performance of the behavioral task, including visual information, linked activation of somatosensory afferents through intact sensorimotor circuits, and electro-tactile stimulation of the tongue. In this report, we describe device parameters and intervention protocols of our BCI-FES system which, combined with standard physical rehabilitation approaches, has proven efficacious in treating UE motor impairment in stroke survivors, regardless of level of impairment and chronicity.
Collapse
Affiliation(s)
- Alexander B. Remsik
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
- School of Medicine and Public Health, Institute for Clinical and Translational Research, University of Wisconsin–Madison, Madison, WI, United States
- Department of Kinesiology, University of Wisconsin–Madison, Madison, WI, United States
| | - Peter L. E. van Kan
- Department of Kinesiology, University of Wisconsin–Madison, Madison, WI, United States
- Neuroscience Training Program, University of Wisconsin–Madison, Madison, WI, United States
| | - Shawna Gloe
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
| | - Klevest Gjini
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
- Department of Neurology, University of Wisconsin–Madison, Madison, WI, United States
| | - Leroy Williams
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
- Department of Educational Psychology, University of Wisconsin–Madison, Madison, WI, United States
| | - Veena Nair
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
| | - Kristin Caldera
- Department of Orthopedics and Rehabilitation, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
| | - Justin C. Williams
- Department of Biomedical Engineering, University of Wisconsin–Madison, Madison, WI, United States
- Department of Neurological Surgery, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
| | - Vivek Prabhakaran
- Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
- Neuroscience Training Program, University of Wisconsin–Madison, Madison, WI, United States
- Department of Neurology, University of Wisconsin–Madison, Madison, WI, United States
- Department of Psychiatry, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
| |
Collapse
|
39
|
Vaghei Y, Park EJ, Arzanpour S. Decoding Brain Signals to Classify Gait Direction Anticipation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:309-312. [PMID: 36086221 DOI: 10.1109/embc48229.2022.9871566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The use of brain-computer interface (BCI) technology has emerged as a promising rehabilitation approach for patients with motor function and motor-related disorders. BCIs provide an augmentative communication platform for controlling advanced assistive robots such as a lower-limb exoskeleton. Brain recordings collected by an electroencephalography (EEG) system have been employed in the BCI platform to command the exoskeleton. To date, the literature on this topic is limited to the prediction of gait intention and gait variations from EEG signals. This study, however, aims to predict the anticipated gait direction using a stream of EEG signals collected from the brain cortex. Three healthy participants (age range: 29-31, 2 female) were recruited. While wearing the EEG device, the participants were instructed to initiate gait movement toward the direction of the arrow triggers (pointing forward, backward, left, or right) being shown on a screen with a blank white background. Collected EEG data was then epoched around the trigger timepoints. These epochs were then converted to the time-frequency domain using event- related synchronization (ERS) and event-related desynchronization (ERD) methods. Finally, the classification pipeline was constructed using logistic regression (LR), support vector machine (SVM), and convolutional neural network (CNN). A ten-fold cross-validation scheme was used to evaluate the classification performance. The results revealed that the CNN classifier outperforms the other two classifiers with an accuracy of 0.75. Clinical Relevance - The outcome of this study has the potential to be ultimately used for interactive navigation of the lower-limb exoskeletons during robotic rehabilitation therapy and enhance neurodegeneration and neuroplasticity in a wide range of individuals with lower-limb motor function disabilities.
Collapse
|
40
|
Chi X, Wan C, Wang C, Zhang Y, Chen X, Cui H. A Novel Hybrid Brain-Computer Interface Combining Motor Imagery and Intermodulation Steady-State Visual Evoked Potential. IEEE Trans Neural Syst Rehabil Eng 2022; 30:1525-1535. [PMID: 35657833 DOI: 10.1109/tnsre.2022.3179971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The hybrid brain-computer interface (hBCI) combining motor imagery (MI) and steady-state visual evoked potential (SSVEP) has been proven to have better performance than a pure MI- or SSVEP-based brain-computer interface (BCI). In most studies on hBCIs, subjects have been required to focus their attention on flickering light-emitting diodes (LEDs) or blocks while imagining body movements. However, these two classical tasks performed concurrently have a poor correlation. Therefore, it is necessary to reduce the task complexity of such a system and improve its user-friendliness. Aiming to achieve this goal, this study proposes a novel hybrid BCI that combines MI and intermodulation SSVEPs. In the proposed system, images of both hands flicker at the same frequency (i.e., 30 Hz) but at different grasp frequencies (i.e., 1 Hz for the left hand, and 1.5 Hz for the right hand), resulting in different intermodulation frequencies for encoding targets. Additionally, movement observation for subjects can help to perform the MI task better. In this study, two types of brain signals are classified independently and then fused by a scoring mechanism based on the probability distribution of relevant parameters. The online verification results showed that the average accuracies of 12 healthy subjects and 11 stroke patients were 92.40 ± 7.45% and 73.07 ± 9.07%, respectively. The average accuracies of 10 healthy subjects in the MI, SSVEP, and hybrid tasks were 84.00 ± 12.81%, 80.75 ± 8.08%, and 89.00 ± 9.94%, respectively. The high recognition accuracy verifies the feasibility and robustness of the proposed system. This study provides a novel and natural paradigm for a hybrid BCI based on MI and SSVEP.
Collapse
|
41
|
Arpaia P, Esposito A, Natalizio A, Parvis M. How to successfully classify EEG in motor imagery BCI: a metrological analysis of the state of the art. J Neural Eng 2022; 19. [PMID: 35640554 DOI: 10.1088/1741-2552/ac74e0] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 05/31/2022] [Indexed: 11/11/2022]
Abstract
Objective. Processing strategies are analysed with respect to the classification of electroencephalographic signals related to brain-computer interfaces based on motor imagery. A review of literature is carried out to understand the achievements in motor imagery classification, the most promising trends, and the challenges in replicating these results. Main focus is placed on performance by means of a rigorous metrological analysis carried out in compliance with the international vocabulary of metrology. Hence, classification accuracy and its uncertainty are considered, as well as repeatability and reproducibility.Approach. The paper works included in the review concern the classification of electroencephalographic signals in motor-imagery- based brain-computer interfaces. Article search was carried out in accordance with the PRISMA standard and 89 studies were included.Main results. Statistically-based analyses show that brain-inspired approaches are increasingly proposed, and that these are particularly successful in discriminating against multiple classes. Notably, many proposals involve convolutional neural networks. Instead, classical machine learning approaches are still effective for binary classifications. Many proposals combine common spatial pattern, least absolute shrinkage and selection operator, and support vector machines. Regarding reported classification accuracies, performance above the upper quartile is in the 85 % to 100 % range for the binary case and in the 83 % to 93 % range for multi-class one. Associated uncertainties are up to 6 % while repeatability for a predetermined dataset is up to 8 %. Reproducibility assessment was instead prevented by lack of standardization in experiments.Significance. By relying on the analysed studies, the reader is guided towards the development of a successful processing strategy as a crucial part of a brain-computer interface. Moreover, it is suggested that future studies should extend these approaches on data from more subjects and with custom experiments, even by investigating online operation. This would also enable the quantification of results reproducibility.
Collapse
Affiliation(s)
- Pasquale Arpaia
- Centro Interdipartimentale di Ricerca in Management Sanitario e Innovazione in Sanità, Università degli Studi di Napoli Federico II, Via Claudio, 21, Napoli, Campania, 80125, ITALY
| | - Antonio Esposito
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, 10129, ITALY
| | - Angela Natalizio
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, Piemonte, 10129, ITALY
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, Piemonte, 10129, ITALY
| |
Collapse
|
42
|
Fry A, Chan HW, Harel N, Spielman L, Escalon M, Putrino D. Evaluating the clinical benefit of brain-computer interfaces for control of a personal computer. J Neural Eng 2022; 19. [PMID: 35325875 DOI: 10.1088/1741-2552/ac60ca] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Accepted: 03/24/2022] [Indexed: 11/11/2022]
Abstract
Brain-computer interfaces (BCIs) enabling the control of a personal computer could provide myriad benefits to individuals with disabilities including paralysis. However, to realize this potential, these BCIs must gain regulatory approval and be made clinically available beyond research participation. Therefore, a transition from engineering-oriented to clinically oriented outcome measures will be required in the evaluation of BCIs. This review examined how to assess the clinical benefit of BCIs for the control of a personal computer. We report that: 1) a variety of different patient-reported outcome measures can be used to evaluate improvements in how a patient feels, and we offer some considerations that should guide instrument selection. 2) Activities of daily living can be assessed to demonstrate improvements in how a patient functions, however, new instruments that are sensitive to increases in functional independence via the ability to perform digital tasks may be needed. 3) Benefits to how a patient survives has not previously been evaluated, but establishing patient-initiated communication channels using BCIs might facilitate quantifiable improvements in health outcomes.
Collapse
Affiliation(s)
- Adam Fry
- Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, New York, New York, 10029, UNITED STATES
| | - Ho Wing Chan
- Department of Neurology, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, New York, New York, 10029, UNITED STATES
| | - Noam Harel
- James J Peters VA Medical Center, 130 W Kingsbridge Rd, New York, New York, 10468, UNITED STATES
| | - Lisa Spielman
- Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, New York, New York, 10029, UNITED STATES
| | - Miguel Escalon
- Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, New York, New York, 10029, UNITED STATES
| | - David Putrino
- Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, New York, New York, 10029, UNITED STATES
| |
Collapse
|
43
|
Tedla JS, Gular K, Reddy RS, de Sá Ferreira A, Rodrigues EC, Kakaraparthi VN, Gyer G, Sangadala DR, Qasheesh M, Kovela RK, Nambi G. Effectiveness of Constraint-Induced Movement Therapy (CIMT) on Balance and Functional Mobility in the Stroke Population: A Systematic Review and Meta-Analysis. Healthcare (Basel) 2022; 10:healthcare10030495. [PMID: 35326973 PMCID: PMC8949312 DOI: 10.3390/healthcare10030495] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 03/02/2022] [Accepted: 03/04/2022] [Indexed: 02/01/2023] Open
Abstract
Constraint-induced movement therapy (CIMT) is one of the most popular treatments for enhancing upper and lower extremity motor activities and participation in patients following a stroke. However, the effect of CIMT on balance is unclear and needs further clarification. The aim of this research was to estimate the effect of CIMT on balance and functional mobility in patients after stroke. After reviewing 161 studies from search engines including Google Scholar, EBSCO, PubMed, PEDro, Science Direct, Scopus, and Web of Science, we included eight randomized controlled trials (RCT) in this study. The methodological quality of the included RCTs was verified using PEDro scoring. This systematic review showed positive effects of CIMT on balance in three studies and similar effects in five studies when compared to the control interventions such as neuro developmental treatment, modified forced-use therapy and conventional physical therapy. Furthermore, a meta-analysis indicated a statistically significant effect size by a standardized mean difference of 0.51 (P = 0.01), showing that the groups who received CIMT had improved more than the control groups. However, the meta-analysis results for functional mobility were statistically insignificant, with an effect size of −4.18 (P = 0.16), indicating that the functional mobility improvements in the investigated groups were not greater than the control group. This study’s findings demonstrated the superior effects of CIMT on balance; however, the effect size analysis of functional mobility was statistically insignificant. These findings indicate that CIMT interventions can improve balance-related motor function better than neuro developmental treatment, modified forced-use therapy and conventional physical therapy in patients after a stroke.
Collapse
Affiliation(s)
- Jaya Shanker Tedla
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61413, Saudi Arabia; (J.S.T.); (K.G.); (V.N.K.); (D.R.S.)
| | - Kumar Gular
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61413, Saudi Arabia; (J.S.T.); (K.G.); (V.N.K.); (D.R.S.)
| | - Ravi Shankar Reddy
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61413, Saudi Arabia; (J.S.T.); (K.G.); (V.N.K.); (D.R.S.)
- Correspondence:
| | - Arthur de Sá Ferreira
- Postgraduate Program in Rehabilitation Science, University Center Augusto Motta UNISUAM, Rio de Janeiro 21032-060, Brazil; (A.d.S.F.); (E.C.R.)
| | - Erika Carvalho Rodrigues
- Postgraduate Program in Rehabilitation Science, University Center Augusto Motta UNISUAM, Rio de Janeiro 21032-060, Brazil; (A.d.S.F.); (E.C.R.)
| | - Venkata Nagaraj Kakaraparthi
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61413, Saudi Arabia; (J.S.T.); (K.G.); (V.N.K.); (D.R.S.)
| | - Giles Gyer
- The London College of Osteopathic Medicine, London NW1 6QH, UK;
| | - Devika Rani Sangadala
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61413, Saudi Arabia; (J.S.T.); (K.G.); (V.N.K.); (D.R.S.)
| | - Mohammed Qasheesh
- Department of Medical Rehabilitation Sciences, College of Applied Medical Sciences, Jazan University, Jazan 45142, Saudi Arabia;
| | - Rakesh Krishna Kovela
- Department of Neuro Physiotherapy, Ravi Nair Physiotherapy College, Datta Meghe Institute of Medical Sciences, Sawangi (Meghe), Wardha 442001, Maharastra, India;
| | - Gopal Nambi
- Gopal Nambi, Department of Health and Rehabilitation Sciences, College of Applied Medical Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 16278, Saudi Arabia;
| |
Collapse
|
44
|
Ma X, Qiu S, He H. Time-Distributed Attention Network for EEG-based Motor Imagery Decoding from the Same Limb. IEEE Trans Neural Syst Rehabil Eng 2022; 30:496-508. [PMID: 35201988 DOI: 10.1109/tnsre.2022.3154369] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
A brain-computer interface (BCI) based on motor imagery (MI) from the same limb can provide an intuitive control pathway but has received limited attention. It is still a challenge to classify multiple MI tasks from the same limb. The goal of this study is to propose a novel decoding method to classify the MI tasks of four joints of the same upper limb and the resting state. EEG signals were collected from 20 participants. A time-distributed attention network (TD-Atten) was proposed to adaptively assign different weights to different classes and frequency bands of the input multiband Common Spatial Pattern (CSP) features. The long short-term memory (LSTM) and dense layers were then used to learn sequential information from the reweight features and perform the classification. Our proposed method outperformed other baseline and deep learning-based methods and obtained the accuracies of 46.8% in the 5-class scenario and 53.4% in the 4-class scenario. The visualization results of attention weights indicated that the proposed framework can adaptively pay attention to alpha-band related features in MI tasks, which was consistent with the analysis of brain activation patterns. These results demonstrated the feasibility and interpretability of the attention mechanism in MI decoding and the potential of this fine MI paradigm to be applied for the control of a robotic arm or a neural prosthesis.
Collapse
|
45
|
Yang W, Zhang X, Li Z, Zhang Q, Xue C, Huai Y. The Effect of Brain–Computer Interface Training on Rehabilitation of Upper Limb Dysfunction After Stroke: A Meta-Analysis of Randomized Controlled Trials. Front Neurosci 2022; 15:766879. [PMID: 35197817 PMCID: PMC8859107 DOI: 10.3389/fnins.2021.766879] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 12/13/2021] [Indexed: 11/13/2022] Open
Abstract
Background Upper limb motor dysfunction caused by stroke greatly affects the daily life of patients, significantly reduces their quality of life, and places serious burdens on society. As an emerging rehabilitation training method, brain–computer interface (BCI)–based training can provide closed-loop rehabilitation and is currently being applied to the restoration of upper limb function following stroke. However, because of the differences in the type of experimental clinical research, the quality of the literature varies greatly, and debate around the efficacy of BCI for the rehabilitation of upper limb dysfunction after stroke has continued. Objective We aimed to provide medical evidence-based support for BCI in the treatment of upper limb dysfunction after stroke by conducting a meta-analysis of relevant clinical studies. Methods The search terms used to retrieve related articles included “brain-computer interface,” “stroke,” and “upper extremity.” A total of 13 randomized controlled trials involving 258 participants were retrieved from five databases (PubMed, Cochrane Library, Science Direct, MEDLINE, and Web of Science), and RevMan 5.3 was used for data analysis. Results The total effect size for BCI training on upper limb motor function of post-stroke patients was 0.56 (95% CI: 0.29–0.83). Subgroup analysis indicated that the standard mean differences of BCI training on upper limb motor function of subacute stroke patients and chronic stroke patients were 1.10 (95% CI: 0.20–2.01) and 0.51 (95% CI: 0.09–0.92), respectively (p = 0.24). Conclusion Brain–computer interface training was shown to be effective in promoting upper limb motor function recovery in post-stroke patients, and the effect size was moderate.
Collapse
|
46
|
Tiboni M, Borboni A, Vérité F, Bregoli C, Amici C. Sensors and Actuation Technologies in Exoskeletons: A Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:884. [PMID: 35161629 PMCID: PMC8839165 DOI: 10.3390/s22030884] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 01/16/2022] [Accepted: 01/19/2022] [Indexed: 02/06/2023]
Abstract
Exoskeletons are robots that closely interact with humans and that are increasingly used for different purposes, such as rehabilitation, assistance in the activities of daily living (ADLs), performance augmentation or as haptic devices. In the last few decades, the research activity on these robots has grown exponentially, and sensors and actuation technologies are two fundamental research themes for their development. In this review, an in-depth study of the works related to exoskeletons and specifically to these two main aspects is carried out. A preliminary phase investigates the temporal distribution of scientific publications to capture the interest in studying and developing novel ideas, methods or solutions for exoskeleton design, actuation and sensors. The distribution of the works is also analyzed with respect to the device purpose, body part to which the device is dedicated, operation mode and design methods. Subsequently, actuation and sensing solutions for the exoskeletons described by the studies in literature are analyzed in detail, highlighting the main trends in their development and spread. The results are presented with a schematic approach, and cross analyses among taxonomies are also proposed to emphasize emerging peculiarities.
Collapse
Affiliation(s)
- Monica Tiboni
- Department of Mechanical and Industrial Engineering, University of Brescia, Via Branze, 38, 25123 Brescia, Italy; (M.T.); (C.A.)
| | - Alberto Borboni
- Department of Mechanical and Industrial Engineering, University of Brescia, Via Branze, 38, 25123 Brescia, Italy; (M.T.); (C.A.)
| | - Fabien Vérité
- Agathe Group INSERM U 1150, UMR 7222 CNRS, ISIR (Institute of Intelligent Systems and Robotics), Sorbonne Université, 75005 Paris, France;
| | - Chiara Bregoli
- Institute of Condensed Matter Chemistry and Technologies for Energy (ICMATE), National Research Council (CNR), Via Previati 1/E, 23900 Lecco, Italy;
| | - Cinzia Amici
- Department of Mechanical and Industrial Engineering, University of Brescia, Via Branze, 38, 25123 Brescia, Italy; (M.T.); (C.A.)
| |
Collapse
|
47
|
Shen X, Wang X, Lu S, Li Z, Shao W, Wu Y. Research on the real-time control system of lower-limb gait movement based on motor imagery and central pattern generator. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.102803] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
48
|
Lupanova KV, Snopkov PS, Mikhailova AA, Sidyakina IV. [Methods to restore fine motor skills in stroke patients]. VOPROSY KURORTOLOGII, FIZIOTERAPII, I LECHEBNOI FIZICHESKOI KULTURY 2022; 99:56-64. [PMID: 36511468 DOI: 10.17116/kurort20229906256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The review article considers the problem of nonmedical post-stroke rehabilitation, in particular the restoration of fine motor skills in patients in the early period of the disease. A review and analysis of various randomized controlled trials concerning the use of various rehabilitation methods both in monotherapy and in their combined application is carried out, and modern technical devices, with the use of computer technology and biofeedback, are reviewed. Proceeding from the presented literature data and their analysis, there are certain grounds for introducing modern apparatus complexes and robotized devices for fine motor skills restoration in post-stroke patients, especially in the early period, into the multimodal rehabilitation system. However, further research in this direction is needed to achieve a sustained positive result.
Collapse
Affiliation(s)
- K V Lupanova
- Biomedical University of Innovation and Continuing Education of the Burnazyan Federal Medical Biophysical Center, Moscow, Russia
| | - P S Snopkov
- Clinical Hospital in Otradnoe of the Medsi Group of Companies JSC, Moscow, Russia
| | - A A Mikhailova
- Clinical Hospital in Otradnoe of the Medsi Group of Companies JSC, Moscow, Russia.,Petrovsky Russian Scientific Center of Surgery, Moscow, Russia
| | - I V Sidyakina
- Biomedical University of Innovation and Continuing Education of the Burnazyan Federal Medical Biophysical Center, Moscow, Russia.,Clinical Hospital in Otradnoe of the Medsi Group of Companies JSC, Moscow, Russia
| |
Collapse
|
49
|
Hamos JA, Tarca RC, Birouas IF, Anton DM. A Review Regarding Neurorehabilitation Technologies for Hand Motor Functions. ROBOTICA & MANAGEMENT 2022. [DOI: 10.24193/rm.2022.1.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
The paper deals with a short review regarding neurorehabilitation technologies for regaining human hand mobility functions after a cerebrovascular accident or stroke. The aim of this paper is to form a general understanding of the current technologies used in the field of neurorehabilitation and highlight key characteristics, advantages and disadvantages. Technologies that are studies include robot exoskeletons, electro stimulation, brain computer interfaces (BCI), EEG and limb mounted sensors. After a presenting a summary of current existing technologies, a brief conclusion proposing the future direction of this study is proposed.
Collapse
|
50
|
Gutierrez-Martinez J, Mercado-Gutierrez JA, Carvajal-Gámez BE, Rosas-Trigueros JL, Contreras-Martinez AE. Artificial Intelligence Algorithms in Visual Evoked Potential-Based Brain-Computer Interfaces for Motor Rehabilitation Applications: Systematic Review and Future Directions. Front Hum Neurosci 2021; 15:772837. [PMID: 34899220 PMCID: PMC8656949 DOI: 10.3389/fnhum.2021.772837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 11/04/2021] [Indexed: 11/13/2022] Open
Abstract
Brain-Computer Interface (BCI) is a technology that uses electroencephalographic (EEG) signals to control external devices, such as Functional Electrical Stimulation (FES). Visual BCI paradigms based on P300 and Steady State Visually Evoked potentials (SSVEP) have shown high potential for clinical purposes. Numerous studies have been published on P300- and SSVEP-based non-invasive BCIs, but many of them present two shortcomings: (1) they are not aimed for motor rehabilitation applications, and (2) they do not report in detail the artificial intelligence (AI) methods used for classification, or their performance metrics. To address this gap, in this paper the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology was applied to prepare a systematic literature review (SLR). Papers older than 10 years, repeated or not related to a motor rehabilitation application, were excluded. Of all the studies, 51.02% referred to theoretical analysis of classification algorithms. Of the remaining, 28.48% were for spelling, 12.73% for diverse applications (control of wheelchair or home appliances), and only 7.77% were focused on motor rehabilitation. After the inclusion and exclusion criteria were applied and quality screening was performed, 34 articles were selected. Of them, 26.47% used the P300 and 55.8% the SSVEP signal. Five applications categories were established: Rehabilitation Systems (17.64%), Virtual Reality environments (23.52%), FES (17.64%), Orthosis (29.41%), and Prosthesis (11.76%). Of all the works, only four performed tests with patients. The most reported machine learning (ML) algorithms used for classification were linear discriminant analysis (LDA) (48.64%) and support vector machine (16.21%), while only one study used a deep learning algorithm: a Convolutional Neural Network (CNN). The reported accuracy ranged from 38.02 to 100%, and the Information Transfer Rate from 1.55 to 49.25 bits per minute. While LDA is still the most used AI algorithm, CNN has shown promising results, but due to their high technical implementation requirements, many researchers do not justify its implementation as worthwile. To achieve quick and accurate online BCIs for motor rehabilitation applications, future works on SSVEP-, P300-based and hybrid BCIs should focus on optimizing the visual stimulation module and the training stage of ML and DL algorithms.
Collapse
Affiliation(s)
- Josefina Gutierrez-Martinez
- División de Investigación en Ingeniería Médica, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| | - Jorge A. Mercado-Gutierrez
- División de Investigación en Ingeniería Médica, Instituto Nacional de Rehabilitación Luis Guillermo Ibarra Ibarra, Mexico City, Mexico
| | | | | | | |
Collapse
|