Design and Optimization of an EEG-Based Brain Machine Interface (BMI) to an Upper-Limb Exoskeleton for Stroke Survivors

Research hotspots and trends of brain-computer interface technology in stroke: a bibliometric study and visualization analysis

Background

The incidence and mortality rates of stroke are escalating due to the growing aging population, which presents a significant hazard to human health. In the realm of stroke, brain-computer interface (BCI) technology has gained considerable attention as a means to enhance treatment efficacy and improve quality of life. Consequently, a bibliometric visualization analysis was performed to investigate the research hotspots and trends of BCI technology in stroke, with the objective of furnishing reference and guidance for future research.

Methods

This study utilized the Science Citation Index Expanded (SCI-Expanded) within the Web of Science Core Collection (WoSCC) database as the data source, selecting relevant literature published between 2013 and 2022 as research sample. Through the application of VOSviewer 1.6.19 and CiteSpace 6.2.R2 visualization analysis software, as well as the bibliometric online analysis platform, the scientific knowledge maps were constructed and subjected to visualization display, and statistical analysis.

Results

This study encompasses a total of 693 relevant literature, which were published by 2,556 scholars from 975 institutions across 53 countries/regions and have been collected by 185 journals. In the past decade, BCI technology in stroke research has exhibited an upward trend in both annual publications and citations. China and the United States are high productivity countries, while the University of Tubingen stands out as the most contributing institution. Birbaumer N and Pfurtscheller G are the authors with the highest publication and citation frequency in this field, respectively. Frontiers in Neuroscience has published the most literature, while Journal of Neural Engineering has the highest citation frequency. The research hotspots in this field cover keywords such as stroke, BCI, rehabilitation, motor imagery (MI), motor recovery, electroencephalogram (EEG), neurorehabilitation, neural plasticity, task analysis, functional electrical stimulation (FES), motor impairment, feature extraction, and induced movement therapy, which to a certain extent reflect the development trend and frontier research direction of this field.

Conclusion

This study comprehensively and visually presents the extensive and in-depth literature resources of BCI technology in stroke research in the form of knowledge maps, which facilitates scholars to gain a more convenient understanding of the development and prospects in this field, thereby promoting further research work.

The Emergence of Functional Ultrasound for Noninvasive Brain-Computer Interface

A noninvasive brain-computer interface is a central task in the comprehensive analysis and understanding of the brain and is an important challenge in international brain-science research. Current implanted brain-computer interfaces are cranial and invasive, which considerably limits their applications. The development of new noninvasive reading and writing technologies will advance substantial innovations and breakthroughs in the field of brain-computer interfaces. Here, we review the theory and development of the ultrasound brain functional imaging and its applications. Furthermore, we introduce latest advancements in ultrasound brain modulation and its applications in rodents, primates, and human; its mechanism and closed-loop ultrasound neuromodulation based on electroencephalograph are also presented. Finally, high-frequency acoustic noninvasive brain-computer interface is prospected based on ultrasound super-resolution imaging and acoustic tweezers.

Design and Validation of a Low-Cost Mobile EEG-Based Brain-Computer Interface

Objective: We designed and validated a wireless, low-cost, easy-to-use, mobile, dry-electrode headset for scalp electroencephalography (EEG) recordings for closed-loop brain-computer (BCI) interface and internet-of-things (IoT) applications. Approach: The EEG-based BCI headset was designed from commercial off-the-shelf (COTS) components using a multi-pronged approach that balanced interoperability, cost, portability, usability, form factor, reliability, and closed-loop operation. Main Results: The adjustable headset was designed to accommodate 90% of the population. A patent-pending self-positioning dry electrode bracket allowed for vertical self-positioning while parting the user's hair to ensure contact of the electrode with the scalp. In the current prototype, five EEG electrodes were incorporated in the electrode bracket spanning the sensorimotor cortices bilaterally, and three skin sensors were included to measure eye movement and blinks. An inertial measurement unit (IMU) provides monitoring of head movements. The EEG amplifier operates with 24-bit resolution up to 500 Hz sampling frequency and can communicate with other devices using 802.11 b/g/n WiFi. It has high signal-to-noise ratio (SNR) and common-mode rejection ratio (CMRR) (121 dB and 110 dB, respectively) and low input noise. In closed-loop BCI mode, the system can operate at 40 Hz, including real-time adaptive noise cancellation and 512 MB of processor memory. It supports LabVIEW as a backend coding language and JavaScript (JS), Cascading Style Sheets (CSS), and HyperText Markup Language (HTML) as front-end coding languages and includes training and optimization of support vector machine (SVM) neural classifiers. Extensive bench testing supports the technical specifications and human-subject pilot testing of a closed-loop BCI application to support upper-limb rehabilitation and provides proof-of-concept validation for the device's use at both the clinic and at home. Significance: The usability, interoperability, portability, reliability, and programmability of the proposed wireless closed-loop BCI system provides a low-cost solution for BCI and neurorehabilitation research and IoT applications.

Identifying risk controls for future advanced brain-computer interfaces: A prospective risk assessment approach using work domain analysis

Brain-computer interface (BCI) technologies are progressing rapidly and may eventually be implemented widely within society, yet their risks have arguably not yet been comprehensively identified, nor understood. This study analysed an anticipated invasive BCI system lifecycle to identify the individual, organisational, and societal risks associated with BCIs, and controls that could be used to mitigate or eliminate these risks. A BCI system lifecycle work domain analysis model was developed and validated with 10 subject matter experts. The model was subsequently used to undertake a systems thinking-based risk assessment approach to identify risks that could emerge when functions are either undertaken sub-optimally or not undertaken at all. Eighteen broad risk themes were identified that could negatively impact the BCI system lifecycle in a variety of unique ways, while a larger number of controls for these risks were also identified. The most concerning risks included inadequate regulation of BCI technologies and inadequate training of BCI stakeholders, such as users and clinicians. In addition to specifying a practical set of risk controls to inform BCI device design, manufacture, adoption, and utilisation, the results demonstrate the complexity involved in managing BCI risks and suggests that a system-wide coordinated response is required. Future research is required to evaluate the comprehensiveness of the identified risks and the practicality of implementing the risk controls.

Literature review of stroke assessment for upper-extremity physical function via EEG, EMG, kinematic, and kinetic measurements and their reliability

BACKGROUND

Significant clinician training is required to mitigate the subjective nature and achieve useful reliability between measurement occasions and therapists. Previous research supports that robotic instruments can improve quantitative biomechanical assessments of the upper limb, offering reliable and more sensitive measures. Furthermore, combining kinematic and kinetic measurements with electrophysiological measurements offers new insights to unlock targeted impairment-specific therapy. This review presents common methods for analyzing biomechanical and neuromuscular data by describing their validity and reporting their reliability measures.

METHODS

This paper reviews literature (2000-2021) on sensor-based measures and metrics for upper-limb biomechanical and electrophysiological (neurological) assessment, which have been shown to correlate with clinical test outcomes for motor assessment. The search terms targeted robotic and passive devices developed for movement therapy. Journal and conference papers on stroke assessment metrics were selected using PRISMA guidelines. Intra-class correlation values of some of the metrics are recorded, along with model, type of agreement, and confidence intervals, when reported.

RESULTS

A total of 60 articles are identified. The sensor-based metrics assess various aspects of movement performance, such as smoothness, spasticity, efficiency, planning, efficacy, accuracy, coordination, range of motion, and strength. Additional metrics assess abnormal activation patterns of cortical activity and interconnections between brain regions and muscle groups; aiming to characterize differences between the population who had a stroke and the healthy population.

CONCLUSION

Range of motion, mean speed, mean distance, normal path length, spectral arc length, number of peaks, and task time metrics have all demonstrated good to excellent reliability, as well as provide a finer resolution compared to discrete clinical assessment tests. EEG power features for multiple frequency bands of interest, specifically the bands relating to slow and fast frequencies comparing affected and non-affected hemispheres, demonstrate good to excellent reliability for populations at various stages of stroke recovery. Further investigation is needed to evaluate the metrics missing reliability information. In the few studies combining biomechanical measures with neuroelectric signals, the multi-domain approaches demonstrated agreement with clinical assessments and provide further information during the relearning phase. Combining the reliable sensor-based metrics in the clinical assessment process will provide a more objective approach, relying less on therapist expertise. This paper suggests future work on analyzing the reliability of metrics to prevent biasedness and selecting the appropriate analysis.

Input Shape Effect on Classification Performance of Raw EEG Motor Imagery Signals with Convolutional Neural Networks for Use in Brain-Computer Interfaces

EEG signals are interpreted, analyzed and classified by many researchers for use in brain-computer interfaces. Although there are many different EEG signal acquisition methods, one of the most interesting is motor imagery signals. Many different signal processing methods, machine learning and deep learning models have been developed for the classification of motor imagery signals. Among these, Convolutional Neural Network models generally achieve better results than other models. Because the size and shape of the data is important for training Convolutional Neural Network models and discovering the right relationships, researchers have designed and experimented with many different input shape structures. However, no study has been found in the literature evaluating the effect of different input shapes on model performance and accuracy. In this study, the effects of different input shapes on model performance and accuracy in the classification of EEG motor imagery signals were investigated, which had not been specifically studied before. In addition, signal preprocessing methods, which take a long time before classification, were not used; rather, two CNN models were developed for training and classification using raw data. Two different datasets, BCI Competition IV 2A and 2B, were used in classification processes. For different input shapes, 53.03-89.29% classification accuracy and 2-23 s epoch time were obtained for 2A dataset, 64.84-84.94% classification accuracy and 4-10 s epoch time were obtained for 2B dataset. This study showed that the input shape has a significant effect on the classification performance, and when the correct input shape is selected and the correct CNN architecture is developed, feature extraction and classification can be done well by the CNN architecture without any signal preprocessing.

A Parallel Feature Fusion Network Combining GRU and CNN for Motor Imagery EEG Decoding

In recent years, deep-learning-based motor imagery (MI) electroencephalography (EEG) decoding methods have shown great potential in the field of the brain–computer interface (BCI). The existing literature is relatively mature in decoding methods for two classes of MI tasks. However, with the increase in MI task classes, decoding studies for four classes of MI tasks need to be further explored. In addition, it is difficult to obtain large-scale EEG datasets. When the training data are limited, deep-learning-based decoding models are prone to problems such as overfitting and poor robustness. In this study, we design a data augmentation method for MI-EEG. The original EEG is slid along the time axis and reconstructed to expand the size of the dataset. Second, we combine the gated recurrent unit (GRU) and convolutional neural network (CNN) to construct a parallel-structured feature fusion network to decode four classes of MI tasks. The parallel structure can avoid temporal, frequency and spatial features interfering with each other. Experimenting on the well-known four-class MI dataset BCI Competition IV 2a shows a global average classification accuracy of 80.7% and a kappa value of 0.74. The proposed method improves the robustness of deep learning to decode small-scale EEG datasets and alleviates the overfitting phenomenon caused by insufficient data. The method can be applied to BCI systems with a small amount of daily recorded data.

An EEG-based asynchronous MI-BCI system to reduce false positives with a small number of channels for neurorehabilitation: A pilot study

Many studies have used motor imagery-based brain–computer interface (MI-BCI) systems for stroke rehabilitation to induce brain plasticity. However, they mainly focused on detecting motor imagery but did not consider the effect of false positive (FP) detection. The FP could be a threat to patients with stroke as it can induce wrong-directed brain plasticity that would result in adverse effects. In this study, we proposed a rehabilitative MI-BCI system that focuses on rejecting the FP. To this end, we first identified numerous electroencephalogram (EEG) signals as the causes of the FP, and based on the characteristics of the signals, we designed a novel two-phase classifier using a small number of EEG channels, including the source of the FP. Through experiments with eight healthy participants and nine patients with stroke, our proposed MI-BCI system showed 71.76% selectivity and 13.70% FP rate by using only four EEG channels in the patient group with stroke. Moreover, our system can compensate for day-to-day variations for prolonged session intervals by recalibration. The results suggest that our proposed system, a practical approach for the clinical setting, could improve the therapeutic effect of MI-BCI by reducing the adverse effect of the FP.

Pseudo-online detection and classification for upper-limb movements

Objective. This study analyzed detection (movement vs. non-movement) and classification (different types of movements) to decode upper-limb movement volitions in a pseudo-online fashion.Approach. Nine healthy subjects executed four self-initiated movements: left wrist extension, right wrist extension, left index finger extension, and right index finger extension. For detection, we investigated the performance of three individual classifiers (support vector machine (SVM), EEGNET, and Riemannian geometry featured SVM) on three frequency bands (0.05-5 Hz, 5-40 Hz, 0.05-40 Hz). The best frequency band and the best classifier combinations were constructed to realize an ensemble processing pipeline using majority voting. For classification, we used adaptive boosted Riemannian geometry model to differentiate contra-lateral and ipsilateral movements.Main results. The ensemble model achieved 79.6 ± 8.8% true positive rate and 3.1 ± 1.2 false positives per minute with 75.3 ± 112.6 ms latency on a pseudo-online detection task. The following classification gave around 67% accuracy to differentiate contralateral movements.Significance. The newly proposed ensemble method and pseudo-online testing procedure could provide a robust brain-computer interface design for movement decoding.

Multimodal Human-Exoskeleton Interface for Lower Limb Movement Prediction Through a Dense Co-Attention Symmetric Mechanism

A challenging task for the biological neural signal-based human-exoskeleton interface is to achieve accurate lower limb movement prediction of patients with hemiplegia in rehabilitation training scenarios. The human-exoskeleton interface based on single-modal biological signals such as electroencephalogram (EEG) is currently not mature in predicting movements, due to its unreliability. The multimodal human-exoskeleton interface is a very novel solution to this problem. This kind of interface normally combines the EEG signal with surface electromyography (sEMG) signal. However, their use for the lower limb movement prediction is still limited—the connection between sEMG and EEG signals and the deep feature fusion between them are ignored. In this article, a Dense con-attention mechanism-based Multimodal Enhance Fusion Network (DMEFNet) is proposed for predicting lower limb movement of patients with hemiplegia. The DMEFNet introduces the con-attention structure to extract the common attention between sEMG and EEG signal features. To verify the effectiveness of DMEFNet, an sEMG and EEG data acquisition experiment and an incomplete asynchronous data collection paradigm are designed. The experimental results show that DMEFNet has a good movement prediction performance in both within-subject and cross-subject situations, reaching an accuracy of 82.96 and 88.44%, respectively.

Neuromotor prosthetic to treat stroke-related paresis: N-of-1 trial

Background

Functional recovery of arm movement typically plateaus following a stroke, leaving chronic motor deficits. Brain-computer interfaces (BCI) may be a potential treatment for post-stroke deficits

Methods

In this n-of-1 trial (NCT03913286), a person with chronic subcortical stroke with upper-limb motor impairment used a powered elbow-wrist-hand orthosis that opened and closed the affected hand using cortical activity, recorded from a percutaneous BCI comprised of four microelectrode arrays implanted in the ipsilesional precentral gyrus, based on decoding of spiking patterns and high frequency field potentials generated by imagined hand movements. The system was evaluated in a home setting for 12 weeks

Results

Robust single unit activity, modulating with attempted or imagined movement, was present throughout the precentral gyrus. The participant acquired voluntary control over a hand-orthosis, achieving 10 points on the Action Research Arm Test using the BCI, compared to 0 without any device, and 5 using myoelectric control. Strength, spasticity, the Fugl-Meyer scores improved.

Conclusions

We demonstrate in a human being that ensembles of individual neurons in the cortex overlying a chronic supratentorial, subcortical stroke remain active and engaged in motor representation and planning and can be used to electrically bypass the stroke and promote limb function. The participant’s ability to rapidly acquire control over otherwise paralyzed hand opening, more than 18 months after a stroke, may justify development of a fully implanted movement restoration system to expand the utility of fully implantable BCI to a clinical population that numbers in the tens of millions worldwide.

Stroke is a restriction of blood flow to part of the brain and can lead to chronic issues with a person’s ability to control the limbs. The aim of this study was to see if a new type of device could restore movement in a person with arm weakness due to a stroke that occurred a year earlier. In our trial, a sensor was implanted into the surface of the brain, near the site of the stroke, and was connected to a computer that generated a command to open and close the hand with a motorized brace worn on the hand. This person was able to use their own brain activity to trigger the brace and pick up and move objects. This research could support the development of similar medical devices to restore movement in people who have had strokes.

Serruya et al. test in an N-of-1 trial whether a wearable, powered exoskeletal orthosis, driven by a percutaneous, implanted brain–computer interface can restore voluntary upper extremity function following chronic hemiparesis subsequent to a cerebral subcortical stroke. Using this approach, voluntary opening of the paralyzed hand is restored.

Eyes-Free Tongue Gesture and Tongue Joystick Control of a Five DOF Upper-Limb Exoskeleton for Severely Disabled Individuals

Spinal cord injury can leave the affected individual severely disabled with a low level of independence and quality of life. Assistive upper-limb exoskeletons are one of the solutions that can enable an individual with tetraplegia (paralysis in both arms and legs) to perform simple activities of daily living by mobilizing the arm. Providing an efficient user interface that can provide full continuous control of such a device—safely and intuitively—with multiple degrees of freedom (DOFs) still remains a challenge. In this study, a control interface for an assistive upper-limb exoskeleton with five DOFs based on an intraoral tongue-computer interface (ITCI) for individuals with tetraplegia was proposed. Furthermore, we evaluated eyes-free use of the ITCI for the first time and compared two tongue-operated control methods, one based on tongue gestures and the other based on dynamic virtual buttons and a joystick-like control. Ten able-bodied participants tongue controlled the exoskeleton for a drinking task with and without visual feedback on a screen in three experimental sessions. As a baseline, the participants performed the drinking task with a standard gamepad. The results showed that it was possible to control the exoskeleton with the tongue even without visual feedback and to perform the drinking task at 65.1% of the speed of the gamepad. In a clinical case study, an individual with tetraplegia further succeeded to fully control the exoskeleton and perform the drinking task only 5.6% slower than the able-bodied group. This study demonstrated the first single-modal control interface that can enable individuals with complete tetraplegia to fully and continuously control a five-DOF upper limb exoskeleton and perform a drinking task after only 2 h of training. The interface was used both with and without visual feedback.

Artificial Intelligence Algorithms in Visual Evoked Potential-Based Brain-Computer Interfaces for Motor Rehabilitation Applications: Systematic Review and Future Directions

Brain-Computer Interface (BCI) is a technology that uses electroencephalographic (EEG) signals to control external devices, such as Functional Electrical Stimulation (FES). Visual BCI paradigms based on P300 and Steady State Visually Evoked potentials (SSVEP) have shown high potential for clinical purposes. Numerous studies have been published on P300- and SSVEP-based non-invasive BCIs, but many of them present two shortcomings: (1) they are not aimed for motor rehabilitation applications, and (2) they do not report in detail the artificial intelligence (AI) methods used for classification, or their performance metrics. To address this gap, in this paper the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology was applied to prepare a systematic literature review (SLR). Papers older than 10 years, repeated or not related to a motor rehabilitation application, were excluded. Of all the studies, 51.02% referred to theoretical analysis of classification algorithms. Of the remaining, 28.48% were for spelling, 12.73% for diverse applications (control of wheelchair or home appliances), and only 7.77% were focused on motor rehabilitation. After the inclusion and exclusion criteria were applied and quality screening was performed, 34 articles were selected. Of them, 26.47% used the P300 and 55.8% the SSVEP signal. Five applications categories were established: Rehabilitation Systems (17.64%), Virtual Reality environments (23.52%), FES (17.64%), Orthosis (29.41%), and Prosthesis (11.76%). Of all the works, only four performed tests with patients. The most reported machine learning (ML) algorithms used for classification were linear discriminant analysis (LDA) (48.64%) and support vector machine (16.21%), while only one study used a deep learning algorithm: a Convolutional Neural Network (CNN). The reported accuracy ranged from 38.02 to 100%, and the Information Transfer Rate from 1.55 to 49.25 bits per minute. While LDA is still the most used AI algorithm, CNN has shown promising results, but due to their high technical implementation requirements, many researchers do not justify its implementation as worthwile. To achieve quick and accurate online BCIs for motor rehabilitation applications, future works on SSVEP-, P300-based and hybrid BCIs should focus on optimizing the visual stimulation module and the training stage of ML and DL algorithms.

Biosignal-Based Human-Machine Interfaces for Assistance and Rehabilitation: A Survey

As a definition, Human–Machine Interface (HMI) enables a person to interact with a device. Starting from elementary equipment, the recent development of novel techniques and unobtrusive devices for biosignals monitoring paved the way for a new class of HMIs, which take such biosignals as inputs to control various applications. The current survey aims to review the large literature of the last two decades regarding biosignal-based HMIs for assistance and rehabilitation to outline state-of-the-art and identify emerging technologies and potential future research trends. PubMed and other databases were surveyed by using specific keywords. The found studies were further screened in three levels (title, abstract, full-text), and eventually, 144 journal papers and 37 conference papers were included. Four macrocategories were considered to classify the different biosignals used for HMI control: biopotential, muscle mechanical motion, body motion, and their combinations (hybrid systems). The HMIs were also classified according to their target application by considering six categories: prosthetic control, robotic control, virtual reality control, gesture recognition, communication, and smart environment control. An ever-growing number of publications has been observed over the last years. Most of the studies (about 67%) pertain to the assistive field, while 20% relate to rehabilitation and 13% to assistance and rehabilitation. A moderate increase can be observed in studies focusing on robotic control, prosthetic control, and gesture recognition in the last decade. In contrast, studies on the other targets experienced only a small increase. Biopotentials are no longer the leading control signals, and the use of muscle mechanical motion signals has experienced a considerable rise, especially in prosthetic control. Hybrid technologies are promising, as they could lead to higher performances. However, they also increase HMIs’ complexity, so their usefulness should be carefully evaluated for the specific application.

Participant-specific classifier tuning increases the performance of hand movement detection from EEG in patients with amyotrophic lateral sclerosis

Objective.Brain-computer interface (BCI) systems can be employed to provide motor and communication assistance to patients suffering from neuromuscular diseases, such as amyotrophic lateral sclerosis (ALS). Movement related cortical potentials (MRCPs), which are naturally generated during movement execution, can be used to implement a BCI triggered by motor attempts. Such BCI could assist impaired motor functions of ALS patients during disease progression, and facilitate the training for the generation of reliable MRCPs. The training aspect is relevant to establish a communication channel in the late stage of the disease. Therefore, the aim of this study was to investigate the possibility of detecting MRCPs associated to movement intention in ALS patients with different levels of disease progression from slight to complete paralysis.Approach.Electroencephalography signals were recorded from nine channels in 30 ALS patients at various stages of the disease while they performed or attempted to perform hand movements timed to a visual cue. The movement detection was implemented using offline classification between movement and rest phase. Temporal and spectral features were extracted using 500 ms sliding windows with 50% overlap. The detection was tested for each individual channel and two surrogate channels by performing feature selection followed by classification using linear and non-linear support vector machine and linear discriminant analysis.Main results.The results demonstrated that the detection performance was high in all patients (accuracy 80.5 ± 5.6%) but that the classification parameters (channel, features and classifier) leading to the best performance varied greatly across patients. When the same channel and classifier were used for all patients (participant-generic analysis), the performance significantly decreased (accuracy 74 ± 8.3%).Significance.The present study demonstrates that to maximize the detection of brain waves across ALS patients at different stages of the disease, the classification pipeline should be tuned to each patient individually.

Physiologic signaling and viability of the muscle cuff regenerative peripheral nerve interface (MC-RPNI) for intact peripheral nerves

Background. Robotic exoskeleton devices have become a promising modality for restoration of extremity function in individuals with limb loss or functional weakness. However, there exists no consistent or reliable way to record efferent motor action potentials from intact peripheral nerves to control device movement. Peripheral nerve motor action potentials are similar in amplitude to that of background noise, producing an unfavorable signal-to-noise ratio (SNR) that makes these signals difficult to detect and interpret. To address this issue, we have developed the muscle cuff regenerative peripheral nerve interface (MC-RPNI), a construct consisting of a free skeletal muscle graft wrapped circumferentially around an intact peripheral nerve. Over time, the muscle graft regenerates, and the intact nerve undergoes collateral axonal sprouting to reinnervate the muscle. The MC-RPNI amplifies efferent motor action potentials by several magnitudes, thereby increasing the SNR, allowing for higher fidelity signaling and detection of motor intention. The goal of this study was to characterize the signaling capabilities and viability of the MC-RPNI over time.Methods. Thirty-seven rats were randomly assigned to one of five experimental groups (Groups A-E). For MC-RPNI animals, their contralateral extensor digitorum longus (EDL) muscle was harvested and trimmed to either 8 mm (Group A) or 13 mm (Group B) in length, wrapped circumferentially around the intact ipsilateral common peroneal (CP) nerve, secured, and allowed to heal for 3 months. Additionally, one 8 mm (Group C) and one 13 mm (Group D) length group had an epineurial window created in the CP nerve immediately preceding MC-RPNI creation. Group E consisted of sham surgery animals. At 3 months, electrophysiologic analyses were conducted to determine the signaling capabilities of the MC-RPNI. Additionally, electromyography and isometric force analyses were performed on the CP-innervated EDL to determine the effects of the MC-RPNI on end organ function. Following evaluation, the CP nerve, MC-RPNI, and ipsilateral EDL muscle were harvested for histomorphometric analysis.Results. Study endpoint analysis was performed at 3 months post-surgery. All rats displayed visible muscle contractions in both the MC-RPNI and EDL following proximal CP nerve stimulation. Compound muscle action potentials were recorded from the MC-RPNI following proximal CP nerve stimulation and ranged from 3.67 ± 0.58 mV to 6.04 ± 1.01 mV, providing efferent motor action potential amplification of 10-20 times that of a normal physiologic nerve action potential. Maximum tetanic isometric force (F_o) testing of the distally-innervated EDL muscle in MC-RPNI groups producedF_o(2341 ± 114 mN-2832 ± 102 mN) similar to controls (2497 ± 122 mN), thus demonstrating that creation of MC-RPNIs did not adversely impact the function of the distally-innervated EDL muscle. Overall, comparison between all MC-RPNI sub-groups did not reveal any statistically significant differences in signaling capabilities or negative effects on distal-innervated muscle function as compared to the control group.Conclusions. MC-RPNIs have the capability to provide efferent motor action potential amplification from intact nerves without adversely impacting distal muscle function. Neither the size of the muscle graft nor the presence of an epineurial window in the nerve had any significant impact on the ability of the MC-RPNI to amplify efferent motor action potentials from intact nerves. These results support the potential for the MC-RPNI to serve as a biologic nerve interface to control advanced exoskeleton devices.

Experimental Protocol to Assess Neuromuscular Plasticity Induced by an Exoskeleton Training Session

Exoskeleton gait rehabilitation is an emerging area of research, with potential applications in the elderly and in people with central nervous system lesions, e.g., stroke, traumatic brain/spinal cord injury. However, adaptability of such technologies to the user is still an unmet goal. Despite important technological advances, these robotic systems still lack the fine tuning necessary to adapt to the physiological modification of the user and are not yet capable of a proper human-machine interaction. Interfaces based on physiological signals, e.g., recorded by electroencephalography (EEG) and/or electromyography (EMG), could contribute to solving this technological challenge. This protocol aims to: (1) quantify neuro-muscular plasticity induced by a single training session with a robotic exoskeleton on post-stroke people and on a group of age and sex-matched controls; (2) test the feasibility of predicting lower limb motor trajectory from physiological signals for future use as control signal for the robot. An active exoskeleton that can be set in full mode (i.e., the robot fully replaces and drives the user motion), adaptive mode (i.e., assistance to the user can be tuned according to his/her needs), and free mode (i.e., the robot completely follows the user movements) will be used. Participants will undergo a preparation session, i.e., EMG sensors and EEG cap placement and inertial sensors attachment to measure, respectively, muscular and cortical activity, and motion. They will then be asked to walk in a 15 m corridor: (i) self-paced without the exoskeleton (pre-training session); (ii) wearing the exoskeleton and walking with the three modes of use; (iii) self-paced without the exoskeleton (post-training session). From this dataset, we will: (1) quantitatively estimate short-term neuroplasticity of brain connectivity in chronic stroke survivors after a single session of gait training; (2) compare muscle activation patterns during exoskeleton-gait between stroke survivors and age and sex-matched controls; and (3) perform a feasibility analysis on the use of physiological signals to decode gait intentions.

Noninvasive Electroencephalography Equipment for Assistive, Adaptive, and Rehabilitative Brain-Computer Interfaces: A Systematic Literature Review

Humans interact with computers through various devices. Such interactions may not require any physical movement, thus aiding people with severe motor disabilities in communicating with external devices. The brain-computer interface (BCI) has turned into a field involving new elements for assistive and rehabilitative technologies. This systematic literature review (SLR) aims to help BCI investigator and investors to decide which devices to select or which studies to support based on the current market examination. This examination of noninvasive EEG devices is based on published BCI studies in different research areas. In this SLR, the research area of noninvasive BCIs using electroencephalography (EEG) was analyzed by examining the types of equipment used for assistive, adaptive, and rehabilitative BCIs. For this SLR, candidate studies were selected from the IEEE digital library, PubMed, Scopus, and ScienceDirect. The inclusion criteria (IC) were limited to studies focusing on applications and devices of the BCI technology. The data used herein were selected using IC and exclusion criteria to ensure quality assessment. The selected articles were divided into four main research areas: education, engineering, entertainment, and medicine. Overall, 238 papers were selected based on IC. Moreover, 28 companies were identified that developed wired and wireless equipment as means of BCI assistive technology. The findings of this review indicate that the implications of using BCIs for assistive, adaptive, and rehabilitative technologies are encouraging for people with severe motor disabilities and healthy people. With an increasing number of healthy people using BCIs, other research areas, such as the motivation of players when participating in games or the security of soldiers when observing certain areas, can be studied and collaborated using the BCI technology. However, such BCI systems must be simple (wearable), convenient (sensor fabrics and self-adjusting abilities), and inexpensive.

An artificial nervous system to treat chronic stroke

Despite remarkable advances in the treatment of numerous medical conditions, neurological disease and injury remains an outstanding challenge and cause of disability worldwide. The decreased regenerative capacity and extreme complexity and heterogeneity of nervous tissue, in particular the brain, and the fact that the brain remains the least understood organ, have hampered our ability to provide definitive treatments for prevalent conditions such as stroke. Stroke is the second-leading cause of death worldwide, and the nervous system is intimately involved in other prevalent conditions including ischemic heart disease, diabetes mellitus, and hypertension. Advances in neuromodulation, electroceuticals, microsurgical techniques, optogenetics, brain-computer interfaces, and autologous constructs offer potential solutions to address the otherwise permanent neurological deficits of stroke and other conditions. Here we review these various approaches to build an "artificial nervous system" that could restore function and independence in people living with these conditions. We focus on stroke both because it is the leading cause of neurological disability worldwide and because we anticipate that advances in the reversal of stroke-related deficits will have ripple effects benefiting people with other neurological conditions including spinal cord injury, traumatic brain injury, ALS, and muscular dystrophy.

Tremor-Suppression Orthoses for the Upper Limb: Current Developments and Future Challenges

Introduction: Pathological tremor is the most common motor disorder in adults and characterized by involuntary, rhythmic muscular contraction leading to shaking movements in one or more parts of the body. Functional Electrical Stimulation (FES) and biomechanical loading using wearable orthoses have emerged as effective and non-invasive methods for tremor suppression. A variety of upper-limb orthoses for tremor suppression have been introduced; however, a systematic review of the mechanical design, algorithms for tremor extraction, and the experimental design is still missing.

Methods: To address this gap, we applied a standard systematic review methodology to conduct a literature search in the PubMed and PMC databases. Inclusion criteria and full-text access eligibility were used to filter the studies from the search results. Subsequently, we extracted relevant information, such as suppression mechanism, system weights, degrees of freedom (DOF), algorithms for tremor estimation, experimental settings, and the efficacy.

Results: The results show that the majority of tremor-suppression orthoses are active with 47% prevalence. Active orthoses are also the heaviest with an average weight of 561 ± 467 g, followed by semi-active 486 ± 395 g, and passive orthoses 191 ± 137 g. Most of the orthoses only support one DOF (54.5%). Two-DOF and three-DOF orthoses account for 33 and 18%, respectively. The average efficacy of tremor suppression using wearable orthoses is 83 ± 13%. Active orthoses are the most efficient with an average efficacy of 83 ± 8%, following by the semi-active 77 ± 19%, and passive orthoses 75 ± 12%. Among different experimental setups, bench testing shows the highest efficacy at 95 ± 5%, this value dropped to 86 ± 8% when evaluating with tremor-affected subjects. The majority of the orthoses (92%) measured voluntary and/or tremorous motions using biomechanical sensors (e.g., IMU, force sensor). Only one system was found to utilize EMG for tremor extraction.

Conclusions: Our review showed an improvement in efficacy of using robotic orthoses in tremor suppression. However, significant challenges for the translations of these systems into clinical or home use remain unsolved. Future challenges include improving the wearability of the orthoses (e.g., lightweight, aesthetic, and soft structure), and user control interfaces (i.e., neural machine interface). We also suggest addressing non-technical challenges (e.g., regulatory compliance, insurance reimbursement) to make the technology more accessible.

A Deep Classifier for Upper-Limbs Motor Anticipation Tasks in an Online BCI Setting

Decoding motor intentions from non-invasive brain activity monitoring is one of the most challenging aspects in the Brain Computer Interface (BCI) field. This is especially true in online settings, where classification must be performed in real-time, contextually with the user’s movements. In this work, we use a topology-preserving input representation, which is fed to a novel combination of 3D-convolutional and recurrent deep neural networks, capable of performing multi-class continual classification of subjects’ movement intentions. Our model is able to achieve a higher accuracy than a related state-of-the-art model from literature, despite being trained in a much more restrictive setting and using only a simple form of input signal preprocessing. The results suggest that deep learning models are well suited for deployment in challenging real-time BCI applications such as movement intention recognition.

Neural activity modulations and motor recovery following brain-exoskeleton interface mediated stroke rehabilitation

•

Motor intention based arm training targets activity-dependent neuroplasticity.

•

80% of stroke participants recovered clinically relevant functional movements.

•

Ipsi-lesional, delta-band EEG activity was highly correlated with motor recovery.

•

Results suggest higher activation of ipsi-lesional hemisphere post-intervention.

Brain-machine interfaces (BMI) based on scalp EEG have the potential to promote cortical plasticity following stroke, which has been shown to improve motor recovery outcomes. However, the efficacy of BMI enabled robotic training for upper-limb recovery is seldom quantified using clinical, EEG-based, and kinematics-based metrics. Further, a movement related neural correlate that can predict the extent of motor recovery still remains elusive, which impedes the clinical translation of BMI-based stroke rehabilitation.

To address above knowledge gaps, 10 chronic stroke individuals with stable baseline clinical scores were recruited to participate in 12 therapy sessions involving a BMI enabled powered exoskeleton for elbow training. On average, 132 ± 22 repetitions were performed per participant, per session. BMI accuracy across all sessions and subjects was 79 ± 18% with a false positives rate of 23 ± 20%.

Post-training clinical assessments found that FMA for upper extremity and ARAT scores significantly improved over baseline by 3.92 ± 3.73 and 5.35 ± 4.62 points, respectively. Also, 80% participants (7 with moderate-mild impairment, 1 with severe impairment) achieved minimal clinically important difference (MCID: FMA-UE >5.2 or ARAT >5.7) during the course of the study. Kinematic measures indicate that, on average, participants’ movements became faster and smoother. Moreover, modulations in movement related cortical potentials, an EEG-based neural correlate measured contralateral to the impaired arm, were significantly correlated with ARAT scores (ρ = 0.72, p < 0.05) and marginally correlated with FMA-UE (ρ = 0.63, p = 0.051). This suggests higher activation of ipsi-lesional hemisphere post-intervention or inhibition of competing contra-lesional hemisphere, which may be evidence of neuroplasticity and cortical reorganization following BMI mediated rehabilitation therapy.

Hybrid Human-Machine Interface for Gait Decoding Through Bayesian Fusion of EEG and EMG Classifiers

Despite the advances in the field of brain computer interfaces (BCI), the use of the sole electroencephalography (EEG) signal to control walking rehabilitation devices is currently not viable in clinical settings, due to its unreliability. Hybrid interfaces (hHMIs) represent a very recent solution to enhance the performance of single-signal approaches. These are classification approaches that combine multiple human-machine interfaces, normally including at least one BCI with other biosignals, such as the electromyography (EMG). However, their use for the decoding of gait activity is still limited. In this work, we propose and evaluate a hybrid human-machine interface (hHMI) to decode walking phases of both legs from the Bayesian fusion of EEG and EMG signals. The proposed hHMI significantly outperforms its single-signal counterparts, by providing high and stable performance even when the reliability of the muscular activity is compromised temporarily (e.g., fatigue) or permanently (e.g., weakness). Indeed, the hybrid approach shows a smooth degradation of classification performance after temporary EMG alteration, with more than 75% of accuracy at 30% of EMG amplitude, with respect to the EMG classifier whose performance decreases below 60% of accuracy. Moreover, the fusion of EEG and EMG information helps keeping a stable recognition rate of each gait phase of more than 80% independently on the permanent level of EMG degradation. From our study and findings from the literature, we suggest that the use of hybrid interfaces may be the key to enhance the usability of technologies restoring or assisting the locomotion on a wider population of patients in clinical applications and outside the laboratory environment.

Neural decoding of continuous upper limb movements: a meta-analysis

OBJECTIVE

EEG-based motion trajectory decoding makes a promising approach for neurotechnology which can be used for neural control of motion reconstruction and neurorehabilitation tools. However, the feasibility and validity of continuous motion decoding by non-invasive brain activity are not clear. The main aim of this study was to perform a meta-analysis across studies that examined the ability of EEG-based continuous motion decoding of upper limb movements.

APPROACH

Pearson's correlation coefficient (CC) was used to evaluate the model performance of the studies and considered as an effect size. To estimate the overall effect size of neural decoding of motion trajectory across studies, characteristics of included studies were addressed and the random effect model was applied to the heterogeneous studies which estimated overall effect size distribution. Furthermore, the significant difference between the two subgroups of imagined and executed movements was analysed.

MAIN RESULTS

The mean of the overall effect size was computed 0.46 across the nonhomogeneous studies. The results showed no significant difference between imagined and executed movements (Chi²=0.28, df = 1, p = 0.60).

SIGNIFICANCE

Meta-analysis results confirm that imagination like execution movements can be used for neural decoding of motion trajectory in neural motor control systems. Also, nonlinear compare with linear model statistically confirmed to be more beneficial for complex movements. Furthermore, a new approach of synergy-based motion decoding can be significantly effective to increase model performance and more research needs to evaluate this method for different levels of complexity of movements.IMPLICATIONS FOR REHABILITATIONNeural decoding methods base on EEG as a non-invasive brain activity, are more user friendly for neurorehabilitation than invasive methods that developing of it makes it more applicable for reconstructing activities of daily living.Neurotechnology for neural control of motion reconstruction, makes the rehabilitation tools to be more synchrony with human intentional movement that can be used to improve the brain neuroplastisity in stroke or other paralysed people.The feasibility and validity of imagined movements equal with executed movements show that amputee people also can benefit EEG-based motion decoding for controling rehabilitation tools just by imagination of their intentional movements.For neurorehabilitation tools, comparing the study outcomes illucidate that the approach of synergy-based motor control in brain activities concluded significantly high performance that highlighted the need it to more investigated in future research.

EEG Analysis in Coincident Timing Task Towards Motor Rehabilitation

The identification of specific components in EEG signals is often key when designing EEG-based brain-computer interfaces (BCIs), and a good understanding of the factors that elicit such components can be helpful when it comes to precise, energy-efficient and time-accurate actuation of exoskeletons. CNVs (Contingent Negative Variations), ERDs or ERSs (Event-Related Desynchronizations/Synchronizations) as well as ErrPs (Error-Related Potentials) are particularly important components can be identified during motor tasks and related to specific events in a Coincident Timing (CT) task. This work investigates offline EEG signals acquired during an upper limb CT task and analyzes the task protocol with the purpose of correlating the aforementioned EEG features to movement onset. CNVs and ERD/ERS were successfully identified after averaging multiple trials, and it was further concluded that complementary information about muscle activity (via EMG) as well as video tracking of arm movement play a critical role in the synchronization of EEG components with movement onset. The framework for EEG analysis presented in this paper allows for future development of a BCI on top of this CT task capable of assessing motor learning and actuating an exoskeleton to enable faster motor rehabilitation.

Upper Limb Bionic Orthoses: General Overview and Forecasting Changes

Using robotics in modern medicine is slowly becoming a common practice. However, there are still important life science fields which are currently devoid of such advanced technology. A noteworthy example of a life sciences field which would benefit from process automation and advanced robotic technology is rehabilitation of the upper limb with the use of an orthosis. Here, we present the state-of-the-art and prospects for development of mechanical design, actuator technology, control systems, sensor systems, and machine learning methods in rehabilitation engineering. Moreover, current technical solutions, as well as forecasts on improvement, for exoskeletons are presented and reviewed. The overview presented might be the cornerstone for future research on advanced rehabilitation engineering technology, such as an upper limb bionic orthosis.

A Systematic Review Establishing the Current State-of-the-Art, the Limitations, and the DESIRED Checklist in Studies of Direct Neural Interfacing With Robotic Gait Devices in Stroke Rehabilitation

Background: Stroke is a disease with a high associated disability burden. Robotic-assisted gait training offers an opportunity for the practice intensity levels associated with good functional walking outcomes in this population. Neural interfacing technology, electroencephalography (EEG), or electromyography (EMG) can offer new strategies for robotic gait re-education after a stroke by promoting more active engagement in movement intent and/or neurophysiological feedback. Objectives: This study identifies the current state-of-the-art and the limitations in direct neural interfacing with robotic gait devices in stroke rehabilitation. Methods: A pre-registered systematic review was conducted using standardized search operators that included the presence of stroke and robotic gait training and neural biosignals (EMG and/or EEG) and was not limited by study type. Results: From a total of 8,899 papers identified, 13 articles were considered for the final selection. Only five of the 13 studies received a strong or moderate quality rating as a clinical study. Three studies recorded EEG activity during robotic gait, two of which used EEG for BCI purposes. While demonstrating utility for decoding kinematic and EMG-related gait data, no EEG study has been identified to close the loop between robot and human. Twelve of the studies recorded EMG activity during or after robotic walking, primarily as an outcome measure. One study used multisource information fusion from EMG, joint angle, and force to modify robotic commands in real time, with higher error rates observed during active movement. A novel study identified used EMG data during robotic gait to derive the optimal, individualized robot-driven step trajectory. Conclusions: Wide heterogeneity in the reporting and the purpose of neurobiosignal use during robotic gait training after a stroke exists. Neural interfacing with robotic gait after a stroke demonstrates promise as a future field of study. However, as a nascent area, direct neural interfacing with robotic gait after a stroke would benefit from a more standardized protocol for biosignal collection and processing and for robotic deployment. Appropriate reporting for clinical studies of this nature is also required with respect to the study type and the participants' characteristics.

Perturbation-evoked potentials can be classified from single-trial EEG

OBJECTIVE

Loss of balance control can have serious consequences on interaction between humans and machines as well as the general well-being of humans. Perceived balance perturbations are always accompanied by a specific cortical activation, the so-called perturbation-evoked potential (PEP). In this study, we investigate the possibility to classify PEPs from ongoing EEG.

APPROACH

Fifteen healthy subjects were exposed to seated whole-body perturbations. Each participant performed 120 trials; they were rapidly tilted to the right and left, 60 times respectively.

MAIN RESULTS

We achieved classification accuracies of more than 85% between PEPs and rest EEG using a window-based classification approach. Different window lengths and electrode layouts were compared. We were able to achieve excellent classification performance (87.6 ± 8.0% accuracy) by using a short window length of 200 ms and a minimal electrode layout consisting of only the Cz electrode. The peak classification accuracy coincides in time with the strongest component of PEPs, called N1.

SIGNIFICANCE

We showed that PEPs can be discriminated against ongoing EEG with high accuracy. These findings can contribute to the development of a system that can detect balance perturbations online.

Decoding Movement-Related Cortical Potentials Based on Subject-Dependent and Section-Wise Spectral Filtering

An important challenge in developing a movement-related cortical potential (MRCP)-based brain-machine interface (BMI) is an accurate decoding of the user intention for real-world environments. However, the performance remains insufficient for real-time decoding owing to the endogenous signal characteristics compared to other BMI paradigms. This study aims to enhance the MRCP decoding performance from the perspective of preprocessing techniques (i.e., spectral filtering). To the best of our knowledge, existing MRCP studies have used spectral filters with a fixed frequency bandwidth for all subjects. Hence, we propose a subject-dependent and section-wise spectral filtering (SSSF) method that considers the subjects' individual MRCP characteristics for two different temporal sections. In this study, MRCP data were acquired under a powered exoskeleton environments in which the subjects conducted self-initiated walking. We evaluated our method using both our experimental data and a public dataset (BNCI Horizon 2020). The decoding performance using the SSSF was 0.86 (±0.09), and the performance on the public dataset was 0.73 (±0.06) across all subjects. The experimental results showed a statistically significant enhancement ( ) compared with the fixed frequency bands used in previous methods on both datasets. In addition, we presented successful decoding results from a pseudo-online analysis. Therefore, we demonstrated that the proposed SSSF method can involve more meaningful MRCP information than conventional methods.

HS-CNN: a CNN with hybrid convolution scale for EEG motor imagery classification

OBJECTIVE

Electroencephalography (EEG) motor imagery classification has been widely used in healthcare applications such as mobile assistive robots and post-stroke rehabilitation. Recently, EEG motor imagery classification methods based on convolutional neural networks (CNNs) have been proposed and have achieved relatively high classification accuracy. However, these methods use single convolution scale in the CNN, while the best convolution scale differs from subject to subject. This limits the classification accuracy. Another issue is that the classification accuracy degrades when training data is limited.

APPROACH

To address these issues, we have proposed a hybrid-scale CNN architecture with a data augmentation method for EEG motor imagery classification.

MAIN RESULTS

Compared with several state-of-the-art methods, the proposed method achieves an average classification accuracy of 91.57% and 87.6% on two commonly used datasets, which outperforms several state-of-the-art EEG motor imagery classification methods.

SIGNIFICANCE

The proposed method effectively addresses the issues of existing CNN-based EEG motor imagery classification methods and improves the classification accuracy.

Decoding Imagined 3D Arm Movement Trajectories From EEG to Control Two Virtual Arms-A Pilot Study

Background: Realization of online control of an artificial or virtual arm using information decoded from EEG normally occurs by classifying different activation states or voluntary modulation of the sensorimotor activity linked to different overt actions of the subject. However, using a more natural control scheme, such as decoding the trajectory of imagined 3D arm movements to move a prosthetic, robotic, or virtual arm has been reported in a limited amount of studies, all using offline feed-forward control schemes.

Objective: In this study, we report the first attempt to realize online control of two virtual arms generating movements toward three targets/arm in 3D space. The 3D trajectory of imagined arm movements was decoded from power spectral density of mu, low beta, high beta, and low gamma EEG oscillations using multiple linear regression. The analysis was performed on a dataset recorded from three subjects in seven sessions wherein each session comprised three experimental blocks: an offline calibration block and two online feedback blocks. Target classification accuracy using predicted trajectories of the virtual arms was computed and compared with results of a filter-bank common spatial patterns (FBCSP) based multi-class classification method involving mutual information (MI) selection and linear discriminant analysis (LDA) modules.

Main Results: Target classification accuracy from predicted trajectory of imagined 3D arm movements in the offline runs for two subjects (mean 45%, std 5%) was significantly higher (p < 0.05) than chance level (33.3%). Nevertheless, the accuracy during real-time control of the virtual arms using the trajectory decoded directly from EEG was in the range of chance level (33.3%). However, the results of two subjects show that false-positive feedback may increase the accuracy in closed-loop. The FBCSP based multi-class classification method distinguished imagined movements of left and right arm with reasonable accuracy for two of the three subjects (mean 70%, std 5% compared to 50% chance level). However, classification of the imagined arm movement toward three targets was not successful with the FBCSP classifier as the achieved accuracy (mean 33%, std 5%) was similar to the chance level (33.3%). Sub-optimal components of the multi-session experimental paradigm were identified, and an improved paradigm proposed.

Academic Review and Perspectives on Robotic Exoskeletons

Since the first robotic exoskeleton was developed in 1960, this research field has attracted much interest from both the academic and industrial communities resulting in scientific publications, prototype developments and commercialized products. In this article, to document the progress in and current status of this field, we performed a bibliometric analysis. This analysis evaluated the publications in the field of robotic exoskeletons from 1990 to July 2019 that were retrieved from the Science Citation Index Expanded database. The bibliometric analyses were presented in terms of author keywords, year, country, institution, journal, author, and the citation. Results show that currently the United States has taken the leading position in this field and has built the largest collaborative network with other countries. The Massachusetts Institute of Technology (MIT) made the greatest contribution to the field of robotic exoskeleton investigations in terms of the number of publications, average citations per publication and the h-index. In addition, the Journal of NeuroEngineering and Rehabilitation ranks first among the top 20 academic journals in terms of the number of publications related to robotic exoskeletons during the period investigated. Author keyword analysis indicates that most research has focused on rehabilitation robotics. Biomedical engineering, rehabilitation and the neurosciences are the most common disciplines conducting research in this area according to the Web of Science (WoS). Our study comprehensively assesses the current research status and collaboration network of robotic exoskeletons, thus helping researchers steer their projects or locate potential collaborators.

Brain-machine interfaces for controlling lower-limb powered robotic systems

OBJECTIVE

Lower-limb, powered robotics systems such as exoskeletons and orthoses have emerged as novel robotic interventions to assist or rehabilitate people with walking disabilities. These devices are generally controlled by certain physical maneuvers, for example pressing buttons or shifting body weight. Although effective, these control schemes are not what humans naturally use. The usability and clinical relevance of these robotics systems could be further enhanced by brain-machine interfaces (BMIs). A number of preliminary studies have been published on this topic, but a systematic understanding of the experimental design, tasks, and performance of BMI-exoskeleton systems for restoration of gait is lacking.

APPROACH

To address this gap, we applied standard systematic review methodology for a literature search in PubMed and EMBASE databases and identified 11 studies involving BMI-robotics systems. The devices, user population, input and output of the BMIs and robot systems respectively, neural features, decoders, denoising techniques, and system performance were reviewed and compared.

MAIN RESULTS

Results showed BMIs classifying walk versus stand tasks are the most common. The results also indicate that electroencephalography (EEG) is the only recording method for humans. Performance was not clearly presented in most of the studies. Several challenges were summarized, including EEG denoising, safety, responsiveness and others.

SIGNIFICANCE

We conclude that lower-body powered exoskeletons with automated gait intention detection based on BMIs open new possibilities in the assistance and rehabilitation fields, although the current performance, clinical benefits and several key challenging issues indicate that additional research and development is required to deploy these systems in the clinic and at home. Moreover, rigorous EEG denoising techniques, suitable performance metrics, consistent trial reporting, and more clinical trials are needed to advance the field.

Unimanual and Bimanual Reach-and-Grasp Actions Can Be Decoded From Human EEG

While most tasks of daily life can be handled through a small number of different grasps, many tasks require the action of both hands. In these bimanual tasks, the second hand has either a supporting role (e.g. for fixating a jar) or a more active role (e.g. grasping a pot on both handles). In this study we attempt to discriminate the neural correlates of unimanual (performed with left and right hand) from bimanual reach-and-grasp actions using the low-frequency time-domain electroencephalogram (EEG). In a self-initiated movement task, 15 healthy participants were asked to perform unimanual (palmar and lateral grasps with left and right hand) and bimanual (double lateral, mixed palmar/lateral) reach-and-grasps on objects of daily life. Using EEG time-domain features in the frequency range of 0.3-3 Hz, we achieved multiclass-classification accuracies of 38.6 ± 6.6% (7 classes, 17.1% chance level) for a combination of 6 movements and 1 rest condition. The grand average confusion matrix shows highest true positive rates (TPR) for the rest (63%) condition while TPR for the movement classes varied between 33 to 41%. The underlying movement-related cortical potentials (MRCPs) show significant differences between unimanual (e.g left hand vs. right hand grasps) as well unimanual vs. bimanual conditions which both can be attributed to lateralization effects. We believe that these findings can be exploited and further used for attempts in providing persons with spinal cord injury a form of natural control for bimanual neuroprostheses.

Characterizing Intent Changes in Exoskeleton-Assisted Walking Through Onboard Sensors

Robotic exoskeletons are a promising technology for rehabilitation and locomotion following musculoskeletal injury, but their adoption outside the physical therapy clinic has been limited by relatively primitive methods for identifying and incorporating the user's gait intentions. Various intent detection approaches have been demonstrated using electromyography and electroencephalography signals. These technologies sense the human directly but introduce complications for donning/doffing the device and in measurement consistency. By contrast, sensors onboard the exoskeleton avoid these complications but sense the human indirectly via the human-robot interface. This pilot study examines if onboard sensors alone may enable identification of user intent. Joint positions and commanded motor currents are compared prior to and after changes in the user's intended gait speed. Preliminary experimental results confirm that these measures are significantly different following intent changes for both able-bodied and non-able-bodied users. The findings suggest that intent detection is possible with onboard sensors alone, but the intent signals depend on exoskeleton control settings, user ability, and temporal considerations.

Detection of reaching intention using EEG signals and nonlinear dynamic system identification

BACKGROUND AND OBJECTIVES

Low frequency electroencephalography (EEG) signals are associated with preparation of movement and thus provide valuable information for brain-machine interface applications. The purpose of this study was to detect movement intention from EEG signals before execution of self-paced arm reaching movements.

METHODS

Ten healthy individuals were recruited. Movement onset was determined from surface electromyography recordings time-locked with EEG signals. Unlike previous studies, which employed feature extraction and classification for decoding, a nonlinear dynamic multiple-input/single output (MISO) model was developed. The MISO model consisted of a cascade of Volterra structures and a threshold block, generating the binary output corresponding to intention/no-intention. The modeling process included input selection from a pool of different EEG channels. The predictive performance of the model was evaluated using the receiver operating characteristics curve, from which the optimum threshold was also selected. The Mann-Whitney statistics was employed to select the significant EEG channels for the output by examining the statistical significance of improvement in the predictive capability of the model when the respective channels were included.

RESULTS

With the proposed approach, movement intention was detected approximately 500 ms before the movement onset and on average, with an accuracy of 96.37 ± 0.94%, a sensitivity of 77.93 ± 4.40% and a specificity of 98.52 ± 1.19%.

CONCLUSIONS

The model output can be converted to motion commands for neuroprosthetic devices and exoskeletons in future applications.

An Attention-Controlled Hand Exoskeleton for the Rehabilitation of Finger Extension and Flexion Using a Rigid-Soft Combined Mechanism

Hand rehabilitation exoskeletons are in need of improving key features such as simplicity, compactness, bi-directional actuation, low cost, portability, safe human-robotic interaction, and intuitive control. This article presents a brain-controlled hand exoskeleton based on a multi-segment mechanism driven by a steel spring. Active rehabilitation training is realized using a threshold of the attention value measured by an electroencephalography (EEG) sensor as a brain-controlled switch for the hand exoskeleton. We present a prototype implementation of this rigid-soft combined multi-segment mechanism with active training and provide a preliminary evaluation. The experimental results showed that the proposed mechanism could generate enough range of motion with a single input by distributing an actuated linear motion into the rotational motions of finger joints during finger flexion/extension. The average attention value in the experiment of concentration with visual guidance was significantly higher than that in the experiment without visual guidance. The feasibility of the attention-based control with visual guidance was proven with an overall exoskeleton actuation success rate of 95.54% (14 human subjects). In the exoskeleton actuation experiment using the general threshold, it performed just as good as using the customized thresholds; therefore, a general threshold of the attention value can be set for a certain group of users in hand exoskeleton activation.

Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury

We show that persons with spinal cord injury (SCI) retain decodable neural correlates of attempted arm and hand movements. We investigated hand open, palmar grasp, lateral grasp, pronation, and supination in 10 persons with cervical SCI. Discriminative movement information was provided by the time-domain of low-frequency electroencephalography (EEG) signals. Based on these signals, we obtained a maximum average classification accuracy of 45% (chance level was 20%) with respect to the five investigated classes. Pattern analysis indicates central motor areas as the origin of the discriminative signals. Furthermore, we introduce a proof-of-concept to classify movement attempts online in a closed loop, and tested it on a person with cervical SCI. We achieved here a modest classification performance of 68.4% with respect to palmar grasp vs hand open (chance level 50%).

Learning Discriminative Spatiospectral Features of ERPs for Accurate Brain-Computer Interfaces

Constructing accurate predictive models is at the heart of brain-computer interfaces (BCIs) because these models can ultimately translate brain activities into communication and control commands. The majority of the previous work in BCI use spatial, temporal, or spatiotemporal features of event-related potentials (ERPs). In this study, we examined the discriminatory effect of their spatiospectral features to capture the most relevant set of neural activities from electroencephalographic recordings that represent users' mental intent. In this regard, we model ERP waveforms using a sum of sinusoids with unknown amplitudes, frequencies, and phases. The effect of this signal modeling step is to represent high-dimensional ERP waveforms in a substantially lower dimensionality space, which includes their dominant power spectral contents. We found that the most discriminative frequencies for accurate decoding of visual attention modulated ERPs lie in a spectral range less than 6.4 Hz. This was empirically verified by treating dominant frequency contents of ERP waveforms as feature vectors in the state-of-the-art machine learning techniques used herein. The constructed predictive models achieved remarkable performance, which for some subjects was as high as 94% as measured by the area under curve. Using these spectral contents, we further studied the discriminatory effect of each channel and proposed an efficient strategy to choose subject-specific subsets of channels that generally led to classifiers with comparable performance.

EEG-Based Control for Upper and Lower Limb Exoskeletons and Prostheses: A Systematic Review

Electroencephalography (EEG) signals have great impact on the development of assistive rehabilitation devices. These signals are used as a popular tool to investigate the functions and the behavior of the human motion in recent research. The study of EEG-based control of assistive devices is still in early stages. Although the EEG-based control of assistive devices has attracted a considerable level of attention over the last few years, few studies have been carried out to systematically review these studies, as a means of offering researchers and experts a comprehensive summary of the present, state-of-the-art EEG-based control techniques used for assistive technology. Therefore, this research has three main goals. The first aim is to systematically gather, summarize, evaluate and synthesize information regarding the accuracy and the value of previous research published in the literature between 2011 and 2018. The second goal is to extensively report on the holistic, experimental outcomes of this domain in relation to current research. It is systematically performed to provide a wealthy image and grounded evidence of the current state of research covering EEG-based control for assistive rehabilitation devices to all the experts and scientists. The third goal is to recognize the gap of knowledge that demands further investigation and to recommend directions for future research in this area.

Early Findings on Functional Connectivity Correlates of Behavioral Outcomes of Brain-Computer Interface Stroke Rehabilitation Using Machine Learning

The primary goal of this work was to apply data-driven machine learning regression to assess if resting state functional connectivity (rs-FC) could estimate measures of behavioral domains in stroke subjects who completed brain-computer interface (BCI) intervention for motor rehabilitation. The study cohort consisted of 20 chronic-stage stroke subjects exhibiting persistent upper-extremity motor deficits who received the intervention using a closed-loop neurofeedback BCI device. Over the course of this intervention, resting state functional MRI scans were collected at four distinct time points: namely, pre-intervention, mid-intervention, post-intervention and 1-month after completion of intervention. Behavioral assessments were administered outside the scanner at each time-point to collect objective measures such as the Action Research Arm Test, Nine-Hole Peg Test, and Barthel Index as well as subjective measures including the Stroke Impact Scale. The present analysis focused on neuroplasticity and behavioral outcomes measured across pre-intervention, post-intervention and 1-month post-intervention to study immediate and carry-over effects. Rs-FC, changes in rs-FC within the motor network and the behavioral measures at preceding stages were used as input features and behavioral measures and associated changes at succeeding stages were used as outcomes for machine-learning-based support vector regression (SVR) models. Potential clinical confounding factors such as age, gender, lesion hemisphere, and stroke severity were included as additional features in each of the regression models. Sequential forward feature selection procedure narrowed the search for important correlates. Behavioral outcomes at preceding time-points outperformed rs-FC-based correlates. Rs-FC and changes associated with bilateral primary motor areas were found to be important correlates of across several behavioral outcomes and were stable upon inclusion of clinical variables as well. NIH Stroke Scale and motor impairment severity were the most influential clinical variables. Comparatively, linear SVR models aided in evaluation of contribution of individual correlates and seed regions while non-linear SVR models achieved higher performance in prediction of behavioral outcomes.

Improving robotic stroke rehabilitation by incorporating neural intent detection: Preliminary results from a clinical trial

This paper presents the preliminary findings of a multi-year clinical study evaluating the effectiveness of adding a brain-machine interface (BMI) to the MAHI-Exo II, a robotic upper limb exoskeleton, for elbow flexion/extension rehabilitation in chronic stroke survivors. The BMI was used to trigger robot motion when movement intention was detected from subjects' neural signals, thus requiring that subjects be mentally engaged during robotic therapy. The first six subjects to complete the program have shown improvements in both Fugl-Meyer Upper-Extremity scores as well as in kinematic movement quality measures that relate to movement planning, coordination, and control. These results are encouraging and suggest that increasing subject engagement during therapy through the addition of an intent-detecting BMI enhances the effectiveness of standard robotic rehabilitation.

EEG-Based Lower-Limb Movement Onset Decoding: Continuous Classification and Asynchronous Detection

Brain-machine interfaces have been used to incorporate the user intention to trigger robotic devices by decoding movement onset from electroencephalography. Active neural participation is crucial to promote brain plasticity thus to enhance the opportunity of motor recovery. This paper presents the decoding of lower-limb movement-related cortical potentials with continuous classification and asynchronous detection. We executed experiments in a customized gait trainer, where 10 healthy subjects performed self-initiated ankle plantar flexion. We further analyzed the features, evaluated the impact of the limb side, and compared the proposed framework with other typical decoding methods. No significant differences were observed between the left and right legs in terms of neural signatures of movement and classification performance. We obtained a higher true positive rate, lower false positives, and comparable latencies with respect to the existing online detection methods. This paper demonstrates the feasibility of the proposed framework to build a closed-loop gait trainer. Potential applications include gait training neurorehabilitation in clinical trials.

Novel tDCS montage favors lower limb motor imagery detection

This work studies a novel transcranial direct current stimulation (tDCS) montage to improve a brain-machine interface (BMI) lower limb motor imagery detection. The tDCS montage is composed by two anodes and one cathode. One anode is located over the motor cortex and the other one over the cerebellum. Ten healthy subjects participated in this experiment. They were randomly separated into two groups: sham, which received a fake stimulation, and active tDCS, which received a real stimulation. Each subject was experimented on five consecutive days. Results pointed out that there was a significant difference $(p < 0 .05)$ in the classification accuracy between the sham and the active tDCS group. On each of the five days of the experiment the active tDCS group achieved better accuracy results than the sham group: 4%, 10%, 10%, 9% and 7% higher respectively.

Towards Control of a Transhumeral Prosthesis with EEG Signals

Robotic prostheses are expected to allow amputees greater freedom and mobility. However, available options to control transhumeral prostheses are reduced with increasing amputation level. In addition, for electromyography-based control of prostheses, the residual muscles alone cannot generate sufficiently different signals for accurate distal arm function. Thus, controlling a multi-degree of freedom (DoF) transhumeral prosthesis is challenging with currently available techniques. In this paper, an electroencephalogram (EEG)-based hierarchical two-stage approach is proposed to achieve multi-DoF control of a transhumeral prosthesis. In the proposed method, the motion intention for arm reaching or hand lifting is identified using classifiers trained with motion-related EEG features. For this purpose, neural network and k-nearest neighbor classifiers are used. Then, elbow motion and hand endpoint motion is estimated using a different set of neural-network-based classifiers, which are trained with motion information recorded using healthy subjects. The predictions from the classifiers are compared with residual limb motion to generate a final prediction of motion intention. This can then be used to realize multi-DoF control of a prosthesis. The experimental results show the feasibility of the proposed method for multi-DoF control of a transhumeral prosthesis. This proof of concept study was performed with healthy subjects.