Using an Artificial Neural Bypass to Restore Cortical Control of Rhythmic Movements in a Human with Quadriplegia

Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation

High-density electromyography (HD-EMG) can provide a natural interface to enhance human-computer interaction (HCI). This study aims to demonstrate the capability of a novel HD-EMG forearm sleeve equipped with up to 150 electrodes to capture high-resolution muscle activity, decode complex hand gestures, and estimate continuous hand position via joint angle predictions. Ten able-bodied participants performed 37 hand movements and grasps while EMG was recorded using the HD-EMG sleeve. Simultaneously, an 18-sensor motion capture glove calculated 23 joint angles from the hand and fingers across all movements for training regression models. For classifying across the 37 gestures, our decoding algorithm was able to differentiate between sequential movements with 97.3 ± 0.3 % accuracy calculated on a 100 ms bin-by-bin basis. In a separate mixed dataset consisting of 19 movements randomly interspersed, decoding performance achieved an average bin-wise accuracy of 92.8 ± 0.8 % . When evaluating decoders for use in real-time scenarios, we found that decoders can reliably decode both movements and movement transitions, achieving an average accuracy of 93.3 ± 0.9 % on the sequential set and 88.5 ± 0.9 % on the mixed set. Furthermore, we estimated continuous joint angles from the EMG sleeve data, achieving a R 2 of 0.884 ± 0.003 in the sequential set and 0.750 ± 0.008 in the mixed set. Median absolute error (MAE) was kept below 10° across all joints, with a grand average MAE of 1.8 ± 0 . 04 ∘ and 3.4 ± 0 . 07 ∘ for the sequential and mixed datasets, respectively. We also assessed two algorithm modifications to address specific challenges for EMG-driven HCI applications. To minimize decoder latency, we used a method that accounts for reaction time by dynamically shifting cue labels in time. To reduce training requirements, we show that pretraining models with historical data provided an increase in decoding performance compared with models that were not pretrained when reducing the in-session training data to only one attempt of each movement. The HD-EMG sleeve, combined with sophisticated machine learning algorithms, can be a powerful tool for hand gesture recognition and joint angle estimation. This technology holds significant promise for applications in HCI, such as prosthetics, assistive technology, rehabilitation, and human-robot collaboration.

Invasive Brain Computer Interface for Motor Restoration in Spinal Cord Injury: A Systematic Review

STUDY DESIGN

Systematic review of the literature.

OBJECTIVES

In recent years, brain-computer interface (BCI) has emerged as a potential treatment for patients with spinal cord injury (SCI). This is the first systematic review of the literature on invasive closed-loop BCI technologies for the treatment of SCI in humans.

MATERIALS AND METHODS

A comprehensive search of PubMed MEDLINE, Web of Science, and Ovid EMBASE was conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

RESULTS

Of 8316 articles collected, 19 studies met all the inclusion criteria. Data from 21 patients were extracted from these studies. All patients sustained a cervical SCI and were treated using either a BCI with intracortical microelectrode arrays (n = 18, 85.7%) or electrocorticography (n = 3, 14.3%). To decode these neural signals, machine learning and statistical models were used: support vector machine in eight patients (38.1%), linear estimator in seven patients (33.3%), Hidden Markov Model in three patients (14.3%), and other in three patients (14.3%). As the outputs, ten patients (47.6%) underwent noninvasive functional electrical stimulation (FES) with a cuff; one (4.8%) had an invasive FES with percutaneous stimulation, and ten (47.6%) used an external device (neuroprosthesis or virtual avatar). Motor function was restored in all patients for each assigned task. Clinical outcome measures were heterogeneous across all studies.

CONCLUSIONS

Invasive techniques of BCI show promise for the treatment of SCI, but there is currently no technology that can restore complete functional autonomy in patients with SCI. The current techniques and outcomes of BCI vary greatly. Because invasive BCIs are still in the early stages of development, further clinical studies should be conducted to optimize the prognosis for patients with SCI.

A causal perspective on brainwave modeling for brain-computer interfaces

Objective. Machine learning (ML) models have opened up enormous opportunities in the field of brain-computer Interfaces (BCIs). Despite their great success, they usually face severe limitations when they are employed in real-life applications outside a controlled laboratory setting.Approach. Mixing causal reasoning, identifying causal relationships between variables of interest, with brainwave modeling can change one's viewpoint on some of these major challenges which can be found in various stages in the ML pipeline, ranging from data collection and data pre-processing to training methods and techniques.Main results. In this work, we employ causal reasoning and present a framework aiming to breakdown and analyze important challenges of brainwave modeling for BCIs.Significance. Furthermore, we present how general ML practices as well as brainwave-specific techniques can be utilized and solve some of these identified challenges. And finally, we discuss appropriate evaluation schemes in order to measure these techniques' performance and efficiently compare them with other methods that will be developed in the future.

Intracortical brain-computer interfaces for improved motor function: a systematic review

In this systematic review, we address the status of intracortical brain-computer interfaces (iBCIs) applied to the motor cortex to improve function in patients with impaired motor ability. This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 Guidelines for Systematic Reviews. Risk Of Bias In Non-randomized Studies - of Interventions (ROBINS-I) and the Effective Public Health Practice Project (EPHPP) were used to assess bias and quality. Advances in iBCIs in the last two decades demonstrated the use of iBCI to activate limbs for functional tasks, achieve neural typing for communication, and other applications. However, the inconsistency of performance metrics employed by these studies suggests the need for standardization. Each study was a pilot clinical trial consisting of 1-4, majority male (64.28 %) participants, with most trials featuring participants treated for more than 12 months (55.55 %). The systems treated patients with various conditions: amyotrophic lateral sclerosis, stroke, spinocerebellar degeneration without cerebellar involvement, and spinal cord injury. All participants presented with tetraplegia at implantation and were implanted with microelectrode arrays via pneumatic insertion, with nearly all electrode locations solely at the precentral gyrus of the motor cortex (88.88 %). The development of iBCI devices using neural signals from the motor cortex to improve motor-impaired patients has enhanced the ability of these systems to return ability to their users. However, many milestones remain before these devices can prove their feasibility for recovery. This review summarizes the achievements and shortfalls of these systems and their respective trials.

Boosting brain-computer interfaces with functional electrical stimulation: potential applications in people with locked-in syndrome

Individuals with a locked-in state live with severe whole-body paralysis that limits their ability to communicate with family and loved ones. Recent advances in brain-computer interface (BCI) technology have presented a potential alternative for these people to communicate by detecting neural activity associated with attempted hand or speech movements and translating the decoded intended movements to a control signal for a computer. A technique that could potentially enrich the communication capacity of BCIs is functional electrical stimulation (FES) of paralyzed limbs and face to restore body and facial movements of paralyzed individuals, allowing to add body language and facial expression to communication BCI utterances. Here, we review the current state of the art of existing BCI and FES work in people with paralysis of body and face and propose that a combined BCI-FES approach, which has already proved successful in several applications in stroke and spinal cord injury, can provide a novel promising mode of communication for locked-in individuals.

Intracortical brain-computer interfaces in primates: a review and outlook

Brain-computer interfaces (BCI) translate brain signals into artificial output to restore or replace natural central nervous system (CNS) functions. Multiple processes, including sensorimotor integration, decision-making, motor planning, execution, and updating, are involved in any movement. For example, a BCI may be better able to restore naturalistic motor behaviors if it uses signals from multiple brain areas and decodes natural behaviors' cognitive and motor aspects. This review provides an overview of the preliminary information necessary to plan a BCI project focusing on intracortical implants in primates. Since the brain structure and areas of non-human primates (NHP) are similar to humans, exploring the result of NHP studies will eventually benefit human BCI studies. The different types of BCI systems based on the target cortical area, types of signals, and decoding methods will be discussed. In addition, various successful state-of-the-art cases will be reviewed in more detail, focusing on the general algorithm followed in the real-time system. Finally, an outlook for improving the current BCI research studies will be debated.

BCI-activated electrical stimulation in children with perinatal stroke and hemiparesis: A pilot study

Background

Perinatal stroke (PS) causes most hemiparetic cerebral palsy (CP) and results in lifelong disability. Children with severe hemiparesis have limited rehabilitation options. Brain computer interface- activated functional electrical stimulation (BCI-FES) of target muscles may enhance upper extremity function in hemiparetic adults. We conducted a pilot clinical trial to assess the safety and feasibility of BCI-FES in children with hemiparetic CP.

Methods

Thirteen participants (mean age = 12.2 years, 31% female) were recruited from a population-based cohort. Inclusion criteria were: (1) MRI-confirmed PS, (2) disabling hemiparetic CP, (3) age 6–18 years, (4) informed consent/assent. Those with neurological comorbidities or unstable epilepsy were excluded. Participants attended two BCI sessions: training and rehabilitation. They wore an EEG-BCI headset and two forearm extensor stimulation electrodes. Participants’ imagination of wrist extension was classified on EEG, after which muscle stimulation and visual feedback were provided when the correct visualization was detected.

Results

No serious adverse events or dropouts occurred. The most common complaints were mild headache, headset discomfort and muscle fatigue. Children ranked the experience as comparable to a long car ride and none reported as unpleasant. Sessions lasted a mean of 87 min with 33 min of stimulation delivered. Mean classification accuracies were (M = 78.78%, SD = 9.97) for training and (M = 73.48, SD = 12.41) for rehabilitation. Mean Cohen’s Kappa across rehabilitation trials was M = 0.43, SD = 0.29, range = 0.019–1.00, suggesting BCI competency.

Conclusion

Brain computer interface-FES was well -tolerated and feasible in children with hemiparesis. This paves the way for clinical trials to optimize approaches and test efficacy.

Neural Bypasses: Literature Review and Future Directions in Developing Artificial Neural Connections

Reported neuro-modulation schemes in the literature are typically classified as closed-loop or open-loop. A novel group of recently developed neuro-modulation devices may be better described as a neural bypass, which attempts to transmit neural data from one location of the nervous system to another. The most common form of neural bypasses in the literature utilize EEG recordings of cortical information paired with functional electrical stimulation for effector muscle output, most commonly for assistive applications and rehabilitation in spinal cord injury or stroke. Other neural bypass locations that have also been described, or may soon be in development, include cortical-spinal bypasses, cortical-cortical bypasses, autonomic bypasses, peripheral-central bypasses, and inter-subject bypasses. The most common recording devices include EEG, ECoG, and microelectrode arrays, while stimulation devices include both invasive and noninvasive electrodes. Several devices are in development to improve the temporal and spatial resolution and biocompatibility for neuronal recording and stimulation. A major barrier to entry includes neuroplasticity and current decoding mechanisms that regularly require retraining. Neural bypasses are a unique class of neuro-modulation. Continued advancement of neural recording and stimulating devices with high spatial and temporal resolution, combined with decoding mechanisms uninhibited by neuroplasticity, can expand the therapeutic capability of neural bypassing. Overall, neural bypasses are a promising modality to improve the treatment of common neurologic disorders, including stroke, spinal cord injury, peripheral nerve injury, brain injury and more.

Central pattern generator network model for the alternating hind limb gait of rats based on the modified Van der Pol equation

Herein, we employed a central pattern generator (CPG), a spinal cord neural network that regulates lower-limb gait during intra-spinal micro-stimulation (ISMS). Particularly, ISMS was used to determine the spatial distribution pattern of CPG sites in the spinal cord and the signal regulation pattern that induced the CPG network to produce coordinated actions. Based on the oscillation phenomenon of the single CPG neurons of Van der Pol (VDP) oscillators, a double-cell CPG neural network model was constructed to realise double lower limbs, six-joint modelling, the simulation of 12 neural circuits, the CPG loci characterising stimuli-inducing alternating movements and changes in polarity stimulation signals in rat hindlimbs, and leg-state change movements. The feasibility and effectiveness of the CPG neural network were verified by recording the electromyographic burst-release mode of the flexor and extensor muscles of the knee joints during CPG electrical stimulation. The results revealed that the output pattern of the CPG presented stable rhythm and coordination characteristics. The 12-neuron CPG model based on the improved VDP equation realised single-point control while significantly reducing the number of stimulation electrodes in the gait training of spinal cord injury patients. We believe that this study advances motor function recovery in rehabilitation medicine.

Brain-Computer Interfaces in Visualized Medicine

The brain-computer interface (BCI), also known as a brain-machine interface (BMI), has attracted extensive attention in biomedical applications. More importantly, BCI technologies have substantially revolutionized early predictions, diagnostic techniques, and rehabilitation strategies addressing acute diseases because of BCI's innovations and clinical translations. Therefore, in this chapter, a comprehensive description of the basic concepts of BCI will be exhibited, and various visualization techniques employed in BCI's medical applications will be discussed.

Increasing Robustness of Brain-Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals

For brain–computer interfaces (BCIs) to be viable for long-term daily usage, they must be able to quickly identify and adapt to signal disruptions. Furthermore, the detection and mitigation steps need to occur automatically and without the need for user intervention while also being computationally tractable for the low-power hardware that will be used in a deployed BCI system. Here, we focus on disruptions that are likely to occur during chronic use that cause some recording channels to fail but leave the remaining channels unaffected. In these cases, the algorithm that translates recorded neural activity into actions, the neural decoder, should seamlessly identify and adjust to the altered neural signals with minimal inconvenience to the user. First, we introduce an adapted statistical process control (SPC) method that automatically identifies disrupted channels so that both decoding algorithms can be adjusted, and technicians can be alerted. Next, after identifying corrupted channels, we demonstrate the automated and rapid removal of channels from a neural network decoder using a masking approach that does not change the decoding architecture, making it amenable for transfer learning. Finally, using transfer and unsupervised learning techniques, we update the model weights to adjust for the corrupted channels without requiring the user to collect additional calibration data. We demonstrate with both real and simulated neural data that our approach can maintain high-performance while simultaneously minimizing computation time and data storage requirements. This framework is invisible to the user but can dramatically increase BCI robustness and usability.

Historical perspectives, challenges, and future directions of implantable brain-computer interfaces for sensorimotor applications

Almost 100 years ago experiments involving electrically stimulating and recording from the brain and the body launched new discoveries and debates on how electricity, movement, and thoughts are related. Decades later the development of brain-computer interface technology began, which now targets a wide range of applications. Potential uses include augmentative communication for locked-in patients and restoring sensorimotor function in those who are battling disease or have suffered traumatic injury. Technical and surgical challenges still surround the development of brain-computer technology, however, before it can be widely deployed. In this review we explore these challenges, historical perspectives, and the remarkable achievements of clinical study participants who have bravely forged new paths for future beneficiaries.

Can Children With Perinatal Stroke Use a Simple Brain Computer Interface?

[Figure: see text].

Application of a neural interface for restoration of leg movements: Intra-spinal stimulation using the brain electrical activity in spinally injured rabbits

This study aimed to design a neural interface that extracts movement commands from the brain to generate appropriate intra-spinal stimulation to restore leg movement. This study comprised four steps: (1) Recording electrocorticographic (ECoG) signals and corresponding leg movements in different trials. (2) Partial laminectomy to induce spinal cord injury (SCI) and detect motor modules in the spinal cord. (3) Delivering appropriate intra-spinal stimulation to the motor modules for restoration of the movements to those documented before SCI. (4) Development of a neural interface created by sparse linear regression (SLiR) model to detect movement commands transmitted from the brain to the modules. Correlation coefficient (CC) and normalized root mean square (NRMS) error was calculated to evaluate the neural interface effectiveness. It was found that by stimulating detected spinal cord modules, joint angle evaluated before SCI was not significantly different from that of post-SCI (P > 0.05). Based on results of SLiR model, overall CC and NRMS values were 0.63 ± 0.14 and 0.34 ± 0.16 (mean ± SD), respectively. These results indicated that ECoG data contained information about intra-spinal stimulations and the developed neural interface could produce intra-spinal stimulation based on ECoG data, for restoration of leg movements after SCI.

Restoring Movement in Paralysis with a Bioelectronic Neural Bypass Approach: Current State and Future Directions

Bioelectronic medicine is a rapidly growing field that explores targeted neuromodulation in new treatment options addressing both disease and injury. New bioelectronic methods are being developed to monitor and modulate neural activity directly. The therapeutic benefit of these approaches has been validated in recent clinical studies in various conditions, including paralysis. By using decoding and modulation strategies together, it is possible to restore lost function to those living with paralysis and other debilitating conditions by interpreting and rerouting signals around the affected portion of the nervous system. This, in effect, creates a bioelectronic "neural bypass" to serve the function of the damaged/degenerated network. By learning the language of neurons and using neural interface technology to tap into critical networks, new approaches to repairing or restoring function in areas impacted by disease or injury may become a reality.

Closed-loop neuromuscular electrical stimulation using feedforward-feedback control and textile electrodes to regulate grasp force in quadriplegia

BACKGROUND

Transcutaneous neuromuscular electrical stimulation is routinely used in physical rehabilitation and more recently in brain-computer interface applications for restoring movement in paralyzed limbs. Due to variable muscle responses to repeated or sustained stimulation, grasp force levels can change significantly over time. Here we develop and assess closed-loop methods to regulate individual finger forces to facilitate functional movement. We combined this approach with custom textile-based electrodes to form a light-weight, wearable device and evaluated in paralyzed study participants.

METHODS

A textile-based electrode sleeve was developed by the study team and Myant, Corp. (Toronto, ON, Canada) and evaluated in a study involving three able-body participants and two participants with quadriplegia. A feedforward-feedback control structure was designed and implemented to accurately maintain finger force levels in a quadriplegic study participant.

RESULTS

Individual finger flexion and extension movements, along with functional grasping, were evoked during neuromuscular electrical stimulation. Closed-loop control methods allowed accurate steady state performance (< 15% error) with a settling time of 0.67 s (SD = 0.42 s) for individual finger contact force in a participant with quadriplegia.

CONCLUSIONS

Textile-based electrodes were identified to be a feasible alternative to conventional electrodes and facilitated individual finger movement and functional grasping. Furthermore, closed-loop methods demonstrated accurate control of individual finger flexion force. This approach may be a viable solution for enabling grasp force regulation in quadriplegia.

TRIAL REGISTRATION

NCT, NCT03385005. Registered Dec. 28, 2017.

Brain Computer Interfaces in Rehabilitation Medicine

One innovation currently influencing physical medicine and rehabilitation is brain-computer interface (BCI) technology. BCI systems used for motor control record neural activity associated with thoughts, perceptions, and motor intent; decode brain signals into commands for output devices; and perform the user's intended action through an output device. BCI systems used for sensory augmentation transduce environmental stimuli into neural signals interpretable by the central nervous system. Both types of systems have potential for reducing disability by facilitating a user's interaction with the environment. Investigational BCI systems are being used in the rehabilitation setting both as neuroprostheses to replace lost function and as potential plasticity-enhancing therapy tools aimed at accelerating neurorecovery. Populations benefitting from motor and somatosensory BCI systems include those with spinal cord injury, motor neuron disease, limb amputation, and stroke. This article discusses the basic components of BCI for rehabilitation, including recording systems and locations, signal processing and translation algorithms, and external devices controlled through BCI commands. An overview of applications in motor and sensory restoration is provided, along with ethical questions and user perspectives regarding BCI technology.

Human motor decoding from neural signals: a review

Many people suffer from movement disability due to amputation or neurological diseases. Fortunately, with modern neurotechnology now it is possible to intercept motor control signals at various points along the neural transduction pathway and use that to drive external devices for communication or control. Here we will review the latest developments in human motor decoding. We reviewed the various strategies to decode motor intention from human and their respective advantages and challenges. Neural control signals can be intercepted at various points in the neural signal transduction pathway, including the brain (electroencephalography, electrocorticography, intracortical recordings), the nerves (peripheral nerve recordings) and the muscles (electromyography). We systematically discussed the sites of signal acquisition, available neural features, signal processing techniques and decoding algorithms in each of these potential interception points. Examples of applications and the current state-of-the-art performance were also reviewed. Although great strides have been made in human motor decoding, we are still far away from achieving naturalistic and dexterous control like our native limbs. Concerted efforts from material scientists, electrical engineers, and healthcare professionals are needed to further advance the field and make the technology widely available in clinical use.

Clinically Significant Gains in Skillful Grasp Coordination by an Individual With Tetraplegia Using an Implanted Brain-Computer Interface With Forearm Transcutaneous Muscle Stimulation

OBJECTIVE

To demonstrate naturalistic motor control speed, coordinated grasp, and carryover from trained to novel objects by an individual with tetraplegia using a brain-computer interface (BCI)-controlled neuroprosthetic.

DESIGN

Phase I trial for an intracortical BCI integrated with forearm functional electrical stimulation (FES). Data reported span postimplant days 137 to 1478.

SETTING

Tertiary care outpatient rehabilitation center.

PARTICIPANT

A 27-year-old man with C5 class A (on the American Spinal Injury Association Impairment Scale) traumatic spinal cord injury INTERVENTIONS: After array implantation in his left (dominant) motor cortex, the participant trained with BCI-FES to control dynamic, coordinated forearm, wrist, and hand movements.

MAIN OUTCOME MEASURES

Performance on standardized tests of arm motor ability (Graded Redefined Assessment of Strength, Sensibility, and Prehension [GRASSP], Action Research Arm Test [ARAT], Grasp and Release Test [GRT], Box and Block Test), grip myometry, and functional activity measures (Capabilities of Upper Extremity Test [CUE-T], Quadriplegia Index of Function-Short Form [QIF-SF], Spinal Cord Independence Measure-Self-Report [SCIM-SR]) with and without the BCI-FES.

RESULTS

With BCI-FES, scores improved from baseline on the following: Grip force (2.9 kg); ARAT cup, cylinders, ball, bar, and blocks; GRT can, fork, peg, weight, and tape; GRASSP strength and prehension (unscrewing lids, pouring from a bottle, transferring pegs); and CUE-T wrist and hand skills. QIF-SF and SCIM-SR eating, grooming, and toileting activities were expected to improve with home use of BCI-FES. Pincer grips and mobility were unaffected. BCI-FES grip skills enabled the participant to play an adapted "Battleship" game and manipulate household objects.

CONCLUSIONS

Using BCI-FES, the participant performed skillful and coordinated grasps and made clinically significant gains in tests of upper limb function. Practice generalized from training objects to household items and leisure activities. Motor ability improved for palmar, lateral, and tip-to-tip grips. The expects eventual home use to confer greater independence for activities of daily living, consistent with observed neurologic level gains from C5-6 to C7-T1. This marks a critical translational step toward clinical viability for BCI neuroprosthetics.

Neural Prosthetics:A Review of Empirical vs. Systems Engineering Strategies

Implantable electrical interfaces with the nervous system were first enabled by cardiac pacemaker technology over 50 years ago and have since diverged into almost all of the physiological functions controlled by the nervous system. There have been a few major clinical and commercial successes, many contentious claims, and some outright failures. These tend to be reviewed within each clinical subspecialty, obscuring the many commonalities of neural control, biophysics, interface materials, electronic technologies, and medical device regulation that they share. This review cites a selection of foundational and recent journal articles and reviews for all major applications of neural prosthetic interfaces in clinical use, trials, or development. The hard-won knowledge and experience across all of these fields can now be amalgamated and distilled into more systematic processes for development of clinical products instead of the often empirical (trial and error) approaches to date. These include a frank assessment of a specific clinical problem, the state of its underlying science, the identification of feasible targets, the availability of suitable technologies, and the path to regulatory and reimbursement approval. Increasing commercial interest and investment facilitates this systematic approach, but it also motivates projects and products whose claims are dubious.

A Characterization of Brain-Computer Interface Performance Trade-Offs Using Support Vector Machines and Deep Neural Networks to Decode Movement Intent

Laboratory demonstrations of brain-computer interface (BCI) systems show promise for reducing disability associated with paralysis by directly linking neural activity to the control of assistive devices. Surveys of potential users have revealed several key BCI performance criteria for clinical translation of such a system. Of these criteria, high accuracy, short response latencies, and multi-functionality are three key characteristics directly impacted by the neural decoding component of the BCI system, the algorithm that translates neural activity into control signals. Building a decoder that simultaneously addresses these three criteria is complicated because optimizing for one criterion may lead to undesirable changes in the other criteria. Unfortunately, there has been little work to date to quantify how decoder design simultaneously affects these performance characteristics. Here, we systematically explore the trade-off between accuracy, response latency, and multi-functionality for discrete movement classification using two different decoding strategies-a support vector machine (SVM) classifier which represents the current state-of-the-art for discrete movement classification in laboratory demonstrations and a proposed deep neural network (DNN) framework. We utilized historical intracortical recordings from a human tetraplegic study participant, who imagined performing several different hand and finger movements. For both decoders, we found that response time increases (i.e., slower reaction) and accuracy decreases as the number of functions increases. However, we also found that both the increase of response times and the decline in accuracy with additional functions is less for the DNN than the SVM. We also show that data preprocessing steps can affect the performance characteristics of the two decoders in drastically different ways. Finally, we evaluated the performance of our tetraplegic participant using the DNN decoder in real-time to control functional electrical stimulation (FES) of his paralyzed forearm. We compared his performance to that of able-bodied participants performing the same task, establishing a quantitative target for ideal BCI-FES performance on this task. Cumulatively, these results help quantify BCI decoder performance characteristics relevant to potential users and the complex interactions between them.

Meeting brain-computer interface user performance expectations using a deep neural network decoding framework

Brain-computer interface (BCI) neurotechnology has the potential to reduce disability associated with paralysis by translating neural activity into control of assistive devices^1-9. Surveys of potential end-users have identified key BCI system features^10-14, including high accuracy, minimal daily setup, rapid response times, and multifunctionality. These performance characteristics are primarily influenced by the BCI's neural decoding algorithm^1,15, which is trained to associate neural activation patterns with intended user actions. Here, we introduce a new deep neural network¹⁶ decoding framework for BCI systems enabling discrete movements that addresses these four key performance characteristics. Using intracortical data from a participant with tetraplegia, we provide offline results demonstrating that our decoder is highly accurate, sustains this performance beyond a year without explicit daily retraining by combining it with an unsupervised updating procedure^3,17-20, responds faster than competing methods⁸, and can increase functionality with minimal retraining by using a technique known as transfer learning²¹. We then show that our participant can use the decoder in real-time to reanimate his paralyzed forearm with functional electrical stimulation (FES), enabling accurate manipulation of three objects from the grasp and release test (GRT)²². These results demonstrate that deep neural network decoders can advance the clinical translation of BCI technology.

A High Definition Noninvasive Neuromuscular Electrical Stimulation System for Cortical Control of Combinatorial Rotary Hand Movements in a Human With Tetraplegia

OBJECTIVE

Paralysis resulting from spinal cord injury (SCI) can have a devastating effect on multiple arm and hand motor functions. Rotary hand movements, such as supination and pronation, are commonly impaired by upper extremity paralysis, and are essential for many activities of daily living. In this proof-of-concept study, we utilize a neural bypass system (NBS) to decode motor intention from motor cortex to control combinatorial rotary hand movements elicited through stimulation of the arm muscles, effectively bypassing the SCI of the study participant. We describe the NBS system architecture and design that enabled this functionality.

METHODS

The NBS consists of three main functional components: 1) implanted intracortical microelectrode array, 2) neural data processing using a computer, and, 3) a noninvasive neuromuscular electrical stimulation (NMES) system.

RESULTS

We address previous limitations of the NBS, and confirm the enhanced capability of the NBS to enable, in real-time, combinatorial hand rotary motor functions during a functionally relevant object manipulation task.

CONCLUSION

This enhanced capability was enabled by accurate decoding of multiple movement intentions from the participant's motor cortex, interleaving NMES patterns to combine hand movements, and dynamically switching between NMES patterns to adjust for hand position changes during movement.

SIGNIFICANCE

These results have implications for enabling complex rotary hand functions in sequence with other functionally relevant movements for patients suffering from SCI, stroke, and other sensorimotor dysfunctions.

Extracting wavelet based neural features from human intracortical recordings for neuroprosthetics applications

Background

Understanding the long-term behavior of intracortically-recorded signals is essential for improving the performance of Brain Computer Interfaces. However, few studies have systematically investigated chronic neural recordings from an implanted microelectrode array in the human brain.

Methods

In this study, we show the applicability of wavelet decomposition method to extract and demonstrate the utility of long-term stable features in neural signals obtained from a microelectrode array implanted in the motor cortex of a human with tetraplegia. Wavelet decomposition was applied to the raw voltage data to generate mean wavelet power (MWP) features, which were further divided into three sub-frequency bands, low-frequency MWP (lf-MWP, 0–234 Hz), mid-frequency MWP (mf-MWP, 234 Hz–3.75 kHz) and high-frequency MWP (hf-MWP, >3.75 kHz). We analyzed these features using data collected from two experiments that were repeated over the course of about 3 years and compared their signal stability and decoding performance with the more standard threshold crossings, local field potentials (LFP), multi-unit activity (MUA) features obtained from the raw voltage recordings.

Results

All neural features could stably track neural information for over 3 years post-implantation and were less prone to signal degradation compared to threshold crossings. Furthermore, when used as an input to support vector machine based decoding algorithms, the mf-MWP and MUA demonstrated significantly better performance, respectively, in classifying imagined motor tasks than using the lf-MWP, hf-MWP, LFP, or threshold crossings.

Conclusions

Our results suggest that using MWP features in the appropriate frequency bands can provide an effective neural feature for brain computer interface intended for chronic applications.

Trial registration

This study was approved by the U.S. Food and Drug Administration (Investigational Device Exemption) and the Ohio State University Medical Center Institutional Review Board (Columbus, Ohio). The study conformed to institutional requirements for the conduct of human subjects and was filed on ClinicalTrials.gov (Identifier NCT01997125).

Electronic supplementary material

The online version of this article (10.1186/s42234-018-0011-x) contains supplementary material, which is available to authorized users.

Integration of Nanobots Into Neural Circuits As a Future Therapy for Treating Neurodegenerative Disorders

Recent neuroscientific research demonstrates that the human brain is becoming altered by technological devices. Improvements in biotechnologies and computer based technologies are now increasing the likelihood for the development of brain augmentation devices in the next 20 years. We have developed the idea of an “Endomyccorhizae like interface” (ELI) nanocognitive device as a new kind of future neuroprosthetic which aims to facilitate neuronal network properties in individuals with neurodegenerative disorders. The design of our ELI may overcome the problems of invasive neuroprosthetics, post-operative inflammation, and infection and neuroprosthetic degradation. The method in which our ELI is connected and integrated to neuronal networks is based on a mechanism similar to endomyccorhizae which is the oldest and most widespread form of plant symbiosis. We propose that the principle of Endomyccorhizae could be relevant for developing a crossing point between the ELI and neuronal networks. Similar to endomyccorhizae the ELI will be designed to form webs, each of which connects multiple neurons together. The ELI will function to sense action potentials and deliver it to the neurons it connects to. This is expected to compensate for neuronal loss in some neurodegenerative disorders, such as Alzheimer's disease and Parkinson's disease.

Dexterous Control of Seven Functional Hand Movements Using Cortically-Controlled Transcutaneous Muscle Stimulation in a Person With Tetraplegia

Individuals with tetraplegia identify restoration of hand function as a critical, unmet need to regain their independence and improve quality of life. Brain-Computer Interface (BCI)-controlled Functional Electrical Stimulation (FES) technology addresses this need by reconnecting the brain with paralyzed limbs to restore function. In this study, we quantified performance of an intuitive, cortically-controlled, transcutaneous FES system on standardized object manipulation tasks from the Grasp and Release Test (GRT). We found that a tetraplegic individual could use the system to control up to seven functional hand movements, each with >95% individual accuracy. He was able to select one movement from the possible seven movements available to him and use it to appropriately manipulate all GRT objects in real-time using naturalistic grasps. With the use of the system, the participant not only improved his GRT performance over his baseline, demonstrating an increase in number of transfers for all objects except the Block, but also significantly improved transfer times for the heaviest objects (videocassette (VHS), Can). Analysis of underlying motor cortex neural representations associated with the hand grasp states revealed an overlap or non-separability in neural activation patterns for similarly shaped objects that affected BCI-FES performance. These results suggest that motor cortex neural representations for functional grips are likely more related to hand shape and force required to hold objects, rather than to the objects themselves. These results, demonstrating multiple, naturalistic functional hand movements with the BCI-FES, constitute a further step toward translating BCI-FES technologies from research devices to clinical neuroprosthetics.

A Mosquito Inspired Strategy to Implant Microprobes into the Brain

Mosquitos are among the deadliest insects on the planet due to their ability to transmit diseases like malaria through their bite. In order to bite, a mosquito must insert a set of micro-sized needles through the skin to reach vascular structures. The mosquito uses a combination of mechanisms including an insertion guide to enable it to bite and feed off of larger animals. Here, we report on a biomimetic strategy inspired by the mosquito insertion guide to enable the implantation of intracortical microelectrodes into the brain. Next generation microelectrode designs leveraging ultra-small dimensions and/or flexible materials offer the promise of increased performance, but present difficulties in reliable implantation. With the biomimetic guide in place, the rate of successful microprobe insertion increased from 37.5% to 100% due to the rise in the critical buckling force of the microprobes by 3.8-fold. The prototype guides presented here provide a reproducible method to augment the insertion of small, flexible devices into the brain. In the future, similar approaches may be considered and applied to the insertion of other difficult to implant medical devices.

Delivering the Sense of Touch to the Human Brain

Intracortical somatosensory interfaces have now entered the clinical domain. Darie et al. explore the implications of research published in Science Translational Medicine by Flesher et al. (2016), discuss how to design such a system given current technology, and question how to effectively communicate with users about their experience.

Neuroprosthetic-enabled control of graded arm muscle contraction in a paralyzed human

Neuroprosthetics that combine a brain computer interface (BCI) with functional electrical stimulation (FES) can restore voluntary control of a patients’ own paralyzed limbs. To date, human studies have demonstrated an “all-or-none” type of control for a fixed number of pre-determined states, like hand-open and hand-closed. To be practical for everyday use, a BCI-FES system should enable smooth control of limb movements through a continuum of states and generate situationally appropriate, graded muscle contractions. Crucially, this functionality will allow users of BCI-FES neuroprosthetics to manipulate objects of different sizes and weights without dropping or crushing them. In this study, we present the first evidence that using a BCI-FES system, a human with tetraplegia can regain volitional, graded control of muscle contraction in his paralyzed limb. In addition, we show the critical ability of the system to generalize beyond training states and accurately generate wrist flexion states that are intermediate to training levels. These innovations provide the groundwork for enabling enhanced and more natural fine motor control of paralyzed limbs by BCI-FES neuroprosthetics.

Neurophysiology and neural engineering: a review

Neurophysiology is the branch of physiology concerned with understanding the function of neural systems. Neural engineering (also known as neuroengineering) is a discipline within biomedical engineering that uses engineering techniques to understand, repair, replace, enhance, or otherwise exploit the properties and functions of neural systems. In most cases neural engineering involves the development of an interface between electronic devices and living neural tissue. This review describes the origins of neural engineering, the explosive development of methods and devices commencing in the late 1950s, and the present-day devices that have resulted. The barriers to interfacing electronic devices with living neural tissues are many and varied, and consequently there have been numerous stops and starts along the way. Representative examples are discussed. None of this could have happened without a basic understanding of the relevant neurophysiology. I also consider examples of how neural engineering is repaying the debt to basic neurophysiology with new knowledge and insight.

Cracking the neural code, treating paralysis and the future of bioelectronic medicine

The human nervous system is a vast network carrying not only sensory and movement information, but also information to and from our organs, intimately linking it to our overall health. Scientists and engineers have been working for decades to tap into this network and 'crack the neural code' by decoding neural signals and learning how to 'speak' the language of the nervous system. Progress has been made in developing neural decoding methods to decipher brain activity and bioelectronic technologies to treat rheumatoid arthritis, paralysis, epilepsy and for diagnosing brain-related diseases such as Parkinson's and Alzheimer's disease. In a recent first-in-human study involving paralysis, a paralysed male study participant regained movement in his hand, years after his injury, through the use of a bioelectronic neural bypass. This work combined neural decoding and neurostimulation methods to translate and re-route signals around damaged neural pathways within the central nervous system. By extending these methods to decipher neural messages in the peripheral nervous system, status information from our bodily functions and specific organs could be gained. This, one day, could allow real-time diagnostics to be performed to give us a deeper insight into a patient's condition, or potentially even predict disease or allow early diagnosis. The future of bioelectronic medicine is extremely bright and is wide open as new diagnostic and treatment options are developed for patients around the world.