1
|
Ajiboye AB, Willett FR, Young DR, Memberg WD, Murphy BA, Miller JP, Walter BL, Sweet JA, Hoyen HA, Keith MW, Peckham PH, Simeral JD, Donoghue JP, Hochberg LR, Kirsch RF. Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration. Lancet 2017; 389:1821-1830. [PMID: 28363483 PMCID: PMC5516547 DOI: 10.1016/s0140-6736(17)30601-3] [Citation(s) in RCA: 508] [Impact Index Per Article: 63.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/17/2016] [Revised: 01/02/2017] [Accepted: 01/06/2017] [Indexed: 11/01/2022]
Abstract
BACKGROUND People with chronic tetraplegia, due to high-cervical spinal cord injury, can regain limb movements through coordinated electrical stimulation of peripheral muscles and nerves, known as functional electrical stimulation (FES). Users typically command FES systems through other preserved, but unrelated and limited in number, volitional movements (eg, facial muscle activity, head movements, shoulder shrugs). We report the findings of an individual with traumatic high-cervical spinal cord injury who coordinated reaching and grasping movements using his own paralysed arm and hand, reanimated through implanted FES, and commanded using his own cortical signals through an intracortical brain-computer interface (iBCI). METHODS We recruited a participant into the BrainGate2 clinical trial, an ongoing study that obtains safety information regarding an intracortical neural interface device, and investigates the feasibility of people with tetraplegia controlling assistive devices using their cortical signals. Surgical procedures were performed at University Hospitals Cleveland Medical Center (Cleveland, OH, USA). Study procedures and data analyses were performed at Case Western Reserve University (Cleveland, OH, USA) and the US Department of Veterans Affairs, Louis Stokes Cleveland Veterans Affairs Medical Center (Cleveland, OH, USA). The study participant was a 53-year-old man with a spinal cord injury (cervical level 4, American Spinal Injury Association Impairment Scale category A). He received two intracortical microelectrode arrays in the hand area of his motor cortex, and 4 months and 9 months later received a total of 36 implanted percutaneous electrodes in his right upper and lower arm to electrically stimulate his hand, elbow, and shoulder muscles. The participant used a motorised mobile arm support for gravitational assistance and to provide humeral abduction and adduction under cortical control. We assessed the participant's ability to cortically command his paralysed arm to perform simple single-joint arm and hand movements and functionally meaningful multi-joint movements. We compared iBCI control of his paralysed arm with that of a virtual three-dimensional arm. This study is registered with ClinicalTrials.gov, number NCT00912041. FINDINGS The intracortical implant occurred on Dec 1, 2014, and we are continuing to study the participant. The last session included in this report was Nov 7, 2016. The point-to-point target acquisition sessions began on Oct 8, 2015 (311 days after implant). The participant successfully cortically commanded single-joint and coordinated multi-joint arm movements for point-to-point target acquisitions (80-100% accuracy), using first a virtual arm and second his own arm animated by FES. Using his paralysed arm, the participant volitionally performed self-paced reaches to drink a mug of coffee (successfully completing 11 of 12 attempts within a single session 463 days after implant) and feed himself (717 days after implant). INTERPRETATION To our knowledge, this is the first report of a combined implanted FES+iBCI neuroprosthesis for restoring both reaching and grasping movements to people with chronic tetraplegia due to spinal cord injury, and represents a major advance, with a clear translational path, for clinically viable neuroprostheses for restoration of reaching and grasping after paralysis. FUNDING National Institutes of Health, Department of Veterans Affairs.
Collapse
|
Case Reports |
8 |
508 |
2
|
Simeral JD, Kim SP, Black MJ, Donoghue JP, Hochberg LR. Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array. J Neural Eng 2011; 8:025027. [PMID: 21436513 PMCID: PMC3715131 DOI: 10.1088/1741-2560/8/2/025027] [Citation(s) in RCA: 320] [Impact Index Per Article: 22.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
The ongoing pilot clinical trial of the BrainGate neural interface system aims in part to assess the feasibility of using neural activity obtained from a small-scale, chronically implanted, intracortical microelectrode array to provide control signals for a neural prosthesis system. Critical questions include how long implanted microelectrodes will record useful neural signals, how reliably those signals can be acquired and decoded, and how effectively they can be used to control various assistive technologies such as computers and robotic assistive devices, or to enable functional electrical stimulation of paralyzed muscles. Here we examined these questions by assessing neural cursor control and BrainGate system characteristics on five consecutive days 1000 days after implant of a 4 × 4 mm array of 100 microelectrodes in the motor cortex of a human with longstanding tetraplegia subsequent to a brainstem stroke. On each of five prospectively-selected days we performed time-amplitude sorting of neuronal spiking activity, trained a population-based Kalman velocity decoding filter combined with a linear discriminant click state classifier, and then assessed closed-loop point-and-click cursor control. The participant performed both an eight-target center-out task and a random target Fitts metric task which was adapted from a human-computer interaction ISO standard used to quantify performance of computer input devices. The neural interface system was further characterized by daily measurement of electrode impedances, unit waveforms and local field potentials. Across the five days, spiking signals were obtained from 41 of 96 electrodes and were successfully decoded to provide neural cursor point-and-click control with a mean task performance of 91.3% ± 0.1% (mean ± s.d.) correct target acquisition. Results across five consecutive days demonstrate that a neural interface system based on an intracortical microelectrode array can provide repeatable, accurate point-and-click control of a computer interface to an individual with tetraplegia 1000 days after implantation of this sensor.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
320 |
3
|
Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Black MJ. Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia. J Neural Eng 2008; 5:455-76. [PMID: 19015583 PMCID: PMC2911243 DOI: 10.1088/1741-2560/5/4/010] [Citation(s) in RCA: 253] [Impact Index Per Article: 14.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Computer-mediated connections between human motor cortical neurons and assistive devices promise to improve or restore lost function in people with paralysis. Recently, a pilot clinical study of an intracortical neural interface system demonstrated that a tetraplegic human was able to obtain continuous two-dimensional control of a computer cursor using neural activity recorded from his motor cortex. This control, however, was not sufficiently accurate for reliable use in many common computer control tasks. Here, we studied several central design choices for such a system including the kinematic representation for cursor movement, the decoding method that translates neuronal ensemble spiking activity into a control signal and the cursor control task used during training for optimizing the parameters of the decoding method. In two tetraplegic participants, we found that controlling a cursor's velocity resulted in more accurate closed-loop control than controlling its position directly and that cursor velocity control was achieved more rapidly than position control. Control quality was further improved over conventional linear filters by using a probabilistic method, the Kalman filter, to decode human motor cortical activity. Performance assessment based on standard metrics used for the evaluation of a wide range of pointing devices demonstrated significantly improved cursor control with velocity rather than position decoding.
Collapse
|
Research Support, N.I.H., Extramural |
17 |
253 |
4
|
Hampson RE, Simeral JD, Deadwyler SA. Distribution of spatial and nonspatial information in dorsal hippocampus. Nature 1999; 402:610-4. [PMID: 10604466 DOI: 10.1038/45154] [Citation(s) in RCA: 214] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The hippocampus in the mammalian brain is required for the encoding of current and the retention of past experience. Previous studies have shown that the hippocampus contains neurons that encode information required to perform spatial and nonspatial short-term memory tasks. A more detailed understanding of the functional anatomy of the hippocampus would provide important insight into how such encoding occurs. Here we show that hippocampal neurons in the rat are distributed anatomically in distinct segments along the length of the hippocampus. Each longitudinal segment contains clusters of neurons that become active when the animal performs a task with spatial attributes. Within these same segments are ordered arrangements of neurons that encode the nonspatial aspects of the task appropriate to those spatial features. Thus, anatomical segregation of spatial information, together with the interleaved representation of nonspatial information, represents a structural framework that may help to resolve conflicting views of hippocampal function.
Collapse
|
|
26 |
214 |
5
|
Jarosiewicz B, Sarma AA, Bacher D, Masse NY, Simeral JD, Sorice B, Oakley EM, Blabe C, Pandarinath C, Gilja V, Cash SS, Eskandar EN, Friehs G, Henderson JM, Shenoy KV, Donoghue JP, Hochberg LR. Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface. Sci Transl Med 2016; 7:313ra179. [PMID: 26560357 DOI: 10.1126/scitranslmed.aac7328] [Citation(s) in RCA: 210] [Impact Index Per Article: 23.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Brain-computer interfaces (BCIs) promise to restore independence for people with severe motor disabilities by translating decoded neural activity directly into the control of a computer. However, recorded neural signals are not stationary (that is, can change over time), degrading the quality of decoding. Requiring users to pause what they are doing whenever signals change to perform decoder recalibration routines is time-consuming and impractical for everyday use of BCIs. We demonstrate that signal nonstationarity in an intracortical BCI can be mitigated automatically in software, enabling long periods (hours to days) of self-paced point-and-click typing by people with tetraplegia, without degradation in neural control. Three key innovations were included in our approach: tracking the statistics of the neural activity during self-timed pauses in neural control, velocity bias correction during neural control, and periodically recalibrating the decoder using data acquired during typing by mapping neural activity to movement intentions that are inferred retrospectively based on the user's self-selected targets. These methods, which can be extended to a variety of neurally controlled applications, advance the potential for intracortical BCIs to help restore independent communication and assistive device control for people with paralysis.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
9 |
210 |
6
|
Kim SP, Simeral JD, Hochberg LR, Donoghue JP, Friehs GM, Black MJ. Point-and-click cursor control with an intracortical neural interface system by humans with tetraplegia. IEEE Trans Neural Syst Rehabil Eng 2011; 19:193-203. [PMID: 21278024 PMCID: PMC3294291 DOI: 10.1109/tnsre.2011.2107750] [Citation(s) in RCA: 104] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
We present a point-and-click intracortical neural interface system (NIS) that enables humans with tetraplegia to volitionally move a 2-D computer cursor in any desired direction on a computer screen, hold it still, and click on the area of interest. This direct brain-computer interface extracts both discrete (click) and continuous (cursor velocity) signals from a single small population of neurons in human motor cortex. A key component of this system is a multi-state probabilistic decoding algorithm that simultaneously decodes neural spiking activity of a small population of neurons and outputs either a click signal or the velocity of the cursor. The algorithm combines a linear classifier, which determines whether the user is intending to click or move the cursor, with a Kalman filter that translates the neural population activity into cursor velocity. We present a paradigm for training the multi-state decoding algorithm using neural activity observed during imagined actions. Two human participants with tetraplegia (paralysis of the four limbs) performed a closed-loop radial target acquisition task using the point-and-click NIS over multiple sessions. We quantified point-and-click performance using various human-computer interaction measurements for pointing devices. We found that participants could control the cursor motion and click on specified targets with a small error rate (< 3% in one participant). This study suggests that signals from a small ensemble of motor cortical neurons (∼40) can be used for natural point-and-click 2-D cursor control of a personal computer.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
104 |
7
|
Nuyujukian P, Albites Sanabria J, Saab J, Pandarinath C, Jarosiewicz B, Blabe CH, Franco B, Mernoff ST, Eskandar EN, Simeral JD, Hochberg LR, Shenoy KV, Henderson JM. Cortical control of a tablet computer by people with paralysis. PLoS One 2018; 13:e0204566. [PMID: 30462658 PMCID: PMC6248919 DOI: 10.1371/journal.pone.0204566] [Citation(s) in RCA: 83] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2017] [Accepted: 09/11/2018] [Indexed: 12/16/2022] Open
Abstract
General-purpose computers have become ubiquitous and important for everyday life, but they are difficult for people with paralysis to use. Specialized software and personalized input devices can improve access, but often provide only limited functionality. In this study, three research participants with tetraplegia who had multielectrode arrays implanted in motor cortex as part of the BrainGate2 clinical trial used an intracortical brain-computer interface (iBCI) to control an unmodified commercial tablet computer. Neural activity was decoded in real time as a point-and-click wireless Bluetooth mouse, allowing participants to use common and recreational applications (web browsing, email, chatting, playing music on a piano application, sending text messages, etc.). Two of the participants also used the iBCI to "chat" with each other in real time. This study demonstrates, for the first time, high-performance iBCI control of an unmodified, commercially available, general-purpose mobile computing device by people with tetraplegia.
Collapse
|
Clinical Trial |
7 |
83 |
8
|
Brandman DM, Hosman T, Saab J, Burkhart MC, Shanahan BE, Ciancibello JG, Sarma AA, Milstein DJ, Vargas-Irwin CE, Franco B, Kelemen J, Blabe C, Murphy BA, Young DR, Willett FR, Pandarinath C, Stavisky SD, Kirsch RF, Walter BL, Bolu Ajiboye A, Cash SS, Eskandar EN, Miller JP, Sweet JA, Shenoy KV, Henderson JM, Jarosiewicz B, Harrison MT, Simeral JD, Hochberg LR. Rapid calibration of an intracortical brain-computer interface for people with tetraplegia. J Neural Eng 2019; 15:026007. [PMID: 29363625 DOI: 10.1088/1741-2552/aa9ee7] [Citation(s) in RCA: 75] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Brain-computer interfaces (BCIs) can enable individuals with tetraplegia to communicate and control external devices. Though much progress has been made in improving the speed and robustness of neural control provided by intracortical BCIs, little research has been devoted to minimizing the amount of time spent on decoder calibration. APPROACH We investigated the amount of time users needed to calibrate decoders and achieve performance saturation using two markedly different decoding algorithms: the steady-state Kalman filter, and a novel technique using Gaussian process regression (GP-DKF). MAIN RESULTS Three people with tetraplegia gained rapid closed-loop neural cursor control and peak, plateaued decoder performance within 3 min of initializing calibration. We also show that a BCI-naïve user (T5) was able to rapidly attain closed-loop neural cursor control with the GP-DKF using self-selected movement imagery on his first-ever day of closed-loop BCI use, acquiring a target 37 s after initiating calibration. SIGNIFICANCE These results demonstrate the potential for an intracortical BCI to be used immediately after deployment by people with paralysis, without the need for user learning or extensive system calibration.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
6 |
75 |
9
|
Bacher D, Jarosiewicz B, Masse NY, Stavisky SD, Simeral JD, Newell K, Oakley EM, Cash SS, Friehs G, Hochberg LR. Neural Point-and-Click Communication by a Person With Incomplete Locked-In Syndrome. Neurorehabil Neural Repair 2014; 29:462-71. [PMID: 25385765 DOI: 10.1177/1545968314554624] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
A goal of brain-computer interface research is to develop fast and reliable means of communication for individuals with paralysis and anarthria. We evaluated the ability of an individual with incomplete locked-in syndrome enrolled in the BrainGate Neural Interface System pilot clinical trial to communicate using neural point-and-click control. A general-purpose interface was developed to provide control of a computer cursor in tandem with one of two on-screen virtual keyboards. The novel BrainGate Radial Keyboard was compared to a standard QWERTY keyboard in a balanced copy-spelling task. The Radial Keyboard yielded a significant improvement in typing accuracy and speed-enabling typing rates over 10 correct characters per minute. The participant used this interface to communicate face-to-face with research staff by using text-to-speech conversion, and remotely using an internet chat application. This study demonstrates the first use of an intracortical brain-computer interface for neural point-and-click communication by an individual with incomplete locked-in syndrome.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
11 |
75 |
10
|
Milekovic T, Sarma AA, Bacher D, Simeral JD, Saab J, Pandarinath C, Sorice BL, Blabe C, Oakley EM, Tringale KR, Eskandar E, Cash SS, Henderson JM, Shenoy KV, Donoghue JP, Hochberg LR. Stable long-term BCI-enabled communication in ALS and locked-in syndrome using LFP signals. J Neurophysiol 2018; 120:343-360. [PMID: 29694279 DOI: 10.1152/jn.00493.2017] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023] Open
Abstract
Restoring communication for people with locked-in syndrome remains a challenging clinical problem without a reliable solution. Recent studies have shown that people with paralysis can use brain-computer interfaces (BCIs) based on intracortical spiking activity to efficiently type messages. However, due to neuronal signal instability, most intracortical BCIs have required frequent calibration and continuous assistance of skilled engineers to maintain performance. Here, an individual with locked-in syndrome due to brain stem stroke and an individual with tetraplegia secondary to amyotrophic lateral sclerosis (ALS) used a simple communication BCI based on intracortical local field potentials (LFPs) for 76 and 138 days, respectively, without recalibration and without significant loss of performance. BCI spelling rates of 3.07 and 6.88 correct characters/minute allowed the participants to type messages and write emails. Our results indicate that people with locked-in syndrome could soon use a slow but reliable LFP-based BCI for everyday communication without ongoing intervention from a technician or caregiver. NEW & NOTEWORTHY This study demonstrates, for the first time, stable repeated use of an intracortical brain-computer interface by people with tetraplegia over up to four and a half months. The approach uses local field potentials (LFPs), signals that may be more stable than neuronal action potentials, to decode participants' commands. Throughout the several months of evaluation, the decoder remained unchanged; thus no technical interventions were required to maintain consistent brain-computer interface operation.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
7 |
67 |
11
|
Simeral JD, Hosman T, Saab J, Flesher SN, Vilela M, Franco B, Kelemen J, Brandman DM, Ciancibello JG, Rezaii PG, Eskandar EN, Rosler DM, Shenoy KV, Henderson JM, Nurmikko AV, Hochberg LR. Home Use of a Percutaneous Wireless Intracortical Brain-Computer Interface by Individuals With Tetraplegia. IEEE Trans Biomed Eng 2021; 68:2313-2325. [PMID: 33784612 PMCID: PMC8218873 DOI: 10.1109/tbme.2021.3069119] [Citation(s) in RCA: 62] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
OBJECTIVE Individuals with neurological disease or injury such as amyotrophic lateral sclerosis, spinal cord injury or stroke may become tetraplegic, unable to speak or even locked-in. For people with these conditions, current assistive technologies are often ineffective. Brain-computer interfaces are being developed to enhance independence and restore communication in the absence of physical movement. Over the past decade, individuals with tetraplegia have achieved rapid on-screen typing and point-and-click control of tablet apps using intracortical brain-computer interfaces (iBCIs) that decode intended arm and hand movements from neural signals recorded by implanted microelectrode arrays. However, cables used to convey neural signals from the brain tether participants to amplifiers and decoding computers and require expert oversight, severely limiting when and where iBCIs could be available for use. Here, we demonstrate the first human use of a wireless broadband iBCI. METHODS Based on a prototype system previously used in pre-clinical research, we replaced the external cables of a 192-electrode iBCI with wireless transmitters and achieved high-resolution recording and decoding of broadband field potentials and spiking activity from people with paralysis. Two participants in an ongoing pilot clinical trial completed on-screen item selection tasks to assess iBCI-enabled cursor control. RESULTS Communication bitrates were equivalent between cabled and wireless configurations. Participants also used the wireless iBCI to control a standard commercial tablet computer to browse the web and use several mobile applications. Within-day comparison of cabled and wireless interfaces evaluated bit error rate, packet loss, and the recovery of spike rates and spike waveforms from the recorded neural signals. In a representative use case, the wireless system recorded intracortical signals from two arrays in one participant continuously through a 24-hour period at home. SIGNIFICANCE Wireless multi-electrode recording of broadband neural signals over extended periods introduces a valuable tool for human neuroscience research and is an important step toward practical deployment of iBCI technology for independent use by individuals with paralysis. On-demand access to high-performance iBCI technology in the home promises to enhance independence and restore communication and mobility for individuals with severe motor impairment.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
4 |
62 |
12
|
Chadwick EK, Blana D, Simeral JD, Lambrecht J, Kim SP, Cornwell AS, Taylor DM, Hochberg LR, Donoghue JP, Kirsch RF. Continuous neuronal ensemble control of simulated arm reaching by a human with tetraplegia. J Neural Eng 2011; 8:034003. [PMID: 21543840 PMCID: PMC3608269 DOI: 10.1088/1741-2560/8/3/034003] [Citation(s) in RCA: 62] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Functional electrical stimulation (FES), the coordinated electrical activation of multiple muscles, has been used to restore arm and hand function in people with paralysis. User interfaces for such systems typically derive commands from mechanically unrelated parts of the body with retained volitional control, and are unnatural and unable to simultaneously command the various joints of the arm. Neural interface systems, based on spiking intracortical signals recorded from the arm area of motor cortex, have shown the ability to control computer cursors, robotic arms and individual muscles in intact non-human primates. Such neural interface systems may thus offer a more natural source of commands for restoring dexterous movements via FES. However, the ability to use decoded neural signals to control the complex mechanical dynamics of a reanimated human limb, rather than the kinematics of a computer mouse, has not been demonstrated. This study demonstrates the ability of an individual with long-standing tetraplegia to use cortical neuron recordings to command the real-time movements of a simulated dynamic arm. This virtual arm replicates the dynamics associated with arm mass and muscle contractile properties, as well as those of an FES feedback controller that converts user commands into the required muscle activation patterns. An individual with long-standing tetraplegia was thus able to control a virtual, two-joint, dynamic arm in real time using commands derived from an existing human intracortical interface technology. These results show the feasibility of combining such an intracortical interface with existing FES systems to provide a high-performance, natural system for restoring arm and hand function in individuals with extensive paralysis.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
62 |
13
|
Thompson DE, Quitadamo LR, Mainardi L, Laghari KUR, Gao S, Kindermans PJ, Simeral JD, Fazel-Rezai R, Matteucci M, Falk TH, Bianchi L, Chestek CA, Huggins JE. Performance measurement for brain-computer or brain-machine interfaces: a tutorial. J Neural Eng 2014; 11:035001. [PMID: 24838070 DOI: 10.1088/1741-2560/11/3/035001] [Citation(s) in RCA: 52] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
OBJECTIVE Brain-computer interfaces (BCIs) have the potential to be valuable clinical tools. However, the varied nature of BCIs, combined with the large number of laboratories participating in BCI research, makes uniform performance reporting difficult. To address this situation, we present a tutorial on performance measurement in BCI research. APPROACH A workshop on this topic was held at the 2013 International BCI Meeting at Asilomar Conference Center in Pacific Grove, California. This paper contains the consensus opinion of the workshop members, refined through discussion in the following months and the input of authors who were unable to attend the workshop. MAIN RESULTS Checklists for methods reporting were developed for both discrete and continuous BCIs. Relevant metrics are reviewed for different types of BCI research, with notes on their use to encourage uniform application between laboratories. SIGNIFICANCE Graduate students and other researchers new to BCI research may find this tutorial a helpful introduction to performance measurement in the field.
Collapse
|
Research Support, N.I.H., Extramural |
11 |
52 |
14
|
Hampson RE, Simeral JD, Kelly EJ, Deadwyler SA. Tolerance to the memory disruptive effects of cannabinoids involves adaptation by hippocampal neurons. Hippocampus 2003; 13:543-56. [PMID: 12921345 DOI: 10.1002/hipo.10081] [Citation(s) in RCA: 36] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
The effects of chronic exposure to cannabinoids on short-term memory in rats were assessed during repeated daily injections of an initially debilitating dose (3.75 mg/kg) of the potent CB1 cannabinoid receptor ligand, WIN 55,212-2. Delayed nonmatch to sample (DNMS) performance was assessed over a 35-day exposure period in which performance was initially disrupted during the first 21 days of exposure but recovered by day 30 and was stable at pre-drug levels for 5 days thereafter. Withdrawal was precipitated by injections of the CB1 receptor antagonist SR141716A and transiently reduced performance for 2 days but was restabilized to pre-drug levels within 3-4 days. Concomitant recording from identified CA1 and CA3 hippocampal neurons demonstrated a marked correspondence in the time course of suppression of peak firing in the sample and delay phases of the task to the drug-induced performance deficits over the same days of exposure. Hippocampal encoding of task-relevant events and performance levels "tracked" each other on a daily basis throughout the chronic cannabinoid treatment and withdrawal regimen. However, hippocampal neuronal activity in the nonmatch phase of the task was unaffected by the chronic cannabinoid treatment or withdrawal, suggesting that only a select population of hippocampal neurons and synapses are involved in cannabinoid-sensitive short-term memory processes.
Collapse
|
|
22 |
36 |
15
|
Ajiboye AB, Simeral JD, Donoghue JP, Hochberg LR, Kirsch RF. Prediction of imagined single-joint movements in a person with high-level tetraplegia. IEEE Trans Biomed Eng 2012; 59:2755-65. [PMID: 22851229 DOI: 10.1109/tbme.2012.2209882] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Cortical neuroprostheses for movement restoration require developing models for relating neural activity to desired movement. Previous studies have focused on correlating single-unit activities (SUA) in primary motor cortex to volitional arm movements in able-bodied primates. The extent of the cortical information relevant to arm movements remaining in severely paralyzed individuals is largely unknown. We record intracortical signals using a microelectrode array chronically implanted in the precentral gyrus of a person with tetraplegia, and estimate positions of imagined single-joint arm movements. Using visually guided motor imagery, the participant imagined performing eight distinct single-joint arm movements, while SUA, multispike trains (MSP), multiunit activity, and local field potential time (LFPrms), and frequency signals (LFPstft) were recorded. Using linear system identification, imagined joint trajectories were estimated with 20-60% variance explained, with wrist flexion/extension predicted the best and pronation/supination the poorest. Statistically, decoding of MSP and LFPstft yielded estimates that equaled those of SUA. Including multiple signal types in a decoder increased prediction accuracy in all cases. We conclude that signals recorded from a single restricted region of the precentral gyrus in this person with tetraplegia contained useful information regarding the intended movements of upper extremity joints.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
13 |
34 |
16
|
Willett FR, Pandarinath C, Jarosiewicz B, Murphy BA, Memberg WD, Blabe CH, Saab J, Walter BL, Sweet JA, Miller JP, Henderson JM, Shenoy KV, Simeral JD, Hochberg LR, Kirsch RF, Ajiboye AB. Feedback control policies employed by people using intracortical brain-computer interfaces. J Neural Eng 2016; 14:016001. [PMID: 27900953 DOI: 10.1088/1741-2560/14/1/016001] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
OBJECTIVE When using an intracortical BCI (iBCI), users modulate their neural population activity to move an effector towards a target, stop accurately, and correct for movement errors. We call the rules that govern this modulation a 'feedback control policy'. A better understanding of these policies may inform the design of higher-performing neural decoders. APPROACH We studied how three participants in the BrainGate2 pilot clinical trial used an iBCI to control a cursor in a 2D target acquisition task. Participants used a velocity decoder with exponential smoothing dynamics. Through offline analyses, we characterized the users' feedback control policies by modeling their neural activity as a function of cursor state and target position. We also tested whether users could adapt their policy to different decoder dynamics by varying the gain (speed scaling) and temporal smoothing parameters of the iBCI. MAIN RESULTS We demonstrate that control policy assumptions made in previous studies do not fully describe the policies of our participants. To account for these discrepancies, we propose a new model that captures (1) how the user's neural population activity gradually declines as the cursor approaches the target from afar, then decreases more sharply as the cursor comes into contact with the target, (2) how the user makes constant feedback corrections even when the cursor is on top of the target, and (3) how the user actively accounts for the cursor's current velocity to avoid overshooting the target. Further, we show that users can adapt their control policy to decoder dynamics by attenuating neural modulation when the cursor gain is high and by damping the cursor velocity more strongly when the smoothing dynamics are high. SIGNIFICANCE Our control policy model may help to build better decoders, understand how neural activity varies during active iBCI control, and produce better simulations of closed-loop iBCI movements.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
9 |
31 |
17
|
Song YK, Patterson WR, Bull CW, Beals J, Hwang N, Deangelis AP, Lay C, McKay JL, Nurmikko AV, Fellows MR, Simeral JD, Donoghue JP, Connors BW. Development of a chipscale integrated microelectrode/microelectronic device for brain implantable neuroengineering applications. IEEE Trans Neural Syst Rehabil Eng 2005; 13:220-6. [PMID: 16003903 DOI: 10.1109/tnsre.2005.848337] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
An ultralow power analog CMOS chip and a silicon based microelectrode array have been fully integrated to a microminiaturized "neuroport" for brain implantable neuroengineering applications. The CMOS integrated circuit (IC) includes preamplifier and multiplexing circuitry, and a hybrid flip-chip bonding technique was developed to fabricate a functional, encapsulated microminiaturized neuroprobe device. Our neuroport has been evaluated using various methods, including pseudospike detection and local excitation measurement, and showed suitable characteristics for recording neural activities. As a proof-of-concept demonstration, we have measured local field potentials from thalamocortical brain slices of rats, suggesting that the new neuroport can form a prime platform for the development of a microminiaturized neural interface to the brain in a single implantable unit. An alternative power delivery scheme using photovoltaic power converter, and an encapsulation strategy for chronic implantation are also discussed.
Collapse
|
|
20 |
30 |
18
|
Rubin DB, Hosman T, Kelemen JN, Kapitonava A, Willett FR, Coughlin BF, Halgren E, Kimchi EY, Williams ZM, Simeral JD, Hochberg LR, Cash SS. Learned Motor Patterns Are Replayed in Human Motor Cortex during Sleep. J Neurosci 2022; 42:5007-5020. [PMID: 35589391 PMCID: PMC9233445 DOI: 10.1523/jneurosci.2074-21.2022] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 02/04/2022] [Accepted: 02/28/2022] [Indexed: 11/30/2022] Open
Abstract
Consolidation of memory is believed to involve offline replay of neural activity. While amply demonstrated in rodents, evidence for replay in humans, particularly regarding motor memory, is less compelling. To determine whether replay occurs after motor learning, we sought to record from motor cortex during a novel motor task and subsequent overnight sleep. A 36-year-old man with tetraplegia secondary to cervical spinal cord injury enrolled in the ongoing BrainGate brain-computer interface pilot clinical trial had two 96-channel intracortical microelectrode arrays placed chronically into left precentral gyrus. Single- and multi-unit activity was recorded while he played a color/sound sequence matching memory game. Intended movements were decoded from motor cortical neuronal activity by a real-time steady-state Kalman filter that allowed the participant to control a neurally driven cursor on the screen. Intracortical neural activity from precentral gyrus and 2-lead scalp EEG were recorded overnight as he slept. When decoded using the same steady-state Kalman filter parameters, intracortical neural signals recorded overnight replayed the target sequence from the memory game at intervals throughout at a frequency significantly greater than expected by chance. Replay events occurred at speeds ranging from 1 to 4 times as fast as initial task execution and were most frequently observed during slow-wave sleep. These results demonstrate that recent visuomotor skill acquisition in humans may be accompanied by replay of the corresponding motor cortex neural activity during sleep.SIGNIFICANCE STATEMENT Within cortex, the acquisition of information is often followed by the offline recapitulation of specific sequences of neural firing. Replay of recent activity is enriched during sleep and may support the consolidation of learning and memory. Using an intracortical brain-computer interface, we recorded and decoded activity from motor cortex as a human research participant performed a novel motor task. By decoding neural activity throughout subsequent sleep, we find that neural sequences underlying the recently practiced motor task are repeated throughout the night, providing direct evidence of replay in human motor cortex during sleep. This approach, using an optimized brain-computer interface decoder to characterize neural activity during sleep, provides a framework for future studies exploring replay, learning, and memory.
Collapse
|
Case Reports |
3 |
24 |
19
|
Song YK, Patterson WR, Bull CW, Borton DA, Li Y, Nurmikko AV, Simeral JD, Donoghue JP. A Brain Implantable Microsystem with Hybrid RF/IR Telemetry for Advanced Neuroengineering Applications. ACTA ACUST UNITED AC 2007; 2007:445-8. [DOI: 10.1109/iembs.2007.4352319] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
|
18 |
23 |
20
|
Masse NY, Jarosiewicz B, Simeral JD, Bacher D, Stavisky SD, Cash SS, Oakley EM, Berhanu E, Eskandar E, Friehs G, Hochberg LR, Donoghue JP. Non-causal spike filtering improves decoding of movement intention for intracortical BCIs. J Neurosci Methods 2014; 236:58-67. [PMID: 25128256 DOI: 10.1016/j.jneumeth.2014.08.004] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2014] [Revised: 07/30/2014] [Accepted: 08/05/2014] [Indexed: 10/24/2022]
Abstract
BACKGROUND Multiple types of neural signals are available for controlling assistive devices through brain-computer interfaces (BCIs). Intracortically recorded spiking neural signals are attractive for BCIs because they can in principle provide greater fidelity of encoded information compared to electrocorticographic (ECoG) signals and electroencephalograms (EEGs). Recent reports show that the information content of these spiking neural signals can be reliably extracted simply by causally band-pass filtering the recorded extracellular voltage signals and then applying a spike detection threshold, without relying on "sorting" action potentials. NEW METHOD We show that replacing the causal filter with an equivalent non-causal filter increases the information content extracted from the extracellular spiking signal and improves decoding of intended movement direction. This method can be used for real-time BCI applications by using a 4ms lag between recording and filtering neural signals. RESULTS Across 18 sessions from two people with tetraplegia enrolled in the BrainGate2 pilot clinical trial, we found that threshold crossing events extracted using this non-causal filtering method were significantly more informative of each participant's intended cursor kinematics compared to threshold crossing events derived from causally filtered signals. This new method decreased the mean angular error between the intended and decoded cursor direction by 9.7° for participant S3, who was implanted 5.4 years prior to this study, and by 3.5° for participant T2, who was implanted 3 months prior to this study. CONCLUSIONS Non-causally filtering neural signals prior to extracting threshold crossing events may be a simple yet effective way to condition intracortically recorded neural activity for direct control of external devices through BCIs.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
11 |
23 |
21
|
Vargas-Irwin CE, Feldman JM, King B, Simeral JD, Sorice BL, Oakley EM, Cash SS, Eskandar EN, Friehs GM, Hochberg LR, Donoghue JP. Watch, Imagine, Attempt: Motor Cortex Single-Unit Activity Reveals Context-Dependent Movement Encoding in Humans With Tetraplegia. Front Hum Neurosci 2018; 12:450. [PMID: 30524258 PMCID: PMC6262367 DOI: 10.3389/fnhum.2018.00450] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2018] [Accepted: 10/19/2018] [Indexed: 12/11/2022] Open
Abstract
Planning and performing volitional movement engages widespread networks in the human brain, with motor cortex considered critical to the performance of skilled limb actions. Motor cortex is also engaged when actions are observed or imagined, but the manner in which ensembles of neurons represent these volitional states (VoSs) is unknown. Here we provide direct demonstration that observing, imagining or attempting action activates shared neural ensembles in human motor cortex. Two individuals with tetraplegia (due to brainstem stroke or amyotrophic lateral sclerosis, ALS) were verbally instructed to watch, imagine, or attempt reaching actions displayed on a computer screen. Neural activity in the precentral gyrus incorporated information about both cognitive state and movement kinematics; the three conditions presented overlapping but unique, statistically distinct activity patterns. These findings demonstrate that individual neurons in human motor cortex reflect information related to sensory inputs and VoS in addition to movement features, and are a key part of a broader network linking perception and cognition to action.
Collapse
|
Journal Article |
7 |
20 |
22
|
Willett FR, Young DR, Murphy BA, Memberg WD, Blabe CH, Pandarinath C, Stavisky SD, Rezaii P, Saab J, Walter BL, Sweet JA, Miller JP, Henderson JM, Shenoy KV, Simeral JD, Jarosiewicz B, Hochberg LR, Kirsch RF, Bolu Ajiboye A. Principled BCI Decoder Design and Parameter Selection Using a Feedback Control Model. Sci Rep 2019; 9:8881. [PMID: 31222030 PMCID: PMC6586941 DOI: 10.1038/s41598-019-44166-7] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2018] [Accepted: 03/04/2019] [Indexed: 02/01/2023] Open
Abstract
Decoders optimized offline to reconstruct intended movements from neural recordings sometimes fail to achieve optimal performance online when they are used in closed-loop as part of an intracortical brain-computer interface (iBCI). This is because typical decoder calibration routines do not model the emergent interactions between the decoder, the user, and the task parameters (e.g. target size). Here, we investigated the feasibility of simulating online performance to better guide decoder parameter selection and design. Three participants in the BrainGate2 pilot clinical trial controlled a computer cursor using a linear velocity decoder under different gain (speed scaling) and temporal smoothing parameters and acquired targets with different radii and distances. We show that a user-specific iBCI feedback control model can predict how performance changes under these different decoder and task parameters in held-out data. We also used the model to optimize a nonlinear speed scaling function for the decoder. When used online with two participants, it increased the dynamic range of decoded speeds and decreased the time taken to acquire targets (compared to an optimized standard decoder). These results suggest that it is feasible to simulate iBCI performance accurately enough to be useful for quantitative decoder optimization and design.
Collapse
|
Research Support, U.S. Gov't, Non-P.H.S. |
6 |
18 |
23
|
Rubin DB, Ajiboye AB, Barefoot L, Bowker M, Cash SS, Chen D, Donoghue JP, Eskandar EN, Friehs G, Grant C, Henderson JM, Kirsch RF, Marujo R, Masood M, Mernoff ST, Miller JP, Mukand JA, Penn RD, Shefner J, Shenoy KV, Simeral JD, Sweet JA, Walter BL, Williams ZM, Hochberg LR. Interim Safety Profile From the Feasibility Study of the BrainGate Neural Interface System. Neurology 2023; 100:e1177-e1192. [PMID: 36639237 PMCID: PMC10074470 DOI: 10.1212/wnl.0000000000201707] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Accepted: 11/03/2022] [Indexed: 01/15/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Brain-computer interfaces (BCIs) are being developed to restore mobility, communication, and functional independence to people with paralysis. Though supported by decades of preclinical data, the safety of chronically implanted microelectrode array BCIs in humans is unknown. We report safety results from the prospective, open-label, nonrandomized BrainGate feasibility study (NCT00912041), the largest and longest-running clinical trial of an implanted BCI. METHODS Adults aged 18-75 years with quadriparesis from spinal cord injury, brainstem stroke, or motor neuron disease were enrolled through 7 clinical sites in the United States. Participants underwent surgical implantation of 1 or 2 microelectrode arrays in the motor cortex of the dominant cerebral hemisphere. The primary safety outcome was device-related serious adverse events (SAEs) requiring device explantation or resulting in death or permanently increased disability during the 1-year postimplant evaluation period. The secondary outcomes included the type and frequency of other adverse events and the feasibility of the BrainGate system for controlling a computer or other assistive technologies. RESULTS From 2004 to 2021, 14 adults enrolled in the BrainGate trial had devices surgically implanted. The average duration of device implantation was 872 days, yielding 12,203 days of safety experience. There were 68 device-related adverse events, including 6 device-related SAEs. The most common device-related adverse event was skin irritation around the percutaneous pedestal. There were no safety events that required device explantation, no unanticipated adverse device events, no intracranial infections, and no participant deaths or adverse events resulting in permanently increased disability related to the investigational device. DISCUSSION The BrainGate Neural Interface system has a safety record comparable with other chronically implanted medical devices. Given rapid recent advances in this technology and continued performance gains, these data suggest a favorable risk/benefit ratio in appropriately selected individuals to support ongoing research and development. TRIAL REGISTRATION INFORMATION ClinicalTrials.gov Identifier: NCT00912041. CLASSIFICATION OF EVIDENCE This study provides Class IV evidence that the neurosurgically placed BrainGate Neural Interface system is associated with a low rate of SAEs defined as those requiring device explantation, resulting in death, or resulting in permanently increased disability during the 1-year postimplant period.
Collapse
|
Clinical Trial |
2 |
16 |
24
|
Huggins JE, Guger C, Ziat M, Zander TO, Taylor D, Tangermann M, Soria-Frisch A, Simeral J, Scherer R, Rupp R, Ruffini G, Robinson DKR, Ramsey NF, Nijholt A, Müller-Putz G, McFarland DJ, Mattia D, Lance BJ, Kindermans PJ, Iturrate I, Herff C, Gupta D, Do AH, Collinger JL, Chavarriaga R, Chase SM, Bleichner MG, Batista A, Anderson CW, Aarnoutse EJ. Workshops of the Sixth International Brain-Computer Interface Meeting: brain-computer interfaces past, present, and future. BRAIN-COMPUTER INTERFACES 2017; 4:3-36. [PMID: 29152523 PMCID: PMC5693371 DOI: 10.1080/2326263x.2016.1275488] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The Sixth International Brain-Computer Interface (BCI) Meeting was held 30 May-3 June 2016 at the Asilomar Conference Grounds, Pacific Grove, California, USA. The conference included 28 workshops covering topics in BCI and brain-machine interface research. Topics included BCI for specific populations or applications, advancing BCI research through use of specific signals or technological advances, and translational and commercial issues to bring both implanted and non-invasive BCIs to market. BCI research is growing and expanding in the breadth of its applications, the depth of knowledge it can produce, and the practical benefit it can provide both for those with physical impairments and the general public. Here we provide summaries of each workshop, illustrating the breadth and depth of BCI research and highlighting important issues and calls for action to support future research and development.
Collapse
|
research-article |
8 |
14 |
25
|
Hosman T, Hynes JB, Saab J, Wilcoxen KG, Buchbinder BR, Schmansky N, Cash SS, Eskandar EN, Simeral JD, Franco B, Kelemen J, Vargas-Irwin CE, Hochberg LR. Auditory cues reveal intended movement information in middle frontal gyrus neuronal ensemble activity of a person with tetraplegia. Sci Rep 2021; 11:98. [PMID: 33431994 PMCID: PMC7801741 DOI: 10.1038/s41598-020-77616-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 11/12/2020] [Indexed: 01/29/2023] Open
Abstract
Intracortical brain-computer interfaces (iBCIs) allow people with paralysis to directly control assistive devices using neural activity associated with the intent to move. Realizing the full potential of iBCIs critically depends on continued progress in understanding how different cortical areas contribute to movement control. Here we present the first comparison between neuronal ensemble recordings from the left middle frontal gyrus (MFG) and precentral gyrus (PCG) of a person with tetraplegia using an iBCI. As expected, PCG was more engaged in selecting and generating intended movements than in earlier perceptual stages of action planning. By contrast, MFG displayed movement-related information during the sensorimotor processing steps preceding the appearance of the action plan in PCG, but only when the actions were instructed using auditory cues. These results describe a previously unreported function for neurons in the human left MFG in auditory processing contributing to motor control.
Collapse
|
Research Support, N.I.H., Extramural |
4 |
14 |