1
|
Ames KC, Ryu SI, Shenoy KV. Neural dynamics of reaching following incorrect or absent motor preparation. Neuron 2014; 81:438-51. [PMID: 24462104 DOI: 10.1016/j.neuron.2013.11.003] [Citation(s) in RCA: 106] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/29/2013] [Indexed: 12/13/2022]
Abstract
Moving is thought to take separate preparation and execution steps. During preparation, neural activity in primary motor and dorsal premotor cortices achieves a state specific to an upcoming action but movements are not performed until the execution phase. We investigated whether this preparatory state (more precisely, prepare-and-hold state) is required for movement execution using two complementary experiments. We compared monkeys' neural activity during delayed and nondelayed reaches and in a delayed reaching task in which the target switched locations on a small percentage of trials. Neural population activity bypassed the prepare-and-hold state both in the absence of a delay and if the wrong reach was prepared. However, the initial neural response to the target was similar across behavioral conditions. This suggests that the prepare-and-hold state can be bypassed if needed, but there is a short-latency preparatory step that is performed prior to movement even without a delay.
Collapse
Affiliation(s)
- K Cora Ames
- Neurosciences Program, School of Medicine, Stanford University, Stanford, CA 94305, USA
| | - Stephen I Ryu
- Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, CA 94301, USA; Department of Electrical Engineering, Stanford University, Stanford, CA 94305, USA
| | - Krishna V Shenoy
- Neurosciences Program, School of Medicine, Stanford University, Stanford, CA 94305, USA; Department of Electrical Engineering, Stanford University, Stanford, CA 94305, USA; Department of Bioengineering, Stanford University, Stanford, CA 94305, USA; Department of Neurobiology, School of Medicine, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
2
|
Kaufman MT, Churchland MM, Ryu SI, Shenoy KV. Cortical activity in the null space: permitting preparation without movement. Nat Neurosci 2014; 17:440-8. [PMID: 24487233 PMCID: PMC3955357 DOI: 10.1038/nn.3643] [Citation(s) in RCA: 416] [Impact Index Per Article: 41.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2013] [Accepted: 01/06/2014] [Indexed: 12/19/2022]
Abstract
Neural circuits must perform computations and then selectively output the results to other circuits. Yet synapses do not change radically at millisecond timescales. A key question then is: how is communication between neural circuits controlled? In motor control, brain areas directly involved in driving movement are active well before movement begins. Muscle activity is some readout of neural activity, yet remains largely unchanged during preparation. Here we find that during preparation, while the monkey holds still, changes in motor cortical activity cancel out at the level of these population readouts. Motor cortex can thereby prepare the movement without prematurely causing it. Further, we found evidence that this mechanism also operates in dorsal premotor cortex (PMd), largely accounting for how preparatory activity is attenuated in primary motor cortex (M1). Selective use of “output-null” vs. “output-potent” patterns of activity may thus help control communication to the muscles and between these brain areas.
Collapse
Affiliation(s)
- Matthew T Kaufman
- 1] Neurosciences Program, Stanford University, Stanford, California, USA. [2] Department of Electrical Engineering, Stanford University, Stanford, California, USA. [3] Cold Spring Harbor Laboratory, Cold Spring Harbor, New York, USA
| | - Mark M Churchland
- 1] Department of Neuroscience, Columbia University Medical Center, New York, New York, USA. [2] Grossman Center for the Statistics of Mind, Columbia University Medical Center, New York, New York, USA. [3] David Mahoney Center for Brain and Behavior Research, Columbia University Medical Center, New York, New York, USA. [4] Kavli Institute for Brain Science, Columbia University Medical Center, New York, New York, USA
| | - Stephen I Ryu
- 1] Department of Electrical Engineering, Stanford University, Stanford, California, USA. [2] Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, California, USA
| | - Krishna V Shenoy
- 1] Neurosciences Program, Stanford University, Stanford, California, USA. [2] Department of Electrical Engineering, Stanford University, Stanford, California, USA. [3] Department of Bioengineering, Stanford University, Stanford, California, USA. [4] Department of Neurobiology, Stanford University, Stanford, California, USA
| |
Collapse
|
3
|
Paek AY, Brown JD, Gillespie RB, O'Malley MK, Shewokis PA, Contreras-Vidal JL. Reconstructing surface EMG from scalp EEG during myoelectric control of a closed looped prosthetic device. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2013:5602-5605. [PMID: 24111007 DOI: 10.1109/embc.2013.6610820] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
In this study, seven able-bodied human subjects controlled a robotic gripper with surface electromyography (sEMG) activity from the biceps. While subjects controlled the gripper, they felt the forces measured by the robotic gripper through an exoskeleton fitted on their non-dominant left arm. Subjects were instructed to identify objects with the force feedback provided by the exoskeleton. While subjects operated the robotic gripper, scalp electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) were recorded. We developed neural decoders that used scalp EEG to reconstruct the sEMG used to control the robotic gripper. The neural decoders used a genetic algorithm embedded in a linear model with memory to reconstruct the sEMG from a plurality of EEG channels. The performance of the decoders, measured with Pearson correlation coefficients (median r-value = 0.59, maximum r-value = 0.91) was found to be comparable to previous studies that reconstructed sEMG linear envelopes from neural activity recorded with invasive techniques. These results show the feasibility of developing EEG-based neural interfaces that in turn could be used to control a robotic device.
Collapse
|
4
|
Nazarpour K, Ethier C, Paninski L, Rebesco JM, Miall RC, Miller LE. EMG prediction from motor cortical recordings via a nonnegative point-process filter. IEEE Trans Biomed Eng 2012; 59:1829-38. [PMID: 21659018 PMCID: PMC3491878 DOI: 10.1109/tbme.2011.2159115] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
A constrained point-process filtering mechanism for prediction of electromyogram (EMG) signals from multichannel neural spike recordings is proposed here. Filters from the Kalman family are inherently suboptimal in dealing with non-Gaussian observations, or a state evolution that deviates from the Gaussianity assumption. To address these limitations, we modeled the non-Gaussian neural spike train observations by using a generalized linear model that encapsulates covariates of neural activity, including the neurons' own spiking history, concurrent ensemble activity, and extrinsic covariates (EMG signals). In order to predict the envelopes of EMGs, we reformulated the Kalman filter in an optimization framework and utilized a nonnegativity constraint. This structure characterizes the nonlinear correspondence between neural activity and EMG signals reasonably. The EMGs were recorded from 12 forearm and hand muscles of a behaving monkey during a grip-force task. In the case of limited training data, the constrained point-process filter improved the prediction accuracy when compared to a conventional Wiener cascade filter (a linear causal filter followed by a static nonlinearity) for different bin sizes and delays between input spikes and EMG output. For longer training datasets, results of the proposed filter and that of the Wiener cascade filter were comparable.
Collapse
|
5
|
Parker RA, Davis TS, House PA, Normann RA, Greger B. The functional consequences of chronic, physiologically effective intracortical microstimulation. PROGRESS IN BRAIN RESEARCH 2011; 194:145-65. [PMID: 21867801 DOI: 10.1016/b978-0-444-53815-4.00010-8] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2023]
Abstract
Many studies have demonstrated the ability of chronically implanted multielectrode arrays (MEAs) to extract information from the motor cortex of both humans and nonhuman primates. Similarly, many studies have shown the ability of intracortical microstimulation to impart information to the brain via a single or a few electrodes acutely implanted in sensory cortex of nonhuman primates, but relatively few microstimulation studies characterizing chronically implanted MEAs have been performed. Additionally, device and tissue damage have been reported at the levels of microstimulation used in these studies. Whether the damage resulting from microstimulation impairs the ability of MEAs to chronically produce physiological effects, however, has not been directly tested. In this study, we examined the functional consequences of multiple months of periodic microstimulation via chronically implanted MEAs at levels capable of evoking physiological responses, that is, electromyogram (EMG) activity. The functionality of the MEA and neural tissue was determined by measuring impedances, the ability of microstimulation to evoke EMG responses, and the recording of action potentials. We found that impedances and the number of recorded action potentials followed the previously reported trend of decreasing over time in both animals that received microstimulation and those which did not receive microstimulation. Despite these trends, the ability to evoke EMG responses and record action potentials was retained throughout the study. The results of this study suggest that intracortical microstimulation via MEAs did not cause functional failure, suggesting that MEA-based microstimulation is ready to transition into subchronic (< 30 days) human trials to determine whether complex spatiotemporal sensory percepts can be evoked by patterned microstimulation.
Collapse
Affiliation(s)
- Rebecca A Parker
- Interdepartmental Program in Neuroscience, University of Utah, Salt Lake City, UT, USA
| | | | | | | | | |
Collapse
|
6
|
Chestek CA, Gilja V, Nuyujukian P, Foster JD, Fan JM, Kaufman MT, Churchland MM, Rivera-Alvidrez Z, Cunningham JP, Ryu SI, Shenoy KV. Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex. J Neural Eng 2011; 8:045005. [PMID: 21775782 DOI: 10.1088/1741-2560/8/4/045005] [Citation(s) in RCA: 223] [Impact Index Per Article: 17.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Cortically-controlled prosthetic systems aim to help disabled patients by translating neural signals from the brain into control signals for guiding prosthetic devices. Recent reports have demonstrated reasonably high levels of performance and control of computer cursors and prosthetic limbs, but to achieve true clinical viability, the long-term operation of these systems must be better understood. In particular, the quality and stability of the electrically-recorded neural signals require further characterization. Here, we quantify action potential changes and offline neural decoder performance over 382 days of recording from four intracortical arrays in three animals. Action potential amplitude decreased by 2.4% per month on average over the course of 9.4, 10.4, and 31.7 months in three animals. During most time periods, decoder performance was not well correlated with action potential amplitude (p > 0.05 for three of four arrays). In two arrays from one animal, action potential amplitude declined by an average of 37% over the first 2 months after implant. However, when using simple threshold-crossing events rather than well-isolated action potentials, no corresponding performance loss was observed during this time using an offline decoder. One of these arrays was effectively used for online prosthetic experiments over the following year. Substantial short-term variations in waveforms were quantified using a wireless system for contiguous recording in one animal, and compared within and between days for all three animals. Overall, this study suggests that action potential amplitude declines more slowly than previously supposed, and performance can be maintained over the course of multiple years when decoding from threshold-crossing events rather than isolated action potentials. This suggests that neural prosthetic systems may provide high performance over multiple years in human clinical trials.
Collapse
Affiliation(s)
- Cynthia A Chestek
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
7
|
Shenoy KV, Kaufman MT, Sahani M, Churchland MM. A dynamical systems view of motor preparation: implications for neural prosthetic system design. PROGRESS IN BRAIN RESEARCH 2011; 192:33-58. [PMID: 21763517 DOI: 10.1016/b978-0-444-53355-5.00003-8] [Citation(s) in RCA: 55] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Neural prosthetic systems aim to help disabled patients suffering from a range of neurological injuries and disease by using neural activity from the brain to directly control assistive devices. This approach in effect bypasses the dysfunctional neural circuitry, such as an injured spinal cord. To do so, neural prostheses depend critically on a scientific understanding of the neural activity that drives them. We review here several recent studies aimed at understanding the neural processes in premotor cortex that precede arm movements and lead to the initiation of movement. These studies were motivated by hypotheses and predictions conceived of within a dynamical systems perspective. This perspective concentrates on describing the neural state using as few degrees of freedom as possible and on inferring the rules that govern the motion of that neural state. Although quite general, this perspective has led to a number of specific predictions that have been addressed experimentally. It is hoped that the resulting picture of the dynamical role of preparatory and movement-related neural activity will be particularly helpful to the development of neural prostheses, which can themselves be viewed as dynamical systems under the control of the larger dynamical system to which they are attached.
Collapse
Affiliation(s)
- Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, California, USA.
| | | | | | | |
Collapse
|