A nonlinear model for hippocampal cognitive prosthesis: memory facilitation by hippocampal ensemble stimulation

Neurotechnology and ethics guidelines for human enhancement: The case of the hippocampal cognitive prosthesis

Neurotechnologies offer both therapeutic and enhancement potential. In this article, we demonstrate how ethics guidelines can help with critical reflection on their potential for enhancement. We do this through the case of the hippocampal cognitive prosthesis. This prothesis developed in the US, has primarily therapeutic ends, with scope for enhancement. This technology raises several ethical issues, including as related to identity and memory, autonomy and authenticity. In the first section, we outline what we mean by enhancement, and introduce neurotechnologies generally and the hippocampal cognitive prosthesis specifically, with an introduction to generally relevant ethical issues. In the second section, we outline ethical issues pertinent to the hippocampal cognitive prosthesis and explore how ethics guidelines can help to promote essential critical reflection on a technology like this. Through all this, our emphasis is to balance between technological optimism and caution, especially where technologies have enhancement potential.

Binless Kernel Machine: Modeling Spike Train Transformation for Cognitive Neural Prostheses

Modeling spike train transformation among brain regions helps in designing a cognitive neural prosthesis that restores lost cognitive functions. Various methods analyze the nonlinear dynamic spike train transformation between two cortical areas with low computational eficiency. The application of a real-time neural prosthesis requires computational eficiency, performance stability, and better interpretation of the neural firing patterns that modulate target spike generation. We propose the binless kernel machine in the point-process framework to describe nonlinear dynamic spike train transformations. Our approach embeds the binless kernel to eficiently capture the feedforward dynamics of spike trains and maps the input spike timings into reproducing kernel Hilbert space (RKHS). An inhomogeneous Bernoulli process is designed to combine with a kernel logistic regression that operates on the binless kernel to generate an output spike train as a point process. Weights of the proposed model are estimated by maximizing the log likelihood of output spike trains in RKHS, which allows a global-optimal solution. To reduce computational complexity, we design a streaming-based clustering algorithm to extract typical and important spike train features. The cluster centers and their weights enable the visualization of the important input spike train patterns that motivate or inhibit output neuron firing. We test the proposed model on both synthetic data and real spike train data recorded from the dorsal premotor cortex and the primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaling Kolmogorov-Smirnov tests. Our model outperforms the existing methods with higher stability regardless of weight initialization and demonstrates higher eficiency in analyzing neural patterns from spike timing with less historical input (50%). Meanwhile, the typical spike train patterns selected according to weights are validated to encode output spike from the spike train of single-input neuron and the interaction of two input neurons.

Task-dependent effects of intracranial hippocampal stimulation on human memory and hippocampal theta power

BACKGROUND

Despite its potential to revolutionize the treatment of memory dysfunction, the efficacy of direct electrical hippocampal stimulation for memory performance has not yet been well characterized. One of the main challenges to cross-study comparison in this area of research is the diversity of the cognitive tasks used to measure memory performance.

OBJECTIVE

We hypothesized that the tasks that differentially engage the hippocampus may be differentially influenced by hippocampal stimulation and the behavioral effects would be related to the underlying hippocampal activity.

METHODS

To investigate this issue, we recorded intracranial EEG from and directly applied stimulation to the hippocampus of 10 epilepsy patients while they performed two different verbal memory tasks - a word pair associative memory task and a single item memory task.

RESULTS

Hippocampal stimulation modulated memory performance in a task-dependent manner, improving associative memory performance, while impairing item memory performance. In addition, subjects with poorer baseline cognitive function improved much more with stimulation. iEEG recordings from the hippocampus during non-stimulation encoding blocks revealed that the associative memory task elicited stronger theta oscillations than did item memory and that stronger theta power was related to memory performance.

CONCLUSIONS

We show here for the first time that stimulation-induced associative memory enhancement was linked to increased theta power during retrieval. These results suggest that hippocampal stimulation enhances associative memory but not item memory because it engages more hippocampal theta activity and that, in general, increasing hippocampal theta may provide a neural mechanism for successful memory enhancement.

A K-Medoids based Point-Process Modeling on Neural Spike Transformation using Binless Kernel

A neural prosthesis is designed to compensate for cognitive functional losses by modeling the information transmission among cortical areas. Existing methods generally build a generalized linear model to approximate the nonlinear transformation among two areas, and use the temporal information of the neural spike with low efficiency. It is essential to efficiently model the nonlinearity embedded in spike generation and transmission for the real-time. This paper proposes a nonlinear point-process model to describe spike-in and spike-out transformation using the theory of reproducing kernel Hilbert space (RKHS) and the binless kernel on spike trains. The binless kernel efficiently maps exact spike timing information to the RKHS to describe nonlinear transformations with global minimum regardless of the weight initialization. A streaming K-medoids algorithm is introduced to select typical and important features in this nonlinear binless kernel for further modeling. We test our model on the nonlinearly generated synthetic neural spike trains, and compare with the existing spike transformation methods, such as Volterra model and staged point-process model. The results show that our model has higher goodness-of-fit evaluated by Kolmogorov-Smirnov test and less variance on the prediction results, which indicates the potential better modeling approach for neural prosthesis application.

Real-time cerebellar neuroprosthetic system based on a spiking neural network model of motor learning

OBJECTIVE

Damage to the brain, as a result of various medical conditions, impacts the everyday life of patients and there is still no complete cure to neurological disorders. Neuroprostheses that can functionally replace the damaged neural circuit have recently emerged as a possible solution to these problems. Here we describe the development of a real-time cerebellar neuroprosthetic system to substitute neural function in cerebellar circuitry for learning delay eyeblink conditioning (DEC).

APPROACH

The system was empowered by a biologically realistic spiking neural network (SNN) model of the cerebellar neural circuit, which considers the neuronal population and anatomical connectivity of the network. The model simulated synaptic plasticity critical for learning DEC. This SNN model was carefully implemented on a field programmable gate array (FPGA) platform for real-time simulation. This hardware system was interfaced in in vivo experiments with anesthetized rats and it used neural spikes recorded online from the animal to learn and trigger conditioned eyeblink in the animal during training.

MAIN RESULTS

This rat-FPGA hybrid system was able to process neuronal spikes in real-time with an embedded cerebellum model of ~10 000 neurons and reproduce learning of DEC with different inter-stimulus intervals. Our results validated that the system performance is physiologically relevant at both the neural (firing pattern) and behavioral (eyeblink pattern) levels.

SIGNIFICANCE

This integrated system provides the sufficient computation power for mimicking the cerebellar circuit in real-time. The system interacts with the biological system naturally at the spike level and can be generalized for including other neural components (neuron types and plasticity) and neural functions for potential neuroprosthetic applications.

A Multi-Channel Asynchronous Neurostimulator With Artifact Suppression for Neural Code-Based Stimulations

A novel neurostimulator for generating neural code-based, precise, asynchronous electrical stimulation pulses is designed, fabricated, and characterized. Through multiplexing, this system can deliver constant current biphasic pulses, with arbitrary temporal patterns, and pulse parameters to 32 electrodes using one pulse generator. The design also features a stimulus artifact suppression (SAS) technique that can be integrated with commercial amplifiers. Using an array of CMOS switches, electrodes are disconnected from recording amplifiers during stimulation, while the input of the recording system is shorted to ground through another CMOS switch to suppress ringing in the recording system. The timing of the switches used to block and suppress the stimulus artifact are crucial and are determined by the electrochemical properties of the electrode. This system allows stimulation and recording from the same electrodes to monitor local field potentials with short latencies from the region of stimulation for achieving feedback control of neural stimulation. In this way, timing between each pulse is controlled by inputs from an external source and stimulus magnitude is controlled by feed-back from neural response from the stimulated tissue. The system was implemented with low-power and compact packaged microchips to constitute an effective, cost-efficient, and miniaturized neurostimulator. The device has been first evaluated in phantom preparations and then tested in hippocampi of behaving rats. Benchtop results demonstrate the capability of the stimulator to generate arbitrary spatio-temporal pattern of stimulation pulses dictated by random number generators (RNGs) to control magnitude and timing between each individual biphasic pulse. In vivo results show that evoked potentials elicited by the neurostimulator can be recorded ∼2 ms after the termination of stimulus pulses from the same electrodes where stimulation pulses are delivered, whereas commercial amplifiers without such an artifact suppression typically result in tens to hundreds of milliseconds recovery period. This neurostimulator design is desirable in a variety of neural interface applications, particularly hippocampal memory prosthesis aiming to restore cognitive functions by reinstating neural code transmissions in the brain.

Memory Prosthesis: Is It Time for a Deep Neuromimetic Computing Approach?

Memory loss, one of the most dreaded afflictions of the human condition, presents considerable burden on the world's health care system and it is recognized as a major challenge in the elderly. There are only a few neuromodulation treatments for memory dysfunctions. Open loop deep brain stimulation is such a treatment for memory improvement, but with limited success and conflicting results. In recent years closed-loop neuroprosthesis systems able to simultaneously record signals during behavioral tasks and generate with the use of internal neural factors the precise timing of stimulation patterns are presented as attractive alternatives and show promise in memory enhancement and restoration. A few such strides have already been made in both animals and humans, but with limited insights into their mechanisms of action. Here, I discuss why a deep neuromimetic computing approach linking multiple levels of description, mimicking the dynamics of brain circuits, interfaced with recording and stimulating electrodes could enhance the performance of current memory prosthesis systems, shed light into the neurobiology of learning and memory and accelerate the progress of memory prosthesis research. I propose what the necessary components (nodes, structure, connectivity, learning rules, and physiological responses) of such a deep neuromimetic model should be and what type of data are required to train/test its performance, so it can be used as a true substitute of damaged brain areas capable of restoring/enhancing their missing memory formation capabilities. Considerations to neural circuit targeting, tissue interfacing, electrode placement/implantation, and multi-network interactions in complex cognition are also provided.

Optogenetic Stimulation of the Basolateral Amygdala Increased Theta-Modulated Gamma Oscillations in the Hippocampus

The amygdala can modulate declarative memory. For example, previous research in rats and humans showed that brief electrical stimulation to the basolateral complex of the amygdala (BLA) prioritized specific objects to be consolidated into long term memory in the absence of emotional stimuli and without awareness of stimulation. The capacity of the BLA to influence memory depends on its substantial projections to many other brain regions, including the hippocampus. Nevertheless, how activation of the BLA influences ongoing neuronal activity in other regions is poorly understood. The current study used optogenetic stimulation of putative glutamatergic neurons in the BLA of freely exploring rats to determine whether brief activation of the BLA could increase in the hippocampus gamma oscillations for which the amplitude was modulated by the phase of theta oscillations, an oscillatory state previously reported to correlate with good memory. BLA neurons were stimulated in 1-s bouts with pulse frequencies that included the theta range (8 Hz), the gamma range (50 Hz), or a combination of both ranges (eight 50-Hz bursts). Local field potentials were recorded in the BLA and in the pyramidal layer of CA1 in the intermediate hippocampus. A key question was whether BLA stimulation at either theta or gamma frequencies could combine with ongoing hippocampal oscillations to result in theta-modulated gamma or whether BLA stimulation that included both theta and gamma frequencies would be necessary to increase theta–gamma comodulation in the hippocampus. All stimulation conditions elicited robust responses in BLA and CA1, but theta-modulated gamma oscillations increased in CA1 only when BLA stimulation included both theta and gamma frequencies. Longer bouts (5-s) of BLA stimulation resulted in hippocampal activity that evolved away from the initial oscillatory states and toward those characterized more by prominent low-frequency oscillations. The current results indicated that one mechanism by which the amygdala might influence declarative memory is by eliciting neuronal oscillatory states in the hippocampus that benefit memory.

Direct Stimulation of Human Hippocampus During Verbal Associative Encoding Enhances Subsequent Memory Recollection

Previous studies have reported conflicting results regarding the effect of direct electrical stimulation of the human hippocampus on memory performance. A major function of the hippocampus is to form associations between individual elements of experience. However, the effect of direct hippocampal stimulation on associative memory remains largely inconclusive, with most evidence coming from studies employing non-invasive stimulation. Here, we therefore tested the hypothesis that direct electrical stimulation of the hippocampus specifically enhances hippocampal-dependent associative memory. To test this hypothesis, we recruited surgical patients with implanted subdural electrodes to perform a word pair memory task during which the hippocampus was stimulated. Our results indicate that stimulation of the hippocampus during encoding helped to build strong associative memories and enhanced recollection in subsequent trials. Moreover, stimulation significantly increased theta power in the lateral middle temporal cortex during successful memory encoding. Overall, our findings indicate that hippocampal stimulation positively impacts performance during a word pair memory task, suggesting that successful memory encoding involves the temporal cortex, which may act together with the hippocampus.

How the Hippocampus Represents Memories: Making Sense of Memory Allocation Studies

In recent years there has been a wealth of studies investigating how memories are allocated in the hippocampus. Some of those studies showed that it is possible to manipulate the identity of neurons recruited to represent a given memory without affecting the memory's behavioral expression. Those findings raised questions about how the hippocampus represents memories, with some researchers arguing that hippocampal neurons do not represent fixed stimuli. Herein, an alternative hypothesis is argued. Neurons in high-order brain regions can be tuned to multiple dimensions, forming complex, abstract representations. It is argued that such complex receptive fields allow those neurons to show some flexibility in their responses while still representing relatively fixed sets of stimuli. Moreover, it is pointed out that changes induced by artificial manipulation of cell assemblies are not completely redundant-the observed behavioral redundancy does not imply cognitive redundancy, as different, but similar, memories may induce the same behavior.

ASIC Implementation of a Nonlinear Dynamical Model for Hippocampal Prosthesis

A hippocampal prosthesis is a very large scale integration (VLSI) biochip that needs to be implanted in the biological brain to solve a cognitive dysfunction. In this letter, we propose a novel low-complexity, small-area, and low-power programmable hippocampal neural network application-specific integrated circuit (ASIC) for a hippocampal prosthesis. It is based on the nonlinear dynamical model of the hippocampus: namely multi-input, multi-output (MIMO)-generalized Laguerre-Volterra model (GLVM). It can realize the real-time prediction of hippocampal neural activity. New hardware architecture, a storage space configuration scheme, low-power convolution, and gaussian random number generator modules are proposed. The ASIC is fabricated in 40 nm technology with a core area of 0.122 mm[Formula: see text] and test power of 84.4 [Formula: see text]W. Compared with the design based on the traditional architecture, experimental results show that the core area of the chip is reduced by 84.94% and the core power is reduced by 24.30%.

Multiple Approaches to the Investigation of Cell Assembly in Memory Research-Present and Future

In this review article we focus on research methodologies for detecting the actual activity of cell assemblies, which are populations of functionally connected neurons that encode information in the brain. We introduce and discuss traditional and novel experimental methods and those currently in development and briefly discuss their advantages and disadvantages for the detection of cell-assembly activity. First, we introduce the electrophysiological method, i.e., multineuronal recording, and review former and recent examples of studies showing models of dynamic coding by cell assemblies in behaving rodents and monkeys. We also discuss how the firing correlation of two neurons reflects the firing synchrony among the numerous surrounding neurons that constitute cell assemblies. Second, we review the recent outstanding studies that used the novel method of optogenetics to show causal relationships between cell-assembly activity and behavioral change. Third, we review the most recently developed method of live-cell imaging, which facilitates the simultaneous observation of firings of a large number of neurons in behaving rodents. Currently, all these available methods have both advantages and disadvantages, and no single measurement method can directly and precisely detect the actual activity of cell assemblies. The best strategy is to combine the available methods and utilize each of their advantages with the technique of operant conditioning of multiple-task behaviors in animals and, if necessary, with brain-machine interface technology to verify the accuracy of neural information detected as cell-assembly activity.

Evolving Applications, Technological Challenges and Future Opportunities in Neuromodulation: Proceedings of the Fifth Annual Deep Brain Stimulation Think Tank

The annual Deep Brain Stimulation (DBS) Think Tank provides a focal opportunity for a multidisciplinary ensemble of experts in the field of neuromodulation to discuss advancements and forthcoming opportunities and challenges in the field. The proceedings of the fifth Think Tank summarize progress in neuromodulation neurotechnology and techniques for the treatment of a range of neuropsychiatric conditions including Parkinson's disease, dystonia, essential tremor, Tourette syndrome, obsessive compulsive disorder, epilepsy and cognitive, and motor disorders. Each section of this overview of the meeting provides insight to the critical elements of discussion, current challenges, and identified future directions of scientific and technological development and application. The report addresses key issues in developing, and emphasizes major innovations that have occurred during the past year. Specifically, this year's meeting focused on technical developments in DBS, design considerations for DBS electrodes, improved sensors, neuronal signal processing, advancements in development and uses of responsive DBS (closed-loop systems), updates on National Institutes of Health and DARPA DBS programs of the BRAIN initiative, and neuroethical and policy issues arising in and from DBS research and applications in practice.

Mechanism-Based and Input-Output Modeling of the Key Neuronal Connections and Signal Transformations in the CA3-CA1 Regions of the Hippocampus

This letter examines the results of input-output (nonparametric) modeling based on the analysis of data generated by a mechanism-based (parametric) model of CA3-CA1 neuronal connections in the hippocampus. The motivation is to obtain biological insight into the interpretation of such input-output (Volterra-equivalent) models estimated from synthetic data. The insights obtained may be subsequently used to interpretat input-output models extracted from actual experimental data. Specifically, we found that a simplified parametric model may serve as a useful tool to study the signal transformations in the hippocampal CA3-CA1 regions. Input-output modeling of model-based synthetic data show that GABAergic interneurons are responsible for regulating neuronal excitation, controlling the precision of spike timing, and maintaining network oscillations, in a manner consistent with previous studies. The input-output model obtained from real data exhibits intriguing similarities with its synthetic-data counterpart, demonstrating the importance of a dynamic resonance in the system/model response around 2 Hz to 3 Hz. Using the input-output model from real data as a guide, we may be able to amend the parametric model by incorporating more mechanisms in order to yield better-matching input-output model. The approach we present can also be applied to the study of other neural systems and pathways.

Neuromorphic neural interfaces: from neurophysiological inspiration to biohybrid coupling with nervous systems

OBJECTIVE

Computation in nervous systems operates with different computational primitives, and on different hardware, than traditional digital computation and is thus subjected to different constraints from its digital counterpart regarding the use of physical resources such as time, space and energy. In an effort to better understand neural computation on a physical medium with similar spatiotemporal and energetic constraints, the field of neuromorphic engineering aims to design and implement electronic systems that emulate in very large-scale integration (VLSI) hardware the organization and functions of neural systems at multiple levels of biological organization, from individual neurons up to large circuits and networks. Mixed analog/digital neuromorphic VLSI systems are compact, consume little power and operate in real time independently of the size and complexity of the model.

APPROACH

This article highlights the current efforts to interface neuromorphic systems with neural systems at multiple levels of biological organization, from the synaptic to the system level, and discusses the prospects for future biohybrid systems with neuromorphic circuits of greater complexity.

MAIN RESULTS

Single silicon neurons have been interfaced successfully with invertebrate and vertebrate neural networks. This approach allowed the investigation of neural properties that are inaccessible with traditional techniques while providing a realistic biological context not achievable with traditional numerical modeling methods. At the network level, populations of neurons are envisioned to communicate bidirectionally with neuromorphic processors of hundreds or thousands of silicon neurons. Recent work on brain-machine interfaces suggests that this is feasible with current neuromorphic technology.

SIGNIFICANCE

Biohybrid interfaces between biological neurons and VLSI neuromorphic systems of varying complexity have started to emerge in the literature. Primarily intended as a computational tool for investigating fundamental questions related to neural dynamics, the sophistication of current neuromorphic systems now allows direct interfaces with large neuronal networks and circuits, resulting in potentially interesting clinical applications for neuroengineering systems, neuroprosthetics and neurorehabilitation.

Sparse Large-Scale Nonlinear Dynamical Modeling of Human Hippocampus for Memory Prostheses

In order to build hippocampal prostheses for restoring memory functions, we build sparse multi-input, multi-output (MIMO) nonlinear dynamical models of the human hippocampus. Spike trains are recorded from hippocampal CA3 and CA1 regions of epileptic patients performing a variety of memory-dependent delayed match-to-sample (DMS) tasks. Using CA3 and CA1 spike trains as inputs and outputs respectively, sparse generalized Laguerre-Volterra models are estimated with group lasso and local coordinate descent methods to capture the nonlinear dynamics underlying the CA3-CA1 spike train transformations. These models can accurately predict the CA1 spike trains based on the ongoing CA3 spike trains during multiple memory events, e.g., sample presentation, sample response, match presentation and match response, of the DMS task, and thus will serve as the computational basis of human hippocampal memory prostheses.

A cognitive prosthesis for memory facilitation by closed-loop functional ensemble stimulation of hippocampal neurons in primate brain

Very productive collaborative investigations characterized how multineuron hippocampal ensembles recorded in nonhuman primates (NHPs) encode short-term memory necessary for successful performance in a delayed match to sample (DMS) task and utilized that information to devise a unique nonlinear multi-input multi-output (MIMO) memory prosthesis device to enhance short-term memory in real-time during task performance. Investigations have characterized how the hippocampus in primate brain encodes information in a multi-item, rule-controlled, delayed match to sample (DMS) task. The MIMO model was applied via closed loop feedback micro-current stimulation during the task via conformal electrode arrays and enhanced performance of the complex memory requirements. These findings clearly indicate detection of a means by which the hippocampus encodes information and transmits this information to other brain regions involved in memory processing. By employing the nonlinear dynamic multi-input/multi-output (MIMO) model, developed and adapted to hippocampal neural ensemble firing patterns derived from simultaneous recorded multi-neuron CA1 and CA3 activity, it was possible to extract information encoded in the Sample phase of DMS trials that was necessary for successful performance in the subsequent Match phase of the task. The extension of this MIMO model to online delivery of electrical stimulation patterns to the same recording loci that exhibited successful CA1 firing in the DMS Sample Phase provided the means to increase task performance on a trial-by-trial basis. Increased utility of the MIMO model as a memory prosthesis was exhibited by the demonstration of cumulative increases in DMS task performance with repeated MIMO stimulation over many sessions. These results, reported below in this article, provide the necessary demonstrations to further the feasibility of the MIMO model as a memory prosthesis to recover and/or enhance encoding of cognitive information in humans with memory disruptions resulting from brain injury, disease or aging.

Implantable neurotechnologies: bidirectional neural interfaces--applications and VLSI circuit implementations

A bidirectional neural interface is a device that transfers information into and out of the nervous system. This class of devices has potential to improve treatment and therapy in several patient populations. Progress in very large-scale integration has advanced the design of complex integrated circuits. System-on-chip devices are capable of recording neural electrical activity and altering natural activity with electrical stimulation. Often, these devices include wireless powering and telemetry functions. This review presents the state of the art of bidirectional circuits as applied to neuroprosthetic, neurorepair, and neurotherapeutic systems.

Distributed encoding of spatial and object categories in primate hippocampal microcircuits

The primate hippocampus plays critical roles in the encoding, representation, categorization and retrieval of cognitive information. Such cognitive abilities may use the transformational input-output properties of hippocampal laminar microcircuitry to generate spatial representations and to categorize features of objects, images, and their numeric characteristics. Four nonhuman primates were trained in a delayed-match-to-sample (DMS) task while multi-neuron activity was simultaneously recorded from the CA1 and CA3 hippocampal cell fields. The results show differential encoding of spatial location and categorization of images presented as relevant stimuli in the task. Individual hippocampal cells encoded visual stimuli only on specific types of trials in which retention of either, the Sample image, or the spatial position of the Sample image indicated at the beginning of the trial, was required. Consistent with such encoding, it was shown that patterned microstimulation applied during Sample image presentation facilitated selection of either Sample image spatial locations or types of images, during the Match phase of the task. These findings support the existence of specific codes for spatial and numeric object representations in primate hippocampus which can be applied on differentially signaled trials. Moreover, the transformational properties of hippocampal microcircuitry, together with the patterned microstimulation are supporting the practical importance of this approach for cognitive enhancement and rehabilitation, needed for memory neuroprosthetics.

Laguerre-Volterra identification of spike-timing-dependent plasticity from spiking activity: a simulation study

This paper presents a Laguerre-Volterra methodology for identifying a plasticity learning rule from spiking neural data with four components: 1) By analyzing input-output spiking data, the effective contribution of an input on the output firing probability can be quantified with weighted Volterra kernels. 2) The weight of these Volterra kernels can be tracked over time using the stochastic state point processing filtering algorithm (SSPPF) 3) Plasticity system Volterra kernels can be estimated by treating the tracked change in weight over time as the plasticity system output and the spike timing data as the input. 4) Laguerre expansion of all Volterra kernels allows for minimization of open parameters during estimation steps. A single input spiking neuron with Spike-timing-dependent plasticity (STDP) and prolonged STDP induction is simulated. Using the spiking data from this simulation, the amplitude of the STDP learning rule and the time course of the induction is accurately estimated. This framework can be applied to identify plasticity for more complicated plasticity paradigms and is applicable to in vivo data.

Neurons and networks organizing and sequencing memories

Hippocampal CA1 and CA3 neurons sampled randomly in large numbers in primate brain show conclusive examples of hierarchical encoding of task specific information. Hierarchical encoding allows multi-task utilization of the same hippocampal neural networks via distributed firing between neurons that respond to subsets, attributes or "categories" of stimulus features which can be applied in events in different contexts. In addition, such networks are uniquely adaptable to neural systems unrestricted by rigid synaptic architecture (i.e. columns, layers or "patches") which physically limits the number of possible task-specific interactions between neurons. Also hierarchical encoding is not random; it requires multiple exposures to the same types of relevant events to elevate synaptic connectivity between neurons for different stimulus features that occur in different task-dependent contexts. The large number of cells within associated hierarchical circuits in structures such as hippocampus provides efficient processing of information relevant to common memory-dependent behavioral decisions within different contextual circumstances. This article is part of a Special Issue entitled SI: Brain and Memory.

Identification of functional synaptic plasticity from spiking activities using nonlinear dynamical modeling

This paper presents a systems identification approach for studying the long-term synaptic plasticity using natural spiking activities. This approach consists of three modeling steps. First, a multi-input, single-output (MISO), nonlinear dynamical spiking neuron model is formulated to estimate and represent the synaptic strength in means of functional connectivity between input and output neurons. Second, this MISO model is extended to a nonstationary form to track the time-varying properties of the synaptic strength. Finally, a Volterra modeling method is used to extract the synaptic learning rule, e.g., spike-timing-dependent plasticity, for the explanation of the input-output nonstationarity as the consequence of the past input-output spiking patterns. This framework is developed to study the underlying mechanisms of learning and memory formation in behaving animals, and may serve as the computational basis for building the next-generation adaptive cortical prostheses.

Extraction and restoration of hippocampal spatial memories with non-linear dynamical modeling

To build a cognitive prosthesis that can replace the memory function of the hippocampus, it is essential to model the input-output function of the damaged hippocampal region, so the prosthetic device can stimulate the downstream hippocampal region, e.g., CA1, with the output signal, e.g., CA1 spike trains, predicted from the ongoing input signal, e.g., CA3 spike trains, and the identified input-output function, e.g., CA3-CA1 model. In order for the downstream region to form appropriate long-term memories based on the restored output signal, furthermore, the output signal should contain sufficient information about the memories that the animal has formed. In this study, we verify this premise by applying regression and classification modelings of the spatio-temporal patterns of spike trains to the hippocampal CA3 and CA1 data recorded from rats performing a memory-dependent delayed non-match-to-sample (DNMS) task. The regression model is essentially the multiple-input, multiple-output (MIMO) non-linear dynamical model of spike train transformation. It predicts the output spike trains based on the input spike trains and thus restores the output signal. In addition, the classification model interprets the signal by relating the spatio-temporal patterns to the memory events. We have found that: (1) both hippocampal CA3 and CA1 spike trains contain sufficient information for predicting the locations of the sample responses (i.e., left and right memories) during the DNMS task; and more importantly (2) the CA1 spike trains predicted from the CA3 spike trains by the MIMO model also are sufficient for predicting the locations on a single-trial basis. These results show quantitatively that, with a moderate number of unitary recordings from the hippocampus, the MIMO non-linear dynamical model is able to extract and restore spatial memory information for the formation of long-term memories and thus can serve as the computational basis of the hippocampal memory prosthesis.

Donor/recipient enhancement of memory in rat hippocampus

The critical role of the mammalian hippocampus in the formation, translation and retrieval of memory has been documented over many decades. There are many theories of how the hippocampus operates to encode events and a precise mechanism was recently identified in rats performing a short-term memory task which demonstrated that successful information encoding was promoted via specific patterns of activity generated within ensembles of hippocampal neurons. In the study presented here, these “representations” were extracted via a customized non-linear multi-input multi-output (MIMO) mathematical model which allowed prediction of successful performance on specific trials within the testing session. A unique feature of this characterization was demonstrated when successful information encoding patterns were derived online from well-trained “donor” animals during difficult long-delay trials and delivered via online electrical stimulation to synchronously tested naïve “recipient” animals never before exposed to the delay feature of the task. By transferring such model-derived trained (donor) animal hippocampal firing patterns via stimulation to coupled naïve recipient animals, their task performance was facilitated in a direct “donor-recipient” manner. This provides the basis for utilizing extracted appropriate neural information from one brain to induce, recover, or enhance memory related processing in the brain of another subject.

Facilitation of memory encoding in primate hippocampus by a neuroprosthesis that promotes task-specific neural firing

OBJECTIVE

Memory accuracy is a major problem in human disease and is the primary factor that defines Alzheimer's, ageing and dementia resulting from impaired hippocampal function in the medial temporal lobe. Development of a hippocampal memory neuroprosthesis that facilitates normal memory encoding in nonhuman primates (NHPs) could provide the basis for improving memory in human disease states.

APPROACH

NHPs trained to perform a short-term delayed match-to-sample (DMS) memory task were examined with multi-neuron recordings from synaptically connected hippocampal cell fields, CA1 and CA3. Recordings were analyzed utilizing a previously developed nonlinear multi-input multi-output (MIMO) neuroprosthetic model, capable of extracting CA3-to-CA1 spatiotemporal firing patterns during DMS performance.

MAIN RESULTS

The MIMO model verified that specific CA3-to-CA1 firing patterns were critical for the successful encoding of sample phase information on more difficult DMS trials. This was validated by the delivery of successful MIMO-derived encoding patterns via electrical stimulation to the same CA1 recording locations during the sample phase which facilitated task performance in the subsequent, delayed match phase, on difficult trials that required more precise encoding of sample information.

SIGNIFICANCE

These findings provide the first successful application of a neuroprosthesis designed to enhance and/or repair memory encoding in primate brain.

Deep brain stimulation: a mechanistic and clinical update

Deep brain stimulation (DBS), the practice of placing electrodes deep into the brain to stimulate subcortical structures with electrical current, has been increasing as a neurosurgical procedure over the past 15 years. Originally a treatment for essential tremor, DBS is now used and under investigation across a wide spectrum of neurological and psychiatric disorders. In addition to applying electrical stimulation for clinical symptomatic relief, the electrodes implanted can also be used to record local electrical activity in the brain, making DBS a useful research tool. Human single-neuron recordings and local field potentials are now often recorded intraoperatively as electrodes are implanted. Thus, the increasing scope of DBS clinical applications is being matched by an increase in investigational use, leading to a rapidly evolving understanding of cortical and subcortical neurocircuitry. In this review, the authors discuss recent innovations in the clinical use of DBS, both in approved indications as well as in indications under investigation. Deep brain stimulation as an investigational tool is also reviewed, paying special attention to evolving models of basal ganglia and cortical function in health and disease. Finally, the authors look to the future across several indications, highlighting gaps in knowledge and possible future directions of DBS treatment.

On parsing the neural code in the prefrontal cortex of primates using principal dynamic modes

Nonlinear modeling of multi-input multi-output (MIMO) neuronal systems using Principal Dynamic Modes (PDMs) provides a novel method for analyzing the functional connectivity between neuronal groups. This paper presents the PDM-based modeling methodology and initial results from actual multi-unit recordings in the prefrontal cortex of non-human primates. We used the PDMs to analyze the dynamic transformations of spike train activity from Layer 2 (input) to Layer 5 (output) of the prefrontal cortex in primates performing a Delayed-Match-to-Sample task. The PDM-based models reduce the complexity of representing large-scale neural MIMO systems that involve large numbers of neurons, and also offer the prospect of improved biological/physiological interpretation of the obtained models. PDM analysis of neuronal connectivity in this system revealed "input-output channels of communication" corresponding to specific bands of neural rhythms that quantify the relative importance of these frequency-specific PDMs across a variety of different tasks. We found that behavioral performance during the Delayed-Match-to-Sample task (correct vs. incorrect outcome) was associated with differential activation of frequency-specific PDMs in the prefrontal cortex.

Deep brain stimulation for enhancement of learning and memory

Deep brain stimulation (DBS) has emerged as a powerful technique to treat a host of neurological and neuropsychiatric disorders from Parkinson's disease and dystonia, to depression, and obsessive compulsive disorder (Benabid et al., 1987; Lang and Lozano, 1998; Davis et al., 1997; Vidailhet et al., 2005; Mayberg et al., 2005; Nuttin et al., 1999). More recently, results suggest that DBS can enhance memory for facts and events that are dependent on the medial temporal lobe (MTL), thus raising the possibility for DBS to be used as a treatment for MTL- related neurological disorders (e.g. Alzheimer's disease, temporal lobe epilepsy, and MTL injuries). In the following review, we summarize key results that show the ability of DBS or cortical surface stimulation to enhance memory. We also discuss current knowledge regarding the temporal specificity, underlying neurophysiological mechanisms of action, and generalization of stimulation's effects on memory. Throughout our discussion, we also propose several future directions that will provide the necessary insight into if and how DBS could be used as a therapeutic treatment for memory disorders.

Design of optimal stimulation patterns for neuronal ensembles based on Volterra-type hierarchical modeling

This paper presents a general methodology for the optimal design of stimulation patterns applied to neuronal ensembles in order to elicit a desired effect. The methodology follows a variant of the hierarchical Volterra modeling approach that utilizes input-output data to construct predictive models that describe the effects of interactions among multiple input events in an ascending order of interaction complexity. The illustrative example presented in this paper concerns the multi-unit activity of CA1 neurons in the hippocampus of a rodent performing a learned delayed-nonmatch-to-sample (DNMS) task. The multi-unit activity of the hippocampal CA1 neurons is recorded via chronically implanted multi-electrode arrays during this task. The obtained model quantifies the likelihood of having correct performance of the specific task for a given multi-unit (spatiotemporal) activity pattern of a CA1 neuronal ensemble during the 'sample presentation' phase of the DNMS task. The model can be used to determine computationally (off-line) the 'optimal' multi-unit stimulation pattern that maximizes the likelihood of inducing the correct performance of the DNMS task. Our working hypothesis is that application of this optimal stimulation pattern will enhance performance of the DNMS task due to enhancement of memory formation and storage during the 'sample presentation' phase of the task.

Facilitation and restoration of cognitive function in primate prefrontal cortex by a neuroprosthesis that utilizes minicolumn-specific neural firing

OBJECTIVE

Maintenance of cognitive control is a major concern for many human disease conditions; therefore, a major goal of human neuroprosthetics is to facilitate and/or recover the cognitive function when such circumstances impair appropriate decision making.

APPROACH

Minicolumnar activity from the prefrontal cortex (PFC) was recorded from nonhuman primates trained to perform a delayed match to sample (DMS), via custom-designed conformal multielectrode arrays that provided inter-laminar recordings from neurons in the PFC layer 2/3 and layer 5. Such recordings were analyzed via a previously demonstrated nonlinear multi-input-multi-output (MIMO) neuroprosthesis in rodents, which extracted and characterized multicolumnar firing patterns during DMS performance.

MAIN RESULTS

The MIMO model verified that the conformal recorded individual PFC minicolumns responded to entrained target selections in patterns critical for successful DMS performance. This allowed the substitution of task-related layer 5 neuron firing patterns with electrical stimulation in the same recording regions during columnar transmission from layer 2/3 at the time of target selection. Such stimulation improved normal task performance, but more importantly, recovered performance when applied as a neuroprosthesis following the pharmacological disruption of decision making in the same task.

SIGNIFICANCE

These findings provide the first successful application of neuroprosthesis in the primate brain designed specifically to restore or repair the disrupted cognitive function.

A nonlinear autoregressive Volterra model of the Hodgkin-Huxley equations

We propose a new variant of Volterra-type model with a nonlinear auto-regressive (NAR) component that is a suitable framework for describing the process of AP generation by the neuron membrane potential, and we apply it to input-output data generated by the Hodgkin-Huxley (H-H) equations. Volterra models use a functional series expansion to describe the input-output relation for most nonlinear dynamic systems, and are applicable to a wide range of physiologic systems. It is difficult, however, to apply the Volterra methodology to the H-H model because is characterized by distinct subthreshold and suprathreshold dynamics. When threshold is crossed, an autonomous action potential (AP) is generated, the output becomes temporarily decoupled from the input, and the standard Volterra model fails. Therefore, in our framework, whenever membrane potential exceeds some threshold, it is taken as a second input to a dual-input Volterra model. This model correctly predicts membrane voltage deflection both within the subthreshold region and during APs. Moreover, the model naturally generates a post-AP afterpotential and refractory period. It is known that the H-H model converges to a limit cycle in response to a constant current injection. This behavior is correctly predicted by the proposed model, while the standard Volterra model is incapable of generating such limit cycle behavior. The inclusion of cross-kernels, which describe the nonlinear interactions between the exogenous and autoregressive inputs, is found to be absolutely necessary. The proposed model is general, non-parametric, and data-derived.

Nonlinear modeling of dynamic interactions within neuronal ensembles using Principal Dynamic Modes

A methodology for nonlinear modeling of multi-input multi-output (MIMO) neuronal systems is presented that utilizes the concept of Principal Dynamic Modes (PDM). The efficacy of this new methodology is demonstrated in the study of the dynamic interactions between neuronal ensembles in the Pre-Frontal Cortex (PFC) of a behaving non-human primate (NHP) performing a Delayed Match-to-Sample task. Recorded spike trains from Layer-2 and Layer-5 neurons were viewed as the "inputs" and "outputs", respectively, of a putative MIMO system/model that quantifies the dynamic transformation of multi-unit neuronal activity between Layer-2 and Layer-5 of the PFC. Model prediction performance was evaluated by means of computed Receiver Operating Characteristic (ROC) curves. The PDM-based approach seeks to reduce the complexity of MIMO models of neuronal ensembles in order to enable the practicable modeling of large-scale neural systems incorporating hundreds or thousands of neurons, which is emerging as a preeminent issue in the study of neural function. The "scaling-up" issue has attained critical importance as multi-electrode recordings are increasingly used to probe neural systems and advance our understanding of integrated neural function. The initial results indicate that the PDM-based modeling methodology may greatly reduce the complexity of the MIMO model without significant degradation of performance. Furthermore, the PDM-based approach offers the prospect of improved biological/physiological interpretation of the obtained MIMO models.

Closing the loop for memory prosthesis: detecting the role of hippocampal neural ensembles using nonlinear models

A major factor involved in providing closed loop feedback for control of neural function is to understand how neural ensembles encode online information critical to the final behavioral endpoint. This issue was directly assessed in rats performing a short-term delay memory task in which successful encoding of task information is dependent upon specific spatio-temporal firing patterns recorded from ensembles of CA3 and CA1 hippocampal neurons. Such patterns, extracted by a specially designed nonlinear multi-input multi-output (MIMO) nonlinear mathematical model, were used to predict successful performance online via a closed loop paradigm which regulated trial difficulty (time of retention) as a function of the "strength" of stimulus encoding. The significance of the MIMO model as a neural prosthesis has been demonstrated by substituting trains of electrical stimulation pulses to mimic these same ensemble firing patterns. This feature was used repeatedly to vary "normal" encoding as a means of understanding how neural ensembles can be "tuned" to mimic the inherent process of selecting codes of different strength and functional specificity. The capacity to enhance and tune hippocampal encoding via MIMO model detection and insertion of critical ensemble firing patterns shown here provides the basis for possible extension to other disrupted brain circuitry.

A hippocampal cognitive prosthesis: multi-input, multi-output nonlinear modeling and VLSI implementation

This paper describes the development of a cognitive prosthesis designed to restore the ability to form new long-term memories typically lost after damage to the hippocampus. The animal model used is delayed nonmatch-to-sample (DNMS) behavior in the rat, and the "core" of the prosthesis is a biomimetic multi-input/multi-output (MIMO) nonlinear model that provides the capability for predicting spatio-temporal spike train output of hippocampus (CA1) based on spatio-temporal spike train inputs recorded presynaptically to CA1 (e.g., CA3). We demonstrate the capability of the MIMO model for highly accurate predictions of CA1 coded memories that can be made on a single-trial basis and in real-time. When hippocampal CA1 function is blocked and long-term memory formation is lost, successful DNMS behavior also is abolished. However, when MIMO model predictions are used to reinstate CA1 memory-related activity by driving spatio-temporal electrical stimulation of hippocampal output to mimic the patterns of activity observed in control conditions, successful DNMS behavior is restored. We also outline the design in very-large-scale integration for a hardware implementation of a 16-input, 16-output MIMO model, along with spike sorting, amplification, and other functions necessary for a total system, when coupled together with electrode arrays to record extracellularly from populations of hippocampal neurons, that can serve as a cognitive prosthesis in behaving animals.