Nonlinear modeling of dynamic interactions within neuronal ensembles using Principal Dynamic Modes

Multi-Input, Multi-Output Neuronal Mode Network Approach to Modeling the Encoding Dynamics and Functional Connectivity of Neural Systems

This letter proposes a novel method, multi-input, multi-output neuronal mode network (MIMO-NMN), for modeling encoding dynamics and functional connectivity in neural ensembles such as the hippocampus. Compared with conventional approaches such as the Volterra-Wiener model, linear-nonlinear-cascade (LNC) model, and generalized linear model (GLM), the NMN has several advantages in terms of estimation accuracy, model interpretation, and functional connectivity analysis. We point out the limitations of current neural spike modeling methods, especially the estimation biases caused by the imbalanced class problem when the number of zeros is significantly larger than ones in the spike data. We use synthetic data to test the performance of NMN with a comparison of the traditional methods, and the results indicate the NMN approach could reduce the imbalanced class problem and achieve better predictions. Subsequently, we apply the MIMO-NMN method to analyze data from the human hippocampus. The results indicate that the MIMO-NMN method is a promising approach to modeling neural dynamics and analyzing functional connectivity of multi-neuronal data.

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt (L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

Characterisation of ictal and interictal states of epilepsy: A system dynamic approach of principal dynamic modes analysis

Epilepsy is a brain disorder characterised by the recurrent and unpredictable interruptions of normal brain function, called epileptic seizures. The present study attempts to derive new diagnostic indices which may delineate between ictal and interictal states of epilepsy. To achieve this, the nonlinear modeling approach of global principal dynamic modes (PDMs) is adopted to examine the functional connectivity of the temporal and frontal lobes with the occipital brain segment using an ensemble of paediatric EEGs having the presence of epileptic seizure. The distinct spectral characteristics of global PDMs are found to be in line with the neural rhythms of brain dynamics. Moreover, we find that the linear trends of associated nonlinear functions (ANFs) associated with the 2nd and 4th global PDMs (representing delta, theta and alpha bands) of Fp1–F3 may differentiate between ictal and interictal states of epilepsy. These findings suggest that global PDMs and their associated ANFs may offer potential utility as diagnostic neural measures for ictal and interictal states of epilepsy.

Mechanism-Based and Input-Output Modeling of the Key Neuronal Connections and Signal Transformations in the CA3-CA1 Regions of the Hippocampus

This letter examines the results of input-output (nonparametric) modeling based on the analysis of data generated by a mechanism-based (parametric) model of CA3-CA1 neuronal connections in the hippocampus. The motivation is to obtain biological insight into the interpretation of such input-output (Volterra-equivalent) models estimated from synthetic data. The insights obtained may be subsequently used to interpretat input-output models extracted from actual experimental data. Specifically, we found that a simplified parametric model may serve as a useful tool to study the signal transformations in the hippocampal CA3-CA1 regions. Input-output modeling of model-based synthetic data show that GABAergic interneurons are responsible for regulating neuronal excitation, controlling the precision of spike timing, and maintaining network oscillations, in a manner consistent with previous studies. The input-output model obtained from real data exhibits intriguing similarities with its synthetic-data counterpart, demonstrating the importance of a dynamic resonance in the system/model response around 2 Hz to 3 Hz. Using the input-output model from real data as a guide, we may be able to amend the parametric model by incorporating more mechanisms in order to yield better-matching input-output model. The approach we present can also be applied to the study of other neural systems and pathways.

Methodology of Recurrent Laguerre-Volterra Network for Modeling Nonlinear Dynamic Systems

In this paper, we have introduced a general modeling approach for dynamic nonlinear systems that utilizes a variant of the simulated annealing algorithm for training the Laguerre-Volterra network (LVN) to overcome the local minima and convergence problems and employs a pruning technique to achieve sparse LVN representations with l₁ regularization. We tested this new approach with computer simulated systems and extended it to autoregressive sparse LVN (ASLVN) model structures that are suitable for input-output modeling of nonlinear systems that exhibit transitions in dynamic states, such as the Hodgkin-Huxley (H-H) equations of neuronal firing. Application of the proposed ASLVN to the H-H equations yields a more parsimonious input-output model with improved predictive capability that is amenable to more insightful physiological/biological interpretation.

Cannabinoids disrupt memory encoding by functionally isolating hippocampal CA1 from CA3

Much of the research on cannabinoids (CBs) has focused on their effects at the molecular and synaptic level. However, the effects of CBs on the dynamics of neural circuits remains poorly understood. This study aims to disentangle the effects of CBs on the functional dynamics of the hippocampal Schaffer collateral synapse by using data-driven nonparametric modeling. Multi-unit activity was recorded from rats doing an working memory task in control sessions and under the influence of exogenously administered tetrahydrocannabinol (THC), the primary CB found in marijuana. It was found that THC left firing rate unaltered and only slightly reduced theta oscillations. Multivariate autoregressive models, estimated from spontaneous spiking activity, were then used to describe the dynamical transformation from CA3 to CA1. They revealed that THC served to functionally isolate CA1 from CA3 by reducing feedforward excitation and theta information flow. The functional isolation was compensated by increased feedback excitation within CA1, thus leading to unaltered firing rates. Finally, both of these effects were shown to be correlated with memory impairments in the working memory task. By elucidating the circuit mechanisms of CBs, these results help close the gap in knowledge between the cellular and behavioral effects of CBs.

Research into cannabinoids (CBs) over the last several decades has found that they induce a large variety of oftentimes opposing effects on various neuronal receptors and processes. Due to this plethora of effects, disentangling how CBs influence neuronal circuits has proven challenging. This paper contributes to our understanding of the circuit level effects of CBs by using data driven modeling to examine how THC affects the input-output relationship in the Schaffer collateral synapse in the hippocampus. It was found that THC functionally isolated CA1 from CA3 by reducing feedforward excitation and theta information flow while simultaneously increasing feedback excitation within CA1. By elucidating the circuit mechanisms of CBs, these results help close the gap in knowledge between the cellular and behavioral effects of CBs.

Detection of Impaired Sympathetic Cerebrovascular Control Using Functional Biomarkers Based on Principal Dynamic Mode Analysis

This study sought to determine whether models of cerebrovascular function based on Laguerre-Volterra kernels that account for nonlinear cerebral blood flow (CBF) dynamics can detect the effects of functional cerebral sympathetic blockade. We retrospectively analyzed continuous beat-to-beat blood pressure, middle cerebral blood velocity, and partial-pressure of end-tidal CO₂ (P_ETCO₂) recordings from eighteen healthy individuals who were treated with either an oral dose of the α₁-adrenergic receptor blocker Prazosin or a placebo treatment. The global principal dynamic modes (PDMs) were analyzed using Laguerre-Volterra kernels to examine the nonlinear system dynamics. Our principal findings were: (1) very low frequency (<0.03 Hz) linear components of first-order kernels for BP and P_ETCO₂ are mutually coupled to CBF dynamics with the ability to separate individuals between control and blockade conditions, and (2) the gains of the nonlinear functions associated with low-pass and ≈0.03 Hz global PDMs for the BP are sensitive to sympathetic blockade. Collectively these results suggest that very low frequency global PDMs for BP may have potential utility as functional biomarkers of sympathetic neurovascular dysfunction which can occur in conditions like autonomic failure, stroke and traumatic brain injury.

Principal dynamic mode analysis of neural mass model for the identification of epileptic states

The detection of epileptic seizures in Electroencephalography (EEG) signals is significant for the diagnosis and treatment of epilepsy. In this paper, in order to obtain characteristics of various epileptiform EEGs that may differentiate different states of epilepsy, the concept of Principal Dynamic Modes (PDMs) was incorporated to an autoregressive model framework. First, the neural mass model was used to simulate the required intracerebral EEG signals of various epileptiform activities. Then, the PDMs estimated from the nonlinear autoregressive Volterra models, as well as the corresponding Associated Nonlinear Functions (ANFs), were used for the modeling of epileptic EEGs. The efficient PDM modeling approach provided physiological interpretation of the system. Results revealed that the ANFs of the 1st and 2nd PDMs for the auto-regressive input exhibited evident differences among different states of epilepsy, where the ANFs of the sustained spikes' activity encountered at seizure onset or during a seizure were the most differentiable from that of the normal state. Therefore, the ANFs may be characteristics for the classification of normal and seizure states in the clinical detection of seizures and thus provide assistance for the diagnosis of epilepsy.

Transfer function analysis of dynamic cerebral autoregulation: A white paper from the International Cerebral Autoregulation Research Network

Cerebral autoregulation is the intrinsic ability of the brain to maintain adequate cerebral perfusion in the presence of blood pressure changes. A large number of methods to assess the quality of cerebral autoregulation have been proposed over the last 30 years. However, no single method has been universally accepted as a gold standard. Therefore, the choice of which method to employ to quantify cerebral autoregulation remains a matter of personal choice. Nevertheless, given the concept that cerebral autoregulation represents the dynamic relationship between blood pressure (stimulus or input) and cerebral blood flow (response or output), transfer function analysis became the most popular approach adopted in studies based on spontaneous fluctuations of blood pressure. Despite its sound theoretical background, the literature shows considerable variation in implementation of transfer function analysis in practice, which has limited comparisons between studies and hindered progress towards clinical application. Therefore, the purpose of the present white paper is to improve standardisation of parameters and settings adopted for application of transfer function analysis in studies of dynamic cerebral autoregulation. The development of these recommendations was initiated by (but not confined to) theCerebral Autoregulation Research Network(CARNet -www.car-net.org).

Understanding spike-triggered covariance using Wiener theory for receptive field identification

Receptive field identification is a vital problem in sensory neurophysiology and vision. Much research has been done in identifying the receptive fields of nonlinear neurons whose firing rate is determined by the nonlinear interactions of a small number of linear filters. Despite more advanced methods that have been proposed, spike-triggered covariance (STC) continues to be the most widely used method in such situations due to its simplicity and intuitiveness. Although the connection between STC and Wiener/Volterra kernels has often been mentioned in the literature, this relationship has never been explicitly derived. Here we derive this relationship and show that the STC matrix is actually a modified version of the second-order Wiener kernel, which incorporates the input autocorrelation and mixes first- and second-order dynamics. It is then shown how, with little modification of the STC method, the Wiener kernels may be obtained and, from them, the principal dynamic modes, a set of compact and efficient linear filters that essentially combine the spike-triggered average and STC matrix and generalize to systems with both continuous and point-process outputs. Finally, using Wiener theory, we show how these obtained filters may be corrected when they were estimated using correlated inputs. Our correction technique is shown to be superior to those commonly used in the literature for both correlated Gaussian images and natural images.

Hippocampal closed-loop modeling and implications for seizure stimulation design

OBJECTIVE

Traditional hippocampal modeling has focused on the series of feedforward synapses known as the trisynaptic pathway. However, feedback connections from CA1 back to the hippocampus through the entorhinal cortex (EC) actually make the hippocampus a closed-loop system. By constructing a functional closed-loop model of the hippocampus, one may learn how both physiological and epileptic oscillations emerge and design efficient neurostimulation patterns to abate such oscillations.

APPROACH

Point process input-output models where estimated from recorded rodent hippocampal data to describe the nonlinear dynamical transformation from CA3 → CA1, via the schaffer-collateral synapse, and CA1 → CA3 via the EC. Each Volterra-like subsystem was composed of linear dynamics (principal dynamic modes) followed by static nonlinearities. The two subsystems were then wired together to produce the full closed-loop model of the hippocampus.

MAIN RESULTS

Closed-loop connectivity was found to be necessary for the emergence of theta resonances as seen in recorded data, thus validating the model. The model was then used to identify frequency parameters for the design of neurostimulation patterns to abate seizures.

SIGNIFICANCE

Deep-brain stimulation (DBS) is a new and promising therapy for intractable seizures. Currently, there is no efficient way to determine optimal frequency parameters for DBS, or even whether periodic or broadband stimuli are optimal. Data-based computational models have the potential to be used as a testbed for designing optimal DBS patterns for individual patients. However, in order for these models to be successful they must incorporate the complex closed-loop structure of the seizure focus. This study serves as a proof-of-concept of using such models to design efficient personalized DBS patterns for epilepsy.

Neurons and networks organizing and sequencing memories

Hippocampal CA1 and CA3 neurons sampled randomly in large numbers in primate brain show conclusive examples of hierarchical encoding of task specific information. Hierarchical encoding allows multi-task utilization of the same hippocampal neural networks via distributed firing between neurons that respond to subsets, attributes or "categories" of stimulus features which can be applied in events in different contexts. In addition, such networks are uniquely adaptable to neural systems unrestricted by rigid synaptic architecture (i.e. columns, layers or "patches") which physically limits the number of possible task-specific interactions between neurons. Also hierarchical encoding is not random; it requires multiple exposures to the same types of relevant events to elevate synaptic connectivity between neurons for different stimulus features that occur in different task-dependent contexts. The large number of cells within associated hierarchical circuits in structures such as hippocampus provides efficient processing of information relevant to common memory-dependent behavioral decisions within different contextual circumstances. This article is part of a Special Issue entitled SI: Brain and Memory.

System identification of point-process neural systems using probability based Volterra kernels

BACKGROUND

Neural information processing involves a series of nonlinear dynamical input/output transformations between the spike trains of neurons/neuronal ensembles. Understanding and quantifying these transformations is critical both for understanding neural physiology such as short-term potentiation and for developing cognitive neural prosthetics.

NEW METHOD

A novel method for estimating Volterra kernels for systems with point-process inputs and outputs is developed based on elementary probability theory. These Probability Based Volterra (PBV) kernels essentially describe the probability of an output spike given q input spikes at various lags t1, t2, …, tq.

RESULTS

The PBV kernels are used to estimate both synthetic systems where ground truth is available and data from the CA3 and CA1 regions rodent hippocampus. The PBV kernels give excellent predictive results in both cases. Furthermore, they are shown to be quite robust to noise and to have good convergence and overfitting properties. Through a slight modification, the PBV kernels are shown to also deal well with correlated point-process inputs.

COMPARISON WITH EXISTING METHODS

The PBV kernels were compared with kernels estimated through least squares estimation (LSE) and through the Laguerre expansion technique (LET). The LSE kernels were shown to fair very poorly with real data due to the large amount of input noise. Although the LET kernels gave the best predictive results in all cases, they require prior parameter estimation. It was shown how the PBV and LET methods can be combined synergistically to maximize performance.

CONCLUSIONS

The PBV kernels provide a novel and intuitive method of characterizing point-process input-output nonlinear systems.

Principal dynamic mode analysis of the Hodgkin-Huxley equations

We develop an autoregressive model framework based on the concept of Principal Dynamic Modes (PDMs) for the process of action potential (AP) generation in the excitable neuronal membrane described by the Hodgkin-Huxley (H-H) equations. The model's exogenous input is injected current, and whenever the membrane potential output exceeds a specified threshold, it is fed back as a second input. The PDMs are estimated from the previously developed Nonlinear Autoregressive Volterra (NARV) model, and represent an efficient functional basis for Volterra kernel expansion. The PDM-based model admits a modular representation, consisting of the forward and feedback PDM bases as linear filterbanks for the exogenous and autoregressive inputs, respectively, whose outputs are then fed to a static nonlinearity composed of polynomials operating on the PDM outputs and cross-terms of pair-products of PDM outputs. A two-step procedure for model reduction is performed: first, influential subsets of the forward and feedback PDM bases are identified and selected as the reduced PDM bases. Second, the terms of the static nonlinearity are pruned. The first step reduces model complexity from a total of 65 coefficients to 27, while the second further reduces the model coefficients to only eight. It is demonstrated that the performance cost of model reduction in terms of out-of-sample prediction accuracy is minimal. Unlike the full model, the eight coefficient pruned model can be easily visualized to reveal the essential system components, and thus the data-derived PDM model can yield insight into the underlying system structure and function.

Model-based asessment of an in-vivo predictive relationship from CA1 to CA3 in the rodent hippocampus

Although an anatomical connection from CA1 to CA3 via the Entorhinal Cortex (EC) and through backprojecting interneurons has long been known it exist, it has never been examined quantitatively on the single neuron level, in the in-vivo nonpatholgical, nonperturbed brain. Here, single spike activity was recorded using a multi-electrode array from the CA3 and CA1 areas of the rodent hippocampus (N = 7) during a behavioral task. The predictive power from CA3→CA1 and CA1→CA3 was examined by constructing Multivariate Autoregressive (MVAR) models from recorded neurons in both directions. All nonsignificant inputs and models were identified and removed by means of Monte Carlo simulation methods. It was found that 121/166 (73 %) CA3→CA1 models and 96/145 (66 %) CA1→CA3 models had significant predictive power, thus confirming a predictive 'Granger' causal relationship from CA1 to CA3. This relationship is thought to be caused by a combination of truly causal connections such as the CA1→EC→CA3 pathway and common inputs such as those from the Septum. All MVAR models were then examined in the frequency domain and it was found that CA3 kernels had significantly more power in the theta and beta range than those of CA1, confirming CA3's role as an endogenous hippocampal pacemaker.

Donor/recipient enhancement of memory in rat hippocampus

The critical role of the mammalian hippocampus in the formation, translation and retrieval of memory has been documented over many decades. There are many theories of how the hippocampus operates to encode events and a precise mechanism was recently identified in rats performing a short-term memory task which demonstrated that successful information encoding was promoted via specific patterns of activity generated within ensembles of hippocampal neurons. In the study presented here, these “representations” were extracted via a customized non-linear multi-input multi-output (MIMO) mathematical model which allowed prediction of successful performance on specific trials within the testing session. A unique feature of this characterization was demonstrated when successful information encoding patterns were derived online from well-trained “donor” animals during difficult long-delay trials and delivered via online electrical stimulation to synchronously tested naïve “recipient” animals never before exposed to the delay feature of the task. By transferring such model-derived trained (donor) animal hippocampal firing patterns via stimulation to coupled naïve recipient animals, their task performance was facilitated in a direct “donor-recipient” manner. This provides the basis for utilizing extracted appropriate neural information from one brain to induce, recover, or enhance memory related processing in the brain of another subject.

Facilitation of memory encoding in primate hippocampus by a neuroprosthesis that promotes task-specific neural firing

OBJECTIVE

Memory accuracy is a major problem in human disease and is the primary factor that defines Alzheimer's, ageing and dementia resulting from impaired hippocampal function in the medial temporal lobe. Development of a hippocampal memory neuroprosthesis that facilitates normal memory encoding in nonhuman primates (NHPs) could provide the basis for improving memory in human disease states.

APPROACH

NHPs trained to perform a short-term delayed match-to-sample (DMS) memory task were examined with multi-neuron recordings from synaptically connected hippocampal cell fields, CA1 and CA3. Recordings were analyzed utilizing a previously developed nonlinear multi-input multi-output (MIMO) neuroprosthetic model, capable of extracting CA3-to-CA1 spatiotemporal firing patterns during DMS performance.

MAIN RESULTS

The MIMO model verified that specific CA3-to-CA1 firing patterns were critical for the successful encoding of sample phase information on more difficult DMS trials. This was validated by the delivery of successful MIMO-derived encoding patterns via electrical stimulation to the same CA1 recording locations during the sample phase which facilitated task performance in the subsequent, delayed match phase, on difficult trials that required more precise encoding of sample information.

SIGNIFICANCE

These findings provide the first successful application of a neuroprosthesis designed to enhance and/or repair memory encoding in primate brain.

On parsing the neural code in the prefrontal cortex of primates using principal dynamic modes

Nonlinear modeling of multi-input multi-output (MIMO) neuronal systems using Principal Dynamic Modes (PDMs) provides a novel method for analyzing the functional connectivity between neuronal groups. This paper presents the PDM-based modeling methodology and initial results from actual multi-unit recordings in the prefrontal cortex of non-human primates. We used the PDMs to analyze the dynamic transformations of spike train activity from Layer 2 (input) to Layer 5 (output) of the prefrontal cortex in primates performing a Delayed-Match-to-Sample task. The PDM-based models reduce the complexity of representing large-scale neural MIMO systems that involve large numbers of neurons, and also offer the prospect of improved biological/physiological interpretation of the obtained models. PDM analysis of neuronal connectivity in this system revealed "input-output channels of communication" corresponding to specific bands of neural rhythms that quantify the relative importance of these frequency-specific PDMs across a variety of different tasks. We found that behavioral performance during the Delayed-Match-to-Sample task (correct vs. incorrect outcome) was associated with differential activation of frequency-specific PDMs in the prefrontal cortex.