Parameter estimation and identifiability in a neural population model for electro-cortical activity

Bayesian inference of a spectral graph model for brain oscillations

The relationship between brain functional connectivity and structural connectivity has caught extensive attention of the neuroscience community, commonly inferred using mathematical modeling. Among many modeling approaches, spectral graph model (SGM) is distinctive as it has a closed-form solution of the wide-band frequency spectra of brain oscillations, requiring only global biophysically interpretable parameters. While SGM is parsimonious in parameters, the determination of SGM parameters is non-trivial. Prior works on SGM determine the parameters through a computational intensive annealing algorithm, which only provides a point estimate with no confidence intervals for parameter estimates. To fill this gap, we incorporate the simulation-based inference (SBI) algorithm and develop a Bayesian procedure for inferring the posterior distribution of the SGM parameters. Furthermore, using SBI dramatically reduces the computational burden for inferring the SGM parameters. We evaluate the proposed SBI-SGM framework on the resting-state magnetoencephalography recordings from healthy subjects and show that the proposed procedure has similar performance to the annealing algorithm in recovering power spectra and the spatial distribution of the alpha frequency band. In addition, we also analyze the correlations among the parameters and their uncertainty with the posterior distribution which cannot be done with annealing inference. These analyses provide a richer understanding of the interactions among biophysical parameters of the SGM. In general, the use of simulation-based Bayesian inference enables robust and efficient computations of generative model parameter uncertainties and may pave the way for the use of generative models in clinical translation applications.

Kullback-Leibler Divergence of Sleep-Wake Patterns Related with Depressive Severity in Patients with Epilepsy

(1) Objective: Whether abnormal sleep-wake rhythms were associated with depressive symptoms in patents with epilepsy had remained unclear. Our study aimed to establish relative entropy for the assessment of sleep-wake patterns and to explore the relationship between this index and the severity of depressive symptoms in patients with epilepsy. (2) Methods: We recorded long-term scalp electroencephalograms (EEGs) and Hamilton Depression Rating Scale-17 (HAMD-17) questionnaire scores from 64 patients with epilepsy. Patients with HAMD-17 scores of 0-7 points were defined as the non-depressive group, while patients with scores of 8 or higher were defined as the depression group. Sleep stages were firstly classified based on EEG data. We then quantified sleep-wake rhythm variations in brain activity using the Kullback-Leibler divergence (KLD) of daytime wakefulness and nighttime sleep. The KLD at different frequency bands in each brain region was analyzed between the depression and non-depression groups. (3) Results: Of the 64 patients with epilepsy included in our study, 32 had depressive symptoms. It was found that patients with depression had significantly decreased KLD for high-frequency oscillations in most brain areas, especially the frontal lobe. A detailed analysis was conducted in the right frontal region (F4) because of the significant difference in the high-frequency band. We found that the KLDs at the gamma bands were significantly decreased in the depression groups compared to the non-depression group (KLD_D = 0.35 ± 0.05, KLD_ND = 0.57 ± 0.05, p = 0.009). A negative correlation was displayed between the KLD of gamma band oscillation and HAMD-17 score (r = -0.29, p = 0.02). (4) Conclusions: Sleep-wake rhythms can be assessed using the KLD index calculated from long-term scalp EEGs. Moreover, the KLD of high-frequency bands had a negative correlation with HAMD-17 scores in patients with epilepsy, which indicates a close relationship between abnormal sleep-wake patterns and depressive symptoms in patients with epilepsy.

Dynamic causal modelling shows a prominent role of local inhibition in alpha power modulation in higher visual cortex

During resting-state EEG recordings, alpha activity is more prominent over the posterior cortex in eyes-closed (EC) conditions compared to eyes-open (EO). In this study, we characterized the difference in spectra between EO and EC conditions using dynamic causal modelling. Specifically, we investigated the role of intrinsic and extrinsic connectivity-within the visual cortex-in generating EC-EO alpha power differences over posterior electrodes. The primary visual cortex (V1) and the bilateral middle temporal visual areas (V5) were equipped with bidirectional extrinsic connections using a canonical microcircuit. The states of four intrinsically coupled subpopulations-within each occipital source-were also modelled. Using Bayesian model selection, we tested whether modulations of the intrinsic connections in V1, V5 or extrinsic connections (or a combination thereof) provided the best evidence for the data. In addition, using parametric empirical Bayes (PEB), we estimated group averages under the winning model. Bayesian model selection showed that the winning model contained both extrinsic connectivity modulations, as well as intrinsic connectivity modulations in all sources. The PEB analysis revealed increased extrinsic connectivity during EC. Overall, we found a reduction in the inhibitory intrinsic connections during EC. The results suggest that the intrinsic modulations in V5 played the most important role in producing EC-EO alpha differences, suggesting an intrinsic disinhibition in higher order visual cortex, during EC resting state.

Multimodal parameter spaces of a complex multi-channel neuron model

One of the most common types of models that helps us to understand neuron behavior is based on the Hodgkin-Huxley ion channel formulation (HH model). A major challenge with inferring parameters in HH models is non-uniqueness: many different sets of ion channel parameter values produce similar outputs for the same input stimulus. Such phenomena result in an objective function that exhibits multiple modes (i.e., multiple local minima). This non-uniqueness of local optimality poses challenges for parameter estimation with many algorithmic optimization techniques. HH models additionally have severe non-linearities resulting in further challenges for inferring parameters in an algorithmic fashion. To address these challenges with a tractable method in high-dimensional parameter spaces, we propose using a particular Markov chain Monte Carlo (MCMC) algorithm, which has the advantage of inferring parameters in a Bayesian framework. The Bayesian approach is designed to be suitable for multimodal solutions to inverse problems. We introduce and demonstrate the method using a three-channel HH model. We then focus on the inference of nine parameters in an eight-channel HH model, which we analyze in detail. We explore how the MCMC algorithm can uncover complex relationships between inferred parameters using five injected current levels. The MCMC method provides as a result a nine-dimensional posterior distribution, which we analyze visually with solution maps or landscapes of the possible parameter sets. The visualized solution maps show new complex structures of the multimodal posteriors, and they allow for selection of locally and globally optimal value sets, and they visually expose parameter sensitivities and regions of higher model robustness. We envision these solution maps as enabling experimentalists to improve the design of future experiments, increase scientific productivity and improve on model structure and ideation when the MCMC algorithm is applied to experimental data.

Optimal control methods for nonlinear parameter estimation in biophysical neuron models

Functional forms of biophysically-realistic neuron models are constrained by neurobiological and anatomical considerations, such as cell morphologies and the presence of known ion channels. Despite these constraints, neuron models still contain unknown static parameters which must be inferred from experiment. This inference task is most readily cast into the framework of state-space models, which systematically takes into account partial observability and measurement noise. Inferring only dynamical state variables such as membrane voltages is a well-studied problem, and has been approached with a wide range of techniques beginning with the well-known Kalman filter. Inferring both states and fixed parameters, on the other hand, is less straightforward. Here, we develop a method for joint parameter and state inference that combines traditional state space modeling with chaotic synchronization and optimal control. Our methods are tailored particularly to situations with considerable measurement noise, sparse observability, very nonlinear or chaotic dynamics, and highly uninformed priors. We illustrate our approach both in a canonical chaotic model and in a phenomenological neuron model, showing that many unknown parameters can be uncovered reliably and accurately from short and noisy observed time traces. Our method holds promise for estimation in larger-scale systems, given ongoing improvements in calcium reporters and genetically-encoded voltage indicators.

Systems neuroscience aims to understand how individual neurons and neural networks process external stimuli into behavioral responses. Underlying this characterization are mathematical models intimately shaped by experimental observations. But neural systems are high-dimensional and contain highly nonlinear interactions, so developing accurate models remains a challenge given current experimental capabilities. In practice, this means that the dynamical equations characterizing neural activity have many unknown parameters, and these parameters must be inferred from data. This inference problem is nontrivial owing to model nonlinearity, system and measurement noise, and the sparsity of observations from electrode recordings. Here, we present a novel method for inferring model parameters of neural systems. Our technique combines ideas from control theory and optimization, and amounts to using data to “control” estimates toward the best fit. Our method compares well in accuracy against other state-of-the-art inference methods, both in phenomenological chaotic systems and biophysical neuron models. Our work shows that many unknown model parameters of interest can be inferred from voltage measurements, despite signaling noise, instrument noise, and low observability.

Structure-function models of temporal, spatial, and spectral characteristics of non-invasive whole brain functional imaging

We review recent advances in using mathematical models of the relationship between the brain structure and function that capture features of brain dynamics. We argue the need for models that can jointly capture temporal, spatial, and spectral features of brain functional activity. We present recent work on spectral graph theory based models that can accurately capture spectral as well as spatial patterns across multiple frequencies in MEG reconstructions.

Space-time resolved inference-based neurophysiological process imaging: application to resting-state alpha rhythm

Neural processes are complex and difficult to image. This paper presents a new space-time resolved brain imaging framework, called Neurophysiological Process Imaging (NPI), that identifies neurophysiological processes within cerebral cortex at the macroscopic scale. By fitting uncoupled neural mass models to each electromagnetic source time-series using a novel nonlinear inference method, population averaged membrane potentials and synaptic connection strengths are efficiently and accurately inferred and imaged across the whole cerebral cortex at a resolution afforded by source imaging. The efficiency of the framework enables return of the augmented source imaging results overnight using high performance computing. This suggests it can be used as a practical and novel imaging tool. To demonstrate the framework, it has been applied to resting-state magnetoencephalographic source estimates. The results suggest that endogenous inputs to cingulate, occipital, and inferior frontal cortex are essential modulators of resting-state alpha power. Moreover, endogenous input and inhibitory and excitatory neural populations play varied roles in mediating alpha power in different resting-state sub-networks. The framework can be applied to arbitrary neural mass models and has broad applicability to image neural processes in different brain states.

Approaches to Parameter Estimation from Model Neurons and Biological Neurons

Model optimization in neuroscience has focused on inferring intracellular parameters from time series observations of the membrane voltage and calcium concentrations. These parameters constitute the fingerprints of ion channel subtypes and may identify ion channel mutations from observed changes in electrical activity. A central question in neuroscience is whether computational methods may obtain ion channel parameters with sufficient consistency and accuracy to provide new information on the underlying biology. Finding single-valued solutions in particular, remains an outstanding theoretical challenge. This note reviews recent progress in the field. It first covers well-posed problems and describes the conditions that the model and data need to meet to warrant the recovery of all the original parameters—even in the presence of noise. The main challenge is model error, which reflects our lack of knowledge of exact equations. We report on strategies that have been partially successful at inferring the parameters of rodent and songbird neurons, when model error is sufficiently small for accurate predictions to be made irrespective of stimulation.

Towards an efficient validation of dynamical whole-brain models

Simulating the resting-state brain dynamics via mathematical whole-brain models requires an optimal selection of parameters, which determine the model’s capability to replicate empirical data. Since the parameter optimization via a grid search (GS) becomes unfeasible for high-dimensional models, we evaluate several alternative approaches to maximize the correspondence between simulated and empirical functional connectivity. A dense GS serves as a benchmark to assess the performance of four optimization schemes: Nelder-Mead Algorithm (NMA), Particle Swarm Optimization (PSO), Covariance Matrix Adaptation Evolution Strategy (CMAES) and Bayesian Optimization (BO). To compare them, we employ an ensemble of coupled phase oscillators built upon individual empirical structural connectivity of 105 healthy subjects. We determine optimal model parameters from two- and three-dimensional parameter spaces and show that the overall fitting quality of the tested methods can compete with the GS. There are, however, marked differences in the required computational resources and stability properties, which we also investigate before proposing CMAES and BO as efficient alternatives to a high-dimensional GS. For the three-dimensional case, these methods generated similar results as the GS, but within less than 6% of the computation time. Our results contribute to an efficient validation of models for personalized simulations of brain dynamics.

What Models and Tools can Contribute to a Better Understanding of Brain Activity?

Despite impressive scientific advances in understanding the structure and function of the human brain, big challenges remain. A deep understanding of healthy and aberrant brain activity at a wide range of temporal and spatial scales is needed. Here we discuss, from an interdisciplinary network perspective, the advancements in physical and mathematical modeling as well as in data analysis techniques that, in our opinion, have potential to further advance our understanding of brain structure and function.

Computational Evidence for a Competitive Thalamocortical Model of Spikes and Spindle Activity in Rolandic Epilepsy

Rolandic epilepsy (RE) is the most common idiopathic focal childhood epilepsy syndrome, characterized by sleep-activated epileptiform spikes and seizures and cognitive deficits in school age children. Recent evidence suggests that this disease may be caused by disruptions to the Rolandic thalamocortical circuit, resulting in both an abundance of epileptiform spikes and a paucity of sleep spindles in the Rolandic cortex during non-rapid eye movement sleep (NREM); electrographic features linked to seizures and cognitive symptoms, respectively. The neuronal mechanisms that support the competitive shared thalamocortical circuitry between pathological epileptiform spikes and physiological sleep spindles are not well-understood. In this study we introduce a computational thalamocortical model for the sleep-activated epileptiform spikes observed in RE. The cellular and neuronal circuits of this model incorporate recent experimental observations in RE, and replicate the electrophysiological features of RE. Using this model, we demonstrate that: (1) epileptiform spikes can be triggered and promoted by either a reduced NMDA current or h-type current; and (2) changes in inhibitory transmission in the thalamic reticular nucleus mediates an antagonistic dynamic between epileptiform spikes and spindles. This work provides the first computational model that both recapitulates electrophysiological features and provides a mechanistic explanation for the thalamocortical switch between the pathological and physiological electrophysiological rhythms observed during NREM sleep in this common epileptic encephalopathy.

Clinical connectome fingerprints of cognitive decline

Brain connectome fingerprinting is rapidly rising as a novel influential field in brain network analysis. Yet, it is still unclear whether connectivity fingerprints could be effectively used for mapping and predicting disease progression from human brain data. We hypothesize that dysregulation of brain activity in disease would reflect in worse subject identification. We propose a novel framework, Clinical Connectome Fingerprinting, to detect individual connectome features from clinical populations. We show that "clinical fingerprints" can map individual variations between elderly healthy subjects and patients with mild cognitive impairment in functional connectomes extracted from magnetoencephalography data. We find that identifiability is reduced in patients as compared to controls, and show that these connectivity features are predictive of the individual Mini-Mental State Examination (MMSE) score in patients. We hope that the proposed methodology can help in bridging the gap between connectivity features and biomarkers of brain dysfunction in large-scale brain networks.

Estimation of neuron parameters from imperfect observations

The estimation of parameters controlling the electrical properties of biological neurons is essential to determine their complement of ion channels and to understand the function of biological circuits. By synchronizing conductance models to time series observations of the membrane voltage, one may construct models capable of predicting neuronal dynamics. However, identifying the actual set of parameters of biological ion channels remains a formidable theoretical challenge. Here, we present a regularization method that improves convergence towards this optimal solution when data are noisy and the model is unknown. Our method relies on the existence of an offset in parameter space arising from the interplay between model nonlinearity and experimental error. By tuning this offset, we induce saddle-node bifurcations from sub-optimal to optimal solutions. This regularization method increases the probability of finding the optimal set of parameters from 67% to 94.3%. We also reduce parameter correlations by implementing adaptive sampling and stimulation protocols compatible with parameter identifiability requirements. Our results show that the optimal model parameters may be inferred from imperfect observations provided the conditions of observability and identifiability are fulfilled.

Inferring a simple mechanism for alpha-blocking by fitting a neural population model to EEG spectra

Alpha blocking, a phenomenon where the alpha rhythm is reduced by attention to a visual, auditory, tactile or cognitive stimulus, is one of the most prominent features of human electroencephalography (EEG) signals. Here we identify a simple physiological mechanism by which opening of the eyes causes attenuation of the alpha rhythm. We fit a neural population model to EEG spectra from 82 subjects, each showing a different degree of alpha blocking upon opening of their eyes. Though it has been notoriously difficult to estimate parameters by fitting such models, we show how, by regularizing the differences in parameter estimates between eyes-closed and eyes-open states, we can reduce the uncertainties in these differences without significantly compromising fit quality. From this emerges a parsimonious explanation for the spectral differences between states: Changes to just a single parameter, p_ei, corresponding to the strength of a tonic excitatory input to the inhibitory cortical population, are sufficient to explain the reduction in alpha rhythm upon opening of the eyes. We detect this by comparing the shift in each model parameter between eyes-closed and eyes-open states. Whereas changes in most parameters are weak or negligible and do not scale with the degree of alpha attenuation across subjects, the change in p_ei increases monotonically with the degree of alpha blocking observed. These results indicate that opening of the eyes reduces alpha activity by increasing external input to the inhibitory cortical population.

One of the most striking features of the human electroencephalogram (EEG) is the presence of neural oscillations in the range of 8-13 Hz. It is well known that attenuation of these alpha oscillations, a process known as alpha blocking, arises from opening of the eyes, though the cause has remained obscure. In this study we infer the mechanism underlying alpha blocking by fitting a neural population model to EEG spectra from 82 different individuals. Although such models have long held the promise of being able to relate macroscopic recordings of brain activity to microscopic neural parameters, their utility has been limited by the difficulty of inferring these parameters from fits to data. Our approach involves fitting eyes-open and eyes-closed EEG spectra in a way that minimizes unnecessary differences in model parameters between the two states. Surprisingly, we find that changes in just one parameter, the level of external input to the inhibitory neurons in cortex, is sufficient to explain the attenuation of alpha oscillations. This indicates that opening of the eyes reduces alpha activity simply by increasing external inputs to the inhibitory neurons in the cortex.

Evidence that alpha blocking is due to increases in system-level oscillatory damping not neuronal population desynchronisation

The attenuation of the alpha rhythm following eyes-opening (alpha blocking) is among the most robust features of the human electroencephalogram with the prevailing view being that it is caused by changes in neuronal population synchrony. To further study the basis for this phenomenon we use theoretically motivated fixed-order Auto-Regressive Moving-Average (ARMA) time series modelling to study the oscillatory dynamics of spontaneous alpha-band electroencephalographic activity in eyes-open and eyes-closed conditions and its modulation by the NMDA antagonist ketamine. We find that the reduction in alpha-band power between eyes-closed and eyes-open states is explicable in terms of an increase in the damping of stochastically perturbed alpha-band relaxation oscillatory activity. These changes in damping are putatively modified by the antagonism of NMDA-mediated glutamatergic neurotransmission but are not directly driven by changes in input to cortex nor by reductions in the phase synchronisation of populations of near identical oscillators. These results not only provide a direct challenge to the dominant view of the role that thalamus and neuronal population de-/synchronisation have in the genesis and modulation of alpha electro-/magnetoencephalographic activity but also suggest potentially important physiological determinants underlying its dynamical control and regulation.