Prediction-error neurons in circuits with multiple neuron types: Formation, refinement, and functional implications

Computational model of layer 2/3 in mouse primary visual cortex explains observed visuomotor mismatch response

Activity in layer 2/3 of the mouse primary visual cortex has been shown to depend both on visual input and the mouse's locomotion. Moreover, this activity is altered by a mismatch between the observed visual flow and the predicted visual flow from locomotion. Here, I present a simple computational model that explains previously reported recordings from layer 2/3 neurons in mice. In my model, layer 2/3 encodes the velocity difference between the estimate from visual flow and the prediction from locomotion using a neural population code. Moreover, I describe a hypothesized mechanism for how the brain may carry out computations of variables encoded in population codes. This mechanism may point to a general principle for computing any mathematical function in the brain.

Localized estimation of event-related neural source activity from simultaneous MEG-EEG with a recurrent neural network

Estimating intracranial current sources underlying the electromagnetic signals observed from extracranial sensors is a perennial challenge in non-invasive neuroimaging. Established solutions to this inverse problem treat time samples independently without considering the temporal dynamics of event-related brain processes. This paper describes current source estimation from simultaneously recorded magneto- and electro-encephalography (MEEG) using a recurrent neural network (RNN) that learns sequential relationships from neural data. The RNN was trained in two phases: (1) pre-training and (2) transfer learning with L1 regularization applied to the source estimation layer. Performance of using scaled labels derived from MEEG, magnetoencephalography (MEG), or electroencephalography (EEG) were compared, as were results from volumetric source space with free dipole orientation and surface source space with fixed dipole orientation. Exact low-resolution electromagnetic tomography (eLORETA) and mixed-norm L1/L2 (MxNE) source estimation methods were also applied to these data for comparison with the RNN method. The RNN approach outperformed other methods in terms of output signal-to-noise ratio, correlation and mean-squared error metrics evaluated against reference event-related field (ERF) and event-related potential (ERP) waveforms. Using MEEG labels with fixed-orientation surface sources produced the most consistent estimates. To estimate sources of ERF and ERP waveforms, the RNN generates temporal dynamics within its internal computational units, driven by sequential structure in neural data used as training labels. It thus provides a data-driven model of computational transformations from psychophysiological events into corresponding event-related neural signals, which is unique among MEEG source reconstruction solutions.

A layered microcircuit model of somatosensory cortex with three interneuron types and cell-type-specific short-term plasticity

Three major types of GABAergic interneurons, parvalbumin-, somatostatin-, and vasoactive intestinal peptide-expressing (PV, SOM, VIP) cells, play critical but distinct roles in the cortical microcircuitry. Their specific electrophysiology and connectivity shape their inhibitory functions. To study the network dynamics and signal processing specific to these cell types in the cerebral cortex, we developed a multi-layer model incorporating biologically realistic interneuron parameters from rodent somatosensory cortex. The model is fitted to in vivo data on cell-type-specific population firing rates. With a protocol of cell-type-specific stimulation, network responses when activating different neuron types are examined. The model reproduces the experimentally observed inhibitory effects of PV and SOM cells and disinhibitory effect of VIP cells on excitatory cells. We further create a version of the model incorporating cell-type-specific short-term synaptic plasticity (STP). While the ongoing activity with and without STP is similar, STP modulates the responses of Exc, SOM, and VIP cells to cell-type-specific stimulation, presumably by changing the dominant inhibitory pathways. With slight adjustments, the model also reproduces sensory responses of specific interneuron types recorded in vivo. Our model provides predictions on network dynamics involving cell-type-specific short-term plasticity and can serve to explore the computational roles of inhibitory interneurons in sensory functions.

Prediction-error signals in anterior cingulate cortex drive task-switching

Task-switching is a fundamental cognitive ability that allows animals to update their knowledge of current rules or contexts. Detecting discrepancies between predicted and observed events is essential for this process. However, little is known about how the brain computes cognitive prediction-errors and whether neural prediction-error signals are causally related to task-switching behaviours. Here we trained mice to use a prediction-error to switch, in a single trial, between responding to the same stimuli using two distinct rules. Optogenetic silencing and un-silencing, together with widefield and two-photon calcium imaging revealed that the anterior cingulate cortex (ACC) was specifically required for this rapid task-switching, but only when it exhibited neural prediction-error signals. These prediction-error signals were projection-target dependent and were larger preceding successful behavioural transitions. An all-optical approach revealed a disinhibitory interneuron circuit required for successful prediction-error computation. These results reveal a circuit mechanism for computing prediction-errors and transitioning between distinct cognitive states.

Desegregation of neuronal predictive processing

Neural circuits construct internal 'world-models' to guide behavior. The predictive processing framework posits that neural activity signaling sensory predictions and concurrently computing prediction-errors is a signature of those internal models. Here, to understand how the brain generates predictions for complex sensorimotor signals, we investigate the emergence of high-dimensional, multi-modal predictive representations in recurrent networks. We find that robust predictive processing arises in a network with loose excitatory/inhibitory balance. Contrary to previous proposals of functionally specialized cell-types, the network exhibits desegregation of stimulus and prediction-error representations. We confirmed these model predictions by experimentally probing predictive-coding circuits using a rich stimulus-set to violate learned expectations. When constrained by data, our model further reveals and makes concrete testable experimental predictions for the distinct functional roles of excitatory and inhibitory neurons, and of neurons in different layers along a laminar hierarchy, in computing multi-modal predictions. These results together imply that in natural conditions, neural representations of internal models are highly distributed, yet structured to allow flexible readout of behaviorally-relevant information. The generality of our model advances the understanding of computation of internal models across species, by incorporating different types of predictive computations into a unified framework.

Synaptic signaling modeled by functional connectivity predicts metabolic demands of the human brain

PURPOSE

The human brain is characterized by interacting large-scale functional networks fueled by glucose metabolism. Since former studies could not sufficiently clarify how these functional connections shape glucose metabolism, we aimed to provide a neurophysiologically-based approach.

METHODS

51 healthy volunteers underwent simultaneous PET/MRI to obtain BOLD functional connectivity and [18F]FDG glucose metabolism. These multimodal imaging proxies of fMRI and PET were combined in a whole-brain extension of metabolic connectivity mapping. Specifically, functional connectivity of all brain regions were used as input to explain glucose metabolism of a given target region. This enabled the modeling of postsynaptic energy demands by incoming signals from distinct brain regions.

RESULTS

Functional connectivity input explained a substantial part of metabolic demands but with pronounced regional variations (34 - 76%). During cognitive task performance this multimodal association revealed a shift to higher network integration compared to resting state. In healthy aging, a dedifferentiation (decreased segregated/modular structure of the brain) of brain networks during rest was observed. Furthermore, by including data from mRNA maps, [11C]UCB-J synaptic density and aerobic glycolysis (oxygen-to-glucose index from PET data), we show that whole-brain functional input reflects non-oxidative, on-demand metabolism of synaptic signaling. The metabolically-derived directionality of functional inputs further marked them as top-down predictions. In addition, the approach uncovered formerly hidden networks with superior efficiency through metabolically informed network partitioning.

CONCLUSIONS

Applying multimodal imaging, we decipher a crucial part of the metabolic and neurophysiological basis of functional connections in the brain as interregional on-demand synaptic signaling fueled by anaerobic metabolism. The observed task- and age-related effects indicate promising future applications to characterize human brain function and clinical alterations.

Mechanisms for survival: vagal control of goal-directed behavior

Survival is a fundamental physiological drive, and neural circuits have evolved to prioritize actions that meet the energy demands of the body. This fine-tuning of goal-directed actions based on metabolic states ('allostasis') is deeply rooted in our brain, and hindbrain nuclei orchestrate the vital communication between the brain and body through the vagus nerve. Despite mounting evidence for vagal control of allostatic behavior in animals, its broader function in humans is still contested. Based on stimulation studies, we propose that the vagal afferent pathway supports transitions between survival modes by gating the integration of ascending bodily signals, thereby regulating reward-seeking. By reconceptualizing vagal signals as catalysts for goal-directed behavior, our perspective opens new avenues for theory-driven translational work in mental disorders.

Modeling circuit mechanisms of opposing cortical responses to visual flow perturbations

In an ever-changing visual world, animals' survival depends on their ability to perceive and respond to rapidly changing motion cues. The primary visual cortex (V1) is at the forefront of this sensory processing, orchestrating neural responses to perturbations in visual flow. However, the underlying neural mechanisms that lead to distinct cortical responses to such perturbations remain enigmatic. In this study, our objective was to uncover the neural dynamics that govern V1 neurons' responses to visual flow perturbations using a biologically realistic computational model. By subjecting the model to sudden changes in visual input, we observed opposing cortical responses in excitatory layer 2/3 (L2/3) neurons, namely, depolarizing and hyperpolarizing responses. We found that this segregation was primarily driven by the competition between external visual input and recurrent inhibition, particularly within L2/3 and L4. This division was not observed in excitatory L5/6 neurons, suggesting a more prominent role for inhibitory mechanisms in the visual processing of the upper cortical layers. Our findings share similarities with recent experimental studies focusing on the opposing influence of top-down and bottom-up inputs in the mouse primary visual cortex during visual flow perturbations.

Molecularly targetable cell types in mouse visual cortex have distinguishable prediction error responses

Predictive processing postulates the existence of prediction error neurons in cortex. Neurons with both negative and positive prediction error response properties have been identified in layer 2/3 of visual cortex, but whether they correspond to transcriptionally defined subpopulations is unclear. Here we used the activity-dependent, photoconvertible marker CaMPARI2 to tag neurons in layer 2/3 of mouse visual cortex during stimuli and behaviors designed to evoke prediction errors. We performed single-cell RNA-sequencing on these populations and found that previously annotated Adamts2 and Rrad layer 2/3 transcriptional cell types were enriched when photolabeling during stimuli that drive negative or positive prediction error responses, respectively. Finally, we validated these results functionally by designing artificial promoters for use in AAV vectors to express genetically encoded calcium indicators. Thus, transcriptionally distinct cell types in layer 2/3 that can be targeted using AAV vectors exhibit distinguishable negative and positive prediction error responses.

Cortical interneurons: fit for function and fit to function? Evidence from development and evolution

Cortical inhibitory interneurons form a broad spectrum of subtypes. This diversity suggests a division of labor, in which each cell type supports a distinct function. In the present era of optimisation-based algorithms, it is tempting to speculate that these functions were the evolutionary or developmental driving force for the spectrum of interneurons we see in the mature mammalian brain. In this study, we evaluated this hypothesis using the two most common interneuron types, parvalbumin (PV) and somatostatin (SST) expressing cells, as examples. PV and SST interneurons control the activity in the cell bodies and the apical dendrites of excitatory pyramidal cells, respectively, due to a combination of anatomical and synaptic properties. But was this compartment-specific inhibition indeed the function for which PV and SST cells originally evolved? Does the compartmental structure of pyramidal cells shape the diversification of PV and SST interneurons over development? To address these questions, we reviewed and reanalyzed publicly available data on the development and evolution of PV and SST interneurons on one hand, and pyramidal cell morphology on the other. These data speak against the idea that the compartment structure of pyramidal cells drove the diversification into PV and SST interneurons. In particular, pyramidal cells mature late, while interneurons are likely committed to a particular fate (PV vs. SST) during early development. Moreover, comparative anatomy and single cell RNA-sequencing data indicate that PV and SST cells, but not the compartment structure of pyramidal cells, existed in the last common ancestor of mammals and reptiles. Specifically, turtle and songbird SST cells also express the Elfn1 and Cbln4 genes that are thought to play a role in compartment-specific inhibition in mammals. PV and SST cells therefore evolved and developed the properties that allow them to provide compartment-specific inhibition before there was selective pressure for this function. This suggest that interneuron diversity originally resulted from a different evolutionary driving force and was only later co-opted for the compartment-specific inhibition it seems to serve in mammals today. Future experiments could further test this idea using our computational reconstruction of ancestral Elfn1 protein sequences.

Probing inter-areal computations with a cellular resolution two-photon holographic mesoscope

Brain computation depends on intricately connected yet highly distributed neural networks. Due to the absence of the requisite technologies, causally testing fundamental hypotheses on the nature of inter-areal processing have remained largely out-of-each. Here we developed the first two photon holographic mesoscope, a system capable of simultaneously reading and writing neural activity patterns with single cell resolution across large regions of the brain. We demonstrate the precise photo-activation of spatial and temporal sequences of neurons in one brain area while reading out the downstream effect in several other regions. Investigators can use this new platform to understand feed-forward and feed-back processing in distributed neural circuits with single cell precision for the first time.

Neural learning rules for generating flexible predictions and computing the successor representation

The predictive nature of the hippocampus is thought to be useful for memory-guided cognitive behaviors. Inspired by the reinforcement learning literature, this notion has been formalized as a predictive map called the successor representation (SR). The SR captures a number of observations about hippocampal activity. However, the algorithm does not provide a neural mechanism for how such representations arise. Here, we show the dynamics of a recurrent neural network naturally calculate the SR when the synaptic weights match the transition probability matrix. Interestingly, the predictive horizon can be flexibly modulated simply by changing the network gain. We derive simple, biologically plausible learning rules to learn the SR in a recurrent network. We test our model with realistic inputs and match hippocampal data recorded during random foraging. Taken together, our results suggest that the SR is more accessible in neural circuits than previously thought and can support a broad range of cognitive functions.

Regulation of circuit organization and function through inhibitory synaptic plasticity

Diverse inhibitory neurons in the mammalian brain shape circuit connectivity and dynamics through mechanisms of synaptic plasticity. Inhibitory plasticity can establish excitation/inhibition (E/I) balance, control neuronal firing, and affect local calcium concentration, hence regulating neuronal activity at the network, single neuron, and dendritic level. Computational models can synthesize multiple experimental results and provide insight into how inhibitory plasticity controls circuit dynamics and sculpts connectivity by identifying phenomenological learning rules amenable to mathematical analysis. We highlight recent studies on the role of inhibitory plasticity in modulating excitatory plasticity, forming structured networks underlying memory formation and recall, and implementing adaptive phenomena and novelty detection. We conclude with experimental and modeling progress on the role of interneuron-specific plasticity in circuit computation and context-dependent learning.

Key role of neuronal diversity in structured reservoir computing

Chaotic time series have been captured by reservoir computing models composed of a recurrent neural network whose output weights are trained in a supervised manner. These models, however, are typically limited to randomly connected networks of homogeneous units. Here, we propose a new class of structured reservoir models that incorporates a diversity of cell types and their known connections. In a first version of the model, the reservoir was composed of mean-rate units separated into pyramidal, parvalbumin, and somatostatin cells. Stability analysis of this model revealed two distinct dynamical regimes, namely, (i) an inhibition-stabilized network (ISN) where strong recurrent excitation is balanced by strong inhibition and (ii) a non-ISN network with weak excitation. These results were extended to a leaky integrate-and-fire model that captured different cell types along with their network architecture. ISN and non-ISN reservoir networks were trained to relay and generate a chaotic Lorenz attractor. Despite their increased performance, ISN networks operate in a regime of activity near the limits of stability where external perturbations yield a rapid divergence in output. The proposed framework of structured reservoir computing opens avenues for exploring how neural microcircuits can balance performance and stability when representing time series through distinct dynamical regimes.

Decoding violated sensory expectations from the auditory cortex of anaesthetised mice: Hierarchical recurrent neural network depicts separate 'danger' and 'safety' units

The ability to respond appropriately to sensory information received from the external environment is among the most fundamental capabilities of central nervous systems. In the auditory domain, processes underlying this behaviour are studied by measuring auditory‐evoked electrophysiology during sequences of sounds with predetermined regularities. Identifying neural correlates of ensuing auditory novelty responses is supported by research in experimental animals. In the present study, we reanalysed epidural field potential recordings from the auditory cortex of anaesthetised mice during frequency and intensity oddball stimulation. Multivariate pattern analysis (MVPA) and hierarchical recurrent neural network (RNN) modelling were adopted to explore these data with greater resolution than previously considered using conventional methods. Time‐wise and generalised temporal decoding MVPA approaches revealed previously underestimated asymmetry between responses to sound‐level transitions in the intensity oddball paradigm, in contrast with tone frequency changes. After training, the cross‐validated RNN model architecture with four hidden layers produced output waveforms in response to simulated auditory inputs that were strongly correlated with grand‐average auditory‐evoked potential waveforms (r² > .9). Units in hidden layers were classified based on their temporal response properties and characterised using principal component analysis and sample entropy. These demonstrated spontaneous alpha rhythms, sound onset and offset responses and putative ‘safety’ and ‘danger’ units activated by relatively inconspicuous and salient changes in auditory inputs, respectively. The hypothesised existence of corresponding biological neural sources is naturally derived from this model. If proven, this could have significant implications for prevailing theories of auditory processing.