Excitability changes that complement Hebbian learning

The molecular memory code and synaptic plasticity: A synthesis

The most widely accepted view of memory in the brain holds that synapses are the storage sites of memory, and that memories are formed through associative modification of synapses. This view has been challenged on conceptual and empirical grounds. As an alternative, it has been proposed that molecules within the cell body are the storage sites of memory, and that memories are formed through biochemical operations on these molecules. This paper proposes a synthesis of these two views, grounded in a computational model of memory. Synapses are conceived as storage sites for the parameters of an approximate posterior probability distribution over latent causes. Intracellular molecules are conceived as storage sites for the parameters of a generative model. The model stipulates how these two components work together as part of an integrated algorithm for learning and inference.

Reward Devaluation Attenuates Cue-Evoked Sucrose Seeking and Is Associated with the Elimination of Excitability Differences between Ensemble and Non-ensemble Neurons in the Nucleus Accumbens

Animals must learn relationships between foods and the environmental cues that predict their availability for survival. Such cue–food associations are encoded in sparse sets of neurons or “neuronal ensembles” in the nucleus accumbens (NAc). For these ensemble-encoded, cue-controlled appetitive responses to remain adaptive, they must allow for their dynamic updating depending on acute changes in internal states such as physiological hunger or the perceived desirability of food. However, how these neuronal ensembles are recruited and physiologically modified following the update of such learned associations is unclear. To investigate this, we examined the effects of devaluation on ensemble plasticity at the levels of recruitment, intrinsic excitability, and synaptic physiology in sucrose-conditioned Fos-GFP mice that express green fluorescent protein (GFP) in recently activated neurons. Neuronal ensemble activation patterns and their physiology were examined using immunohistochemistry and slice electrophysiology, respectively. Reward-specific devaluation following 4 d of ad libitum sucrose consumption, but not general caloric devaluation, attenuated cue-evoked sucrose seeking. This suggests that changes in the hedonic and/or incentive value of sucrose, and not caloric need, drove this behavior. Moreover, devaluation attenuated the size of the neuronal ensemble recruited by the cue in the NAc shell. Finally, it eliminated the relative enhanced excitability of ensemble (GFP⁺) neurons against non-ensemble (GFP⁻) neurons observed under non-devalued conditions, and did not induce any ensemble-specific changes in excitatory synaptic physiology. Our findings provide new insights into neuronal ensemble mechanisms that underlie the changes in the incentive and/or hedonic impact of cues that support adaptive food seeking.

Versatility and Flexibility of Cortical Circuits

Cortical circuits are known to be plastic and adaptable, as shown by an impressive body of evidence demonstrating the ability of cortical circuits to adapt to changes in environmental stimuli, development, learning, and insults. In this review, we will discuss some of the features of cortical circuits that are thought to facilitate cortical circuit versatility and flexibility. Throughout life, cortical circuits can be extensively shaped and refined by experience while preserving their overall organization, suggesting that mechanisms are in place to favor change but also to stabilize some aspects of the circuit. First, we will describe the basic organization and some of the common features of cortical circuits. We will then discuss how this underlying cortical structure provides a substrate for the experience- and learning-dependent processes that contribute to cortical flexibility.

Stability of Neuronal Networks with Homeostatic Regulation

Neurons are equipped with homeostatic mechanisms that counteract long-term perturbations of their average activity and thereby keep neurons in a healthy and information-rich operating regime. While homeostasis is believed to be crucial for neural function, a systematic analysis of homeostatic control has largely been lacking. The analysis presented here analyses the necessary conditions for stable homeostatic control. We consider networks of neurons with homeostasis and show that homeostatic control that is stable for single neurons, can destabilize activity in otherwise stable recurrent networks leading to strong non-abating oscillations in the activity. This instability can be prevented by slowing down the homeostatic control. The stronger the network recurrence, the slower the homeostasis has to be. Next, we consider how non-linearities in the neural activation function affect these constraints. Finally, we consider the case that homeostatic feedback is mediated via a cascade of multiple intermediate stages. Counter-intuitively, the addition of extra stages in the homeostatic control loop further destabilizes activity in single neurons and networks. Our theoretical framework for homeostasis thus reveals previously unconsidered constraints on homeostasis in biological networks, and identifies conditions that require the slow time-constants of homeostatic regulation observed experimentally.

Despite their apparent robustness many biological system work best in controlled environments, the tightly regulated mammalian body temperature being a good example. Biological homeostatic control systems, not unlike those used in engineering, ensure that the right operating conditions are met. Similarly, neurons appear to adjust the amount of activity they produce to be neither too high nor too low by, among other ways, regulating their excitability. However, for no apparent reason the neural homeostatic processes are very slow, taking hours or even days to regulate the neuron. Here we use results from mathematical control theory to examine under which conditions such slow control is necessary to prevent instabilities that lead to strong, sustained oscillations in the activity. Our results lead to a deeper understanding of neural homeostasis and can help the design of artificial neural systems.

Synaptic and nonsynaptic plasticity approximating probabilistic inference

Learning and memory operations in neural circuits are believed to involve molecular cascades of synaptic and nonsynaptic changes that lead to a diverse repertoire of dynamical phenomena at higher levels of processing. Hebbian and homeostatic plasticity, neuromodulation, and intrinsic excitability all conspire to form and maintain memories. But it is still unclear how these seemingly redundant mechanisms could jointly orchestrate learning in a more unified system. To this end, a Hebbian learning rule for spiking neurons inspired by Bayesian statistics is proposed. In this model, synaptic weights and intrinsic currents are adapted on-line upon arrival of single spikes, which initiate a cascade of temporally interacting memory traces that locally estimate probabilities associated with relative neuronal activation levels. Trace dynamics enable synaptic learning to readily demonstrate a spike-timing dependence, stably return to a set-point over long time scales, and remain competitive despite this stability. Beyond unsupervised learning, linking the traces with an external plasticity-modulating signal enables spike-based reinforcement learning. At the postsynaptic neuron, the traces are represented by an activity-dependent ion channel that is shown to regulate the input received by a postsynaptic cell and generate intrinsic graded persistent firing levels. We show how spike-based Hebbian-Bayesian learning can be performed in a simulated inference task using integrate-and-fire (IAF) neurons that are Poisson-firing and background-driven, similar to the preferred regime of cortical neurons. Our results support the view that neurons can represent information in the form of probability distributions, and that probabilistic inference could be a functional by-product of coupled synaptic and nonsynaptic mechanisms operating over several timescales. The model provides a biophysical realization of Bayesian computation by reconciling several observed neural phenomena whose functional effects are only partially understood in concert.

More than synaptic plasticity: role of nonsynaptic plasticity in learning and memory

Decades of research on the cellular mechanisms of memory have led to the widely held view that memories are stored as modifications of synaptic strength. These changes involve presynaptic processes, such as direct modulation of the release machinery, or postsynaptic processes, such as modulation of receptor properties. Parallel studies have revealed that memories might also be stored by nonsynaptic processes, such as modulation of voltage-dependent membrane conductances, which are expressed as changes in neuronal excitability. Although in some cases nonsynaptic changes can function as part of the engram itself, they might also serve as mechanisms through which a neural circuit is set to a permissive state to facilitate synaptic modifications that are necessary for memory storage.

Dendritic excitability and synaptic plasticity

Most synaptic inputs are made onto the dendritic tree. Recent work has shown that dendrites play an active role in transforming synaptic input into neuronal output and in defining the relationships between active synapses. In this review, we discuss how these dendritic properties influence the rules governing the induction of synaptic plasticity. We argue that the location of synapses in the dendritic tree, and the type of dendritic excitability associated with each synapse, play decisive roles in determining the plastic properties of that synapse. Furthermore, since the electrical properties of the dendritic tree are not static, but can be altered by neuromodulators and by synaptic activity itself, we discuss how learning rules may be dynamically shaped by tuning dendritic function. We conclude by describing how this reciprocal relationship between plasticity of dendritic excitability and synaptic plasticity has changed our view of information processing and memory storage in neuronal networks.

Synergies between intrinsic and synaptic plasticity mechanisms

We propose a model of intrinsic plasticity for a continuous activation model neuron based on information theory. We then show how intrinsic and synaptic plasticity mechanisms interact and allow the neuron to discover heavy-tailed directions in the input. We also demonstrate that intrinsic plasticity may be an alternative explanation for the sliding threshold postulated in the BCM theory of synaptic plasticity. We present a theoretical analysis of the interaction of intrinsic plasticity with different Hebbian learning rules for the case of clustered inputs. Finally, we perform experiments on the "bars" problem, a popular nonlinear independent component analysis problem.