Brief subthreshold events can act as Hebbian signals for long-term plasticity

Synaptic plasticity through a naturalistic lens

From the myriad of studies on neuronal plasticity, investigating its underlying molecular mechanisms up to its behavioral relevance, a very complex landscape has emerged. Recent efforts have been achieved toward more naturalistic investigations as an attempt to better capture the synaptic plasticity underpinning of learning and memory, which has been fostered by the development of in vivo electrophysiological and imaging tools. In this review, we examine these naturalistic investigations, by devoting a first part to synaptic plasticity rules issued from naturalistic in vivo-like activity patterns. We next give an overview of the novel tools, which enable an increased spatio-temporal specificity for detecting and manipulating plasticity expressed at individual spines up to neuronal circuit level during behavior. Finally, we put particular emphasis on works considering brain-body communication loops and macroscale contributors to synaptic plasticity, such as body internal states and brain energy metabolism.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Plasticity in the Hippocampus, Neurogenesis and Drugs of Abuse

Synaptic plasticity in the hippocampus assists with consolidation and storage of long-lasting memories. Decades of research has provided substantial information on the cellular and molecular mechanisms underlying synaptic plasticity in the hippocampus, and this review discusses these mechanisms in brief. Addiction is a chronic relapsing disorder with loss of control over drug taking and drug seeking that is caused by long-lasting memories of drug experience. Relapse to drug use is caused by exposure to context and cues associated with the drug experience, and is a major clinical problem that contributes to the persistence of addiction. This review also briefly discusses some evidence that drugs of abuse alter plasticity in the hippocampus, and that development of novel treatment strategies that reverse or prevent drug-induced synaptic alterations in the hippocampus may reduce relapse behaviors associated with addiction.

Stereotyped, automatized and habitual behaviours: are they similar constructs under the control of the same cerebral areas?

Comprehensive knowledge about higher executive functions of motor control has been covered in the last decades. Critical goals have been targeted through many different technological approaches. An abundant flow of new results greatly progressed our ability to respond at better-posited answers to look more than ever at the challenging neural system functioning. Behaviour is the observable result of the invisible, as complex cerebral functioning. Many pathological states are approached after symptomatology categorisation of behavioural impairments is achieved. Motor, non-motor and psychiatric signs are greatly shared by many neurological/psychiatric disorders. Together with the cerebral cortex, the basal ganglia contribute to the expression of behaviour promoting the correct action schemas and the selection of appropriate sub-goals based on the evaluation of action outcomes. The present review focus on the basic classification of higher motor control functioning, taking into account the recent advances in basal ganglia structural knowledge and the computational model of basal ganglia functioning. We discuss about the basal ganglia capability in executing ordered motor patterns in which any single movement is linked to each other into an action, and many actions are ordered into each other, giving them a syntactic value to the final behaviour. The stereotypic, automatized and habitual behaviour's constructs and controls are the expression of successive stages of rule internalization and categorisation aimed in producing the perfect spatial-temporal control of motor command.

Dopamine-endocannabinoid interactions mediate spike-timing-dependent potentiation in the striatum

Dopamine modulates striatal synaptic plasticity, a key substrate for action selection and procedural learning. Thus, characterizing the repertoire of activity-dependent plasticity in striatum and its dependence on dopamine is of crucial importance. We recently unraveled a striatal spike-timing-dependent long-term potentiation (tLTP) mediated by endocannabinoids (eCBs) and induced with few spikes (~5–15). Whether this eCB-tLTP interacts with the dopaminergic system remains to be investigated. Here, we report that eCB-tLTP is impaired in a rodent model of Parkinson’s disease and rescued by L-DOPA. Dopamine controls eCB-tLTP via dopamine type-2 receptors (D₂R) located presynaptically in cortical terminals. Dopamine–endocannabinoid interactions via D₂R are required for the emergence of tLTP in response to few coincident pre- and post-synaptic spikes and control eCB-plasticity by modulating the long-term potentiation (LTP)/depression (LTD) thresholds. While usually considered as a depressing synaptic function, our results show that eCBs in the presence of dopamine constitute a versatile system underlying bidirectional plasticity implicated in basal ganglia pathophysiology.

Dopamine tightly regulates plasticity at corticostriatal synapses. Here, the authors report that endocannabinoid dependent LTP induced with few spikes in the striatum is impaired in a rodent model of Parkinson’s disease, requires dopamine through presynaptic D2 receptors located on corticostriatal inputs.

Region-specific and state-dependent action of striatal GABAergic interneurons

Striatum processes a wide range of functions including goal-directed behavior and habit formation, respectively encoded by the dorsomedial striatum (DMS) and dorsolateral striatum (DLS). GABAergic feedforward inhibition is known to control the integration of cortical information by striatal projection neurons (SPNs). Here we questioned whether this control is specific between distinct striatal functional territories. Using opto-activation and opto-inhibition of identified GABAergic interneurons, we found that different circuits are engaged in DLS and DMS, both ex vivo and in vivo: while parvalbumin interneurons efficiently control SPNs in DLS, somatostatin interneurons control SPNs in DMS. Moreover, both parvalbumin and somatostatin interneurons use a dual hyperpolarizing/depolarizing effect to control cortical input integration depending on SPN activity state: GABAergic interneurons potently inhibit spiking SPNs while in resting SPNs, they favor cortical activity summation via a depolarizing effect. Our findings establish that striatal GABAergic interneurons exert efficient territory-specific and state-dependent control of SPN activity and functional output.

Robustness of STDP to spike timing jitter

In Hebbian plasticity, neural circuits adjust their synaptic weights depending on patterned firing. Spike-timing-dependent plasticity (STDP), a synaptic Hebbian learning rule, relies on the order and timing of the paired activities in pre- and postsynaptic neurons. Classically, in ex vivo experiments, STDP is assessed with deterministic (constant) spike timings and time intervals between successive pairings, thus exhibiting a regularity that differs from biological variability. Hence, STDP emergence from noisy inputs as occurring in in vivo-like firing remains unresolved. Here, we used noisy STDP pairings where the spike timing and/or interval between pairings were jittered. We explored with electrophysiology and mathematical modeling, the impact of jitter on three forms of STDP at corticostriatal synapses: NMDAR-LTP, endocannabinoid-LTD and endocannabinoid-LTP. We found that NMDAR-LTP was highly fragile to jitter, whereas endocannabinoid-plasticity appeared more resistant. When the frequency or number of pairings was increased, NMDAR-LTP became more robust and could be expressed despite strong jittering. Our results identify endocannabinoid-plasticity as a robust form of STDP, whereas the sensitivity to jitter of NMDAR-LTP varies with activity frequency. This provides new insights into the mechanisms at play during the different phases of learning and memory and the emergence of Hebbian plasticity in in vivo-like activity.

Magnitude and behavior of cross-talk effects in multichannel electrophysiology experiments

Modern neurophysiological experiments frequently involve multiple channels separated by very small distances. A unique methodological concern for multiple-electrode experiments is that of capacitive coupling (cross-talk) between channels. Yet the nature of the cross-talk recording circuit is not well known in the field, and the extent to which it practically affects neurophysiology experiments has never been fully investigated. Here we describe a simple electrical circuit model of simultaneous recording and stimulation with two or more channels and experimentally verify the model using ex vivo brain slice and in vivo whole-brain preparations. In agreement with the model, we find that cross-talk amplitudes increase nearly linearly with the impedance of a recording electrode and are larger for higher frequencies. We demonstrate cross-talk contamination of action potential waveforms from intracellular to extracellular channels, which is observable in part because of the different orders of magnitude between the channels. This contamination is electrode impedance-dependent and matches predictions from the model. We use recently published parameters to simulate cross-talk in high-density multichannel extracellular recordings. Cross-talk effectively spatially smooths current source density (CSD) estimates in these recordings and induces artefactual phase shifts where underlying voltage gradients occur; however, these effects are modest. We show that the effects of cross-talk are unlikely to affect most conclusions inferred from neurophysiology experiments when both originating and receiving electrode record signals of similar magnitudes. We discuss other types of experiments and analyses that may be susceptible to cross-talk, techniques for detecting and experimentally reducing cross-talk, and implications for high-density probe design.NEW & NOTEWORTHY We develop and experimentally verify an electrical circuit model describing cross-talk that necessarily occurs between two channels. Recorded cross-talk increased with electrode impedance and signal frequency. We recorded cross-talk contamination of spike waveforms from intracellular to extracellular channels. We simulated high-density multichannel extracellular recordings and demonstrate spatial smoothing and phase shifts that cross-talk enacts on CSD measurements. However, when channels record similar-magnitude signals, effects are modest and unlikely to affect most conclusions.

Learning of Precise Spike Times with Homeostatic Membrane Potential Dependent Synaptic Plasticity

Precise spatio-temporal patterns of neuronal action potentials underly e.g. sensory representations and control of muscle activities. However, it is not known how the synaptic efficacies in the neuronal networks of the brain adapt such that they can reliably generate spikes at specific points in time. Existing activity-dependent plasticity rules like Spike-Timing-Dependent Plasticity are agnostic to the goal of learning spike times. On the other hand, the existing formal and supervised learning algorithms perform a temporally precise comparison of projected activity with the target, but there is no known biologically plausible implementation of this comparison. Here, we propose a simple and local unsupervised synaptic plasticity mechanism that is derived from the requirement of a balanced membrane potential. Since the relevant signal for synaptic change is the postsynaptic voltage rather than spike times, we call the plasticity rule Membrane Potential Dependent Plasticity (MPDP). Combining our plasticity mechanism with spike after-hyperpolarization causes a sensitivity of synaptic change to pre- and postsynaptic spike times which can reproduce Hebbian spike timing dependent plasticity for inhibitory synapses as was found in experiments. In addition, the sensitivity of MPDP to the time course of the voltage when generating a spike allows MPDP to distinguish between weak (spurious) and strong (teacher) spikes, which therefore provides a neuronal basis for the comparison of actual and target activity. For spatio-temporal input spike patterns our conceptually simple plasticity rule achieves a surprisingly high storage capacity for spike associations. The sensitivity of the MPDP to the subthreshold membrane potential during training allows robust memory retrieval after learning even in the presence of activity corrupted by noise. We propose that MPDP represents a biophysically plausible mechanism to learn temporal target activity patterns.

Calcium: amplitude, duration, or location?

Calcium plays a role in long-term plasticity by triggering postsynaptic signaling pathways for both the strengthening (LTP) and weakening (LTD) of synapses. Since these are opposing processes, several hypotheses have been developed to explain how calcium can trigger LTP in some situations and LTD in others. These hypotheses fall broadly into three categories, based on the amplitude of calcium concentration, the duration of the calcium elevation, and the location of the calcium influx. Here we review the experimental evidence for and against each of these hypotheses and the recent computational models utilizing each. We argue that with new experimental techniques for the precise visualization of calcium and new computational techniques for the modeling of calcium diffusion, it is time to take a new look at the location hypothesis.

Mossy fiber-evoked subthreshold responses induce timing-dependent plasticity at hippocampal CA3 recurrent synapses

Dentate granule cells exhibit exceptionally low levels of activity and rarely elicit action potentials in targeted CA3 pyramidal cells. It is thus unclear how such weak input from the granule cells sustains adequate levels of synaptic plasticity in the targeted CA3 network. We report that subthreshold potentials evoked by mossy fibers are sufficient to induce synaptic plasticity between CA3 pyramidal cells, thereby complementing the sparse action potential discharge. Repetitive pairing of a CA3-CA3 recurrent synaptic response with a subsequent subthreshold mossy fiber response induced long-term potentiation at CA3 recurrent synapses in rat hippocampus in vitro. Reversing the timing of the inputs induced long-term depression. The underlying mechanism depends on a passively conducted giant excitatory postsynaptic potential evoked by a mossy fiber that enhances NMDA receptor-mediated current at active CA3 recurrent synapses by relieving magnesium block. The resulting NMDA spike generates a supralinear depolarization that contributes to synaptic plasticity in hippocampal neuronal ensembles implicated in memory.

Does Perceptual Learning Require Consciousness or Attention?

It has been proposed that visual attention and consciousness are separate [Koch, C., & Tsuchiya, N. Attention and consciousness: Two distinct brain processes. Trends in Cognitive Sciences, 11, 16–22, 2007] and possibly even orthogonal processes [Lamme, V. A. F. Why visual attention and awareness are different. Trends in Cognitive Sciences, 7, 12–18, 2003]. Attention and consciousness converge when conscious visual percepts are attended and hence become available for conscious report. In such a view, a lack of reportability can have two causes: the absence of attention or the absence of a conscious percept. This raises an important question in the field of perceptual learning. It is known that learning can occur in the absence of reportability [Gutnisky, D. A., Hansen, B. J., Iliescu, B. F., & Dragoi, V. Attention alters visual plasticity during exposure-based learning. Current Biology, 19, 555–560, 2009; Seitz, A. R., Kim, D., & Watanabe, T. Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron, 61, 700–707, 2009; Seitz, A. R., & Watanabe, T. Is subliminal learning really passive? Nature, 422, 36, 2003; Watanabe, T., Náñez, J. E., & Sasaki, Y. Perceptual learning without perception. Nature, 413, 844–848, 2001], but it is unclear which of the two ingredients—consciousness or attention—is not necessary for learning. We presented textured figure-ground stimuli and manipulated reportability either by masking (which only interferes with consciousness) or with an inattention paradigm (which only interferes with attention). During the second session (24 hr later), learning was assessed neurally and behaviorally, via differences in figure-ground ERPs and via a detection task. Behavioral and neural learning effects were found for stimuli presented in the inattention paradigm and not for masked stimuli. Interestingly, the behavioral learning effect only became apparent when performance feedback was given on the task to measure learning, suggesting that the memory trace that is formed during inattention is latent until accessed. The results suggest that learning requires consciousness, and not attention, and further strengthen the idea that consciousness is separate from attention.

Dynamic modulation of spike timing-dependent calcium influx during corticostriatal upstates

The striatum of the basal ganglia demonstrates distinctive upstate and downstate membrane potential oscillations during slow-wave sleep and under anesthetic. The upstates generate calcium transients in the dendrites, and the amplitude of these calcium transients depends strongly on the timing of the action potential (AP) within the upstate. Calcium is essential for synaptic plasticity in the striatum, and these large calcium transients during the upstates may control which synapses undergo plastic changes. To investigate the mechanisms that underlie the relationship between calcium and AP timing, we have developed a realistic biophysical model of a medium spiny neuron (MSN). We have implemented sophisticated calcium dynamics including calcium diffusion, buffering, and pump extrusion, which accurately replicate published data. Using this model, we found that either the slow inactivation of dendritic sodium channels (NaSI) or the calcium inactivation of voltage-gated calcium channels (CDI) can cause high calcium corresponding to early APs and lower calcium corresponding to later APs. We found that only CDI can account for the experimental observation that sensitivity to AP timing is dependent on NMDA receptors. Additional simulations demonstrated a mechanism by which MSNs can dynamically modulate their sensitivity to AP timing and show that sensitivity to specifically timed pre- and postsynaptic pairings (as in spike timing-dependent plasticity protocols) is altered by the timing of the pairing within the upstate. These findings have implications for synaptic plasticity in vivo during sleep when the upstate-downstate pattern is prominent in the striatum.

New rules governing synaptic plasticity in core nucleus accumbens medium spiny neurons

The nucleus accumbens is a forebrain region responsible for drug reward and goal-directed behaviors. It has long been believed that drugs of abuse exert their addictive properties on behavior by altering the strength of synaptic communication over long periods of time. To date, attempts at understanding the relationship between drugs of abuse and synaptic plasticity have relied on the high-frequency long-term potentiation model of T.V. Bliss & T. Lømo [(1973) Journal of Physiology, 232, 331-356]. We examined synaptic plasticity using spike-timing-dependent plasticity, a stimulation paradigm that reflects more closely the in vivo firing patterns of mouse core nucleus accumbens medium spiny neurons and their afferents. In contrast to other brain regions, the same stimulation paradigm evoked bidirectional long-term plasticity. The magnitude of spike-timing-dependent long-term potentiation (tLTP) changed with the delay between action potentials and excitatory post-synaptic potentials, and frequency, whereas that of spike-timing-dependent long-term depression (tLTD) remained unchanged. We showed that tLTP depended on N-methyl-d-aspartate receptors, whereas tLTD relied on action potentials. Importantly, the intracellular calcium signaling pathways mobilised during tLTP and tLTD were different. Thus, calcium-induced calcium release underlies tLTD but not tLTP. Finally, we found that the firing pattern of a subset of medium spiny neurons was strongly inhibited by dopamine receptor agonists. Surprisingly, these neurons were exclusively associated with tLTP but not with tLTD. Taken together, these data point to the existence of two subgroups of medium spiny neurons with distinct properties, each displaying unique abilities to undergo synaptic plasticity.

Effects of alcohol on the membrane excitability and synaptic transmission of medium spiny neurons in the nucleus accumbens

Chronic and excessive alcohol drinking lead to alcohol dependence and loss of control over alcohol consumption, with serious detrimental health consequences. Chronic alcohol exposure followed by protracted withdrawal causes profound alterations in the brain reward system that leads to marked changes in reinforcement mechanisms and motivational state. These long-lasting neuroadaptations are thought to contribute to the development of cravings and relapse. The nucleus accumbens (NAcc), a central component of the brain reward system, plays a critical role in alcohol-induced neuroadaptive changes underlying alcohol-seeking behaviors. Here we review the findings that chronic alcohol exposure produces long-lasting neuroadaptive changes in various ion channels that govern intrinsic membrane properties and neuronal excitability, as well as excitatory and inhibitory synaptic transmission in the NAcc that underlie alcohol-seeking behavior during protracted withdrawal.

Spike-timing dependent plasticity in striatal interneurons

Basal ganglia, an ensemble of interconnected subcortical nuclei, are involved in adaptive motor planning and procedural learning. Striatum, the primary input nucleus of basal ganglia, extracts the pertinent cortical and thalamic information from background noise in relation with the environmental stimuli and motivation. The striatum comprises different neuronal populations: the GABAergic striatal output neurons, three classes of GABAergic interneurons and the cholinergic cells. Striatal interneurons exert a powerful control of striatal output neuron excitability and therefore shape the cortico-basal ganglia information processing. Besides output neurons, striatal interneurons also receive directly cortical information and are able to adapt their behavior depending on the level of cortical and striatal activation. In this review, we focus on the corticostriatal long-term synaptic efficacy changes occurring in interneurons, and especially the spike-timing dependent plasticity (STDP), as a Hebbian synaptic learning rule. Combined with the striatal local interactions between interneurons and output neurons, we will consider the functional consequences of the interneuron plasticity on the striatal output. This article is part of a Special Issue entitled 'Synaptic Plasticity & Interneurons'.

Distinct coincidence detectors govern the corticostriatal spike timing-dependent plasticity

Corticostriatal projections constitute the main input to the basal ganglia, an ensemble of interconnected subcortical nuclei involved in procedural learning. Thus, long-term plasticity at corticostriatal synapses would provide a basic mechanism for the function of basal ganglia in learning and memory. We had previously reported the existence of a corticostriatal anti-Hebbian spike timing-dependent plasticity (STDP) at synapses onto striatal output neurons, the medium-sized spiny neurons. Here, we show that the blockade of GABAergic transmission reversed the time dependence of corticostriatal STDP. We explored the receptors and signalling mechanisms involved in the corticostriatal STDP. Although classical models for STDP propose NMDA receptors as the unique coincidence detector, the involvement of multiple coincidence detectors has also been demonstrated. Here, we show that corticostriatal STDP depends on distinct coincidence detectors. Specifically, long-term potentiation is dependent on NMDA receptor activation, while long-term depression requires distinct coincidence detectors: the phospholipase Cbeta (PLCbeta) and the inositol-trisphosphate receptor (IP3R)-gated calcium stores. Furthermore, we found that PLCbeta activation is controlled by group-I metabotropic glutamate receptors, type-1 muscarinic receptors and voltage-sensitive calcium channel activities. Activation of PLCbeta and IP3Rs leads to robust retrograde endocannabinoid signalling mediated by 2-arachidonoyl-glycerol and cannabinoid CB1 receptors. Interestingly, the same coincidence detectors govern the corticostriatal anti-Hebbian STDP and the Hebbian STDP reported at cortical synapses. Therefore, LTP and LTD induced by STDP at corticostriatal synapses are mediated by independent signalling mechanisms, each one being controlled by distinct coincidence detectors.

Spike-timing dependent plasticity in the striatum

The striatum is the major input nucleus of basal ganglia, an ensemble of interconnected sub-cortical nuclei associated with fundamental processes of action-selection and procedural learning and memory. The striatum receives afferents from the cerebral cortex and the thalamus. In turn, it relays the integrated information towards the basal ganglia output nuclei through which it operates a selected activation of behavioral effectors. The striatal output neurons, the GABAergic medium-sized spiny neurons (MSNs), are in charge of the detection and integration of behaviorally relevant information. This property confers to the striatum the ability to extract relevant information from the background noise and select cognitive-motor sequences adapted to environmental stimuli. As long-term synaptic efficacy changes are believed to underlie learning and memory, the corticostriatal long-term plasticity provides a fundamental mechanism for the function of the basal ganglia in procedural learning. Here, we reviewed the different forms of spike-timing dependent plasticity (STDP) occurring at corticostriatal synapses. Most of the studies have focused on MSNs and their ability to develop long-term plasticity. Nevertheless, the striatal interneurons (the fast-spiking GABAergic, NO-synthase and cholinergic interneurons) also receive monosynaptic afferents from the cortex and tightly regulated corticostriatal information processing. Therefore, it is important to take into account the variety of striatal neurons to fully understand the ability of striatum to develop long-term plasticity. Corticostriatal STDP with various spike-timing dependence have been observed depending on the neuronal sub-populations and experimental conditions. This complexity highlights the extraordinary potentiality in term of plasticity of the corticostriatal pathway.