Dopamine D1 and D5 receptors modulate spike timing-dependent plasticity at medial perforant path to dentate granule cell synapses

Ventral tegmental area dopamine projections to the hippocampus trigger long-term potentiation and contextual learning

In most models of neuronal plasticity and memory, dopamine is thought to promote the long-term maintenance of Long-Term Potentiation (LTP) underlying memory processes, but not the initiation of plasticity or new information storage. Here, we used optogenetic manipulation of midbrain dopamine neurons in male DAT::Cre mice, and discovered that stimulating the Schaffer collaterals - the glutamatergic axons connecting CA3 and CA1 regions - of the dorsal hippocampus concomitantly with midbrain dopamine terminals within a 200 millisecond time-window triggers LTP at glutamatergic synapses. Moreover, we showed that the stimulation of this dopaminergic pathway facilitates contextual learning in awake behaving mice, while its inhibition hinders it. Thus, activation of midbrain dopamine can operate as a teaching signal that triggers NeoHebbian LTP and promotes supervised learning.

Gm527 deficiency in dentate gyrus improves memory through upregulating dopamine D1 receptor pathway

AIMS

Dopamine D1 receptor (D1R) hypofunction is associated with negative and cognitive symptoms in schizophrenia; therefore, the mechanism of D1R function modulation needs further investigation. Gm527 is the rodent homologous of the schizophrenia-related gene C14orf28, encoding a predicated D1R-interacting protein. However, the role of Gm527-D1R interaction in schizophrenia needs to be clarified.

METHODS

Gm527-floxed mice were generated and crossed with D1-Cre mice (D1:Gm527-/-) to knockout Gm527 in D1R-positive neurons. Then behavioral tests were performed to explore the schizophrenia-related phenotypes. Immunofluorescence, fluorescence in situ hybridization, electrophysiological recording, quantitative real-time PCR, and western blotting were conducted to investigate the mechanisms.

RESULTS

Working memory, long-term memories, and adult neurogenesis in the DG were enhanced in D1:Gm527-/- mice. LTP was also increased in the DG in D1:Gm527-/- mice, resulting from the Gm527 knockout-induced D1R expression enhancement on the plasma membrane and subsequently cAMP signaling and NMDA receptor pathways activation. The requirement of Gm527 knockout in the DG was confirmed by reversing Gm527 expression or knockdown Gm527 in the DG D1R-positive neurons through AAV-CAG-FLEX-Gm527-GFP or AAV-CMV-FLEX-EGFP-Gm527-RNAi injection.

CONCLUSIONS

The DG Gm527 knockout induces D1R hyperfunction in improving schizophrenia cognitive symptoms.

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.

Dopaminergic regulation of hippocampal plasticity, learning, and memory

The hippocampus is responsible for encoding behavioral episodes into short-term and long-term memory. The circuits that mediate these processes are subject to neuromodulation, which involves regulation of synaptic plasticity and local neuronal excitability. In this review, we present evidence to demonstrate the influence of dopaminergic neuromodulation on hippocampus-dependent memory, and we address the controversy surrounding the source of dopamine innervation. First, we summarize historical and recent retrograde and anterograde anatomical tracing studies of direct dopaminergic projections from the ventral tegmental area and discuss dopamine release from the adrenergic locus coeruleus. Then, we present evidence of dopaminergic modulation of synaptic plasticity in the hippocampus. Plasticity mechanisms are examined in brain slices and in recordings from in vivo neuronal populations in freely moving rodents. Finally, we review pharmacological, genetic, and circuitry research that demonstrates the importance of dopamine release for learning and memory tasks while dissociating anatomically distinct populations of direct dopaminergic inputs.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

Activation of a Locus Coeruleus to Dorsal Hippocampus Noradrenergic Circuit Facilitates Associative Learning

Processing of contextual information during a new episodic event is crucial for learning and memory. Neuromodulation in the hippocampus and prefrontal cortex plays an important role in the formation of associations between environmental cues and an aversive experience. Noradrenergic neurons in the locus coeruleus send dense projections to both regions, but their contribution to contextual associative learning has not been established. Here, we utilize selective optogenetic and pharmacological manipulations to control noradrenergic transmission in the hippocampus during the encoding of a contextual fear memory. We find that boosting noradrenergic terminal release in the dorsal CA1 enhances the acquisition of contextual associative learning and that this effect requires local activation of β-adrenenergic receptors. Moreover, we show that increasing norepinephrine release can ameliorate contextual fear learning impairments caused by dopaminergic dysregulation in the hippocampus. Our data suggest that increasing of hippocampal noradrenergic activity can have important implications in the treatment of cognitive disorders that involve problems in contextual processing.

Periodicity Pitch Perception Part III: Sensibility and Pachinko Volatility

Neuromorphic computer models are used to explain sensory perceptions. Auditory models generate cochleagrams, which resemble the spike distributions in the auditory nerve. Neuron ensembles along the auditory pathway transform sensory inputs step by step and at the end pitch is represented in auditory categorical spaces. In two previous articles in the series on periodicity pitch perception an extended auditory model had been successfully used for explaining periodicity pitch proved for various musical instrument generated tones and sung vowels. In this third part in the series the focus is on octopus cells as they are central sensitivity elements in auditory cognition processes. A powerful numerical model had been devised, in which auditory nerve fibers (ANFs) spike events are the inputs, triggering the impulse responses of the octopus cells. Efficient algorithms are developed and demonstrated to explain the behavior of octopus cells with a focus on a simple event-based hardware implementation of a layer of octopus neurons. The main finding is, that an octopus' cell model in a local receptive field fine-tunes to a specific trajectory by a spike-timing-dependent plasticity (STDP) learning rule with synaptic pre-activation and the dendritic back-propagating signal as post condition. Successful learning explains away the teacher and there is thus no need for a temporally precise control of plasticity that distinguishes between learning and retrieval phases. Pitch learning is cascaded: At first octopus cells respond individually by self-adjustment to specific trajectories in their local receptive fields, then unions of octopus cells are collectively learned for pitch discrimination. Pitch estimation by inter-spike intervals is shown exemplary using two input scenarios: a simple sinus tone and a sung vowel. The model evaluation indicates an improvement in pitch estimation on a fixed time-scale.

Cell-type-specific disruption of PERK-eIF2α signaling in dopaminergic neurons alters motor and cognitive function

Endoplasmic reticulum (ER) stress and the unfolded protein response (UPR) has been shown to activate the eIF2α kinase PERK to directly regulate translation initiation. Tight control of PERK-eIF2α signaling has been shown to be necessary for normal long-lasting synaptic plasticity and cognitive function, including memory. In contrast, chronic activation of PERK-eIF2α signaling has been shown to contribute to pathophysiology, including memory impairments, associated with multiple neurological diseases, making this pathway an attractive therapeutic target. Herein, using multiple genetic approaches we show that selective deletion of the PERK in mouse midbrain dopaminergic (DA) neurons results in multiple cognitive and motor phenotypes. Conditional expression of phospho-mutant eIF2α in DA neurons recapitulated the phenotypes caused by deletion of PERK, consistent with a causal role of decreased eIF2α phosphorylation for these phenotypes. In addition, deletion of PERK in DA neurons resulted in altered de novo translation, as well as changes in axonal DA release and uptake in the striatum that mirror the pattern of motor changes observed. Taken together, our findings show that proper regulation of PERK-eIF2α signaling in DA neurons is required for normal cognitive and motor function in a non-pathological state, and also provide new insight concerning the onset of neuropsychiatric disorders that accompany UPR failure.

Calcium and Spike Timing-Dependent Plasticity

Since its discovery, spike timing-dependent synaptic plasticity (STDP) has been thought to be a primary mechanism underlying the brain's ability to learn and to form new memories. However, despite the enormous interest in both the experimental and theoretical neuroscience communities in activity-dependent plasticity, it is still unclear whether plasticity rules inferred from in vitro experiments apply to in vivo conditions. Among the multiple reasons why plasticity rules in vivo might differ significantly from in vitro studies is that extracellular calcium concentration use in most studies is higher than concentrations estimated in vivo. STDP, like many forms of long-term synaptic plasticity, strongly depends on intracellular calcium influx for its induction. Here, we discuss the importance of considering physiological levels of extracellular calcium concentration to study functional plasticity.

Midbrain dopaminergic innervation of the hippocampus is sufficient to modulate formation of aversive memories

Aversive memories are important for survival, and dopaminergic signaling in the hippocampus has been implicated in aversive learning. However, the source and mode of action of hippocampal dopamine remain controversial. Here, we utilize anterograde and retrograde viral tracing methods to label midbrain dopaminergic projections to the dorsal hippocampus. We identify a population of midbrain dopaminergic neurons near the border of the substantia nigra pars compacta and the lateral ventral tegmental area that sends direct projections to the dorsal hippocampus. Using optogenetic manipulations and mutant mice to control dopamine transmission in the hippocampus, we show that midbrain dopamine potently modulates aversive memory formation during encoding of contextual fear. Moreover, we demonstrate that dopaminergic transmission in the dorsal CA1 is required for the acquisition of contextual fear memories, and that this acquisition is sustained in the absence of catecholamine release from noradrenergic terminals. Our findings identify a cluster of midbrain dopamine neurons that innervate the hippocampus and show that the midbrain dopamine neuromodulation in the dorsal hippocampus is sufficient to maintain aversive memory formation.

Calcium-Permeable AMPA Receptors Mediate Timing-Dependent LTP Elicited by Low Repeat Coincident Pre- and Postsynaptic Activity at Schaffer Collateral-CA1 Synapses

High-frequency stimulation induced long-term potentiation (LTP) and low-frequency stimulation induced LTD are considered as cellular models of memory formation. Interestingly, spike timing-dependent plasticity (STDP) can induce equally robust timing-dependent LTP (t-LTP) and t-LTD in response to low frequency repeats of coincident action potential (AP) firing in presynaptic and postsynaptic cells. Commonly, STDP paradigms relying on 25-100 repeats of coincident AP firing are used to elicit t-LTP or t-LTD, but the minimum number of repeats required for successful STDP is barely explored. However, systematic investigation of physiologically relevant low repeat STDP paradigms is of utmost importance to explain learning mechanisms in vivo. Here, we examined low repeat STDP at Schaffer collateral-CA1 synapses by pairing one presynaptic AP with either one postsynaptic AP (1:1 t-LTP), or a burst of 4 APs (1:4 t-LTP) and found 3-6 repeats to be sufficient to elicit t-LTP. 6× 1:1 t-LTP required postsynaptic Ca2+ influx via NMDARs and L-type VGCCs and was mediated by increased presynaptic glutamate release. In contrast, 1:4 t-LTP depended on postsynaptic metabotropic GluRs and ryanodine receptor signaling and was mediated by postsynaptic insertion of AMPA receptors. Unexpectedly, both 6× t-LTP variants were strictly dependent on activation of postsynaptic Ca2+-permeable AMPARs but were differentially regulated by dopamine receptor signaling. Our data show that synaptic changes induced by only 3-6 repeats of mild STDP stimulation occurring in ≤10 s can take place on time scales observed also during single trial learning.

Dopaminergic Neuromodulation of Spike Timing Dependent Plasticity in Mature Adult Rodent and Human Cortical Neurons

Synapses in the cerebral cortex constantly change and this dynamic property regulated by the action of neuromodulators such as dopamine (DA), is essential for reward learning and memory. DA modulates spike-timing-dependent plasticity (STDP), a cellular model of learning and memory, in juvenile rodent cortical neurons. However, it is unknown whether this neuromodulation also occurs at excitatory synapses of cortical neurons in mature adult mice or in humans. Cortical layer V pyramidal neurons were recorded with whole cell patch clamp electrophysiology and an extracellular stimulating electrode was used to induce STDP. DA was either bath-applied or optogenetically released in slices from mice. Classical STDP induction protocols triggered non-hebbian excitatory synaptic depression in the mouse or no plasticity at human cortical synapses. DA reverted long term synaptic depression to baseline in mouse via dopamine 2 type receptors or elicited long term synaptic potentiation in human cortical synapses. Furthermore, when DA was applied during an STDP protocol it depressed presynaptic inhibition in the mouse but not in the human cortex. Thus, DA modulates excitatory synaptic plasticity differently in human vs. mouse cortex. The data strengthens the importance of DA in gating cognition in humans, and may inform on therapeutic interventions to recover brain function from diseases.

Dopamine: The Neuromodulator of Long-Term Synaptic Plasticity, Reward and Movement Control

Dopamine (DA) is a key neurotransmitter involved in multiple physiological functions including motor control, modulation of affective and emotional states, reward mechanisms, reinforcement of behavior, and selected higher cognitive functions. Dysfunction in dopaminergic transmission is recognized as a core alteration in several devastating neurological and psychiatric disorders, including Parkinson's disease (PD), schizophrenia, bipolar disorder, attention deficit hyperactivity disorder (ADHD) and addiction. Here we will discuss the current insights on the role of DA in motor control and reward learning mechanisms and its involvement in the modulation of synaptic dynamics through different pathways. In particular, we will consider the role of DA as neuromodulator of two forms of synaptic plasticity, known as long-term potentiation (LTP) and long-term depression (LTD) in several cortical and subcortical areas. Finally, we will delineate how the effect of DA on dendritic spines places this molecule at the interface between the motor and the cognitive systems. Specifically, we will be focusing on PD, vascular dementia, and schizophrenia.

GSK3β Modulates Timing-Dependent Long-Term Depression Through Direct Phosphorylation of Kv4.2 Channels

Spike timing-dependent plasticity (STDP) is a form of activity-dependent remodeling of synaptic strength that underlies memory formation. Despite its key role in dictating learning rules in the brain circuits, the molecular mechanisms mediating STDP are still poorly understood. Here, we show that spike timing-dependent long-term depression (tLTD) and A-type K+ currents are modulated by pharmacological agents affecting the levels of active glycogen-synthase kinase 3 (GSK3) and by GSK3β knockdown in layer 2/3 of the mouse somatosensory cortex. Moreover, the blockade of A-type K+ currents mimics the effects of GSK3 up-regulation on tLTD and occludes further changes in synaptic strength. Pharmacological, immunohistochemical and biochemical experiments revealed that GSK3β influence over tLTD induction is mediated by direct phosphorylation at Ser-616 of the Kv4.2 subunit, a molecular determinant of A-type K+ currents. Collectively, these results identify the functional interaction between GSK3β and Kv4.2 channel as a novel mechanism for tLTD modulation providing exciting insight into the understanding of GSK3β role in synaptic plasticity.

Optogenetic Manipulation of Postsynaptic cAMP Using a Novel Transgenic Mouse Line Enables Synaptic Plasticity and Enhances Depolarization Following Tetanic Stimulation in the Hippocampal Dentate Gyrus

cAMP is a positive regulator tightly involved in certain types of synaptic plasticity and related memory functions. However, its spatiotemporal roles at the synaptic and neural circuit levels remain elusive. Using a combination of a cAMP optogenetics approach and voltage-sensitive dye (VSD) imaging with electrophysiological recording, we define a novel capacity of postsynaptic cAMP in enabling dentate gyrus long-term potentiation (LTP) and depolarization in acutely prepared murine hippocampal slices. To manipulate cAMP levels at medial perforant path to granule neuron (MPP-DG) synapses by light, we generated transgenic (Tg) mice expressing photoactivatable adenylyl cyclase (PAC) in DG granule neurons. Using these Tg(CMV-Camk2a-RFP/bPAC)3Koka mice, we recorded field excitatory postsynaptic potentials (fEPSPs) from MPP-DG synapses and found that photoactivation of PAC during tetanic stimulation enabled synaptic potentiation that persisted for at least 30 min. This form of LTP was induced without the need for GABA receptor blockade that is typically required for inducing DG plasticity. The paired-pulse ratio (PPR) remained unchanged, indicating the cAMP-dependent LTP was likely postsynaptic. By employing fast fluorescent voltage-sensitive dye (VSD: di-4-ANEPPS) and fluorescence imaging, we found that photoactivation of the PAC actuator enhanced the intensity and extent of dentate gyrus depolarization triggered following tetanic stimulation. These results demonstrate that the elevation of cAMP in granule neurons is capable of rapidly enhancing synaptic strength and neuronal depolarization. The powerful actions of cAMP are consistent with this second messenger having a critical role in the regulation of synaptic function.

Dopamine Receptor Activation Modulates the Integrity of the Perisynaptic Extracellular Matrix at Excitatory Synapses

In the brain, Hebbian-type and homeostatic forms of plasticity are affected by neuromodulators like dopamine (DA). Modifications of the perisynaptic extracellular matrix (ECM), which control the functions and mobility of synaptic receptors as well as the diffusion of transmitters and neuromodulators in the extracellular space, are crucial for the manifestation of plasticity. Mechanistic links between synaptic activation and ECM modifications are largely unknown. Here, we report that neuromodulation via D1-type DA receptors can induce targeted ECM proteolysis specifically at excitatory synapses of rat cortical neurons via proteases ADAMTS-4 and -5. We showed that receptor activation induces increased proteolysis of brevican (BC) and aggrecan, two major constituents of the adult ECM both in vivo and in vitro. ADAMTS immunoreactivity was detected near synapses, and shRNA-mediated knockdown reduced BC cleavage. We have outlined a molecular scenario of how synaptic activity and neuromodulation are linked to ECM rearrangements via increased cAMP levels, NMDA receptor activation, and intracellular calcium signaling.

Obligatory roles of dopamine D1 receptors in the dentate gyrus in antidepressant actions of a selective serotonin reuptake inhibitor, fluoxetine

Depression is a leading cause of disability. Current pharmacological treatment of depression is insufficient, and development of improved treatments especially for treatment-resistant depression is desired. Understanding the neurobiology of antidepressant actions may lead to development of improved therapeutic approaches. Here, we demonstrate that dopamine D1 receptors in the dentate gyrus act as a pivotal mediator of antidepressant actions in mice. Chronic administration of a selective serotonin reuptake inhibitor (SSRI), fluoxetine, increases D1 receptor expression in mature granule cells in the dentate gyrus. The increased D1 receptor signaling, in turn, contributes to the actions of chronic fluoxetine treatment, such as suppression of acute stress-evoked serotonin release, stimulation of adult neurogenesis and behavioral improvement. Importantly, under severely stressed conditions, chronic administration of a D1 receptor agonist in conjunction with fluoxetine restores the efficacy of fluoxetine actions on D1 receptor expression and behavioral responses. Thus, our results suggest that stimulation of D1 receptors in the dentate gyrus is a potential adjunctive approach to improve therapeutic efficacy of SSRI antidepressants.

Rewards interact with repetition-dependent learning to enhance long-term retention of motor memories

The combination of behavioral experiences that enhance long-term retention remains largely unknown. Informed by neurophysiological lines of work, this study tested the hypothesis that performance-contingent monetary rewards potentiate repetition-dependent forms of learning, as induced by extensive practice at asymptote, to enhance long-term retention of motor memories. To this end, six groups of 14 participants (n = 84) acquired novel motor behaviors by adapting to a gradual visuomotor rotation while these factors were manipulated. Retention was assessed 24 h later. While all groups similarly acquired the novel motor behaviors, results from the retention session revealed an interaction indicating that rewards enhanced long-term retention, but only when practice was extended to asymptote. Specifically, the interaction indicated that this effect selectively occurred when rewards were intermittently available (i.e., 50%), but not when they were absent (i.e., 0%) or continuously available (i.e., 100%) during acquisition. This suggests that the influence of rewards on extensive practice and long-term retention is nonlinear, as continuous rewards did not further enhance retention as compared with intermittent rewards. One possibility is that rewards' intermittent availability allows to maintain their subjective value during acquisition, which may be key to potentiate long-term retention.

Neuromodulation of hippocampal long-term synaptic plasticity

•

Acetylcholine, noradrenaline, dopamine and serotonin all facilitate long-term synaptic plasticity.

•

Neuromodulators facilitate long-term synaptic plasticity by common and divergent mechanisms.

•

Common mechanisms include NMDA receptor facilitation by potassium channel inhibition, gliotransmission and disinhibition.

•

Divergent mechanisms include diversity of disinhibition and temporal and spatial neuromodulator release.

Multiple neuromodulators including acetylcholine, noradrenaline, dopamine and serotonin are released in response to uncertainty to focus attention on events where the predicted outcome does not match observed reality. In these situations, internal representations need to be updated, a process that requires long-term synaptic plasticity. Through a variety of common and divergent mechanisms, it is recently shown that all these neuromodulators facilitate the induction and/or expression of long-term synaptic plasticity within the hippocampus. Under physiological conditions, this may be critical for suprathreshold induction of plasticity endowing neuromodulators with a gating function and providing a mechanism by which neuromodulators enable the targeted updating of memory with relevant information to improve the accuracy of future predictions.

Modulation of Spike-Timing Dependent Plasticity: Towards the Inclusion of a Third Factor in Computational Models

In spike-timing dependent plasticity (STDP) change in synaptic strength depends on the timing of pre- vs. postsynaptic spiking activity. Since STDP is in compliance with Hebb's postulate, it is considered one of the major mechanisms of memory storage and recall. STDP comprises a system of two coincidence detectors with N-methyl-D-aspartate receptor (NMDAR) activation often posited as one of the main components. Numerous studies have unveiled a third component of this coincidence detection system, namely neuromodulation and glia activity shaping STDP. Even though dopaminergic control of STDP has most often been reported, acetylcholine, noradrenaline, nitric oxide (NO), brain-derived neurotrophic factor (BDNF) or gamma-aminobutyric acid (GABA) also has been shown to effectively modulate STDP. Furthermore, it has been demonstrated that astrocytes, via the release or uptake of glutamate, gate STDP expression. At the most fundamental level, the timing properties of STDP are expected to depend on the spatiotemporal dynamics of the underlying signaling pathways. However in most cases, due to technical limitations experiments grant only indirect access to these pathways. Computational models carefully constrained by experiments, allow for a better qualitative understanding of the molecular basis of STDP and its regulation by neuromodulators. Recently, computational models of calcium dynamics and signaling pathway molecules have started to explore STDP emergence in ex and in vivo-like conditions. These models are expected to reproduce better at least part of the complex modulation of STDP as an emergent property of the underlying molecular pathways. Elucidation of the mechanisms underlying STDP modulation and its consequences on network dynamics is of critical importance and will allow better understanding of the major mechanisms of memory storage and recall both in health and disease.

Acetylcholine-modulated plasticity in reward-driven navigation: a computational study

Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.

Dendritic spikes in hippocampal granule cells are necessary for long-term potentiation at the perforant path synapse

Long-term potentiation (LTP) of synaptic responses is essential for hippocampal memory function. Perforant-path (PP) synapses on hippocampal granule cells (GCs) contribute to the formation of associative memories, which are considered the cellular correlates of memory engrams. However, the mechanisms of LTP at these synapses are not well understood. Due to sparse firing activity and the voltage attenuation in their dendrites, it remains unclear how associative LTP at distal synapses occurs. Here, we show that NMDA receptor-dependent LTP can be induced at PP-GC synapses without backpropagating action potentials (bAPs) in acute rat brain slices. Dendritic recordings reveal substantial attenuation of bAPs as well as local dendritic Na⁺ spike generation during PP-GC input. Inhibition of dendritic Na⁺ spikes impairs LTP induction at PP-GC synapse. These data suggest that dendritic spikes may constitute a key cellular mechanism for memory formation in the dentate gyrus.

Dopaminergic innervation and modulation of hippocampal networks

The catecholamine dopamine plays an important role in hippocampus-dependent plasticity and related learning and memory processes. Dopamine secretion in the hippocampus is activated by, e.g., salient or novel stimuli, thereby helping to establish and to stabilize hippocampus-dependent memories. Disturbed dopaminergic function in the hippocampus leads to severe pathophysiological conditions. While the role and importance of dopaminergic modulation of hippocampal networks have been unequivocally proven, there is still a lack of detailed molecular and cellular mechanistic understanding of how dopamine orchestrates these hippocampal processes. In this chapter of the special issue "Hippocampal structure and function," we will discuss the current understanding of dopaminergic modulation of basal synaptic transmission and long-lasting, activity-dependent potentiation or depression.

Long-term potentiation expands information content of hippocampal dentate gyrus synapses

An approach combining signal detection theory and precise 3D reconstructions from serial section electron microscopy (3DEM) was used to investigate synaptic plasticity and information storage capacity at medial perforant path synapses in adult hippocampal dentate gyrus in vivo. Induction of long-term potentiation (LTP) markedly increased the frequencies of both small and large spines measured 30 minutes later. This bidirectional expansion resulted in heterosynaptic counterbalancing of total synaptic area per unit length of granule cell dendrite. Control hemispheres exhibited 6.5 distinct spine sizes for 2.7 bits of storage capacity while LTP resulted in 12.9 distinct spine sizes (3.7 bits). In contrast, control hippocampal CA1 synapses exhibited 4.7 bits with much greater synaptic precision than either control or potentiated dentate gyrus synapses. Thus, synaptic plasticity altered total capacity, yet hippocampal subregions differed dramatically in their synaptic information storage capacity, reflecting their diverse functions and activation histories.

Predictive Place-Cell Sequences for Goal-Finding Emerge from Goal Memory and the Cognitive Map: A Computational Model

Hippocampal place-cell sequences observed during awake immobility often represent previous experience, suggesting a role in memory processes. However, recent reports of goals being overrepresented in sequential activity suggest a role in short-term planning, although a detailed understanding of the origins of hippocampal sequential activity and of its functional role is still lacking. In particular, it is unknown which mechanism could support efficient planning by generating place-cell sequences biased toward known goal locations, in an adaptive and constructive fashion. To address these questions, we propose a model of spatial learning and sequence generation as interdependent processes, integrating cortical contextual coding, synaptic plasticity and neuromodulatory mechanisms into a map-based approach. Following goal learning, sequential activity emerges from continuous attractor network dynamics biased by goal memory inputs. We apply Bayesian decoding on the resulting spike trains, allowing a direct comparison with experimental data. Simulations show that this model (1) explains the generation of never-experienced sequence trajectories in familiar environments, without requiring virtual self-motion signals, (2) accounts for the bias in place-cell sequences toward goal locations, (3) highlights their utility in flexible route planning, and (4) provides specific testable predictions.

Cocaine Promotes Coincidence Detection and Lowers Induction Threshold during Hebbian Associative Synaptic Potentiation in Prefrontal Cortex

Addictive drugs usurp neural plasticity mechanisms that normally serve reward-related learning and memory, primarily by evoking changes in glutamatergic synaptic strength in the mesocorticolimbic dopamine circuitry. Here, we show that repeated cocaine exposure in vivo does not alter synaptic strength in the mouse prefrontal cortex during an early period of withdrawal, but instead modifies a Hebbian quantitative synaptic learning rule by broadening the temporal window and lowers the induction threshold for spike-timing-dependent LTP (t-LTP). After repeated, but not single, daily cocaine injections, t-LTP in layer V pyramidal neurons is induced at +30 ms, a normally ineffective timing interval for t-LTP induction in saline-exposed mice. This cocaine-induced, extended-timing t-LTP lasts for ∼1 week after terminating cocaine and is accompanied by an increased susceptibility to potentiation by fewer pre-post spike pairs, indicating a reduced t-LTP induction threshold. Basal synaptic strength and the maximal attainable t-LTP magnitude remain unchanged after cocaine exposure. We further show that the cocaine facilitation of t-LTP induction is caused by sensitized D1-cAMP/protein kinase A dopamine signaling in pyramidal neurons, which then pathologically recruits voltage-gated l-type Ca²⁺ channels that synergize with GluN2A-containing NMDA receptors to drive t-LTP at extended timing. Our results illustrate a mechanism by which cocaine, acting on a key neuromodulation pathway, modifies the coincidence detection window during Hebbian plasticity to facilitate associative synaptic potentiation in prefrontal excitatory circuits. By modifying rules that govern activity-dependent synaptic plasticity, addictive drugs can derail the experience-driven neural circuit remodeling process important for executive control of reward and addiction.

SIGNIFICANCE STATEMENT

It is believed that addictive drugs often render an addict's brain reward system hypersensitive, leaving the individual more susceptible to relapse. We found that repeated cocaine exposure alters a Hebbian associative synaptic learning rule that governs activity-dependent synaptic plasticity in the mouse prefrontal cortex, characterized by a broader temporal window and a lower threshold for spike-timing-dependent LTP (t-LTP), a cellular form of learning and memory. This rule change is caused by cocaine-exacerbated D1-cAMP/protein kinase A dopamine signaling in pyramidal neurons that in turn pathologically recruits l-type Ca²⁺ channels to facilitate coincidence detection during t-LTP induction. Our study provides novel insights on how cocaine, even with only brief exposure, may prime neural circuits for subsequent experience-dependent remodeling that may underlie certain addictive behavior.

R-Modafinil exerts weak effects on spatial memory acquisition and dentate gyrus synaptic plasticity

Modafinil is a wake promoting drug approved for clinical use and also has cognitive enhancing properties. Its enantiomer R-Modafinil (R-MO) is not well studied in regard to cognitive enhancing properties. Hence we studied its effect in a spatial memory paradigm and its possible effects on dentate gyrus long-term potentiation (DG-LTP). Clinically relevant doses of R-MO, vehicle dimethyl sulfoxide (DMSO) or saline were administered for three days during the hole-board test and in in vivo DG-LTP. Synaptic levels of dopamine receptors D1R, D2R, dopamine transporter (DAT), and its phosphorylated form (ph-DAT) in DG tissue 4 h after LTP induction were quantified by western blot analysis. Monoamine reuptake and release assays were performed by using transfected HEK-293 cells. Possible neurotoxic side effects on general behaviour were also studied. R-MO at both doses significantly enhanced spatial reference memory during the last training session and during memory retrieval compared to DMSO vehicle but not when compared to saline treated rats. Similarly, R-MO rescues DG-LTP from impairing effects of DMSO. DMSO reduced memory performance and LTP magnitude when compared to saline treated groups. The synaptic DR1 levels in R-MO groups were significantly decreased compared to DMSO group but were comparable with saline treated animals. We found no effect of R-MO in neurotoxicity tests. Thus, our results support the notion that LTP-like synaptic plasticity processes could be one of the factors contributing to the cognitive enhancing effects of spatial memory traces. D1R may play an important regulatory role in these processes.

Reproducing Infra-Slow Oscillations with Dopaminergic Modulation

In the human brain, billions of neurons construct a neural network via synaptic connections. Neuronal excitation and inhibition are transmitted to other neurons through synapses via neurotransmitters. Dopamine is one of these neurotransmitters that plays a number of important roles. There are a variety of rhythms in the brain, such as alpha rhythm, beta rhythm, and so on. Infra-slow oscillation, ISO, is one of the rhythms observed in the brain, and ranges below 0.1 Hz. One of the key roles of dopamine is the generation of ISO in neural networks. Although the mechanism underlying the generation of ISO remains unknown, ISO can be generated by activation of the D1-type dopamine receptor. The D1-type receptor regulates spike timing-dependent plasticity (STDP), which is a learning rule of the change in synaptic weights. In this paper, to reproduce ISO in neural networks, we show that dopaminergic modulation of STDP is essential. More specifically, we discovered a close relationship between two dopaminergic effects: modulation of the STDP function and generation of ISO. We therefore, numerically investigated the relationship in detail and proposed a possible mechanism by which ISO is generated.

Coexistence of Multiple Types of Synaptic Plasticity in Individual Hippocampal CA1 Pyramidal Neurons

Understanding learning and memory mechanisms is an important goal in neuroscience. To gain insights into the underlying cellular mechanisms for memory formation, synaptic plasticity processes are studied with various techniques in different brain regions. A valid model to scrutinize different ways to enhance or decrease synaptic transmission is recording of long-term potentiation (LTP) or long-term depression (LTD). At the single cell level, spike timing-dependent plasticity (STDP) protocols have emerged as a powerful tool to investigate synaptic plasticity with stimulation paradigms that also likely occur during memory formation in vivo. Such kind of plasticity can be induced by different STDP paradigms with multiple repeat numbers and stimulation patterns. They subsequently recruit or activate different molecular pathways and neuromodulators for induction and expression of STDP. Dopamine (DA) and brain-derived neurotrophic factor (BDNF) have been recently shown to be important modulators for hippocampal STDP at Schaffer collateral (SC)-CA1 synapses and are activated exclusively by distinguishable STDP paradigms. Distinct types of parallel synaptic plasticity in a given neuron depend on specific subcellular molecular prerequisites. Since the basal and apical dendrites of CA1 pyramidal neurons are known to be heterogeneous, and distance-dependent dendritic gradients for specific receptors and ion channels are described, the dendrites might provide domain specific locations for multiple types of synaptic plasticity in the same neuron. In addition to the distinct signaling and expression mechanisms of various types of LTP and LTD, activation of these different types of plasticity might depend on background brain activity states. In this article, we will discuss some ideas why multiple forms of synaptic plasticity can simultaneously and independently coexist and can contribute so effectively to increasing the efficacy of memory storage and processing capacity of the brain. We hypothesize that resolving the subcellular location of t-LTP and t-LTD mechanisms that are regulated by distinct neuromodulator systems will be essential to reach a more cohesive understanding of synaptic plasticity in memory formation.

Neuromodulation of the Feedforward Dentate Gyrus-CA3 Microcircuit

The feedforward dentate gyrus-CA3 microcircuit in the hippocampus is thought to activate ensembles of CA3 pyramidal cells and interneurons to encode and retrieve episodic memories. The creation of these CA3 ensembles depends on neuromodulatory input and synaptic plasticity within this microcircuit. Here we review the mechanisms by which the neuromodulators aceylcholine, noradrenaline, dopamine, and serotonin reconfigure this microcircuit and thereby infer the net effect of these modulators on the processes of episodic memory encoding and retrieval.

Dopamine receptor activity participates in hippocampal synaptic plasticity associated with novel object recognition

Physiological and behavioral evidence supports that dopamine (DA) receptor signaling influences hippocampal function. While several recent studies examined how DA influences CA1 plasticity and learning, there are fewer studies investigating the influence of DA signaling to the dentate gyrus. The dentate gyrus receives convergent cortical input through the perforant path fiber tracts and has been conceptualized to detect novelty in spatial memory tasks. To test whether DA-receptor activity influences novelty-detection, we used a novel object recognition (NOR) task where mice remember previously presented objects as an indication of learning. Although DA innervation arises from other sources and the main DA signaling may be from those sources, our molecular approaches verified that midbrain dopaminergic fibers also sparsely innervate the dentate gyrus. During the NOR task, wild-type mice spent significantly more time investigating novel objects rather than previously observed objects. Dentate granule cells in slices cut from those mice showed an increased AMPA/NMDA-receptor current ratio indicative of potentiated synaptic transmission. Post-training injection of a D1-like receptor antagonist not only effectively blocked the preference for the novel objects, but also prevented the increased AMPA/NMDA ratio. Consistent with that finding, neither NOR learning nor the increase in the AMPA/NMDA ratio were observed in DA-receptor KO mice under the same experimental conditions. The results indicate that DA-receptor signaling contributes to the successful completion of the NOR task and to the associated synaptic plasticity of the dentate gyrus that likely contributes to the learning.

Dopamine D1/D5, But not D2/D3, Receptor Dependency of Synaptic Plasticity at Hippocampal Mossy Fiber Synapses that Is Enabled by Patterned Afferent Stimulation, or Spatial Learning

Although the mossy fiber (MF) synapses of the hippocampal CA3 region display quite distinct properties in terms of the molecular mechanisms that underlie synaptic plasticity, they nonetheless exhibit persistent (>24 h) synaptic plasticity that is akin to that observed at the Schaffer collateral (SCH)-CA1 and perforant path (PP)-dentate gyrus (DG) synapses of freely behaving rats. In addition, they also respond to novel spatial learning with very enduring forms of long-term potentiation (LTP) and long-term depression (LTD). These latter forms of synaptic plasticity are directly related to the learning behavior: novel exploration of generalized changes in space facilitates the expression of LTP at MF-CA3 synapses, whereas exploration of novel configurations of large environmental features facilitates the expression of LTD. In the absence of spatial novelty, synaptic plasticity is not expressed. Motivation is a potent determinant of whether learning about the spatial experience effectively occurs and the neuromodulator dopamine (DA) plays a key role in motivation-based learning. Prior research on the regulation by DA receptors of long-term synaptic plasticity in CA1 and DG synapses in vivo suggests that whereas D2/D3 receptors may modulate a general predisposition toward expressing plasticity, D1/D5 receptors may directly regulate the direction of change in synaptic strength that occurs during learning. Although the CA3 region is believed to play a pivotal role in many forms of learning, the role of dopamine receptors in persistent (>24 h) forms of synaptic plasticity at MF-CA3 synapses is unknown. Here, we report that whereas pharmacological antagonism of D2/D3 receptors had no impact on LTP or LTD, antagonism of D1/D5 receptors significantly impaired LTP and LTD that were induced by solely by means of patterned afferent stimulation, or LTP/LTD that are typically enhanced by the conjunction of afferent stimulation and novel spatial learning. These data indicate an important role for DA acting on D1/D5 receptors in the support of long-lasting and learning-related forms of synaptic plasticity at MF-CA3 synapses and provide further evidence for an important neuromodulatory role for this receptor in experience-dependent synaptic encoding in the hippocampal subfields.

Long-Term Treatment with Low Doses of Methamphetamine Promotes Neuronal Differentiation and Strengthens Long-Term Potentiation of Glutamatergic Synapses onto Dentate Granule Neurons

Methamphetamine (METH) is a psychostimulant, affecting hippocampal function with disparate cognitive effects, which depends on the dose and time of administration, ranging from improvement to impairment of memory. Importantly, in the United States, METH is approved for the treatment of attention deficit hyperactivity disorder. Modifications of long-term plasticity of synapses originating from the entorhinal cortex onto dentate granule cells (DGCs) have been proposed to underlie cognitive alterations similar to those seen in METH users. However, the effects of METH on synaptic plasticity of the dentate gyrus are unknown. Here, we investigated the impact of long-term administration of METH (2 mg/kg/d) on neurogenesis and synaptic plasticity of immature and mature DGCs of juvenile mice. We used a mouse model of neurogenesis (the G42 line of GAD67-GFP), in which GFP is expressed by differentiating young DGCs. METH treatment enhanced the differentiation of GFP(+) cells, as it increased the fraction of GFP(+) cells expressing the neuronal marker NeuN, and decreased the amount of immature DGCs coexpressing doublecortin. Interestingly, METH did not change the magnitude of long-term potentiation (LTP) in more immature neurons, but facilitated LTP induction in more differentiated GFP(+) and strengthened plasticity in mature GFP(-) DGCs. The METH-induced facilitation of LTP in GFP(+) neurons was accompanied with spine enlargement. Our results reveal a specific action of long-term use of METH in the long-term plasticity of excitatory synapses onto differentiating DGCs and might have important implications toward the understanding of the synaptic basis of METH-induced cognitive alterations.

Associative spike timing-dependent potentiation of the basal dendritic excitatory synapses in the hippocampus in vivo

Spike timing-dependent plasticity in the hippocampus has rarely been studied in vivo. Using extracellular potential and current source density analysis in urethane-anesthetized adult rats, we studied synaptic plasticity at the basal dendritic excitatory synapse in CA1 after excitation-spike (ES) pairing; E was a weak basal dendritic excitation evoked by stratum oriens stimulation, and S was a population spike evoked by stratum radiatum apical dendritic excitation. We hypothesize that positive ES pairing-generating synaptic excitation before a spike-results in long-term potentiation (LTP) while negative ES pairing results in long-term depression (LTD). Pairing (50 pairs at 5 Hz) at ES intervals of -10 to 0 ms resulted in significant input-specific LTP of the basal dendritic excitatory sink, lasting 60-120 min. Pairing at +10- to +20-ms ES intervals, or unpaired 5-Hz stimulation, did not induce significant basal dendritic or apical dendritic LTP or LTD. No basal dendritic LTD was found after stimulation of stratum oriens with 200 pairs of high-intensity pulses at 25-ms interval. Pairing-induced LTP was abolished by pretreatment with an N-methyl-d-aspartate receptor antagonist, 3-(2-carboxypiperazin-4-yl)-propyl-1-phosphonic acid (CPP), which also reduced spike bursting during 5-Hz pairing. Pairing at 0.5 Hz did not induce spike bursts or basal dendritic LTP. In conclusion, ES pairing at 5 Hz resulted in input-specific basal dendritic LTP at ES intervals of -10 ms to 0 ms but no LTD at ES intervals of -20 to +20 ms. Associative LTP likely occurred because of theta-rhythmic coincidence of subthreshold excitation with a backpropagated spike burst, which are conditions that can occur naturally in the hippocampus.

Mature granule cells of the dentate gyrus--Passive bystanders or principal performers in hippocampal function?

The dentate gyrus is the main entrance of highly processed information to the hippocampus which derives from associative cortices and it is one of the few privileged areas in the brain where adult neurogenesis occurs. This creates the unique situation that neurons of diverse maturation stages are part of one neuronal network at any given point in life. While recently adult-born cells have a low induction threshold for long-term potentiation several studies suggest that following maturation granule cells are poorly excitable and they exhibit reduced Hebbian synaptic plasticity to an extent that it was even suggested that they functionally retire. Here, we review the functional properties of mature granule cells and discuss how plasticity of intrinsic excitability and alterations in excitation-inhibition balance might impact on their role in hippocampal information processing.

Dopamine Regulates Aversive Contextual Learning and Associated In Vivo Synaptic Plasticity in the Hippocampus

Dopamine release during reward-driven behaviors influences synaptic plasticity. However, dopamine innervation and release in the hippocampus and its role during aversive behaviors are controversial. Here, we show that in vivo hippocampal synaptic plasticity in the CA3-CA1 circuit underlies contextual learning during inhibitory avoidance (IA) training. Immunohistochemistry and molecular techniques verified sparse dopaminergic innervation of the hippocampus from the midbrain. The long-term synaptic potentiation (LTP) underlying the learning of IA was assessed with a D1-like dopamine receptor agonist or antagonist in ex vivo hippocampal slices and in vivo in freely moving mice. Inhibition of D1-like dopamine receptors impaired memory of the IA task and prevented the training-induced enhancement of both ex vivo and in vivo LTP induction. The results indicate that dopamine-receptor signaling during an aversive contextual task regulates aversive memory retention and regulates associated synaptic mechanisms in the hippocampus that likely underlie learning.

Plasticity of intrinsic excitability in mature granule cells of the dentate gyrus

The dentate gyrus is the main entry gate for cortical input to the hippocampus and one of the few brain areas where adult neurogenesis occurs. Several studies have shown that it is relatively difficult to induce synaptic plasticity in mature but not in newborn dentate granule cells. In the present work we have systematically addressed how classical protocols to induce synaptic plasticity affect action potential firing and intrinsic excitability in mature granule cells. We found that stimulation paradigms considered to be relevant for learning processes consistently modified the probability to generate action potentials in response to a given synaptic input in mature cells, in some paradigms even without any modification of synaptic strength. Collectively the results suggest that plasticity of intrinsic dendritic excitability has a lower induction-threshold than synaptic plasticity in mature granule cells and that this form of plasticity might be an important mechanism by which mature granule cells contribute to hippocampal function.

Priming Spatial Activity by Single-Cell Stimulation in the Dentate Gyrus of Freely Moving Rats

An essential requirement for hippocampal circuits to function in episodic memory is the ability to rapidly disambiguate and store incoming sensory information. This "pattern separation" function has been classically associated to the dentate gyrus, where spatial learning is accompanied by rapid and persistent modifications of place-cell representation. How these rapid modifications are implemented at the cellular level has remained largely unresolved. Here, we tested whether plasticity-inducing stimuli--spike trains--evoked in postsynaptic neurons are sufficient for the rapid induction of place-field activity in the dentate gyrus. We juxtacellularly stimulated 67 silent granule cells while rats explored a maze for the first time. Spike trains with different characteristics (e.g., number of spikes, frequency, and theta-rhythmicity) were evoked at randomly selected spatial locations. We found that, under novelty, ∼30% (10/33) of the stimulated neurons fired selectively at the "primed" spatial location on subsequent laps. Induced place fields were either transient or persisted for multiple laps. The "priming" effect was experience dependent, as it was less frequently observed in habituated animals (3/34 neurons), and it correlated with the number of spikes and theta-rhythmicity of the stimulus trains. These data indicate that, albeit with low efficiency, evoked theta-rhythmic spike trains can be sufficient for priming spatial activity in the dentate gyrus and thus recruiting silent granule cells into the coding population.

A Voltage-Based STDP Rule Combined with Fast BCM-Like Metaplasticity Accounts for LTP and Concurrent "Heterosynaptic" LTD in the Dentate Gyrus In Vivo

Long-term potentiation (LTP) and long-term depression (LTD) are widely accepted to be synaptic mechanisms involved in learning and memory. It remains uncertain, however, which particular activity rules are utilized by hippocampal neurons to induce LTP and LTD in behaving animals. Recent experiments in the dentate gyrus of freely moving rats revealed an unexpected pattern of LTP and LTD from high-frequency perforant path stimulation. While 400 Hz theta-burst stimulation (400-TBS) and 400 Hz delta-burst stimulation (400-DBS) elicited substantial LTP of the tetanized medial path input and, concurrently, LTD of the non-tetanized lateral path input, 100 Hz theta-burst stimulation (100-TBS, a normally efficient LTP protocol for in vitro preparations) produced only weak LTP and concurrent LTD. Here we show in a biophysically realistic compartmental granule cell model that this pattern of results can be accounted for by a voltage-based spike-timing-dependent plasticity (STDP) rule combined with a relatively fast Bienenstock-Cooper-Munro (BCM)-like homeostatic metaplasticity rule, all on a background of ongoing spontaneous activity in the input fibers. Our results suggest that, at least for dentate granule cells, the interplay of STDP-BCM plasticity rules and ongoing pre- and postsynaptic background activity determines not only the degree of input-specific LTP elicited by various plasticity-inducing protocols, but also the degree of associated LTD in neighboring non-tetanized inputs, as generated by the ongoing constitutive activity at these synapses.

The vast majority of computational studies that model synaptic plasticity neglect the fact that in vivo neurons exhibit an ongoing spontaneous spiking which affects the dynamics of synaptic changes. Here we study how key components of learning mechanisms in the brain, namely spike timing-dependent plasticity and metaplasticity, interact with spontaneous activity in the input pathways of the neuron. Using biologically realistic simulations we show that ongoing background activity is a key determinant of the degree of long-term potentiation and long-term depression of synaptic transmission between nerve cells in the hippocampus of freely moving animals. This work helps better understand the computational rules which drive synaptic plasticity in vivo.

Retroactive modulation of spike timing-dependent plasticity by dopamine

Most reinforcement learning models assume that the reward signal arrives after the activity that led to the reward, placing constraints on the possible underlying cellular mechanisms. Here we show that dopamine, a positive reinforcement signal, can retroactively convert hippocampal timing-dependent synaptic depression into potentiation. This effect requires functional NMDA receptors and is mediated in part through the activation of the cAMP/PKA cascade. Collectively, our results support the idea that reward-related signaling can act on a pre-established synaptic eligibility trace, thereby associating specific experiences with behaviorally distant, rewarding outcomes. This finding identifies a biologically plausible mechanism for solving the 'distal reward problem'.

Distinct Eligibility Traces for LTP and LTD in Cortical Synapses

In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

Dopaminergic and cholinergic learning mechanisms in nicotine addiction

Nicotine addiction drives tobacco use by one billion people worldwide, causing nearly six million deaths a year. Nicotine binds to nicotinic acetylcholine receptors that are normally activated by the endogenous neurotransmitter acetylcholine. The widespread expression of nicotinic receptors throughout the nervous system accounts for the diverse physiological effects triggered by nicotine. A crucial influence of nicotine is on the synaptic mechanisms underlying learning that contribute to the addiction process. Here, we focus on the acquisition phase of smoking addiction and review animal model studies on how nicotine modifies dopaminergic and cholinergic signaling in key nodes of the reinforcement circuitry: ventral tegmental area, nucleus accumbens (NAc), amygdala, and hippocampus. Capitalizing on mechanisms that subserve natural rewards, nicotine activates midbrain dopamine neurons directly and indirectly, and nicotine causes dopamine release in very broad target areas throughout the brain, including the NAc, amygdala, and hippocampus. In addition, nicotine orchestrates local changes within those target structures, alters the release of virtually all major neurotransmitters, and primes the nervous system to the influence of other addictive drugs. Hence, understanding how nicotine affects the circuitry for synaptic plasticity and learning may aid in developing reasoned therapies to treat nicotine addiction.

cAMP-dependent protein kinase inhibits α7 nicotinic receptor activity in layer 1 cortical interneurons through activation of D1/D5 dopamine receptors

KEY POINTS

Protein kinases can modify the function of many proteins including ion channels. However, the role of protein kinase A in modifying nicotinic receptors in the CNS has never been investigated. We showed through whole-cell recordings of layer 1 prefrontal cortical interneurons that α7 nicotinic responses are negatively modulated by protein kinase A. Furthermore, we show that stimulation of dopamine receptors can similarly attenuate α7 nicotinic responses through the activation of protein kinase A. These results suggest how the interaction of the cholinergic and dopaminergic systems may influence neuronal excitability in the brain.

ABSTRACT

Phosphorylation of ion channels, including nicotinic acetylcholine receptors (nAChRs), by protein kinases plays a key role in the modification of synaptic transmission and neuronal excitability. α7 nAChRs are the second most prevalent nAChR subtype in the CNS following α4β2. Serine 365 in the M3-M4 cytoplasmic loop of the α7 nAChR is a phosphorylation site for protein kinase A (PKA). D1/D5 dopamine receptors signal through the adenylate cyclase-PKA pathway and play a key role in working memory and attention in the prefrontal cortex. Thus, we examined whether the dopaminergic system, mediated through PKA, functionally interacts with the α7-dependent cholinergic neurotransmission. In layer 1 interneurons of mouse prefrontal cortex, α7 nicotinic currents were decreased upon stimulation with 8-Br-cAMP, a PKA activator. In HEK 293T cells, dominant negative PKA abolished 8-Br-cAMP's effect of diminishing α7 nicotinic currents, while a constitutively active PKA catalytic subunit decreased α7 currents. In brain slices, the PKA inhibitor KT-5720 nullified 8-Br-cAMP's effect of attenuating α7 nicotinic responses, while applying a PKA catalytic subunit in the pipette solution decreased α7 currents. 8-Br-cAMP stimulation reduced surface expression of α7 nAChRs, but there was no change in single-channel conductance. The D1/D5 dopamine receptor agonist SKF 83822 similarly attenuated α7 nicotinic currents from layer 1 interneurons and this attenuation of nicotinic current was prevented by KT-5720. These results demonstrate that dopamine receptor-mediated activation of PKA negatively modulates nicotinic neurotransmission in prefrontal cortical interneurons, which may be a contributing mechanism of dopamine modulation of cognitive behaviours such as attention or working memory.

Rhythms and blues: modulation of oscillatory synchrony and the mechanism of action of antidepressant treatments

Treatments for major depressive disorder (MDD) act at different hierarchical levels of biological complexity, ranging from the individual synapse to the brain as a whole. Theories of antidepressant medication action traditionally have focused on the level of cell-to-cell interaction and synaptic neurotransmission. However, recent evidence suggests that modulation of synchronized electrical activity in neuronal networks is a common effect of antidepressant treatments, including not only medications, but also neuromodulatory treatments such as repetitive transcranial magnetic stimulation. Synchronization of oscillatory network activity in particular frequency bands has been proposed to underlie neurodevelopmental and learning processes, and also may be important in the mechanism of action of antidepressant treatments. Here, we review current research on the relationship between neuroplasticity and oscillatory synchrony, which suggests that oscillatory synchrony may help mediate neuroplastic changes related to neurodevelopment, learning, and memory, as well as medication and neuromodulatory treatment for MDD. We hypothesize that medication and neuromodulation treatments may have related effects on the rate and pattern of neuronal firing, and that these effects underlie antidepressant efficacy. Elucidating the mechanisms through which oscillatory synchrony may be related to neuroplasticity could lead to enhanced treatment strategies for MDD.