Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro

Acetylcholine demixes heterogeneous dopamine signals for learning and moving

Midbrain dopamine neurons promote reinforcement learning and movement vigor. A major outstanding question is how dopamine-recipient neurons in the striatum parse these heterogeneous signals. Here we characterized dopamine and acetylcholine release in the dorsomedial striatum (DMS) of rats performing a decision-making task. We found that dopamine acted as a reward prediction error (RPE), modulating behavior and DMS spiking on subsequent trials when coincident with pauses in cholinergic release. In contrast, at task events that elicited coincident bursts of acetylcholine and dopamine, dopamine preceded contralateral movements and predicted movement vigor without inducing plastic changes in DMS firing rates. Our findings provide a circuit-level mechanism by which cholinergic modulation allows the same dopamine signals to be used for either movement or learning depending on instantaneous behavioral context.

Mesolimbic dopamine encodes reward prediction errors independent of learning rates

Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented in synaptic weights in the striatum, and updated by dopamine-dependent plasticity, suggesting that dopamine release might reflect the product of the learning rate and RPE. Here, we leveraged the fact that animals learn faster in volatile environments to characterize dopamine encoding of learning rates. We trained rats on a task with semi-observable states offering different rewards, and rats adjusted how quickly they initiated trials across states using RPEs. Computational modeling and behavioral analyses showed that learning rates were higher following state transitions, and scaled with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the nucleus accumbens encoded RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.

Dopaminergic Input Regulates the Sensitivity of Indirect Pathway Striatal Spiny Neurons to Brain-Derived Neurotrophic Factor

Motor dysfunction in Parkinson's disease (PD) is closely linked to the dopaminergic depletion of striatal neurons and altered synaptic plasticity at corticostriatal synapses. Dopamine receptor D1 (DRD1) stimulation is a crucial step in the formation of long-term potentiation (LTP), whereas dopamine receptor D2 (DRD2) stimulation is needed for the formation of long-term depression (LTD) in striatal spiny projection neurons (SPNs). Tropomyosin receptor kinase B (TrkB) and its ligand brain-derived neurotrophic factor (BDNF) are centrally involved in plasticity regulation at the corticostriatal synapses. DRD1 activation enhances TrkB's sensitivity for BDNF in direct pathway spiny projection neurons (dSPNs). In this study, we showed that the activation of DRD2 in cultured striatal indirect pathway spiny projection neurons (iSPNs) and cholinergic interneurons causes the retraction of TrkB from the plasma membrane. This provides an explanation for the opposing synaptic plasticity changes observed upon DRD1 or DRD2 stimulation. In addition, TrkB was found within intracellular structures in dSPNs and iSPNs from Pitx3-/- mice, a genetic model of PD with early onset dopaminergic depletion in the dorsolateral striatum (DLS). This dysregulated BDNF/TrkB signaling might contribute to the pathophysiology of direct and indirect pathway striatal projection neurons in PD.

Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks

A major advance in understanding learning behavior stems from experiments showing that reward learning requires dopamine inputs to striatal neurons and arises from synaptic plasticity of cortico-striatal synapses. Numerous reinforcement learning models mimic this dopamine-dependent synaptic plasticity by using the reward prediction error, which resembles dopamine neuron firing, to learn the best action in response to a set of cues. Though these models can explain many facets of behavior, reproducing some types of goal-directed behavior, such as renewal and reversal, require additional model components. Here we present a reinforcement learning model, TD2Q, which better corresponds to the basal ganglia with two Q matrices, one representing direct pathway neurons (G) and another representing indirect pathway neurons (N). Unlike previous two-Q architectures, a novel and critical aspect of TD2Q is to update the G and N matrices utilizing the temporal difference reward prediction error. A best action is selected for N and G using a softmax with a reward-dependent adaptive exploration parameter, and then differences are resolved using a second selection step applied to the two action probabilities. The model is tested on a range of multi-step tasks including extinction, renewal, discrimination; switching reward probability learning; and sequence learning. Simulations show that TD2Q produces behaviors similar to rodents in choice and sequence learning tasks, and that use of the temporal difference reward prediction error is required to learn multi-step tasks. Blocking the update rule on the N matrix blocks discrimination learning, as observed experimentally. Performance in the sequence learning task is dramatically improved with two matrices. These results suggest that including additional aspects of basal ganglia physiology can improve the performance of reinforcement learning models, better reproduce animal behaviors, and provide insight as to the role of direct- and indirect-pathway striatal neurons.

Estradiol Receptors Inhibit Long-Term Potentiation in the Dorsomedial Striatum

Estradiol, a female sex hormone and the predominant form of estrogen, has diverse effects throughout the brain including in learning and memory. Estradiol modulates several types of learning that depend on the dorsomedial striatum (DMS), a subregion of the basal ganglia involved in goal-directed learning, cued action-selection, and motor skills. A cellular basis of learning is synaptic plasticity, and the presence of extranuclear estradiol receptors ERα, ERβ, and G-protein-coupled estrogen receptor (GPER) throughout the DMS suggests that estradiol may influence rapid cellular actions including those involved in plasticity. To test whether estradiol affects synaptic plasticity in the DMS, corticostriatal long-term potentiation (LTP) was induced using theta-burst stimulation (TBS) in ex vivo brain slices from intact male and female C57BL/6 mice. Extracellular field recordings showed that female mice in the diestrous stage of the estrous cycle exhibited LTP similar to male mice, while female mice in estrus did not exhibit LTP. Furthermore, antagonists of ERα or GPER rescued LTP in estrous females and agonists of ERα or GPER reduced LTP in diestrous females. In males, activating ERα but not GPER reduced LTP. These results uncover an inhibitory action of estradiol receptors on cellular learning in the DMS and suggest a cellular mechanism underlying the impairment in certain types of DMS-based learning observed in the presence of high estradiol. Because of the dorsal striatum's role in substance use disorders, these findings may provide a mechanism underlying an estradiol-mediated progression from goal-directed to habitual drug use.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Motor cortical plasticity and its correlation with motor symptoms in Parkinson's disease

Background

The relationship between abnormal cortical plasticity and parkinsonian symptoms remains unclear in Parkinson's disease (PD).

Objective

We studied the relationship between their symptoms and degree of Long-term potentiation (LTP)-like effects induced by quadripulse magnetic stimulation (QPS) over the primary motor cortex, which has a small inter-individual variability in humans.

Methods

Participants were 16 PD patients (drug-naïve or treated with L-DOPA monotherapy) and 13 healthy controls (HC). LTP-like effects by QPS were compared between three conditions (HC､PD with or without L-DOPA). In PD, correlation analyses were performed between clinical scores (MDS-UPDRS, MMSE and MoCA-J) and the degree of LTP-like effects induced by QPS.

Results

In PD, QPS-induced LTP-like effect was reduced and restored by L-DOPA. The degree of the LTP was negatively correlated with MDS-UPDRS Part I and III scores, but not with MMSE and MoCA-J. In the sub-scores, upper limb bradykinesia and rigidity showed a negative correlation with the LTP-like effect whereas the tremor had no correlation.

Conclusions

Our results suggest that motor cortical plasticity relate with mechanisms underlying bradykinesia and rigidity in the upper limb muscles. LTP induced by QPS may be used as an objective marker of parkinsonian symptoms.

•

Quadripulse magnetic stimulation (QPS) was applied to early PD patients.

•

L-DOPA restored QPS-induced LTP of the primary motor cortex in early PD patients.

•

The degree of LTP was negatively correlated with the severity of motor symptoms.

•

Upper limb bradykinesia and rigidity had a strong negative correlation with LTP.

Dopamine Receptors: Is It Possible to Become a Therapeutic Target for Depression?

Dopamine and its receptors are currently recognized targets for the treatment of several neuropsychiatric disorders, including Parkinson’s disease, schizophrenia, some drug use addictions, as well as depression. Dopamine receptors are widely distributed in various regions of the brain, but their role and exact contribution to neuropsychiatric diseases has not yet been thoroughly studied. Based on the types of dopamine receptors and their distribution in different brain regions, this paper reviews the current research status of the molecular, cellular and circuit mechanisms of dopamine and its receptors involved in depression. Multiple lines of investigation of these mechanisms provide a new future direction for understanding the etiology and treatment of depression and potential new targets for antidepressant treatments.

Inhibitory Spike-Timing-Dependent Plasticity Can Account for Pathological Strengthening of Pallido-Subthalamic Synapses in Parkinson's Disease

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with dysfunction of the basal ganglia (BG) circuitry. Dopamine (DA) depletion in experimental PD models leads to the pathological strengthening of pallido-subthalamic synaptic connections, contributing to the emergence of abnormally synchronized neuronal activity in the external segment of the globus pallidus (GPe) and subthalamic nucleus (STN). Augmented GPe-STN transmission following loss of DA was attributed to heterosynaptic plasticity mechanisms induced by cortico-subthalamic inputs. However, synaptic plasticity may play a role in this process. Here, by employing computational modeling we show that assuming inhibitory spike-timing-dependent plasticity (iSTDP) at pallido-subthalamic synapses can account for pathological strengthening of pallido-subthalamic synapses in PD by further promoting correlated neuronal activity in the GPe-STN network. In addition, we show that GPe-STN transmission delays can shape bistable activity-connectivity states due to iSTDP, characterized by strong connectivity and strong synchronized activity (pathological states) as opposed to weak connectivity and desynchronized activity (physiological states). Our results may shed light on how abnormal reshaping of GPe-STN connectivity by synaptic plasticity during parkinsonism is related to the PD pathophysiology and contribute to the development of therapeutic brain stimulation techniques targeting plasticity-induced rewiring of network connectivity.

Coincidence of cholinergic pauses, dopaminergic activation and depolarisation of spiny projection neurons drives synaptic plasticity in the striatum

Dopamine-dependent long-term plasticity is believed to be a cellular mechanism underlying reinforcement learning. In response to reward and reward-predicting cues, phasic dopamine activity potentiates the efficacy of corticostriatal synapses on spiny projection neurons (SPNs). Since phasic dopamine activity also encodes other behavioural variables, it is unclear how postsynaptic neurons identify which dopamine event is to induce long-term plasticity. Additionally, it is unknown how phasic dopamine released from arborised axons can potentiate targeted striatal synapses through volume transmission. To examine these questions we manipulated striatal cholinergic interneurons (ChIs) and dopamine neurons independently in two distinct in vivo paradigms. We report that long-term potentiation (LTP) at corticostriatal synapses with SPNs is dependent on the coincidence of pauses in ChIs and phasic dopamine activation, critically accompanied by SPN depolarisation. Thus, the ChI pause defines the time window for phasic dopamine to induce plasticity, while depolarisation of SPNs constrains the synapses eligible for plasticity.

Intra-dorsal striatal acetylcholine M1 but not dopaminergic D1 or glutamatergic NMDA receptor antagonists inhibit consolidation of duration memory in interval timing

The striatal beat frequency model assumes that striatal medium spiny neurons encode duration via synaptic plasticity. Muscarinic 1 (M1) cholinergic receptors as well as dopamine and glutamate receptors are important for neural plasticity in the dorsal striatum. Therefore, we investigated the effect of inhibiting these receptors on the formation of duration memory. After sufficient training in a peak interval (PI)-20-s procedure, rats were administered a single or mixed infusion of a selective antagonist for the dopamine D1 receptor (SCH23390, 0.5 µg per side), N-methyl-D-aspartic acid (NMDA)-type glutamate receptor (D-AP5, 3 µg), or M1 receptor (pirenzepine, 10 µg) bilaterally in the dorsal striatum, immediately before initiating a PI-40 s session (shift session). The next day, the rats were tested for new duration memory (40 s) in a session in which no lever presses were reinforced (test session). In the shift session, the performance was comparable irrespective of the drug injected. However, in the test session, the mean peak time (an index of duration memory) of the M1 + NMDA co-blockade group, but not of the D1 + NMDA co-blockade group, was lower than that of the control group (Experiments 1 and 2). In Experiment 3, the effect of the co-blockade of M1 and NMDA receptors was replicated. Moreover, sole blockade of M1 receptors induced the same effect as M1 and NMDA blockade. These results suggest that in the dorsal striatum, the M1 receptor, but not the D1 or NMDA receptors, is involved in the consolidation of duration memory.

Basic mechanisms of plasticity and learning

The last century was characterized by a significant scientific effort aimed at unveiling the neurobiological basis of learning and memory. Thanks to the characterization of the mechanisms regulating the long-term changes of neuronal synaptic connections, it was possible to understand how specific neural networks shape themselves during the acquisition of memory traces or complex motor tasks. In this chapter, we will summarize the mechanisms underlying the main forms of synaptic plasticity taking advantage of the studies performed in the hippocampus and in the nucleus striatum, key brain structures that play a crucial role in cognition. Moreover, we will discuss how the molecular pathways involved in the induction of physiologic synaptic long-term changes could be disrupted during neurodegenerative and neuroinflammatory disorders, highlighting the translational relevance of this intriguing research field.

Effects of methamphetamine-induced neurotoxicity on striatal long-term potentiation

RATIONALE

Methamphetamine (METH) exposure is associated with damage to central monoamine systems, particularly dopamine signaling. Rodent models of such damage have revealed a decrease in the amplitude of phasic dopamine signals and significant striatal dysfunction, including changes in the molecular, system, and behavioral functions of the striatum. Dopamine signaling through D1 receptors promotes corticostriatal long-term potentiation (LTP), a critical substrate of these striatal functions.

OBJECTIVES

Therefore, the purpose of this study was to determine if METH-induced dopamine neurotoxicity would impair D1 receptor-dependent striatal LTP in mice.

METHODS

Mice were treated with a METH binge regimen (4 × 10 mg/kg d,l-methamphetamine, s.c.) that recapitulates all of the known METH-induced neurotoxic effects observed in humans, including dopamine toxicity. Three weeks later, acute brain slices containing either the dorsomedial striatum (DMS) or dorsolateral striatum (DLS) were prepared, and plasticity was assessed using white matter, high-frequency stimulation (HFS), and striatal extracellular electrophysiology.

RESULTS

Under these conditions, LTP was induced in brain slices containing the DMS from saline-pretreated mice, but not mice with METH-induced neurotoxicity. Furthermore, the LTP observed in DMS slices from saline-pretreated mice was blocked by the dopamine D1 receptor antagonist SCH23390, indicating that this LTP is dopamine D1 receptor-dependent. Finally, acute in vivo treatment of METH-pretreated mice with bupropion (50 mg/kg, i.p.) promoted LTP in DMS slices.

CONCLUSIONS

Together, these studies demonstrate that METH-induced neurotoxicity impairs dopamine D1 receptor-dependent LTP within the DMS and that the FDA-approved drug bupropion restores induction of striatal LTP in mice with METH-induced dopamine neurotoxicity.

Spike-Timing-Dependent Plasticity Mediated by Dopamine and its Role in Parkinson's Disease Pathophysiology

Parkinson's disease (PD) is a multi-systemic neurodegenerative brain disorder. Motor symptoms of PD are linked to the significant dopamine (DA) loss in substantia nigra pars compacta (SNc) followed by basal ganglia (BG) circuit dysfunction. Increasing experimental and computational evidence indicates that (synaptic) plasticity plays a key role in the emergence of PD-related pathological changes following DA loss. Spike-timing-dependent plasticity (STDP) mediated by DA provides a mechanistic model for synaptic plasticity to modify synaptic connections within the BG according to the neuronal activity. To shed light on how DA-mediated STDP can shape neuronal activity and synaptic connectivity in the PD condition, we reviewed experimental and computational findings addressing the modulatory effect of DA on STDP as well as other plasticity mechanisms and discussed their potential role in PD pathophysiology and related network dynamics and connectivity. In particular, reshaping of STDP profiles together with other plasticity-mediated processes following DA loss may abnormally modify synaptic connections in competing pathways of the BG. The cascade of plasticity-induced maladaptive or compensatory changes can impair the excitation-inhibition balance towards the BG output nuclei, leading to the emergence of pathological activity-connectivity patterns in PD. Pre-clinical, clinical as well as computational studies reviewed here provide an understanding of the impact of synaptic plasticity and other plasticity mechanisms on PD pathophysiology, especially PD-related network activity and connectivity, after DA loss. This review may provide further insights into the abnormal structure-function relationship within the BG contributing to the emergence of pathological states in PD. Specifically, this review is intended to provide detailed information for the development of computational network models for PD, serving as testbeds for the development and optimization of invasive and non-invasive brain stimulation techniques. Computationally derived hypotheses may accelerate the development of therapeutic stimulation techniques and potentially reduce the number of related animal experiments.

Nanoscale Sub-Compartmentalization of the Dendritic Spine Compartment

Compartmentalization of the membrane is essential for cells to perform highly specific tasks and spatially constrained biochemical functions in topographically defined areas. These membrane lateral heterogeneities range from nanoscopic dimensions, often involving only a few molecular constituents, to micron-sized mesoscopic domains resulting from the coalescence of nanodomains. Short-lived domains lasting for a few milliseconds coexist with more stable platforms lasting from minutes to days. This panoply of lateral domains subserves the great variety of demands of cell physiology, particularly high for those implicated in signaling. The dendritic spine, a subcellular structure of neurons at the receiving (postsynaptic) end of central nervous system excitatory synapses, exploits this compartmentalization principle. In its most frequent adult morphology, the mushroom-shaped spine harbors neurotransmitter receptors, enzymes, and scaffolding proteins tightly packed in a volume of a few femtoliters. In addition to constituting a mesoscopic lateral heterogeneity of the dendritic arborization, the dendritic spine postsynaptic membrane is further compartmentalized into spatially delimited nanodomains that execute separate functions in the synapse. This review discusses the functional relevance of compartmentalization and nanodomain organization in synaptic transmission and plasticity and exemplifies the importance of this parcelization in various neurotransmitter signaling systems operating at dendritic spines, using two fast ligand-gated ionotropic receptors, the nicotinic acetylcholine receptor and the glutamatergic receptor, and a second-messenger G-protein coupled receptor, the cannabinoid receptor, as paradigmatic examples.

Optogenetic induction of orbitostriatal long-term potentiation in the dorsomedial striatum elicits a persistent reduction of alcohol-seeking behavior in rats

Uncontrolled drug-seeking and -taking behaviors are generally driven by maladaptive corticostriatal synaptic plasticity. The orbital frontal cortex (OFC) and its projections to the dorsomedial striatum (DMS) have been extensively implicated in drug-seeking and relapse behaviors. The influence of the synaptic plasticity of OFC projections to the DMS (OFC→DMS) on drug-seeking and -taking behaviors has not been fully characterized. To investigate this, we trained rats to self-administer 20% alcohol and then delivered an in vivo optogenetic protocol designed to induce long-term potentiation (LTP) selectively at OFC→DMS synapses. We selected LTP induction because we found that voluntary alcohol self-administration suppressed OFC→DMS transmission and LTP may normalize this transmission, consequently reducing alcohol-seeking behavior. Importantly, ex vivo slice electrophysiology studies confirmed that this in vivo optical stimulation protocol resulted in a significant increase in excitatory OFC→DMS transmission strength on day two after stimulation, suggesting that LTP was induced in vivo. Rat alcohol-seeking and -taking behaviors were significantly reduced on days 1-3, but not on days 7-11, after LTP induction. Striatal synaptic plasticity is modulated by several critical neurotransmitter receptors, including dopamine D1 receptors (D1Rs) and adenosine A2A receptors (A2ARs). We found that delivery of in vivo optical stimulation in the presence of a D1R antagonist abolished the LTP-associated decrease in alcohol-seeking behavior, whereas delivery in the presence of an A2AR antagonist may facilitate this LTP-induced behavioral change. These results demonstrate that alcohol-seeking behavior was negatively regulated by the potentiation of excitatory OFC→DMS neurotransmission. Our findings provide direct evidence that the OFC exerts "top-down" control of alcohol-seeking behavior via the DMS.

Neuro-Immune Cross-Talk in the Striatum: From Basal Ganglia Physiology to Circuit Dysfunction

The basal ganglia network is represented by an interconnected group of subcortical nuclei traditionally thought to play a crucial role in motor learning and movement execution. During the last decades, knowledge about basal ganglia physiology significantly evolved and this network is now considered as a key regulator of important cognitive and emotional processes. Accordingly, the disruption of basal ganglia network dynamics represents a crucial pathogenic factor in many neurological and psychiatric disorders. The striatum is the input station of the circuit. Thanks to the synaptic properties of striatal medium spiny neurons (MSNs) and their ability to express synaptic plasticity, the striatum exerts a fundamental integrative and filtering role in the basal ganglia network, influencing the functional output of the whole circuit. Although it is currently established that the immune system is able to regulate neuronal transmission and plasticity in specific cortical areas, the role played by immune molecules and immune/glial cells in the modulation of intra-striatal connections and basal ganglia activity still needs to be clarified. In this manuscript, we review the available evidence of immune-based regulation of synaptic activity in the striatum, also discussing how an abnormal immune activation in this region could be involved in the pathogenesis of inflammatory and degenerative central nervous system (CNS) diseases.

Prenatal Stress Leads to the Altered Maturation of Corticostriatal Synaptic Plasticity and Related Behavioral Impairments Through Epigenetic Modifications of Dopamine D2 Receptor in Mice

Prenatal stress (PRS) had a long-term adverse effect on motor behaviors. Corticostriatal synaptic plasticity, a cellular basis for motor controlling, has been proven to participate in the pathogenesis of many behavior disorders. Based on the reports about the involvement of epigenetic DNA alterations in PRS-induced long-term effects, this research investigated the influence of PRS on the development and maturation of corticostriatal synaptic plasticity and related behaviors and explored the underlying epigenetic mechanism. Subjects were male offspring of dams that were exposed to stress three times per day from the 10th day of pregnancy until delivery. The development and maturation of plasticity at corticostriatal synapses, dopamine signaling, behavioral habituation, and DNA methylation were examined and analyzed. Control mice expressed long-term potentiation (LTP) at corticostriatal synapses during postnatal days (PD) 12-14 and produced long-term depression (LTD) during PD 20-60. However, PRS mice exhibited sustained LTP during PD 12-60. The treatment with dopamine 2 receptor (D2R) agonist quinpirole recovered striatal LTD and improved the impaired behavioral habituation in PD 45 adult PRS mice. Additionally, adult PRS mice showed reduced D2R, excess DNA methyltransferase 1 (DNMT1), increased binding of DNMT1 to D2R promoter, and hypermethylation at D2R promoter in the striatum. The DNMT1 inhibitor 5-aza-deoxycytidine restored striatal synaptic plasticity and improved behavioral habituation in adult PRS mice via D2R-mediated dopamine signaling. DNMT1-associated D2R hypermethylation is responsible for altering the maturation of plasticity at corticostriatal synapses and impairing the behavioral habituation in PRS mice.

Acute Ethanol Exposure Enhances Synaptic Plasticity in the Dorsal Striatum in Adult Male and Female Rats

Background:

Acute (ex vivo) and chronic (in vivo) alcohol exposure induces neuroplastic changes in the dorsal striatum, a critical region implicated in instrumental learning.

Objective:

Sex differences are evident in alcohol reward and reinforcement, with female rats consuming higher amount of alcohol in operant paradigms compared to male rats. However, sex differences in the neuroplastic changes produced by acute alcohol in the dorsal striatum have been unexplored.

Methods:

Using electrophysiological recordings from dorsal striatal slices obtained from adult male and female rats, we investigated the effects of ex vivo ethanol exposure on synaptic transmission and synaptic plasticity. Ethanol (44 mM) enhanced basal synaptic transmission in both sexes. Ethanol also enhanced long-term potentiation in both sexes. Other measures of synaptic plasticity including paired-pulse ratio were unaltered by ethanol in both sexes.

Results:

The results suggest that alterations in synaptic plasticity induced by acute ethanol, at a concentration associated with intoxication, could play an important role in alcohol-induced experience-dependent modification of corticostriatal circuits underlying the learning of goal-directed instrumental actions and formation of habits mediating alcohol seeking and taking.

Conclusions:

Taken together, understanding the mechanism(s) underlying alcohol induced changes in corticostriatal function may lead to the development of more effective therapeutic agents to reduce habitual drinking and seeking associated with alcohol use disorders.

SCH23390 Reduces Methamphetamine Self-Administration and Prevents Methamphetamine-Induced Striatal LTD

Extended-access methamphetamine self-administration results in unregulated intake of the drug; however, the role of dorsal striatal dopamine D1-like receptors (D1Rs) in the reinforcing properties of methamphetamine under extended-access conditions is unclear. Acute (ex vivo) and chronic (in vivo) methamphetamine exposure induces neuroplastic changes in the dorsal striatum, a critical region implicated in instrumental learning. For example, methamphetamine exposure alters high-frequency stimulation (HFS)-induced long-term depression in the dorsal striatum; however, the effect of methamphetamine on HFS-induced long-term potentiation (LTP) in the dorsal striatum is unknown. In the current study, dorsal striatal infusion of SCH23390, a D1R antagonist, prior to extended-access methamphetamine self-administration reduced methamphetamine addiction-like behavior. Reduced behavior was associated with reduced expression of PSD-95 in the dorsal striatum. Electrophysiological findings demonstrate that superfusion of methamphetamine reduced basal synaptic transmission and HFS-induced LTP in dorsal striatal slices, and SCH23390 prevented this effect. These results suggest that alterations in synaptic transmission and synaptic plasticity induced by acute methamphetamine via D1Rs could assist with methamphetamine-induced modification of corticostriatal circuits underlying the learning of goal-directed instrumental actions and formation of habits, mediating escalation of methamphetamine self-administration and methamphetamine addiction-like behavior.

Dopaminergic afferents from midbrain to dorsolateral bed nucleus of stria terminalis inhibit release and expression of corticotropin-releasing hormone in paraventricular nucleus

Dopaminergic (DAergic) neurons of the midbrain ventral tegmental area (VTA) are known to regulate the hypothalamic-pituitary-adrenal (HPA) axis but have no direct projections to the paraventricular nucleus (PVN) of the hypothalamus. This study investigated whether VTA DAergic afferents modulate glutamatergic transmission-dependent GABAergic neurons in dorsolateral bed nucleus of stria terminalis (dlBNST) to affect the activity of the HPA-axis. Herein, we demonstrate that systemic administration of the neurotoxicant 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) or the VTA-injection of 1-methyl-4-phenylpyridinium ion (MPP+) in male mice (MPTP-mice and MPP+mice) caused a decline of tyrosine hydroxylase positive (TH+) cells in VTA with a reduction in TH+fibers in the dlBNST. MPTP-mice and MPP+mice displayed a clear increase in serum levels of corticosterone (CORT) and adrenocorticotropic hormone, corticotropin-releasing hormone (CRH) expression, and CRH neuron activity in PVN. The presynaptic glutamate release, glutamatergic synaptic transmission and induction of long-term potentiation in dlBNST of MPTP-mice were suppressed, and these effects were rescued by a D1-like DAergic receptor (D1R) agonist and mimicked in control dlBNST by blockade of D1R. MPTP-mice exhibited low expression of glutamic acid decarboxylase and dysfunction of the excitatory-dependent GABAergic circuit in dlBNST, and these effects were recovered by the administration of D1R agonist. Furthermore, either dlBNST-injection of D1R agonist or PVN-injection of GABA_A receptor (GABA_A R) agonist could correct the increased secretion and expression of CRH in MPTP-mice. The results indicate that the DAergic afferents from VTA enhance excitatory-dependent activation of GABAergic neurons in dlBNST, which suppress the activity of the HPA-axis.

Dysfunction of the corticostriatal pathway in autism spectrum disorders

The corticostriatal pathway that carries sensory, motor, and limbic information to the striatum plays a critical role in motor control, action selection, and reward. Dysfunction of this pathway is associated with many neurological and psychiatric disorders. Corticostriatal synapses have unique features in their cortical origins and striatal targets. In this review, we first describe axonal growth and synaptogenesis in the corticostriatal pathway during development, and then summarize the current understanding of the molecular bases of synaptic transmission and plasticity at mature corticostriatal synapses. Genes associated with autism spectrum disorder (ASD) have been implicated in axonal growth abnormalities, imbalance of the synaptic excitation/inhibition ratio, and altered long-term synaptic plasticity in the corticostriatal pathway. Here, we review a number of ASD-associated high-confidence genes, including FMR1, KMT2A, GRIN2B, SCN2A, NLGN1, NLGN3, MET, CNTNAP2, FOXP2, TSHZ3, SHANK3, PTEN, CHD8, MECP2, DYRK1A, RELN, FOXP1, SYNGAP1, and NRXN, and discuss their relevance to proper corticostriatal function.

Neuromodulators and Long-Term Synaptic Plasticity in Learning and Memory: A Steered-Glutamatergic Perspective

The molecular pathways underlying the induction and maintenance of long-term synaptic plasticity have been extensively investigated revealing various mechanisms by which neurons control their synaptic strength. The dynamic nature of neuronal connections combined with plasticity-mediated long-lasting structural and functional alterations provide valuable insights into neuronal encoding processes as molecular substrates of not only learning and memory but potentially other sensory, motor and behavioural functions that reflect previous experience. However, one key element receiving little attention in the study of synaptic plasticity is the role of neuromodulators, which are known to orchestrate neuronal activity on brain-wide, network and synaptic scales. We aim to review current evidence on the mechanisms by which certain modulators, namely dopamine, acetylcholine, noradrenaline and serotonin, control synaptic plasticity induction through corresponding metabotropic receptors in a pathway-specific manner. Lastly, we propose that neuromodulators control plasticity outcomes through steering glutamatergic transmission, thereby gating its induction and maintenance.

Effects of L-DOPA on quadripulse magnetic stimulation-induced long-term potentiation in older adults

Reduced cortical plasticity has been previously reported in older adult as compared with young adults. However, the effects of dopamine on this plasticity reduction remain unknown. Here, we assessed the effects of high-dose (200 mg) and medium-dose (100 mg) L-3,4-dihydroxyphenylalanine (L-DOPA) intake on the long-term potentiation (LTP)-like effect induced by quadripulse magnetic stimulation (QPS) in older adults (aged ∼65 years). The subjects were 32 (200 mg) and 20 (100 mg) healthy older adult volunteers. This study was designed as a double-blind, crossover and placebo-controlled trial on one dose of L-dopa. Two hours after taking L-DOPA or placebo-drug, QPS was applied over the motor cortex. Motor evoked potentials were recorded to evaluate the motor cortical excitability changes. We found that both doses of L-DOPA enhanced LTP after QPS in older adults as one group. We classified subjects into QPS responders and QPS nonresponders. Both L-DOPA doses produced significant LTP enhancement in QPS nonresponders, whereas either of doses did not produce significant LTP enhancement in QPS responders. Collectively, our findings suggest that the neural plasticity reductions observed in older adults could be partly improved by dopamine.

Physiological aging at striatal synapses

Mike Levine's body of work guides thinking on how the basal ganglia process information to create coordinated movements and skill learning throughout the life span and in disease. This special issue is a nod to Mike's career and a well-deserved gesture by the neuroscience community thanking him for the impact he has made on many people's careers and the field of basal ganglia physiology. This paper reviews how aging impacts basal ganglia processing with a focus on single cell and synaptic physiology. This review begins with the work Mike did with his collaborators Nat Buchwald, Chester Hull and Jay Schneider. These early studies paved the way for subsequent studies on changes in synaptic processing that occur with aging in the basal ganglia. The primary focus of this review is aging at corticostriatal synapses. Corticostriatal synapses show reduced expression of both short-term and long-term synaptic potentiation. The roles of age-related changes in calcium homeostasis, vesicle cycling, dopamine modulation, and NMDA receptor function in aging's effect on synaptic plasticity are discussed. The article ends with a review of mitochondrial aging theory as it applies to age-induced changes in corticostriatal synaptic function.

A Computational Model of Dual Competition between the Basal Ganglia and the Cortex

We propose a model that includes interactions between the cortex, the basal ganglia (BG), and the thalamus based on a dual competition. We hypothesize that the striatum, the subthalamic nucleus (STN), the internal globus pallidus (GPi), the thalamus, and the cortex are involved in closed feedback loops through the hyperdirect and direct pathways. These loops support a competition process that results in the ability of BG to make a cognitive decision followed by a motor one. Considering lateral cortical interactions, another competition takes place inside the cortex allowing the latter to make a cognitive and a motor decision. We show how this dual competition endows the model with two regimes. One is driven by reinforcement learning and the other by Hebbian learning. The final decision is made according to a combination of these two mechanisms with a gradual transfer from the former to the latter. We confirmed these theoretical results on primates (Macaca mulatta) using a novel paradigm predicted by the model.

Cell type-specific activation of mitogen-activated protein kinase in D1 receptor-expressing neurons of the nucleus accumbens potentiates stimulus-reward learning in mice

Medium spiny neurons (MSN) in the nucleus accumbens (NAc) are a fundamental component of various aspects of motivated behavior. Although mitogen-activated protein kinase (MAPK) signaling plays a crucial role in several types of learning, the cell type-specific role of MAPK pathway in stimulus-reward learning and motivation remains unclear. We herein investigated the role of MAPK in accumbal MSNs in reward-associated learning and memory. During the acquisition of Pavlovian conditioning, the number of phosphorylated MAPK1/3-positive cells was increased significantly and exclusively in the NAc core by 7-days of extensive training. MAPK signaling in the respective D1R- and D2R-MSNs was manipulated by transfecting an adeno-associated virus (AAV) plasmid into the NAc of Drd1a-Cre and Drd2-Cre transgenic mice. Potentiation of MAPK signaling shifted the learning curve of Pavlovian conditioning to the left only in Drd1a-Cre mice, whereas such manipulation in D2R-MSNs had negligible effects. In contrast, MAPK manipulation in D2R-MSNs of the NAc core significantly increased motivation for food rewards as found in Drd1a-Cre mice. These results suggest that MAPK signaling in the D1R-MSNs of NAc core plays an important role in stimulus-reward learning, while MAPK signaling in both D1R- and D2R-MSNs is involved in motivation for natural rewards.

A Brain-Inspired Decision-Making Spiking Neural Network and Its Application in Unmanned Aerial Vehicle

Decision-making is a crucial cognitive function for various animal species surviving in nature, and it is also a fundamental ability for intelligent agents. To make a step forward in the understanding of the computational mechanism of human-like decision-making, this paper proposes a brain-inspired decision-making spiking neural network (BDM-SNN) and applies it to decision-making tasks on intelligent agents. This paper makes the following contributions: (1) A spiking neural network (SNN) is used to model human decision-making neural circuit from both connectome and functional perspectives. (2) The proposed model combines dopamine and spike-timing-dependent plasticity (STDP) mechanisms to modulate the network learning process, which indicates more biological inspiration. (3) The model considers the effects of interactions among sub-areas in PFC on accelerating the learning process. (4) The proposed model can be easily applied to decision-making tasks in intelligent agents, such as an unmanned aerial vehicle (UAV) flying through a window and a UAV avoiding an obstacle. The experimental results support the effectiveness of the model. Compared with traditional reinforcement learning and existing biologically inspired methods, our method contains more biologically-inspired mechanistic principles, has greater accuracy and is faster.

A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum

Dopamine‐dependent synaptic plasticity is a candidate mechanism for reinforcement learning. A silent eligibility trace – initiated by synaptic activity and transformed into synaptic strengthening by later action of dopamine – has been hypothesized to explain the retroactive effect of dopamine in reinforcing past behaviour. We tested this hypothesis by measuring time‐dependent modulation of synaptic plasticity by dopamine in adult mouse striatum, using whole‐cell recordings. Presynaptic activity followed by postsynaptic action potentials (pre–post) caused spike‐timing‐dependent long‐term depression in D1‐expressing neurons, but not in D2 neurons, and not if postsynaptic activity followed presynaptic activity. Subsequent experiments focused on D1 neurons. Applying a dopamine D1 receptor agonist during induction of pre–post plasticity caused long‐term potentiation. This long‐term potentiation was hidden by long‐term depression occurring concurrently and was unmasked when long‐term depression blocked an L‐type calcium channel antagonist. Long‐term potentiation was blocked by a Ca²⁺‐permeable AMPA receptor antagonist but not by an NMDA antagonist or an L‐type calcium channel antagonist. Pre–post stimulation caused transient elevation of rectification – a marker for expression of Ca²⁺‐permeable AMPA receptors – for 2–4‐s after stimulation. To test for an eligibility trace, dopamine was uncaged at specific time points before and after pre‐ and postsynaptic conjunction of activity. Dopamine caused potentiation selectively at synapses that were active 2‐s before dopamine release, but not at earlier or later times. Our results provide direct evidence for a silent eligibility trace in the synapses of striatal neurons. This dopamine‐timing‐dependent plasticity may play a central role in reinforcement learning.

Exercise-Induced Fatigue Impairs Bidirectional Corticostriatal Synaptic Plasticity

Exercise-induced fatigue (EF) is a ubiquitous phenomenon in sports competition and training. It can impair athletes’ motor skill execution and cognition. Corticostriatal synaptic plasticity is considered to be the cellular mechanism of movement control and motor learning. However, the effect of EF on corticostriatal synaptic plasticity remains elusive. In the present study, using field excitatory postsynaptic potential recording, we found that the corticostriatal long-term potentiation (LTP) and long-term depression (LTD) were both impaired in EF mice. To further investigate the cellular mechanisms underlying the impaired synaptic plasticity in corticostriatal pathway, whole-cell patch clamp recordings were carried out on striatal medium spiny neurons (MSNs). MSNs in EF mice exhibited increased spontaneous excitatory postsynaptic current (sEPSC) frequency and decreased paired-pulse ratio (PPR), while with normal basic electrophysiological properties and normal sEPSC amplitude. Furthermore, the N-methyl-D-aspartate (NMDA)/α-amino-3-hydroxy-5-methyl-4-isoxazolepropionate (AMPA) ratio of MSNs was reduced in EF mice. These results suggest that the enhanced presynaptic glutamate (Glu) release and downregulated postsynaptic NMDA receptor function lead to the impaired corticostriatal plasticity in EF mice. Taken together, our findings for the first time show that the bidirectional corticostriatal synaptic plasticity is impaired after EF, and suggest that the aberrant corticostriatal synaptic plasticity may be involved in the production and/or maintenance of EF.

Regulation of Striatal Neuron Activity by Cyclic Nucleotide Signaling and Phosphodiesterase Inhibition: Implications for the Treatment of Parkinson's Disease

Cyclic nucleotide phosphodiesterase (PDE) enzymes catalyze the hydrolysis and inactivation of cyclic nucleotides (cAMP/cGMP) in the brain. Several classes of PDE enzymes with distinct tissue distributions, cyclic nucleotide selectivity, and regulatory factors are highly expressed in brain regions subserving cognitive and motor processes known to be disrupted in neurodegenerative diseases such as Parkinson's disease (PD). Furthermore, small-molecule inhibitors of several different PDE family members alter cyclic nucleotide levels and favorably enhance motor performance and cognition in animal disease models. This chapter will explore the roles and therapeutic potential of non-selective and selective PDE inhibitors on neural processing in fronto-striatal circuits in normal animals and models of DOPA-induced dyskinesias (LIDs) associated with PD. The impact of selective PDE inhibitors and augmentation of cAMP and cGMP signaling on the membrane excitability of striatal medium-sized spiny projection neurons (MSNs) will be discussed. The effects of cyclic nucleotide signaling and PDE inhibitors on synaptic plasticity of striatonigral and striatopallidal MSNs will be also be reviewed. New data on the efficacy of PDE10A inhibitors for reversing behavioral and electrophysiological correlates of L-DOPA-induced dyskinesias in a rat model of PD will also be presented. Together, these data will highlight the potential of novel PDE inhibitors for treatment of movement disorders such as PD which are associated with abnormal corticostriatal transmission.

GABA and Glutamate Synaptic Coadaptations to Chronic Ethanol in the Striatum

Alcohol (ethanol) is a widely used and abused drug with approximately 90% of adults over the age of 18 consuming alcohol at some point in their lifetime. Alcohol exerts its actions through multiple neurotransmitter systems within the brain, most notably the GABAergic and glutamatergic systems. Alcohol's actions on GABAergic and glutamatergic neurotransmission have been suggested to underlie the acute behavioral effects of ethanol. The striatum is the primary input nucleus of the basal ganglia that plays a role in motor and reward systems. The effect of ethanol on GABAergic and glutamatergic neurotransmission within striatal circuitry has been thought to underlie ethanol taking, seeking, withdrawal and relapse. This chapter reviews the effects of ethanol on GABAergic and glutamatergic transmission, highlighting the dynamic changes in striatal circuitry from acute to chronic exposure and withdrawal.

Identification of 5-(1-Methyl-5-(trifluoromethyl)-1H-pyrazol-3-yl)thiophene-2-Carboxamides as Novel and Selective Monoamine Oxidase B Inhibitors Used to Improve Memory and Cognition

Initial work in Drosophila and mice demonstrated that the transcription factor cyclic adenosine monophosphate (cAMP) response element binding protein (CREB) is a master control gene for memory formation. The relationship between CREB and memory has also been found to be true in other species, including aplysia and rats. It is thus well-established that CREB activation plays a central role in memory enhancement and that CREB is activated during memory formation. On the basis of these findings, a phenotypic high-throughput screening campaign utilizing a CRE-luciferase (CRE-Luci) SK-N-MC cell line was performed to identify compounds that enhance transcriptional activation of the CRE promoter with a suboptimal dose of forskolin. A number of small-molecule hits of unknown mechanisms of action were identified in the screening campaign, including HT-0411. Follow-up studies suggested that the CREB activation by HT-0411 is attributed to its specific and selective inhibition of monoamine oxidase B (MAO-B). Further, HT-0411 was shown to improve 24 h memory in rodents in a contextual fear conditioning model. This report describes the lead optimization of a series of 5-(1-methyl-5-(trifluoromethyl)-1H-pyrazol-3-yl) thiophene-2-carboxamides that were identified as novel, potent, and selective inhibitors of MAO-B. Extensive SAR studies and in vivo behavioral evaluations of this and other related analogue series identified a number of potential clinical development candidates; ultimately, compound 8f was identified as a candidate molecule with high selectivity toward MAO-B (29-56 nM) over MAO-A (19% inhibition at a screening concentration of 50 μM), an excellent profile against a panel of other enzymes and receptors, good pharmacokinetic properties in rodents and dogs, and efficacy in multiple rodent memory models.

The effects of paranodal myelin damage on action potential depend on axonal structure

Biophysical computational models of axons provide an important tool for quantifying the effects of injury and disease on signal conduction characteristics. Several studies have used generic models to study the average behavior of healthy and injured axons; however, few studies have included the effects of normal structural variation on the simulated axon's response to injury. The effects of variations in physiological characteristics on axonal function were mapped by altering the structure of the nodal, paranodal, and juxtaparanodal regions across reported values in three different caliber axons (1, 2, and 5.7 μm). Myelin detachment and retraction were simulated to quantify the effects of each injury mechanism on signal conduction. Conduction velocity was most affected by axonal fiber diameter (89%), while membrane potential amplitude was most affected by nodal length (86%) in healthy axons. Postinjury axonal functionality was most affected by myelin detachment in the paranodal and juxtaparanodal regions when retraction and detachment were modeled simultaneously. The efficacy of simulated potassium channel blockers on restoring membrane potential and velocity varied with axonal caliber and injury type. The structural characteristics of axons affect their functional response to myelin retraction and detachment and their subsequent response to potassium channel blocker treatment.

Long-term plasticity of corticostriatal synapses is modulated by pathway-specific co-release of opioids through κ-opioid receptors

KEY POINTS

Both endogenous opioids and opiate drugs of abuse modulate learning of habitual and goal-directed actions, and can also modify long-term plasticity of corticostriatal synapses. Striatal projection neurons of the direct pathway co-release the opioid neuropeptide dynorphin which can inhibit dopamine release via κ-opioid receptors. Theta-burst stimulation of corticostriatal fibres produces long-term potentiation (LTP) in striatal projection neurons when measured using whole-cell patch recording. Optogenetic activation of direct pathway striatal projection neurons inhibits LTP while reducing dopamine release. Because the endogenous release of opioids is activity dependent, this modulation of synaptic plasticity represents a negative feedback mechanism that may limit runaway enhancement of striatal neuron activity in response to drugs of abuse.

ABSTRACT

Synaptic plasticity in the striatum adjusts behaviour adaptively during skill learning, or maladaptively in the case of addiction. Just as dopamine plays a critical role in synaptic plasticity underlying normal skill learning and addiction, endogenous and exogenous opiates also modulate learning and addiction-related striatal plasticity. Though the role of opioid receptors in long-term depression in striatum has been characterized, their effect on long-term potentiation (LTP) remains unknown. In particular, direct pathway (dopamine D1 receptor-containing; D1R-) spiny projection neurons (SPNs) co-release the opioid neuropeptide dynorphin, which acts at presynaptic κ-opioid receptors (KORs) on dopaminergic afferents and can negatively regulate dopamine release. Therefore, we evaluated the interaction of co-released dynorphin and KOR on striatal LTP. We optogenetically facilitate the release of endogenous dynorphin from D1R-SPNs in brain slice while using whole-cell patch recording to measure changes in the synaptic response of SPNs following theta-burst stimulation (TBS) of cortical afferents. Our results demonstrate that TBS evokes corticostriatal LTP, and that optogenetic activation of D1R-SPNs during induction impairs LTP. Additional experiments demonstrate that optogenetic activation of D1R-SPNs reduces stimulation-evoked dopamine release and that bath application of a KOR antagonist provides full rescue of both LTP induction and dopamine release during optogenetic activation of D1R-SPNs. These results suggest that an increase in the opioid neuropeptide dynorphin is responsible for reduced TBS LTP and illustrate a physiological phenomenon whereby heightened D1R-SPN activity can regulate corticostriatal plasticity. Our findings have important implications for learning in addictive states marked by elevated direct pathway activation.

What makes you tic? Translational approaches to study the role of stress and contextual triggers in Tourette syndrome

Tourette syndrome (TS) is a neurodevelopmental condition characterized by multiple, recurring motor and phonic tics. Rich empirical evidence shows that the severity of tics and associated manifestations is increased by several stressors and contextual triggers; however, the neurobiological mechanisms responsible for symptom exacerbation in TS remain poorly understood. This conceptual gap partially reflects the high phenotypic variability in tics, as well as the existing difficulties in operationalizing and standardizing stress and its effects in a clinical setting. Animal models of TS may be highly informative tools to overcome some of these limitations; these experimental preparations have already provided critical insights on key aspects of TS pathophysiology, and may prove useful to identify the neurochemical alterations induced by different stressful contingencies. In particular, emerging knowledge on the role of contextual triggers in animal models of TS may inform the development of novel pharmacological interventions to reduce tic fluctuations in this disorder.

The leukotriene B4 receptors BLT1 and BLT2 form an antagonistic sensitizing system in peripheral sensory neurons

Sensitization of the heat-activated ion channel transient receptor potential vanilloid 1 (TRPV1) through lipids is a fundamental mechanism during inflammation-induced peripheral sensitization. Leukotriene B4 is a proinflammatory lipid mediator whose role in peripheral nociceptive sensitization is not well understood to date. Two major G-protein-coupled receptors for leukotriene B4 have been identified: the high-affinity receptor BLT1 and the low-affinity receptor BLT2. Transcriptional screening for the expression G-protein-coupled receptors in murine dorsal root ganglia showed that both receptors were among the highest expressed in dorsal root ganglia. Calcium imaging revealed a sensitization of TRPV1-mediated calcium increases in a relative narrow concentration range for leukotriene B4 (100-200 nm). Selective antagonists and neurons from knock-out mice demonstrated a BLT1-dependent sensitization of TRPV1-mediated calcium increases. Accordingly, leukotriene B4-induced thermal hyperalgesia was mediated through BLT1 and TRPV1 as shown using the respective knock-out mice. Importantly, higher leukotriene B4 concentrations (>0.5 μm) and BLT2 agonists abolished sensitization of the TRPV1-mediated calcium increases. Also, BLT2 activation inhibited protein kinase C- and protein kinase A-mediated sensitization processes through the phosphatase calcineurin. Consequently, a selective BLT2-receptor agonist increased thermal and mechanical withdrawal thresholds during zymosan-induced inflammation. In accordance with these data, immunohistochemical analysis showed that both leukotriene B4 receptors were expressed in peripheral sensory neurons. Thus, the data show that the two leukotriene B4 receptors have opposing roles in the sensitization of peripheral sensory neurons forming a self-restricting system.

Current Concepts on the Physiopathological Relevance of Dopaminergic Receptors

Dopamine (DA) is a key neurotransmitter modulating essential functions of the central nervous system (CNS), like voluntary movement, reward, several cognitive functions and goal-oriented behaviors. The factual relevance of DAergic transmission can be well appreciated by considering that its dysfunction is recognized as a core alteration in several devastating neurological and psychiatric disorders, including Parkinson’s disease (PD) and associated movement disorders, as well as, schizophrenia, bipolar disorder, attention deficit hyperactivity disorder (ADHD) and addiction. Here we present an overview of the current knowledge on the involvement of DAergic receptors in the regulation of key physiological brain activities, and the consequences of their dysfunctions in brain disorders such as PD, schizophrenia and addiction.

Morphine Reward Promotes Cue-Sensitive Learning: Implication of Dorsal Striatal CREB Activity

Different parallel neural circuits interact and may even compete to process and store information: whereas stimulus-response (S-R) learning critically depends on the dorsal striatum (DS), spatial memory relies on the hippocampus (HPC). Strikingly, despite its potential importance for our understanding of addictive behaviors, the impact of drug rewards on memory systems dynamics has not been extensively studied. Here, we assessed long-term effects of drug- vs food reinforcement on the subsequent use of S-R vs spatial learning strategies and their neural substrates. Mice were trained in a Y-maze cue-guided task, during which either food or morphine injections into the ventral tegmental area (VTA) were used as rewards. Although drug- and food-reinforced mice learned the Y-maze task equally well, drug-reinforced mice exhibited a preferential use of an S-R learning strategy when tested in a water-maze competition task designed to dissociate cue-based and spatial learning. This cognitive bias was associated with a persistent increase in the phosphorylated form of cAMP response element-binding protein phosphorylation (pCREB) within the DS, and a decrease of pCREB expression in the HPC. Pharmacological inhibition of striatal PKA pathway in drug-rewarded mice limited the morphine-induced increase in levels of pCREB in DS and restored a balanced use of spatial vs cue-based learning. Our findings suggest that drug (opiate) reward biases the engagement of separate memory systems toward a predominant use of the cue-dependent system via an increase in learning-related striatal pCREB activity. Persistent functional imbalance between striatal and hippocampal activity could contribute to the persistence of addictive behaviors, or counteract the efficiency of pharmacological or psychotherapeutic treatments.

Decision making under uncertainty in a spiking neural network model of the basal ganglia

The mechanisms of decision-making and action selection are generally thought to be under the control of parallel cortico-subcortical loops connecting back to distinct areas of cortex through the basal ganglia and processing motor, cognitive and limbic modalities of decision-making. We have used these properties to develop and extend a connectionist model at a spiking neuron level based on a previous rate model approach. This model is demonstrated on decision-making tasks that have been studied in primates and the electrophysiology interpreted to show that the decision is made in two steps. To model this, we have used two parallel loops, each of which performs decision-making based on interactions between positive and negative feedback pathways. This model is able to perform two-level decision-making as in primates. We show here that, before learning, synaptic noise is sufficient to drive the decision-making process and that, after learning, the decision is based on the choice that has proven most likely to be rewarded. The model is then submitted to lesion tests, reversal learning and extinction protocols. We show that, under these conditions, it behaves in a consistent manner and provides predictions in accordance with observed experimental data.

Cdk5 Modulates Long-Term Synaptic Plasticity and Motor Learning in Dorsolateral Striatum

The striatum controls multiple cognitive aspects including motivation, reward perception, decision-making and motor planning. In particular, the dorsolateral striatum contributes to motor learning. Here we define an approach for investigating synaptic plasticity in mouse dorsolateral cortico-striatal circuitry and interrogate the relative contributions of neurotransmitter receptors and intracellular signaling components. Consistent with previous studies, we show that long-term potentiation (LTP) in cortico-striatal circuitry is facilitated by dopamine, and requires activation of D1-dopamine receptors, as well as NMDA receptors (NMDAR) and their calcium-dependent downstream effectors, including CaMKII. Moreover, we assessed the contribution of the protein kinase Cdk5, a key neuronal signaling molecule, in cortico-striatal LTP. Pharmacological Cdk5 inhibition, brain-wide Cdk5 conditional knockout, or viral-mediated dorsolateral striatal-specific loss of Cdk5 all impaired dopamine-facilitated LTP or D1-dopamine receptor-facilitated LTP. Selective loss of Cdk5 in dorsolateral striatum increased locomotor activity and attenuated motor learning. Taken together, we report an approach for studying synaptic plasticity in mouse dorsolateral striatum and critically implicate D1-dopamine receptor, NMDAR, Cdk5, and CaMKII in cortico-striatal plasticity. Furthermore, we associate striatal plasticity deficits with effects upon behaviors mediated by this circuitry. This approach should prove useful for the study of the molecular basis of plasticity in the dorsolateral striatum.

Calcium dynamics predict direction of synaptic plasticity in striatal spiny projection neurons

The striatum is a major site of learning and memory formation for sensorimotor and cognitive association. One of the mechanisms used by the brain for memory storage is synaptic plasticity - the long-lasting, activity-dependent change in synaptic strength. All forms of synaptic plasticity require an elevation in intracellular calcium, and a common hypothesis is that the amplitude and duration of calcium transients can determine the direction of synaptic plasticity. The utility of this hypothesis in the striatum is unclear in part because dopamine is required for striatal plasticity and in part because of the diversity in stimulation protocols. To test whether calcium can predict plasticity direction, we developed a calcium-based plasticity rule using a spiny projection neuron model with sophisticated calcium dynamics including calcium diffusion, buffering and pump extrusion. We utilized three spike timing-dependent plasticity (STDP) induction protocols, in which postsynaptic potentials are paired with precisely timed action potentials and the timing of such pairing determines whether potentiation or depression will occur. Results show that despite the variation in calcium dynamics, a single, calcium-based plasticity rule, which explicitly considers duration of calcium elevations, can explain the direction of synaptic weight change for all three STDP protocols. Additional simulations show that the plasticity rule correctly predicts the NMDA receptor dependence of long-term potentiation and the L-type channel dependence of long-term depression. By utilizing realistic calcium dynamics, the model reveals mechanisms controlling synaptic plasticity direction, and shows that the dynamics of calcium, not just calcium amplitude, are crucial for synaptic plasticity.

Levodopa-induced plasticity: a double-edged sword in Parkinson's disease?

The long-term replacement therapy with the dopamine (DA) precursor 3,4-dihydroxy-l-phenylalanine (L-DOPA) is a milestone in the treatment of Parkinson's disease (PD). Although this drug precursor can be metabolized into the active neurotransmitter DA throughout the brain, its therapeutic benefit is due to restoring extracellular DA levels within the dorsal striatum, which lacks endogenous DA as a consequence of the neurodegenerative process induced by the disease. In the early phases of PD, L-DOPA treatment is able to restore both long-term depression (LTD) and long-term potentiation (LTP), two major forms of corticostriatal synaptic plasticity that are altered by dopaminergic denervation. However, unlike physiological DA transmission, this therapeutic approach in the advanced phase of the disease leads to abnormal peaks of DA, non-synaptically released, which are supposed to trigger behavioural sensitization, namely L-DOPA-induced dyskinesia. This condition is characterized by a loss of synaptic depotentiation, an inability to reverse previously induced LTP. In the advanced stages of PD, L-DOPA can also induce non-motor fluctuations with cognitive dysfunction and neuropsychiatric symptoms such as compulsive behaviours and impulse control disorders. Although the mechanisms underlying the role of L-DOPA in both motor and behavioural symptoms are still incompletely understood, recent data from electrophysiological and imaging studies have increased our understanding of the function of the brain areas involved and of the mechanisms implicated in both therapeutic and adverse actions of L-DOPA in PD patients.

Dissociable hippocampal and amygdalar D1-like receptor contribution to discriminated Pavlovian conditioned approach learning

Pavlovian conditioning is an elementary form of reward-related behavioral adaptation. The mesolimbic dopamine system is widely considered to mediate critical aspects of reward-related learning. For example, initial acquisition of positively-reinforced operant behavior requires dopamine (DA) D1 receptor (D1R) activation in the basolateral amygdala (BLA), central nucleus of the amygdala (CeA), and the ventral subiculum (vSUB). However, the role of D1R activation in these areas on appetitive, non-drug-related, Pavlovian learning is not currently known. In separate experiments, microinfusions of the D1-like receptor antagonist SCH-23390 (3.0 nmol/0.5 μL per side) into the amygdala and subiculum preceded discriminated Pavlovian conditioned approach (dPCA) training sessions. D1-like antagonism in all three structures impaired the acquisition of discriminated approach, but had no effect on performance after conditioning was asymptotic. Moreover, dissociable effects of D1-like antagonism in the three structures on components of discriminated responding were obtained. Lastly, the lack of latent inhibition in drug-treated groups may elucidate the role of D1-like in reward-related Pavlovian conditioning. The present data suggest a role for the D1 receptors in the amygdala and hippocampus in learning the significance of conditional stimuli, but not in the expression of conditional responses.

Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules

Classical Hebbian learning puts the emphasis on joint pre- and postsynaptic activity, but neglects the potential role of neuromodulators. Since neuromodulators convey information about novelty or reward, the influence of neuromodulators on synaptic plasticity is useful not just for action learning in classical conditioning, but also to decide "when" to create new memories in response to a flow of sensory stimuli. In this review, we focus on timing requirements for pre- and postsynaptic activity in conjunction with one or several phasic neuromodulatory signals. While the emphasis of the text is on conceptual models and mathematical theories, we also discuss some experimental evidence for neuromodulation of Spike-Timing-Dependent Plasticity. We highlight the importance of synaptic mechanisms in bridging the temporal gap between sensory stimulation and neuromodulatory signals, and develop a framework for a class of neo-Hebbian three-factor learning rules that depend on presynaptic activity, postsynaptic variables as well as the influence of neuromodulators.

Phasic Dopamine Modifies Sensory-Driven Output of Striatal Neurons through Synaptic Plasticity

Animals are facing a complex sensory world in which only few stimuli are relevant to guide behavior. Value has to be assigned to relevant stimuli such as odors to select them over concurring information. Phasic dopamine is involved in the value assignment to stimuli in the ventral striatum. The underlying cellular mechanisms are incompletely understood. In striatal projection neurons of the ventral striatum in adult mice, we therefore examined the features and dynamics of phasic dopamine-induced synaptic plasticity and how this plasticity may modify the striatal output. Phasic dopamine is predicted to tag inputs that occur in temporal proximity. Indeed, we observed D1 receptor-dependent synaptic potentiation only when odor-like bursts and optogenetically evoked phasic dopamine release were paired within a time window of <1 s. Compatible with predictions of dynamic value assignment, the synaptic potentiation persisted after the phasic dopamine signal had ceased, but gradually reversed when odor-like bursts continued to be presented. The synaptic plasticity depended on the sensory input rate and was input specific. Importantly, synaptic plasticity amplified the firing response to a given olfactory input as the dendritic integration and the firing threshold remained unchanged during synaptic potentiation. Thus, phasic dopamine-induced synaptic plasticity can change information transfer through dynamic increases of the output of striatal projection neurons to specific sensory inputs. This plasticity may provide a neural substrate for dynamic value assignment in the striatum.

Reduced cortical neurotransmitter receptor complex levels in fetal Down syndrome brain

In this study, cortical receptor complex levels were determined in fetal Down syndrome (DS, trisomy 21) brain. Frontal cortices were obtained from individuals with DS (19th-22nd week of gestation) and controls. Membrane proteins were extracted, assayed on blue native gels and immunoblotted with brain receptor antibodies. Levels of a D1R-containing complex were markedly decreased in male and female cortices of DS individuals. Females with DS had significant reductions of nicotinic acetylcholine receptors α4 and α7, NMDA receptor GluN1 and AMPA receptor GluA1- and GluA3-containing receptor complexes. Levels of other brain receptor complexes (5-hydroxytryptamine 1A, GluA2 and GluR4 receptor-containing complexes) were comparable between the groups of females. Levels of GluA2- and GluA3-containing complexes were significantly increased in males. Decreased levels of D1R complexes in both sexes, along with the significant reduction of α4, α7-containing receptor complexes observed in females, may explain the brain deficits and impaired cognition observed in DS.

Differential CaMKII regulation by voltage-gated calcium channels in the striatum

Calcium signaling regulates synaptic plasticity and many other functions in striatal medium spiny neurons to modulate basal ganglia function. Ca(2+)/calmodulin-dependent protein kinase II (CaMKII) is a major calcium-dependent signaling protein that couples calcium entry to diverse cellular changes. CaMKII activation results in autophosphorylation at Thr286 and sustained calcium-independent CaMKII activity after calcium signals dissipate. However, little is known about the mechanisms regulating striatal CaMKII. To address this, mouse brain slices were treated with pharmacological modulators of calcium channels and punches of dorsal striatum were immunoblotted for CaMKII Thr286 autophosphorylation as an index of CaMKII activation. KCl depolarization increased levels of CaMKII autophosphorylation ~2-fold; this increase was blocked by an LTCC antagonist and was mimicked by treatment with pharmacological LTCC activators. The chelation of extracellular calcium robustly decreased basal CaMKII autophosphorylation within 5min and increased levels of total CaMKII in cytosolic fractions, in addition to decreasing the phosphorylation of CaMKII sites in the GluN2B subunit of NMDA receptors and the GluA1 subunit of AMPA receptors. We also found that the maintenance of basal levels of CaMKII autophosphorylation requires low-voltage gated T-type calcium channels, but not LTCCs or R-type calcium channels. Our findings indicate that CaMKII activity is dynamically regulated by multiple calcium channels in the striatum thus coupling calcium entry to key downstream substrates.

Neuronal Reward and Decision Signals: From Theories to Data

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.