Detection of phasic dopamine by D1 and D2 striatal medium spiny neurons

Contrasting patterns of ERK activation in the tail of the striatum in response to aversive and rewarding signals

The caudal part of the striatum, also named the tail of the striatum (TS), defines a fourth striatal domain. Determining whether rewarding, aversive and salient stimuli regulate the activity of striatal spiny projections neurons (SPNs) of the TS is therefore of paramount importance to understand its functions, which remain largely elusive. Taking advantage of genetically encoded biosensors (A-kinase activity reporter 3) to record protein kinase A signals and by analyzing the distribution of dopamine D1R- and D2R-SPNs in the TS, we characterized three subterritories: a D2R/A2aR-lacking, a D1R/D2R-intermingled and a D1R/D2R-SPNs-enriched area (corresponding to the amygdalostriatal transition). In addition, we provide evidence that the distribution of D1R- and D2R-SPNs in the TS is evolutionarily conserved (mouse, rat, gerbil). The in vivo analysis of extracellular signal-regulated kinase (ERK) phosphorylation in these TS subterritories in response to distinct appetitive, aversive and pharmacological stimuli revealed that SPNs of the TS are not recruited by stimuli triggering innate aversive responses, fasting, satiety, or palatable signals whereas a reduction in ERK phosphorylation occurred following learned avoidance. In contrast, D1R-SPNs of the intermingled and D2R/A2aR-lacking areas were strongly activated by both D1R agonists and psychostimulant drugs (d-amphetamine, cocaine, 3,4-methyl enedioxy methamphetamine, or methylphenidate), but not by hallucinogens. Finally, a similar pattern of ERK activation was observed by blocking selectively dopamine reuptake. Together, our results reveal that the caudal TS might participate in the processing of specific reward signals and discrete aversive stimuli. Cover Image for this issue: doi: 10.1111/jnc.14526. Open Science: This manuscript was awarded with the Open Materials Badge For more information see: https://cos.io/our-services/open-science-badges/.

Differential enhancement of ERK, PKA and Ca2+ signaling in direct and indirect striatal neurons of Parkinsonian mice

Parkinson's disease (PD) is characterized by severe locomotor deficits due to the disappearance of dopamine (DA) from the dorsal striatum. The development of PD symptoms and treatment-related complications such as dyskinesia have been proposed to result from complex alterations in intracellular signaling in both direct and indirect pathway striatal projection neurons (dSPNs and iSPNs, respectively) following loss of DA afferents. To identify cell-specific and dynamical modifications of signaling pathways associated with PD, we used a hemiparkinsonian mouse model with 6-hydroxydopamine (6-OHDA) lesion combined with two-photon fluorescence biosensors imaging in adult corticostriatal slices. After DA lesion, extracellular signal-regulated kinase (ERK) activation was increased in response to DA D1 receptor (D1R) or α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) stimulation. The cAMP-dependent protein kinase (PKA) pathway contributing to ERK activation displayed supersensitive responses to D1R stimulation after 6-OHDA lesion. This cAMP/PKA supersensitivity was specific of D1R-responding SPNs and resulted from Gα_olf upregulation and deficient phosphodiesterase activity. In lesioned striatum, the number of D1R-SPNs with spontaneous Ca²⁺ transients augmented while Ca²⁺ response to AMPA receptor stimulation specifically increased in iSPNs. Our work reveals distinct cell type-specific signaling alterations in the striatum after DA denervation. It suggests that over-activation of ERK pathway, observed in PD striatum, known to contribute to dyskinesia, may be linked to the combined dysregulation of DA and glutamate signaling pathways in the two populations of SPNs. These findings bring new insights into the implication of these respective neuronal populations in PD motor symptoms and the occurrence of PD treatment complications.

Dopamine and Cognitive Control in Prefrontal Cortex

Cognitive control, the ability to orchestrate behavior in accord with our goals, depends on the prefrontal cortex. These cognitive functions are heavily influenced by the neuromodulator dopamine. We review here recent insights exploring the influence of dopamine on neuronal response properties in prefrontal cortex (PFC) during ongoing behaviors in primates. This review suggests three major computational roles of dopamine in cognitive control: (i) gating sensory input, (ii) maintaining and manipulating working memory contents, and (iii) relaying motor commands. For each of these roles, we propose a neuronal microcircuit based on known mechanisms of action of dopamine in PFC, which are corroborated by computational network models. This conceptual approach accounts for the various roles of dopamine in prefrontal executive functioning.

A Dual Role Hypothesis of the Cortico-Basal-Ganglia Pathways: Opponency and Temporal Difference Through Dopamine and Adenosine

The hypothesis that the basal-ganglia direct and indirect pathways represent goodness (or benefit) and badness (or cost) of options, respectively, explains a wide range of phenomena. However, this hypothesis, named the Opponent Actor Learning (OpAL), still has limitations. Structurally, the OpAL model does not incorporate differentiation of the two types of cortical inputs to the basal-ganglia pathways received from intratelencephalic (IT) and pyramidal-tract (PT) neurons. Functionally, the OpAL model does not describe the temporal-difference (TD)-type reward-prediction-error (RPE), nor explains how RPE is calculated in the circuitry connecting to the DA neurons. In fact, there is a different hypothesis on the basal-ganglia pathways and DA, named the Cortico-Striatal-Temporal-Difference (CS-TD) model. The CS-TD model differentiates the IT and PT inputs, describes the TD-type RPE, and explains how TD-RPE is calculated. However, a critical difficulty in this model lies in its assumption that DA induces the same direction of plasticity in both direct and indirect pathways, which apparently contradicts the experimentally observed opposite effects of DA on these pathways. Here, we propose a new hypothesis that integrates the OpAL and CS-TD models. Specifically, we propose that the IT-basal-ganglia pathways represent goodness/badness of current options while the PT-indirect pathway represents the overall value of the previously chosen option, and both of these have influence on the DA neurons, through the basal-ganglia output, so that a variant of TD-RPE is calculated. A key assumption is that opposite directions of plasticity are induced upon phasic activation of DA neurons in the IT-indirect pathway and PT-indirect pathway because of different profiles of IT and PT inputs. Specifically, at PT→indirect-pathway-medium-spiny-neuron (iMSN) synapses, sustained glutamatergic inputs generate rich adenosine, which allosterically prevents DA-D2 receptor signaling and instead favors adenosine-A2A receptor signaling. Then, phasic DA-induced phasic adenosine, which reflects TD-RPE, causes long-term synaptic potentiation. In contrast, at IT→iMSN synapses where adenosine is scarce, phasic DA causes long-term synaptic depression via D2 receptor signaling. This new Opponency and Temporal-Difference (OTD) model provides unique predictions, part of which is potentially in line with recently reported activity patterns of neurons in the globus pallidus externus on the indirect pathway.

Dopamine D2-like receptor stimulation blocks negative feedback in visual and spatial reversal learning in the rat: behavioural and computational evidence

RATIONALE

Dopamine D2-like receptors (D2R) are important drug targets in schizophrenia and Parkinson's disease, but D2R ligands also cause cognitive inflexibility such as poor reversal learning. The specific role of D2R in reversal learning remains unclear.

OBJECTIVES

We tested the hypotheses that D2R agonism impairs reversal learning by blocking negative feedback and that antagonism of D1-like receptors (D1R) impairs learning from positive feedback.

METHODS

Male Lister Hooded rats were trained on a novel visual reversal learning task. Performance on "probe trials", during which the correct or incorrect stimulus was presented with a third, probabilistically rewarded (50% of trials) and therefore intermediate stimulus, revealed individual learning curves for the processes of positive and negative feedback. The effects of D2R and D1R agonists and antagonists were evaluated. A separate cohort was tested on a spatial probabilistic reversal learning (PRL) task after D2R agonism. Computational reinforcement learning modelling was applied to choice data from the PRL task to evaluate the contribution of latent factors.

RESULTS

D2R agonism with quinpirole dose-dependently impaired both visual reversal and PRL. Analysis of the probe trials on the visual task revealed a complete blockade of learning from negative feedback at the 0.25 mg/kg dose, while learning from positive feedback was intact. Estimated parameters from the model that best described the PRL choice data revealed a steep and selective decrease in learning rate from losses. D1R antagonism had a transient effect on the positive probe trials.

CONCLUSIONS

D2R stimulation impairs reversal learning by blocking the impact of negative feedback.

The high efficacy of muscarinic M4 receptor in D1 medium spiny neurons reverses striatal hyperdopaminergia

The opposing action of dopamine and acetylcholine has long been known to play an important role in basal ganglia physiology. However, the quantitative analysis of dopamine and acetylcholine signal interaction has been difficult to perform in the native context because the striatum comprises mainly two subtypes of medium-sized spiny neurons (MSNs) on which these neuromodulators exert different actions. We used biosensor imaging in live brain slices of dorsomedial striatum to monitor changes in intracellular cAMP at the level of individual MSNs. We observed that the muscarinic agonist oxotremorine decreases cAMP selectively in the MSN subpopulation that also expresses D₁ dopamine receptors, an action mediated by the M₄ muscarinic receptor. This receptor has a high efficacy on cAMP signaling and can shut down the positive cAMP response induced by dopamine, at acetylcholine concentrations which are consistent with physiological levels. This supports our prediction based on theoretical modeling that acetylcholine could exert a tonic inhibition on striatal cAMP signaling, thus supporting the possibility that a pause in acetylcholine release is required for phasic dopamine to transduce a cAMP signal in D1 MSNs. In vivo experiments with acetylcholinesterase inhibitors donepezil and tacrine, as well as with the positive allosteric modulators of M₄ receptor VU0152100 and VU0010010 show that this effect is sufficient to reverse the increased locomotor activity of DAT-knockout mice. This suggests that M₄ receptors could be a novel therapeutic target to treat hyperactivity disorders.

Insights into Parkinson's disease from computational models of the basal ganglia

Movement disorders arise from the complex interplay of multiple changes to neural circuits. Successful treatments for these disorders could interact with these complex changes in myriad ways, and as a consequence their mechanisms of action and their amelioration of symptoms are incompletely understood. Using Parkinson's disease as a case study, we review here how computational models are a crucial tool for taming this complexity, across causative mechanisms, consequent neural dynamics and treatments. For mechanisms, we review models that capture the effects of losing dopamine on basal ganglia function; for dynamics, we discuss models that have transformed our understanding of how beta-band (15-30 Hz) oscillations arise in the parkinsonian basal ganglia. For treatments, we touch on the breadth of computational modelling work trying to understand the therapeutic actions of deep brain stimulation. Collectively, models from across all levels of description are providing a compelling account of the causes, symptoms and treatments for Parkinson's disease.

A Highly Sensitive A-Kinase Activity Reporter for Imaging Neuromodulatory Events in Awake Mice

Neuromodulation imposes powerful control over brain function, and cAMP-dependent protein kinase (PKA) is a central downstream mediator of multiple neuromodulators. Although genetically encoded PKA sensors have been developed, single-cell imaging of PKA activity in living mice has not been established. Here, we used two-photon fluorescence lifetime imaging microscopy (2pFLIM) to visualize genetically encoded PKA sensors in response to the neuromodulators norepinephrine and dopamine. We screened available PKA sensors for 2pFLIM and further developed a variant (named tAKARα) with increased sensitivity and a broadened dynamic range. This sensor allowed detection of PKA activation by norepinephrine at physiologically relevant concentrations and kinetics, and by optogenetically released dopamine. In vivo longitudinal 2pFLIM imaging of tAKARα tracked bidirectional PKA activities in individual neurons in awake mice and revealed neuromodulatory PKA events that were associated with wakefulness, pharmacological manipulation, and locomotion. This new sensor combined with 2pFLIM will enable interrogation of neuromodulation-induced PKA signaling in awake animals. VIDEO ABSTRACT.

What does dopamine mean?

Dopamine is a critical modulator of both learning and motivation. This presents a problem: how can target cells know whether increased dopamine is a signal to learn or to move? It is often presumed that motivation involves slow ('tonic') dopamine changes, while fast ('phasic') dopamine fluctuations convey reward prediction errors for learning. Yet recent studies have shown that dopamine conveys motivational value and promotes movement even on subsecond timescales. Here I describe an alternative account of how dopamine regulates ongoing behavior. Dopamine release related to motivation is rapidly and locally sculpted by receptors on dopamine terminals, independently from dopamine cell firing. Target neurons abruptly switch between learning and performance modes, with striatal cholinergic interneurons providing one candidate switch mechanism. The behavioral impact of dopamine varies by subregion, but in each case dopamine provides a dynamic estimate of whether it is worth expending a limited internal resource, such as energy, attention, or time.

Basal Ganglia Neuromodulation Over Multiple Temporal and Structural Scales-Simulations of Direct Pathway MSNs Investigate the Fast Onset of Dopaminergic Effects and Predict the Role of Kv4.2

The basal ganglia are involved in the motivational and habitual control of motor and cognitive behaviors. Striatum, the largest basal ganglia input stage, integrates cortical and thalamic inputs in functionally segregated cortico-basal ganglia-thalamic loops, and in addition the basal ganglia output nuclei control targets in the brainstem. Striatal function depends on the balance between the direct pathway medium spiny neurons (D1-MSNs) that express D1 dopamine receptors and the indirect pathway MSNs that express D2 dopamine receptors. The striatal microstructure is also divided into striosomes and matrix compartments, based on the differential expression of several proteins. Dopaminergic afferents from the midbrain and local cholinergic interneurons play crucial roles for basal ganglia function, and striatal signaling via the striosomes in turn regulates the midbrain dopaminergic system directly and via the lateral habenula. Consequently, abnormal functions of the basal ganglia neuromodulatory system underlie many neurological and psychiatric disorders. Neuromodulation acts on multiple structural levels, ranging from the subcellular level to behavior, both in health and disease. For example, neuromodulation affects membrane excitability and controls synaptic plasticity and thus learning in the basal ganglia. However, it is not clear on what time scales these different effects are implemented. Phosphorylation of ion channels and the resulting membrane effects are typically studied over minutes while it has been shown that neuromodulation can affect behavior within a few hundred milliseconds. So how do these seemingly contradictory effects fit together? Here we first briefly review neuromodulation of the basal ganglia, with a focus on dopamine. We furthermore use biophysically detailed multi-compartmental models to integrate experimental data regarding dopaminergic effects on individual membrane conductances with the aim to explain the resulting cellular level dopaminergic effects. In particular we predict dopaminergic effects on Kv4.2 in D1-MSNs. Finally, we also explore dynamical aspects of the onset of neuromodulation effects in multi-scale computational models combining biochemical signaling cascades and multi-compartmental neuron models.

Switch-like PKA responses in the nucleus of striatal neurons

Although it is known that Protein Kinase A (PKA) in the nucleus regulates gene expression, the specificities of nuclear PKA signaling remain poorly understood. Here, we combined computational modeling and live-cell imaging of PKA-dependent phosphorylation in mouse brain slices to investigate how transient dopamine signals are translated into nuclear PKA activity in cortical pyramidal neurons and striatal medium spiny neurons. We observed that the nuclear PKA signal in striatal neurons featured an ultrasensitive responsiveness, associated with fast, all or none responses, which is not consistent with the commonly accepted theory of a slow and passive diffusion of catalytic PKA in the nucleus. Our numerical model suggests that a positive feed-forward mechanism inhibiting nuclear phosphatase activity - possibly mediated by DARPP-32 - could be responsible for this non-linear pattern of nuclear PKA response, allowing for a better detection of the transient dopamine signals that are often associated with reward-mediated learning.