Segregation and crosstalk of D1 receptor-mediated activation of ERK in striatal medium spiny neurons upon acute administration of psychostimulants

Segregation of D1 and D2 dopamine receptors in the striatal direct and indirect pathways: An historical perspective

The direct and indirect striatal pathways form a cornerstone of the circuits of the basal ganglia. Dopamine has opponent affects on the function of these pathways due to the segregation of the D1- and D2-dopamine receptors in the spiny projection neurons giving rise to the direct and indirect pathways. An historical perspective is provided on the discovery of dopamine receptor segregation leading to models of how the direct and indirect affect motor behavior.

Comparison of rule- and ordinary differential equation-based dynamic model of DARPP-32 signalling network

Dynamic modelling has considerably improved our understanding of complex molecular mechanisms. Ordinary differential equations (ODEs) are the most detailed and popular approach to modelling the dynamics of molecular systems. However, their application in signalling networks, characterised by multi-state molecular complexes, can be prohibitive. Contemporary modelling methods, such as rule- based (RB) modelling, have addressed these issues. The advantages of RB modelling over ODEs have been presented and discussed in numerous reviews. In this study, we conduct a direct comparison of the time courses of a molecular system founded on the same reaction network but encoded in the two frameworks. To make such a comparison, a set of reactions that underlie an ODE model was manually encoded in the Kappa language, one of the RB implementations. A comparison of the models was performed at the level of model specification and dynamics, acquired through model simulations. In line with previous reports, we confirm that the Kappa model recapitulates the general dynamics of its ODE counterpart with minor differences. These occur when molecules have multiple sites binding the same interactor. Furthermore, activation of these molecules in the RB model is slower than in the ODE one. As reported for other molecular systems, we find that, also for the DARPP-32 reaction network, the RB representation offers a more expressive and flexible syntax that facilitates access to fine details of the model, easing model reuse. In parallel with these analyses, we report a refactored model of the DARPP-32 interaction network that can serve as a canvas for the development of more complex dynamic models to study this important molecular system.

Combining hypothesis- and data-driven neuroscience modeling in FAIR workflows

Modeling in neuroscience occurs at the intersection of different points of view and approaches. Typically, hypothesis-driven modeling brings a question into focus so that a model is constructed to investigate a specific hypothesis about how the system works or why certain phenomena are observed. Data-driven modeling, on the other hand, follows a more unbiased approach, with model construction informed by the computationally intensive use of data. At the same time, researchers employ models at different biological scales and at different levels of abstraction. Combining these models while validating them against experimental data increases understanding of the multiscale brain. However, a lack of interoperability, transparency, and reusability of both models and the workflows used to construct them creates barriers for the integration of models representing different biological scales and built using different modeling philosophies. We argue that the same imperatives that drive resources and policy for data - such as the FAIR (Findable, Accessible, Interoperable, Reusable) principles - also support the integration of different modeling approaches. The FAIR principles require that data be shared in formats that are Findable, Accessible, Interoperable, and Reusable. Applying these principles to models and modeling workflows, as well as the data used to constrain and validate them, would allow researchers to find, reuse, question, validate, and extend published models, regardless of whether they are implemented phenomenologically or mechanistically, as a few equations or as a multiscale, hierarchical system. To illustrate these ideas, we use a classical synaptic plasticity model, the Bienenstock-Cooper-Munro rule, as an example due to its long history, different levels of abstraction, and implementation at many scales.

Cocaine-Dependent Acquisition of Locomotor Sensitization and Conditioned Place Preference Requires D1 Dopaminergic Signaling through a Cyclic AMP, NCS-Rapgef2, ERK, and Egr-1/Zif268 Pathway

Elucidation of the mechanism of dopamine signaling to ERK that underlies plasticity in dopamine D1 receptor-expressing neurons leading to acquired cocaine preference is incomplete. NCS-Rapgef2 is a novel cAMP effector, expressed in neuronal and endocrine cells in adult mammals, that is required for D1 dopamine receptor-dependent ERK phosphorylation in mouse brain. In this report, we studied the effects of abrogating NCS-Rapgef2 expression on cAMP-dependent ERK→Egr-1/Zif268 signaling in cultured neuroendocrine cells; in D1 medium spiny neurons of NAc slices; and in either male or female mouse brain in a region-specific manner. NCS-Rapgef2 gene deletion in the NAc in adult mice, using adeno-associated virus-mediated expression of cre recombinase, eliminated cocaine-induced ERK phosphorylation and Egr-1/Zif268 upregulation in D1-medium spiny neurons and cocaine-induced behaviors, including locomotor sensitization and conditioned place preference. Abrogation of NCS-Rapgef2 gene expression in mPFC and BLA, by crossing mice bearing a floxed Rapgef2 allele with a cre mouse line driven by calcium/calmodulin-dependent kinase IIα promoter also eliminated cocaine-induced phospho-ERK activation and Egr-1/Zif268 induction, but without effect on the cocaine-induced behaviors. Our results indicate that NCS-Rapgef2 signaling to ERK in dopamine D1 receptor-expressing neurons in the NAc, but not in corticolimbic areas, contributes to cocaine-induced locomotor sensitization and conditioned place preference. Ablation of cocaine-dependent ERK activation by elimination of NCS-Rapgef2 occurred with no effect on phosphorylation of CREB in D1 dopaminoceptive neurons of NAc. This study reveals a new cAMP-dependent signaling pathway for cocaine-induced behavioral adaptations, mediated through NCS-Rapgef2/phospho-ERK activation, independently of PKA/CREB signaling.SIGNIFICANCE STATEMENT ERK phosphorylation in dopamine D1 receptor-expressing neurons exerts a pivotal role in psychostimulant-induced neuronal gene regulation and behavioral adaptation, including locomotor sensitization and drug preference in rodents. In this study, we examined the role of dopamine signaling through the D1 receptor via a novel pathway initiated through the cAMP-activated guanine nucleotide exchange factor NCS-Rapgef2 in mice. NCS-Rapgef2 in the NAc is required for activation of ERK and Egr-1/Zif268 in D1 dopaminoceptive neurons after acute cocaine administration, and subsequent enhanced locomotor response and drug seeking behavior after repeated cocaine administration. This novel component in dopamine signaling provides a potential new target for intervention in psychostimulant-shaped behaviors, and new understanding of how D1-medium spiny neurons encode the experience of psychomotor stimulant exposure.

Dopamine Receptor Subtypes, Physiology and Pharmacology: New Ligands and Concepts in Schizophrenia

Dopamine receptors are widely distributed within the brain where they play critical modulator roles on motor functions, motivation and drive, as well as cognition. The identification of five genes coding for different dopamine receptor subtypes, pharmacologically grouped as D1- (D1 and D5) or D2-like (D2S, D2L, D3, and D4) has allowed the demonstration of differential receptor function in specific neurocircuits. Recent observation on dopamine receptor signaling point at dopamine-glutamate-NMDA neurobiology as the most relevant in schizophrenia and for the development of new therapies. Progress in the chemistry of D1- and D2-like receptor ligands (agonists, antagonists, and partial agonists) has provided more selective compounds possibly able to target the dopamine receptors homo and heterodimers and address different schizophrenia symptoms. Moreover, an extensive evaluation of the functional effect of these agents on dopamine receptor coupling and intracellular signaling highlights important differences that could also result in highly differentiated clinical pharmacology. The review summarizes the recent advances in the field, addressing the relevance of emerging new targets in schizophrenia in particular in relation to the dopamine - glutamate NMDA systems interactions.

The road to ERK activation: Do neurons take alternate routes?

The ERK cascade is a central signaling pathway that regulates a wide variety of cellular processes including proliferation, differentiation, learning and memory, development, and synaptic plasticity. A wide range of inputs travel from the membrane through different signaling pathway routes to reach activation of one set of output kinases, ERK1&2. The classical ERK activation pathway beings with growth factor activation of receptor tyrosine kinases. Numerous G-protein coupled receptors and ionotropic receptors also lead to ERK through increases in the second messengers calcium and cAMP. Though both types of pathways are present in diverse cell types, a key difference is that most stimuli to neurons, e.g. synaptic inputs, are transient, on the order of milliseconds to seconds, whereas many stimuli acting on non-neural tissue, e.g. growth factors, are longer duration. The ability to consolidate these inputs to regulate the activation of ERK in response to diverse signals raises the question of which factors influence the difference in ERK activation pathways. This review presents both experimental studies and computational models aimed at understanding the control of ERK activation and whether there are fundamental differences between neurons and other cells. Our main conclusion is that differences between cell types are quite subtle, often related to differences in expression pattern and quantity of some molecules such as Raf isoforms. In addition, the spatial location of ERK is critical, with regulation by scaffolding proteins producing differences due to colocalization of upstream molecules that may differ between neurons and other cells.

Molecular mechanisms underlying striatal synaptic plasticity: relevance to chronic alcohol consumption and seeking

The striatum, the input structure of the basal ganglia, is a major site of learning and memory for goal-directed actions and habit formation. Spiny projection neurons of the striatum integrate cortical, thalamic, and nigral inputs to learn associations, with cortico-striatal synaptic plasticity as a learning mechanism. Signaling molecules implicated in synaptic plasticity are altered in alcohol withdrawal, which may contribute to overly strong learning and increased alcohol seeking and consumption. To understand how interactions among signaling molecules produce synaptic plasticity, we implemented a mechanistic model of signaling pathways activated by dopamine D1 receptors, acetylcholine receptors, and glutamate. We use our novel, computationally efficient simulator, NeuroRD, to simulate stochastic interactions both within and between dendritic spines. Dopamine release during theta burst and 20-Hz stimulation was extrapolated from fast-scan cyclic voltammetry data collected in mouse striatal slices. Our results show that the combined activity of several key plasticity molecules correctly predicts the occurrence of either LTP, LTD, or no plasticity for numerous experimental protocols. To investigate spatial interactions, we stimulate two spines, either adjacent or separated on a 20-μm dendritic segment. Our results show that molecules underlying LTP exhibit spatial specificity, whereas 2-arachidonoylglycerol exhibits a spatially diffuse elevation. We also implement changes in NMDA receptors, adenylyl cyclase, and G protein signaling that have been measured following chronic alcohol treatment. Simulations under these conditions suggest that the molecular changes can predict changes in synaptic plasticity, thereby accounting for some aspects of alcohol use disorder.

Detection of phasic dopamine by D1 and D2 striatal medium spiny neurons

KEY POINTS

Brief dopamine events are critical actors of reward-mediated learning in the striatum; the intracellular cAMP-protein kinase A (PKA) response of striatal medium spiny neurons to such events was studied dynamically using a combination of biosensor imaging in mouse brain slices and in silico simulations. Both D1 and D2 medium spiny neurons can sense brief dopamine transients in the sub-micromolar range. While dopamine transients profoundly change cAMP levels in both types of medium spiny neurons, the PKA-dependent phosphorylation level remains unaffected in D2 neurons. At the level of PKA-dependent phosphorylation, D2 unresponsiveness depends on protein phosphatase-1 (PP1) inhibition by DARPP-32. Simulations suggest that D2 medium spiny neurons could detect transient dips in dopamine level.

ABSTRACT

The phasic release of dopamine in the striatum determines various aspects of reward and action selection, but the dynamics of the dopamine effect on intracellular signalling remains poorly understood. We used genetically encoded FRET biosensors in striatal brain slices to quantify the effect of transient dopamine on cAMP or PKA-dependent phosphorylation levels, and computational modelling to further explore the dynamics of this signalling pathway. Medium-sized spiny neurons (MSNs), which express either D1 or D2 dopamine receptors, responded to dopamine by an increase or a decrease in cAMP, respectively. Transient dopamine showed similar sub-micromolar efficacies on cAMP in both D1 and D2 MSNs, thus challenging the commonly accepted notion that dopamine efficacy is much higher on D2 than on D1 receptors. However, in D2 MSNs, the large decrease in cAMP level triggered by transient dopamine did not translate to a decrease in PKA-dependent phosphorylation level, owing to the efficient inhibition of protein phosphatase 1 by DARPP-32. Simulations further suggested that D2 MSNs can also operate in a 'tone-sensing' mode, allowing them to detect transient dips in basal dopamine. Overall, our results show that D2 MSNs may sense much more complex patterns of dopamine than previously thought.

Molecular and synaptic mechanisms regulating drug-associated memories: Towards a bidirectional treatment strategy

The successful treatment of substance use disorders is dependent on the establishment of a long-term abstinent state. Relapse can be suppressed by interfering with memories of drug use that are evoked by re-exposure to drug-associated contexts and cues. Two strategies for accomplishing this goal are either to prevent drug-memory reconsolidation or to induce the formation of a competing, extinction memory. However, clinical attempts to prolong abstinence by behavioral modification of drug-related memories have had limited success. One approach to improve behavioral treatment strategies is to identify the molecular mechanisms that regulate these memory processes and then use pharmacological tools as supplements to improve efficacy. Still, due to the involvement of several overlapping signaling cascades in both reconsolidation and extinction, it is difficult to specifically modify one of the two processes. For example, attempting to elicit extinction may instead initiate reconsolidation, resulting in the unintentional strengthening of drug-related memories. A better approach is to identify diverging components of the two processes, whereby a single medication would simultaneously weaken reconsolidation and enhance extinction. This review will provide an overview of the neural substrates that are involved in the regulation of drug-associated memories, and will discuss emerging approaches to pharmacologically weaken these memories, including recent efforts to precisely and bidirectionally target reconsolidation and extinction. Ultimately, pharmacologically-enhanced memory-based approaches have the potential to produce more informed relapse-prevention therapies.

Global sensitivity analysis of a model related to memory formation in synapses: Model reduction based on epistemic parameter uncertainties and related issues

We investigate the epistemic uncertainties of parameters of a mathematical model that describes the dynamics of CaMKII-NMDAR complex related to memory formation in synapses using global sensitivity analysis (GSA). The model, which was published in this journal, is nonlinear and complex with Ca²⁺ patterns with different level of frequencies as inputs. We explore the effects of parameter on the key outputs of the model to discover the most sensitive ones using GSA and partial ranking correlation coefficient (PRCC) and to understand why they are sensitive and others are not based on the biology of the problem. We also extend the model to add presynaptic neurotransmitter vesicles release to have action potentials as inputs of different frequencies. We perform GSA on this extended model to show that the parameter sensitivities are different for the extended model as shown by PRCC landscapes. Based on the results of GSA and PRCC, we reduce the original model to a less complex model taking the most important biological processes into account. We validate the reduced model against the outputs of the original model. We show that the parameter sensitivities are dependent on the inputs and GSA would make us understand the sensitivities and the importance of the parameters. A thorough phenomenological understanding of the relationships involved is essential to interpret the results of GSA and hence for the possible model reduction.

Role of DARPP-32 and ARPP-21 in the Emergence of Temporal Constraints on Striatal Calcium and Dopamine Integration

In reward learning, the integration of NMDA-dependent calcium and dopamine by striatal projection neurons leads to potentiation of corticostriatal synapses through CaMKII/PP1 signaling. In order to elicit the CaMKII/PP1-dependent response, the calcium and dopamine inputs should arrive in temporal proximity and must follow a specific (dopamine after calcium) order. However, little is known about the cellular mechanism which enforces these temporal constraints on the signal integration. In this computational study, we propose that these temporal requirements emerge as a result of the coordinated signaling via two striatal phosphoproteins, DARPP-32 and ARPP-21. Specifically, DARPP-32-mediated signaling could implement an input-interval dependent gating function, via transient PP1 inhibition, thus enforcing the requirement for temporal proximity. Furthermore, ARPP-21 signaling could impose the additional input-order requirement of calcium and dopamine, due to its Ca²⁺/calmodulin sequestering property when dopamine arrives first. This highlights the possible role of phosphoproteins in the temporal aspects of striatal signal transduction.

A response towards an environmental stimulus could be reinforced if it elicits a reward. On the subcellular level, the environmental stimulus and the reward signal lead to a transient increase in striatal calcium- and dopamine-signaling, respectively. The integration of calcium and dopamine signals, which is important for reward-learning, could elicit a downstream response only if they are close in time and arrive in correct order (first calcium and then dopamine). This study proposes that the requirement for the input signals to be temporally close and in correct order could emerge due to the coordinated signaling via two striatal phosphoproteins, DARPP-32 and ARPP-21. The DARPP-32 signaling implements an input-interval dependent gating function and ARPP-21 implements an input-order dependent threshold-like function. Thus, a molecular mechanism has been presented here which could explain the emergence of important temporal aspects of subcellular signal integration in reward-learning.

Ifenprodil Attenuates Methamphetamine-Induced Behavioral Sensitization and Activation of Ras-ERK-∆FosB Pathway in the Caudate Putamen

Addiction is a debilitating, chronic psychiatric disorder that is difficult to cure completely owing to the high rate of relapse. Behavioral sensitization is considered to may underlie behavioral changes, such as relapse, caused by chronic abuse of psychomotor stimulants. Thus, its animal models have been widely used to explore the etiology of addiction. Recently, increasing evidence has demonstrated that N-methyl-D-aspartate receptors (NMDARs) play an important role in addiction to psychomotor stimulants. However, the role of GluN2B-containing receptors and their downstream signaling pathway(s) in behavioral sensitization induced by methamphetamine (METH) have not been investigated yet. In this study, we used different doses of ifenprodil (2.5, 5, 10 mg/kg), a selective antagonist of the GluN2B subunit, to investigate the role of GluN2B-containing NMDARs in METH-induced behavioral sensitization. We then examined changes in the levels of Ras, phosphorylated extracellular signal-regulated kinase (pERK)/ERK, and ∆FosB in the caudate putamen (CPu) by western blot. We found that 2.5 or 10 mg/kg ifenprodil significantly attenuated METH-induced behavioral sensitization, whereas the mice treated with a moderate dose of ifenprodil (5 mg/kg) displayed no significant changes. Further results of western blot experiments showed that repeated administration of METH caused the increases in the levels of Ras, pERK/ERK and ∆FosB in the CPu, and these changes were inhibited by only the 2.5 mg/kg dose of ifenprodil. In conclusion, these results demonstrated that 2.5 mg/kg ifenprodil could attenuate METH-induced behavioral sensitization. Moreover, GluN2B-containing NMDARs and their downstream Ras-ERK-∆FosB signaling pathway in the CPu might be involved in METH-induced behavioral sensitization.

Sensing Positive versus Negative Reward Signals through Adenylyl Cyclase-Coupled GPCRs in Direct and Indirect Pathway Striatal Medium Spiny Neurons

Transient changes in striatal dopamine (DA) concentration are considered to encode a reward prediction error (RPE) in reinforcement learning tasks. Often, a phasic DA change occurs concomitantly with a dip in striatal acetylcholine (ACh), whereas other neuromodulators, such as adenosine (Adn), change slowly. There are abundant adenylyl cyclase (AC) coupled GPCRs for these neuromodulators in striatal medium spiny neurons (MSNs), which play important roles in plasticity. However, little is known about the interaction between these neuromodulators via GPCRs. The interaction between these transient neuromodulator changes and the effect on cAMP/PKA signaling via Golf- and Gi/o-coupled GPCR are studied here using quantitative kinetic modeling. The simulations suggest that, under basal conditions, cAMP/PKA signaling could be significantly inhibited in D1R+ MSNs via ACh/M4R/Gi/o and an ACh dip is required to gate a subset of D1R/Golf-dependent PKA activation. Furthermore, the interaction between ACh dip and DA peak, via D1R and M4R, is synergistic. In a similar fashion, PKA signaling in D2+ MSNs is under basal inhibition via D2R/Gi/o and a DA dip leads to a PKA increase by disinhibiting A2aR/Golf, but D2+ MSNs could also respond to the DA peak via other intracellular pathways. This study highlights the similarity between the two types of MSNs in terms of high basal AC inhibition by Gi/o and the importance of interactions between Gi/o and Golf signaling, but at the same time predicts differences between them with regard to the sign of RPE responsible for PKA activation.

SIGNIFICANCE STATEMENT

Dopamine transients are considered to carry reward-related signal in reinforcement learning. An increase in dopamine concentration is associated with an unexpected reward or salient stimuli, whereas a decrease is produced by omission of an expected reward. Often dopamine transients are accompanied by other neuromodulatory signals, such as acetylcholine and adenosine. We highlight the importance of interaction between acetylcholine, dopamine, and adenosine signals via adenylyl-cyclase coupled GPCRs in shaping the dopamine-dependent cAMP/PKA signaling in striatal neurons. Specifically, a dopamine peak and an acetylcholine dip must interact, via D1 and M4 receptor, and a dopamine dip must interact with adenosine tone, via D2 and A2a receptor, in direct and indirect pathway neurons, respectively, to have any significant downstream PKA activation.

Modeling intracellular signaling underlying striatal function in health and disease

Striatum, which is the input nucleus of the basal ganglia, integrates cortical and thalamic glutamatergic inputs with dopaminergic afferents from the substantia nigra pars compacta. The combination of dopamine and glutamate strongly modulates molecular and cellular properties of striatal neurons and the strength of corticostriatal synapses. These actions are performed via intracellular signaling networks, containing several intertwined feedback loops. Understanding the role of dopamine and other neuromodulators requires the development of quantitative dynamical models for describing the intracellular signaling, in order to provide precise unambiguous descriptions and quantitative predictions. Building such models requires integration of data from multiple data sources containing information regarding the molecular interactions, the strength of these interactions, and the subcellular localization of the molecules. Due to the uncertainty, variability, and sparseness of these data, parameter estimation techniques are critical for inferring or constraining the unknown parameters, and sensitivity analysis evaluates which parameters are most critical for a given observed macroscopic behavior. Here, we briefly review the modeling approaches and tools that have been used to investigate biochemical signaling in the striatum, along with some of the models built around striatum. We also suggest a future direction for the development of such models from the, now becoming abundant, high-throughput data.