Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro

Category learning in the brain

The ability to group items and events into functional categories is a fundamental characteristic of sophisticated thought. It is subserved by plasticity in many neural systems, including neocortical regions (sensory, prefrontal, parietal, and motor cortex), the medial temporal lobe, the basal ganglia, and midbrain dopaminergic systems. These systems interact during category learning. Corticostriatal loops may mediate recursive, bootstrapping interactions between fast reward-gated plasticity in the basal ganglia and slow reward-shaded plasticity in the cortex. This can provide a balance between acquisition of details of experiences and generalization across them. Interactions between the corticostriatal loops can integrate perceptual, response, and feedback-related aspects of the task and mediate the shift from novice to skilled performance. The basal ganglia and medial temporal lobe interact competitively or cooperatively, depending on the demands of the learning task.

Neurogenetics and pharmacology of learning, motivation, and cognition

Many of the individual differences in cognition, motivation, and learning-and the disruption of these processes in neurological conditions-are influenced by genetic factors. We provide an integrative synthesis across human and animal studies, focusing on a recent spate of evidence implicating a role for genes controlling dopaminergic function in frontostriatal circuitry, including COMT, DARPP-32, DAT1, DRD2, and DRD4. These genetic effects are interpreted within theoretical frameworks developed in the context of the broader cognitive and computational neuroscience literature, constrained by data from pharmacological, neuroimaging, electrophysiological, and patient studies. In this framework, genes modulate the efficacy of particular neural computations, and effects of genetic variation are revealed by assays designed to be maximally sensitive to these computations. We discuss the merits and caveats of this approach and outline a number of novel candidate genes of interest for future study.

Contributions of ERK signaling in the striatum to instrumental learning and performance

The striatum is critical for learning and decision making; however, the molecular mechanisms that govern striatum function are not fully understood. The extracellular signal regulated kinase (ERK) cascade is an important signaling pathway that underlies synaptic plasticity, cellular excitability, learning and arousal. This review focuses on the role of ERK signaling in striatum function. ERK is activated in the striatum by coordinated dopamine and glutamate receptor signaling, where it underlies corticostriatal synaptic plasticity and influences striatal cell excitability. ERK activation in the dorsal striatum is necessary for action-outcome learning and performance of goal-directed actions. In the ventral striatum, ERK is necessary for the motivating effects of reward-associated stimuli on instrumental performance. Dysregulation of ERK signaling in the striatum by repeated drug exposure contributes to the development of addictive behavior. These results highlight the importance of ERK signaling in the striatum as a critical substrate for learning and as a regulator of ongoing behavior. Furthermore, they suggest that ERK may be a suitable target for therapeutics to treat disorders of learning and decision making that arise from compromised striatum function.

Functional anatomy: dynamic States in Basal Ganglia circuits

The most appealing models of how the basal ganglia function propose distributed patterns of cortical activity selectively interacting with striatal networks to yield the execution of context-dependent movements. If movement is encoded by patterns of activity then these may be disrupted by influences at once more subtle and more devastating than the increase or decrease of neuronal firing that dominate the usual models of the circuit. In the absence of dopamine the compositional capabilities of cell assemblies in the network could be disrupted by the generation of dominant synchronous activity that engages most of the system. Experimental evidence about Parkinson's disease suggests that dopamine loss produces abnormal patterns of activity in different nuclei. For example, increased oscillatory activity arises in the GPe, GPi, and STN and is reflected as increased cortical beta frequency coherence disrupting the ability to produce motor sequences. When the idea of deep brain stimulation was proposed – it was supported by the information that lesions of the subthalamus reversed the effects of damage to the dopamine input to the system. However, it seems increasingly unlikely that the stimulation acts by silencing the nucleus as was at first proposed. Perhaps the increased cortical beta activity caused by the lack of dopamine could have disabled the patterning of network activity. Stimulation of the subthalamic nucleus disrupts the on-going cortical rhythms. Subsequently asynchronous firing is reinstated and striatal cell assemblies and the whole basal ganglia circuit engage in a more normal pattern of activity. We will review the different variables involved in the generation of sequential activity patterns, integrate our data on deep brain stimulation and network population dynamics, and thus provide a novel interpretation of functional aspects of basal ganglia circuitry.

A behavioral genetics approach to understanding D1 receptor involvement in phasic dopamine signaling

Dopamine-producing neurons fire with both basal level tonic patterns and phasic bursts. Varying affinities of the five dopamine receptors have led to a hypothesis that higher affinity receptors are primarily activated by basal level tonic dopamine, while lower affinity receptors may be tuned to be sensitive to higher levels caused by phasic bursts. Genetically modified mice provide a method to begin to probe this hypothesis. Here we discuss three mouse models. Dopamine-deficient mice were used to determine which behaviors require dopamine. These behaviors were then analyzed in mice lacking D1 receptors and in mice with reduced phasic dopamine release. Comparison of the latter two mouse models revealed a similar failure to learn about and respond normally to cues that indicate either a positive or negative outcome, giving support to the hypothesis that phasic dopamine release and the D1 receptor act in the same pathway. However, the D1 receptor likely has additional roles beyond those of phasic dopamine detection, because D1 receptor knockout mice have deficits in addition to what has been observed in mice with reduced phasic dopamine release.

Cortico-striatal spike-timing dependent plasticity after activation of subcortical pathways

Cortico-striatal spike-timing dependent plasticity (STDP) is modulated by dopamine in vitro. The present study investigated STDP in vivo using alternative procedures for modulating dopaminergic inputs. Postsynaptic potentials (PSP) were evoked in intracellularly recorded spiny neurons by electrical stimulation of the contralateral motor cortex. PSPs often consisted of up to three distinct components, likely representing distinct cortico-striatal pathways. After baseline recording, bicuculline (BIC) was ejected into the superior colliculus (SC) to disinhibit visual pathways to the dopamine cells and striatum. Repetitive cortical stimulation (∼60; 0.2 Hz) was then paired with postsynaptic spike discharge induced by an intracellular current pulse, with each pairing followed 250 ms later by a light flash to the contralateral eye (n = 13). Changes in PSPs, measured as the maximal slope normalized to 5-min pre, ranged from potentiation (∼120%) to depression (∼80%). The determining factor was the relative timing between PSP components and spike: PSP components coinciding or closely following the spike tended towards potentiation, whereas PSP components preceding the spike were depressed. Importantly, STDP was only seen in experiments with successful BIC-mediated disinhibition (n = 10). Cortico-striatal high-frequency stimulation (50 pulses at 100 Hz) followed 100 ms later by a light flash did not induce more robust synaptic plasticity (n = 9). However, an elevated post-light spike rate correlated with depression across plasticity protocols (R(2) = 0.55, p = 0.009, n = 11 active neurons). These results confirm that the direction of cortico-striatal plasticity is determined by the timing of pre- and postsynaptic activity and that synaptic modification is dependent on the activation of additional subcortical inputs.

Seeking brain biomarkers for preventive therapy in Huntington disease

Huntington disease (HD) is a severe incurable nervous system disease that generally has an onset age of around 35-50, and is caused by a dominantly transmitted expansion mutation. A genetic test allows persons at risk, i.e., offspring or siblings of affected individuals, to discover their genetic status. Unaffected mutation-positive subjects will manifest HD sometime during life. Despite major advances in research on pathogenic mechanisms, no studies have yet fully validated preventive therapy or biomarkers for use before the symptoms become clinically manifest. Seeking brain and peripheral biomarkers is a requisite to develop a cure for HD. Changes in the brain can be observed in vivo using methods such as structural magnetic resonance imaging (MRI), diffusion tensor imaging (DTI), functional MRI (fMRI), and positron emission tomography (PET), detecting volumetric changes, microstructural and connectivity alterations, abnormalities in brain activity in response to specific tasks, and abnormalities in metabolism and receptor distribution. Although all these imaging techniques can detect early markers in asymptomatic HD gene carriers for premanifest screening and pharmacological responses to therapeutic interventions no single modality has yet provided and validated an optimal marker probably because this task requires an integrative multimodal imaging approach. In this article, we review the findings from imaging procedures in the attempt to identify potential brain markers, so-called dry biomarkers, for possible application to further, yet unavailable, neuroprotective preventive therapies for HD manifestations.

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success.

Convergent evidence for abnormal striatal synaptic plasticity in dystonia

Dystonia is a functionally disabling movement disorder characterized by abnormal movements and postures. Although substantial recent progress has been made in identifying genetic factors, the pathophysiology of the disease remains a mystery. A provocative suggestion gaining broader acceptance is that some aspect of neural plasticity may be abnormal. There is also evidence that, at least in some forms of dystonia, sensorimotor "use" may be a contributing factor. Most empirical evidence of abnormal plasticity in dystonia comes from measures of sensorimotor cortical organization and physiology. However, the basal ganglia also play a critical role in sensorimotor function. Furthermore, the basal ganglia are prominently implicated in traditional models of dystonia, are the primary targets of stereotactic neurosurgical interventions, and provide a neural substrate for sensorimotor learning influenced by neuromodulators. Our working hypothesis is that abnormal plasticity in the basal ganglia is a critical link between the etiology and pathophysiology of dystonia. In this review we set up the background for this hypothesis by integrating a large body of disparate indirect evidence that dystonia may involve abnormalities in synaptic plasticity in the striatum. After reviewing evidence implicating the striatum in dystonia, we focus on the influence of two neuromodulatory systems: dopamine and acetylcholine. For both of these neuromodulators, we first describe the evidence for abnormalities in dystonia and then the means by which it may influence striatal synaptic plasticity. Collectively, the evidence suggests that many different forms of dystonia may involve abnormal plasticity in the striatum. An improved understanding of these altered plastic processes would help inform our understanding of the pathophysiology of dystonia, and, given the role of the striatum in sensorimotor learning, provide a principled basis for designing therapies aimed at the dynamic processes linking etiology to pathophysiology of the disease.

Gene expression changes in the medial prefrontal cortex and nucleus accumbens following abstinence from cocaine self-administration

Background

Many studies of cocaine-responsive gene expression have focused on changes occurring during cocaine exposure, but few studies have examined the persistence of these changes with cocaine abstinence. Persistent changes in gene expression, as well as alterations induced during abstinence may underlie long-lasting drug craving and relapse liability.

Results

Whole-genome expression analysis was conducted on a rat cocaine binge-abstinence model that has previously been demonstrated to engender increased drug seeking and taking with abstinence. Gene expression changes in two mesolimbic terminal fields (mPFC and NAc) were identified in a comparison of cocaine-naïve rats with rats after 10 days of cocaine self-administration followed by 1, 10, or 100 days of enforced abstinence (n = 6-11 per group). A total of 1,461 genes in the mPFC and 414 genes in the NAc were altered between at least two time points (ANOVA, p < 0.05; ± 1.4 fold-change). These genes can be subdivided into: 1) changes with cocaine self-administration that do not persist into periods of abstinence, 2) changes with cocaine self-administration that persist with abstinence, 3) and those not changed with cocaine self-administration, but changed during enforced abstinence. qPCR analysis was conducted to confirm gene expression changes observed in the microarray analysis.

Conclusions

Together, these changes help to illuminate processes and networks involved in abstinence-induced behaviors, including synaptic plasticity, MAPK signaling, and TNF signaling.

Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum

The dorsal striatum is a large forebrain region involved in action initiation, timing, control, learning and memory. Learning and remembering skilled movement sequences requires the dorsal striatum, and striatal subregions participate in both goal-directed (action-outcome) and habitual (stimulus-response) learning. Modulation of synaptic transmission plays a large part in controlling input to as well as the output from striatal medium spiny projection neurons (MSNs). Synapses in this brain region are subject to short-term modulation, including allosteric alterations in ion channel function and prominent presynaptic inhibition. Two forms of long-term synaptic plasticity have also been observed in striatum, long-term potentiation (LTP) and long-term depression (LTD). LTP at glutamatergic synapses onto MSNs involves activation of NMDA-type glutamate receptors and D1 dopamine or A2A adenosine receptors. Expression of LTP appears to involve postsynaptic mechanisms. LTD at glutamatergic synapses involves retrograde endocannabinoid signaling stimulated by activation of metabotropic glutamate receptors (mGluRs) and D2 dopamine receptors. While postsynaptic mechanisms participate in LTD induction, maintained expression involves presynaptic mechanisms. A similar form of LTD has also been observed at GABAergic synapses onto MSNs. Studies have just begun to examine the roles of synaptic plasticity in striatal-based learning. Findings to date indicate that molecules implicated in induction of plasticity participate in these forms of learning. Neurotransmitter receptors involved in LTP induction are necessary for proper skill and goal-directed instrumental learning. Interestingly, receptors involved in LTP and LTD at glutamatergic synapses onto MSNs of the "indirect pathway" appear to have important roles in habit learning. More work is needed to reveal if and when synaptic plasticity occurs during learning and if so what molecules and cellular processes, both short- and long-term, contribute to this plasticity.

Neurocomputational models of motor and cognitive deficits in Parkinson's disease

We review the contributions of biologically constrained computational models to our understanding of motor and cognitive deficits in Parkinson's disease (PD). The loss of dopaminergic neurons innervating the striatum in PD, and the well-established role of dopamine (DA) in reinforcement learning (RL), enable neural network models of the basal ganglia (BG) to derive concrete and testable predictions. We focus in this review on one simple underlying principle - the notion that reduced DA increases activity and causes long-term potentiation in the indirect pathway of the BG. We show how this theory can provide a unified account of diverse and seemingly unrelated phenomena in PD including progressive motor degeneration as well as cognitive deficits in RL, decision making and working memory. DA replacement therapy and deep brain stimulation can alleviate some aspects of these impairments, but can actually introduce negative effects such as motor dyskinesias and cognitive impulsivity. We discuss these treatment effects in terms of modulation of specific mechanisms within the computational framework. In addition, we review neurocomputational interpretations of increased impulsivity in the face of response conflict in patients with deep-brain-stimulation.

Assemblies of glutamate receptor subunits with post-synaptic density proteins and their alterations in Parkinson's disease

N-methyl-D-aspartate (NMDA) receptors have been implicated as a mediator of neuronal injury associated with many neurological disorders including ischemia, epilepsy, brain trauma, dementia and neurodegenerative disorders such as Parkinson's disease (PD) and Alzheimer's disease. To this, non-selective NMDA receptor antagonists have been tried and have been shown to be effective in many experimental animal models of disease, and some of these compounds have moved into clinical trials. However, the initial enthusiasm for this approach has waned, because the therapeutic index for most NMDA antagonists is quite poor, with significant adverse effects at clinically effective doses, thus limiting their utility. More recently, the concept that the exact pathways downstream NMDA receptor activation could represent a key variable element among neurological disorders has been put forward. In particular, variations in NMDA receptor subunit composition could be important in different disorders, both in the pathophysiological mechanisms of cell death and in the application of specific symptomatic therapies. As to PD, NMDA receptor complex has been shown to be altered in experimental models of parkinsonism and in PD in humans. Further, it has become increasingly evident that the NMDA receptor complex is intimately involved in the regulation of corticostriatal long-term potentiation, which is altered in experimental parkinsonism. The following sections will examine the modifications of specific NMDA receptor subunits as well as post-synaptic associated signalling complex including kinases and scaffolding proteins in experimental parkinsonism. These findings may allow the identification of specific molecular targets whose pharmacological or genetic manipulation might lead to innovative therapies for PD.

Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda

ADHD is associated with altered reinforcement sensitivity, despite a number of inconsistent findings. This review focuses on the overlap and differences between seven neurobiologically valid models and lists 15 predictions assessing reinforcement sensitivity in ADHD. When comparing the models it becomes clear that there are great differences in the level of explanation. For example, some models try to explain a single core deficit in terms lower-level reinforcement systems, such as the dopamine transfer to reward back in time. Other models explain multiple deficits, by describing higher-level systems, such as impaired bottom-up prefrontal activation. When reviewing the available experimental evidence in support of the predictions, most experimental studies have been focusing on behavioral changes in the face of reward and response cost over no-reward, and on delay discounting. There is currently a lack in studies that focus on explaining underlying cognitive or neural mechanisms of altered reinforcement sensitivity in ADHD. Additionally, there is a lack in studies that try to understand what subgroup of children with ADHD shows alterations in reinforcement sensitivity. The scarcity in studies testing the neurobiological predictions is explained partly by a lack in knowledge how to test some of these predictions in humans. Nevertheless, we believe that these predictions can serve as a useful guide to the systematic evaluation of altered reinforcement sensitivity in ADHD.

Intrinsic neuronal plasticity in the juxtacapsular nucleus of the bed nuclei of the stria terminalis (jcBNST)

The juxtacapsular nucleus of the anterior division of the BNST (jcBNST) receives robust glutamatergic projections from the basolateral nucleus of the amygdala (BLA), the postpiriform transition area, and the insular cortex as well as dopamine (DA) inputs from the midbrain. In turn the jcBNST sends GABAergic projections to the medial division of the central nucleus of the amygdala (CEAm) as well as other brain regions. We recently described a form of long-term potentiation of the intrinsic excitability (LTP-IE) of neurons of the juxtacapsular nucleus of BNST (jcBNST) in response to high-frequency stimulation (HFS) of the stria terminalis that was impaired during protracted withdrawal from alcohol, cocaine, and heroin and in rats chronically treated with corticotropin-releasing factor (CRF) intracerebroventricularly. Here we show that DAergic neurotransmission is required for the induction of LTP-IE of jcBNST neurons through dopamine (DA) D1 receptors. Thus, activation of the central CRF stress system and altered DAergic neurotransmission during protracted withdrawal from alcohol and drugs of abuse may contribute to the disruption of LTP-IE in the jcBNST. Impairment of this form of intrinsic neuronal plasticity in the jcBNST could result in inadequate neuronal integration and reduced inhibition of the CEA, contributing to the negative affective state that characterizes protracted abstinence in post-dependent individuals. These results provide a novel neurobiological target for vulnerability to alcohol and drug dependence.

Striatal action-learning based on dopamine concentration

The reinforcement learning hypothesis of dopamine function predicts that dopamine acts as a teaching signal by governing synaptic plasticity in the striatum. Induced changes in synaptic strength enable the cortico-striatal network to learn a mapping between situations and actions that lead to a reward. A review of the relevant neurophysiology of dopamine function in the cortico-striatal network and the machine reinforcement learning hypothesis reveals an apparent mismatch with recent electrophysiological studies. It was found that in addition to the well-described reward-related responses, a subpopulation of dopamine neurons also exhibits phasic responses to aversive stimuli or to cues predicting aversive stimuli. Obviously, actions that lead to aversive events should not be reinforced. However, published data suggest that the phasic responses of dopamine neurons to reward-related stimuli have a higher firing rate and have a longer duration than phasic responses of dopamine neurons to aversion-related stimuli. We propose that based on different dopamine concentrations, the target structures are able to decode reward-related dopamine from aversion-related dopamine responses. Thereby, the learning of actions in the basal-ganglia network integrates information about both costs and benefits. This hypothesis predicts that dopamine concentration should be a crucial parameter for plasticity rules at cortico-striatal synapses. Recent in vitro studies on cortico-striatal synaptic plasticity rules support a striatal action-learning scheme where during reward-related dopamine release dopamine-dependent forms of synaptic plasticity occur, while during aversion-related dopamine release the dopamine concentration only allows dopamine-independent forms of synaptic plasticity to occur.

Metabotropic glutamate receptor-dependent long-term potentiation

The induction of the most common form of LTP is well known to involve activation of N-methyl-D-aspartate receptors. However, considerable evidence has also shown that certain forms of LTP induction at excitatory synapses onto both principle cells and interneurons are dependent on activation of metabotropic glutamate receptors (mGluRs). mGluR-dependent LTP occurs in widespread areas of the brain including the neocortex, hippocampus, striatum and nucleus accumbens. mGluR-dependent forms of LTP have been found to be diverse, involving activation of mGluR1 or mGluR5 and can be of AMPAR-mediated transmission or of NMDAR-mediated transmission. Furthermore, the mGluR-dependent LTP may involve activation of other receptors, in particular, activation of NMDAR, dopamine and adenosine receptors. mGluR-dependent LTP can be expressed presynaptically or postsynaptically, and can involve a range of intracellular mediators including protein kinase C (PKC) and protein kinase A (PKA), tyrosine kinase Src and nitric oxide (NO).

Increased Fos expression among midbrain dopaminergic cell groups during birdsong tutoring

During avian vocal learning, birds memorize conspecific song patterns and then use auditory feedback to match their vocal output to this acquired template. Some models of song learning posit that during tutoring, conspecific visual, social and/or auditory cues activate neuromodulatory systems that encourage acquisition of the tutor's song and attach incentive value to that specific acoustic pattern. This hypothesis predicts that stimuli experienced during social tutoring activate cell populations capable of signaling reward. Using immunocytochemistry for the protein product of the immediate early gene c-Fos, we found that brief exposure of juvenile male zebra finches to a live familiar male tutor increased the density of Fos+ cells within two brain regions implicated in reward processing: the ventral tegmental area (VTA) and substantia nigra pars compacta (SNc). This activation of Fos appears to involve both dopaminergic and non-dopaminergic VTA/SNc neurons. Intriguingly, a familiar tutor was more effective than a novel tutor in stimulating Fos expression within these regions. In the periaqueductal gray, a dopamine-enriched cell population that has been implicated in emotional processing, Fos labeling also was increased after tutoring, with a familiar tutor again being more effective than a novel conspecific. As several neural regions implicated in song acquisition receive strong dopaminergic projections from these midbrain nuclei, their activation in conjunction with hearing the tutor's song could help to establish sensory representations that later guide motor sequence learning.

Neurobiology of ADHD

Attention-deficit hyperactivity disorder (ADHD) is a prevalent and debilitating disorder diagnosed on the basis of persistent and developmentally-inappropriate levels of overactivity, inattention and impulsivity. The etiology and pathophysiology of ADHD is incompletely understood. There is evidence of a genetic basis for ADHD but it is likely to involve many genes of small individual effect. Differences in the dimensions of the frontal lobes, caudate nucleus, and cerebellar vermis have been demonstrated. Neuropsychological testing has revealed a number of well documented differences between children with and without ADHD. These occur in two main domains: executive function and motivation although neither of these is specific to ADHD. In view of the recent advances in the neurobiology of reinforcement, we concentrate in this review on altered reinforcement mechanisms. Among the motivational differences, many pieces of evidence indicate that an altered response to reinforcement may play a central role in the symptoms of ADHD. In particular, sensitivity to delay of reinforcement appears to be a reliable finding. We review neurobiological mechanisms of reinforcement and discuss how these may be altered in ADHD, with particular focus on the neurotransmitter dopamine and its actions at the cellular and systems level. We describe how dopamine cell firing activity is normally associated with reinforcing events, and transfers to earlier time-points in the behavioural sequence as reinforcement becomes more predictable. We discuss how a failure of this transfer may give rise to many symptoms of ADHD, and propose that methylphenidate might act to compensate for the proposed dopamine transfer deficit.

Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses

Spike-timing-dependent plasticity (STDP) is considered a physiologically relevant form of Hebbian learning. However, behavioral learning often involves action of reinforcement or reward signals such as dopamine. Here, we examined how dopamine influences the quantitative rule of STDP at glutamatergic synapses of hippocampal neurons. The presence of 20 muM dopamine during paired pre- and postsynaptic spiking activity expanded the effective time window for timing-dependent long-term potentiation (t-LTP) to at least -45 ms, and allowed normally ineffective weak stimuli with fewer spike pairs to induce significant t-LTP. Meanwhile, dopamine did not affect the degree of t-LTP induced by normal strong stimuli with spike timing (ST) of +10 ms. Such dopamine-dependent enhancement in the sensitivity of t-LTP was completely blocked by the D1-like dopamine receptor antagonist SCH23390, but not by the D2-like dopamine receptor antagonist sulpiride. Surprisingly, timing-dependent long-term depression (t-LTD) at negative ST was converted into t-LTP by dopamine treatment; this conversion was also blocked by SCH23390. In addition, t-LTP in the presence of dopamine was completely blocked by the NMDA receptor antagonist 2-amino-5-phosphonovaleric acid, indicating that D1-like receptor-mediated modulation appears to act through the classical NMDA receptor-mediated signaling pathway that underlies STDP. These results provide a quantitative and mechanistic basis for a previously undescribed learning rule that depends on pre- and postsynaptic ST, as well as the global reward signal.

Computational perspectives on forebrain microcircuits implicated in reinforcement learning, action selection, and cognitive control

Abundant new information about signaling pathways in forebrain microcircuits presents many challenges, and opportunities for discovery, to computational neuroscientists who strive to bridge from microcircuits to flexible cognition and action. Accurate treatment of microcircuit pathways is especially critical for creating models that correctly predict the outcomes of candidate neurological therapies. Recent models are trying to specify how cortical circuits that enable planning and voluntary actions interact with adaptive subcortical microcircuits in the basal ganglia. The basal ganglia are strongly implicated in reinforcement learning, and in all behavior and cognition over which the frontal lobes exert flexible control. The persisting role of the basal ganglia shows that ancient vertebrate designs for motivated action selection proved adaptable enough to support many "modern" behavioral innovations, including fluent generation of language and speech. This paper summarizes how recent models have incorporated realistic representations of microcircuit features, and have begun to trace their computational implications. Also summarized are recent empirical discoveries that provide guidance regarding how to formulate the rules for synaptic modification that govern learning in cortico-striatal pathways. Such efforts are contributing to an emerging synthesis based on an interlocking set of computational hypotheses regarding cortical interactions with basal ganglia and thalamic nuclei. These hypotheses specify how specialized microcircuits solve learning and control problems inherent to the brain's parallel design.

Dopamine receptors in the learning, memory and drug reward circuitry

As primary targets of a variety of abused drugs G-protein-coupled dopamine receptors in the brain play an important role in mediating the various drug-induced alterations in neural and psychological processes thought to underlie the transition from voluntary drug use to habitual and progressively compulsive drug-taking. This review considers the functional involvement of the five major dopamine receptor subtypes in drug reinforcement and reward and discusses the development of addiction as a series of learning transitions from initial goal-directed behaviour to pathological stimulus-response habits in which drug-seeking behaviours are automatically elicited and maintained by cues and stimuli associated with drug rewards.

Distinguishing the contributions of implicit and explicit processes to performance of the weather prediction task

Examinations of the cognitive neuroscience of category learning frequently rely on probabilistic classification-learning tasks-namely, the weather prediction task (WPT)-to study the neural mechanisms of implicit learning. Accumulating evidence suggests that the task also depends on explicit-learning processes. The present investigation manipulated the WPT to assess the specific contributions of implicit- and explicit-learning processes to performance, with a particular focus on how the contributions of these processes change as the task progresses. In Experiment 1, a manipulation designed to disrupt implicit-learning processes had no effect on classification accuracy or the distribution of individual response strategies. In Experiment 2, by contrast, a manipulation designed to disrupt explicit-learning processes substantially reduced classification accuracy and reduced the number of participants who relied on a correct response strategy. The present findings suggest that WPT learning is not an effective tool for investigating nondeclarative learning processes.

Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill

The learning of new skills is characterized by an initial phase of rapid improvement in performance and a phase of more gradual improvements as skills are automatized and performance asymptotes. Using in vivo striatal recordings, we observed region-specific changes in neural activity during the different phases of skill learning, with the associative or dorsomedial striatum being preferentially engaged early in training and the sensorimotor or dorsolateral striatum being engaged later in training. Ex vivo recordings from medium spiny striatal neurons in brain slices of trained mice revealed that the changes observed in vivo corresponded to regional- and training-specific changes in excitatory synaptic transmission in the striatum. Furthermore, the potentiation of glutamatergic transmission observed in dorsolateral striatum after extensive training was preferentially expressed in striatopallidal neurons, rather than striatonigral neurons. These findings demonstrate that region- and pathway-specific plasticity sculpts the circuits involved in the performance of the skill as it becomes automatized.

Striatal plasticity and basal ganglia circuit function

The dorsal striatum, which consists of the caudate and putamen, is the gateway to the basal ganglia. It receives convergent excitatory afferents from cortex and thalamus and forms the origin of the direct and indirect pathways, which are distinct basal ganglia circuits involved in motor control. It is also a major site of activity-dependent synaptic plasticity. Striatal plasticity alters the transfer of information throughout basal ganglia circuits and may represent a key neural substrate for adaptive motor control and procedural memory. Here, we review current understanding of synaptic plasticity in the striatum and its role in the physiology and pathophysiology of basal ganglia function.

Effects of the MEK inhibitor, SL-327, on rewarding, motor- and cellular-activating effects of D-amphetamine and SKF-82958, and their augmentation by food restriction in rat

RATIONALE

Food restriction (FR) enhances learned and unlearned behavioral responses to drugs of abuse and increases D-1 dopamine (DA) receptor-mediated activation of extracellular signal-regulated kinases (ERK) 1/2 MAP kinase in nucleus accumbens (NAc). While a role has been established for ERK signaling in drug-mediated associative learning, it is not clear whether ERK regulates unconditioned behavioral effects of abused drugs.

OBJECTIVES

The purpose of this study was to determine whether blockade of ERK signaling, using the brain-penetrant MEK inhibitor, SL-327, decreases behavioral or NAc cellular responses to acute drug treatment and their augmentation by FR.

MATERIALS AND METHODS

Separate experiments assessed the effects of SL-327 (50 mg/kg, intraperitoneally) on (1) the reward-potentiating effect of D-amphetamine in an intracranial self-stimulation protocol, (2) the locomotor-activating effect of the D-1 agonist, SKF-82958, and (3) Fos-immunostaining induced in the NAc by SKF-82958.

RESULTS

FR rats displayed enhanced responses to drug treatment on all measures. SL-327 had no effect on sensitivity to rewarding brain stimulation or the reward-potentiating effect of D-amphetamine. The MEK inhibitor, U0126, microinjected into the NAc was also without effect. The locomotor-activating effect of SKF-82958 was unaffected by SL-327. In contrast, SL-327 decreased NAc Fos-immunostaining and abolished the difference between feeding groups.

CONCLUSIONS

These results support the conclusion that ERK signaling does not mediate unlearned behavioral responses to drug treatment. However, the upregulation of ERK and downstream transcriptional responses to acute drug treatment may underlie the reported enhancement of reward-related learning in FR subjects.

Stimulus-response and response-outcome learning mechanisms in the striatum

While midbrain DA neurons show phasic activations in response to both reward-predicting and salient non-reward events, activation responses to primary and conditioned rewards are sustained for several hundreds of milliseconds beyond those elicited by salient non-reward-related stimuli. The longer-duration DA reward response and corresponding elevated DA release in striatal target sites may selectively strengthen currently-active corticostriatal synapses, i.e., those associated with the successful reward-procuring behavior. This paper describes how similar models of DA-mediated plasticity of corticostriatal synapses may describe both stimulus-response and response-outcome learning. DA-mediated strengthening of corticostriatal synapses in regions of the dorsolateral striatum receiving afferents from primary sensorimotor cortex is likely to bind corticostriatal inputs representing the previously-emitted movement to striatal outputs contributing to the selection of the next movement segment in a behavioral sequence. Within the striatum, more generally, inputs from distinct regions of the frontal cortex that code independently for movement direction and reward expectation send convergent projections to striatal output cells. DA-mediated strengthening of active corticostriatal synapses promotes the future output of the striatal cell under similar input conditions. This is postulated to promote persistence of neuronal activity in the very cortical cells that drive corticostriatal input, leading to the establishment of sustained reverberatory loops that permit cortical movement-related cells to maintain activity until the appropriate time of movement initiation.

Extracellular recordings of rodents in vivo: their contribution to integrative neuroscience

The prevalent theory in learning and memory processes is that they are underlain by short and long-term changes in synaptic weight, which continuously modulates neural networks during acquisition and recall. This synaptic plasticity has been revealed by recording extracellular field potentials. The enhancement of synaptic transmission was primarily noted in the hippocampus and was named long-term potentiation (LTP). The opposite mechanism, long-term depression (LTD), a reduction of synaptic transmission, was first discovered in the cerebellum. Since then, the LTP-model has been studied mainly using in vitro and acute anesthetized in vivo preparations. This approach has led to remarkable progress in the comprehension of intracellular molecular processes during LTP and LTD. In this review, we focus mainly on what we can learn about molecular events using extracellular field potential recordings with a more ecological model, i.e., studies using the freely behaving animal, with animals that are genetically modified or not, in several behavioral paradigms aimed at gaining insight into some of the conflicting results obtained with in vitro and in vivo preparations.

A dopaminergic axon lattice in the striatum and its relationship with cortical and thalamic terminals

Interactions between glutamatergic corticostriatal afferents and dopaminergic nigrostriatal afferents are central to basal ganglia function. The thalamostriatal projection provides a glutamatergic innervation of similar magnitude to the corticostriatal projection. We tested the hypotheses that (1) thalamostriatal synapses have similar spatial relationships with dopaminergic axons as corticostriatal synapses do and (2) the spatial relationships between excitatory synapses and dopaminergic axons are selective associations. We examined at the electron microscopic level rat striatum immunolabeled to reveal vesicular glutamate transporters (VGluTs) 1 and 2, markers of corticostriatal and thalamostriatal terminals, respectively, together with tyrosine hydroxylase (TH) to reveal dopaminergic axons. Over 80% of VGluT-positive synapses were within 1 microm of a TH-positive axon and >40% were within 1 microm of a TH-positive synapse. Of structures postsynaptic to VGluT1- or VGluT2-positive terminals, 21 and 27%, respectively, were apposed by a TH-positive axon and about half of these made synaptic contact. When structures postsynaptic to VGluT-positive terminals and VGluT-positive terminals themselves were normalized for length of plasma membrane, the probability of them being apposed by, or in synaptic contact with, a TH-positive axon was similar to that of randomly selected structures. Extrapolation of the experimental data to more closely reflect the distribution in 3D reveals that all structures in the striatum are within approximately 1 microm of a TH-positive synapse. We conclude that (1) thalamostriatal synapses are in a position to be influenced by released dopamine to a similar degree as corticostriatal synapses are and (2) these associations arise from a nonselective dopaminergic axon lattice.

Synaptic plasticity in the basal ganglia

Activity-dependent synaptic plasticity occurs in several parts of the basal ganglia. Increasing evidence supports the hypothesis that activity-dependent plasticity underlies the acquisition, maintenance, and extinction of certain types of learning in the basal ganglia. This review focuses on synaptic plasticity in the corticostriatal pathway. As in other systems, both long-term potentiation and long-term depression have been described, and intracellular calcium signalling plays an important role in the induction of plasticity. However, intracellular calcium levels do not appear to be the dominating control factor. Dopamine, via intracellular signalling cascades, also plays a crucial role in determining the magnitude and direction of plasticity, and in modulating the requirements for induction. Endocannabinoids also play an important role in mediating presynaptic expression of synaptic depression. Recent studies have highlighted spike-timing dependent plasticity phenomena, which also involve dopamine and endocannabinoid signalling. Despite significant progress in recent years, many important questions remain unanswered, especially in relation to long-term potentiation. Of particular interest is the question of how to link the molecular and cellular mechanisms of synaptic plasticity to learning operations at the systems level, which are expressed behaviourally as reinforcement-related learning.

FGF acts as a co-transmitter through adenosine A(2A) receptor to regulate synaptic plasticity

Abnormalities of striatal function have been implicated in several major neurological and psychiatric disorders, including Parkinson's disease, schizophrenia and depression. Adenosine, via activation of A(2A) receptors, antagonizes dopamine signaling at D2 receptors and A(2A) receptor antagonists have been tested as therapeutic agents for Parkinson's disease. We found a direct physical interaction between the G protein-coupled A(2A) receptor (A(2A)R) and the receptor tyrosine kinase fibroblast growth factor receptor (FGFR). Concomitant activation of these two classes of receptors, but not individual activation of either one alone, caused a robust activation of the MAPK/ERK pathway, differentiation and neurite extension of PC12 cells, spine morphogenesis in primary neuronal cultures, and cortico-striatal plasticity that was induced by a previously unknown A(2A)R/FGFR-dependent mechanism. The discovery of a direct physical interaction between the A(2A) and FGF receptors and the robust physiological consequences of this association shed light on the mechanism underlying FGF functions as a co-transmitter and open new avenues for therapeutic interventions.

Neurocomputational models of basal ganglia function in learning, memory and choice

The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson's disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more "realistic", the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models.

Short-term and long-term plasticity at corticostriatal synapses: implications for learning and memory

The striatum is the major division of the basal ganglia, representing the input station of the circuit and arguably the principal site within the basal ganglia where information processing occurs. Striatal activity is critically involved in motor control and learning. Many parts of the striatum are involved in reward processing and in various forms of learning and memory, such as reward-association learning. Moreover, the striatum appears to be a brain center for habit formation and is likely to be involved in advanced stages of addiction. The critical role played by the striatum in learning and cognitive processes is thought to be based on changes in neuronal activity when specific behavioral tasks are being learned. Accordingly, excitatory corticostriatal synapses onto both striatal projecting spiny neurons and interneurons are able to undergo the main forms of synaptic plasticity, including long-term potentiation, long-term depression, short-term forms of intrinsic plasticity and spike timing-dependent plasticity. These specific forms of neuroplasticity allow the short-term and long-term selection and differential amplification of cortical neural signals modulating the processes of motor and behavioral selection within the basal ganglia neural circuit.

Dopamine D1 receptor inhibition of NMDA receptor currents mediated by tyrosine kinase-dependent receptor trafficking in neonatal rat striatum

NMDA receptors are of particular importance in the control of synaptic strength and integration of synaptic activity. Dopamine receptor modulation of NMDA receptors in neonatal striatum may influence the efficacy of synaptic transmission in the cortico-striatal pathway and if so, this modulation will affect the behaviour of the basal ganglia network. Here, we show that in acute brain slices of neonatal (P7) rat striatum the dopamine D1 receptor agonist SKF-82958 significantly decreases NMDA receptor currents in patch-clamp whole-cell recordings. This inhibition is not abolished by application of a G protein inhibitor (GDP-beta-S) or irreversible G protein activator (GTP-gamma-S) suggesting a G protein-independent mechanism. In addition, intracellular application of protein tyrosine kinase inhibitors (lavendustin A or PP2) abolished D1 inhibition of NMDA currents. In contrast, in older animals (P28) D1 receptor activation produces a potentiation of the NMDA response which suggests there is a developmental switch in D1 modulation of striatal NMDA receptors. Single-channel recordings show that direct D1 receptor inhibition of NMDA receptors cannot be observed in isolated membrane patches. We hypothesize that D1 inhibition in whole-cell recordings from neonatal rats may be mediated by a change in NMDA receptor trafficking. Consistent with this hypothesis, intracellular application of a dynamin inhibitory peptide (QVPSRPNRAP) abolished D1 inhibition of NMDA receptor currents. We therefore conclude that a tyrosine kinase-dependent alteration of NMDA receptor trafficking underlies D1 dopamine receptor-mediated down-regulation of NMDA receptor currents in medium spiny neurons of neonatal rat striatum.

Decreased striatal dopamine release underlies increased expression of long-term synaptic potentiation at corticostriatal synapses 24 h after 3-nitropropionic-acid-induced chemical hypoxia

The striatum is particularly sensitive to the irreversible inhibitor of succinate dehydrogenase 3-nitropropionic acid (3-NP). In the present study, we examined early changes in behavior and dopamine and glutamate synaptic physiology created by a single systemic injection of 3-NP in Fischer 344 rats. Hindlimb dystonia was seen 2 h after 3-NP injections, and rats performed poorly on balance beam and rotarod motor tests 24 h later. Systemic 3-NP increased NMDA receptor-dependent long-term potentiation (LTP) at corticostriatal synapses over the same time period. The 3-NP-induced corticostriatal LTP was not attributable to increased NMDA receptor number or function, because 3-NP did not change MK-801 [(+)-5-methyl-10,11-dihydro-5H-dibenzo[a,d]cyclohepten-5,10-imine] binding or NMDA/AMPA receptor current ratios. The LTP seen 24 h after 3-NP was D(1) receptor dependent and reversed by exogenous addition of dopamine or a D(2) receptor agonist to brain slices. HPLC and fast-scan cyclic voltammetry revealed a decrease in dopamine content and release in rats injected 24 h earlier with 3-NP, and much like the enhanced LTP, dopamine changes were reversed by 48 h. Tyrosine hydroxylase expression was not changed, and there was no evidence of striatal cell loss at 24-48 h after 3-NP exposure. Sprague Dawley rats showed similar physiological responses to systemic 3-NP, albeit with reduced sensitivity. Thus, 3-NP causes significant changes in motor behavior marked by parallel changes in striatal dopamine release and corticostriatal synaptic plasticity.

Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity

Single action potentials (APs) backpropagate into the higher-order dendrites of striatal spiny projection neurons during cortically driven "up" states. The timing of these backpropagating APs relative to the arriving corticostriatal excitatory inputs determines changes in dendritic calcium concentration. The question arises to whether this spike-timing relative to cortical excitatory inputs can also induce synaptic plasticity at corticostriatal synapses. Here we show that timing of single postsynaptic APs relative to the cortically evoked EPSP determines both the direction and the strength of synaptic plasticity in spiny projection neurons. Single APs occurring 30 ms before the cortically evoked EPSP induced long-term depression (LTD), whereas APs occurring 10 ms after the EPSP induced long-term potentiation (LTP). The amount of plasticity decreased as the time between the APs and EPSPs was increased, with the resulting spike-timing window being broader for LTD than for LTP. In addition, we show that dopamine receptor activation is required for this spike-timing-dependent plasticity (STDP). Blocking dopamine D(1)/D(5) receptors prevented both LTD and LTP induction. In contrast, blocking dopamine D(2) receptors delayed, but did not prevent, LTD and sped induction of LTP. We conclude (1) that, in combination with cortical inputs, single APs evoked in spiny projection neurons can induce both LTP and LTD of the corticostriatal pathway; (2) that the strength and direction of these synaptic changes depend deterministically on the AP timing relative to the arriving cortical inputs; (3) that, whereas dopamine D(2) receptor activation modulates the initial phase of striatal STDP, dopamine D(1)/D(5) receptor activation is critically required for striatal STDP. Thus, the timing of APs relative to cortical inputs alone is not enough to induce corticostriatal plasticity, implying that ongoing activity does not affect synaptic strength unless dopamine receptors are activated.

Striatal proteomic analysis suggests that first L-dopa dose equates to chronic exposure

L-3,4-dihydroxypheylalanine (L-dopa)-induced dyskinesia represent a debilitating complication of therapy for Parkinson's disease (PD) that result from a progressive sensitization through repeated L-dopa exposures. The MPTP macaque model was used to study the proteome in dopamine-depleted striatum with and without subsequent acute and chronic L-dopa treatment using two-dimensional difference in-gel electrophoresis (2D-DIGE) and mass spectrometry. The present data suggest that the dopamine-depleted striatum is so sensitive to de novo L-dopa treatment that the first ever administration alone would be able (i) to induce rapid post-translational modification-based proteomic changes that are specific to this first exposure and (ii), possibly, lead to irreversible protein level changes that would be not further modified by chronic L-dopa treatment. The apparent equivalence between first and chronic L-dopa administration suggests that priming would be the direct consequence of dopamine loss, the first L-dopa administrations only exacerbating the sensitization process but not inducing it.

Morphine produces circuit-specific neuroplasticity in the bed nucleus of the stria terminalis

The bed nucleus of the stria terminalis (BST) is a brain structure located at the interface of the cortex and the cerebrospinal trunk. The BST is a cluster of nuclei organized in a complex intrinsic network that receives inputs from cortical and subcortical sources, and that sends a widespread top-down projection. There is growing evidence that the BST is a key component in the neurobiological basis of substance abuse. In the present study, the regulation of excitatory inputs onto identified neurons in the BST was examined in rats treated chronically with morphine. Neurons projecting to the ventral tegmental area (VTA) were identified by retrograde transport of fluorescent microspheres and recorded in the whole-cell voltage clamp configuration in brain slices. Selective excitatory inputs to these neurons were electrically evoked with electrodes placed in the medial and lateral aspects of the dorsal BST. The chronic morphine treatment selectively increased AMPA-dependent excitatory postsynaptic currents in a subset of inputs activated by dorso-lateral stimulation in the BST. Inputs activated by medial stimulation were not affected by morphine. Likewise, the inputs to neurons that did not project to the VTA were not changed by morphine. Altogether, these results extend the understanding of neuronal circuits intrinsically sensitive to drugs of abuse within the BST.

Dopamine D1 receptors and group I metabotropic glutamate receptors contribute to the induction of long-term potentiation in the nucleus accumbens

Long-term changes in the efficacy of glutamatergic synaptic transmission in the striatal complex are proposed to underlie motor learning and neuroadaptations leading to addiction. Dopamine and glutamate play key roles in the induction of long-term potentiation (LTP) and long-term depression (LTD) in the dorsal striatum, but their contribution to synaptic plasticity in the ventral striatum (nucleus accumbens, NAc) has been less extensively studied. We have examined the role of dopamine, glutamate and GABA in the induction of LTP in mouse brain slices containing the NAc. High-frequency stimulation of glutamatergic inputs elicited LTP of field excitatory postsynaptic potentials/population spikes (fEPSP/PSs) in the core region of the NAc. GABA did not seem to participate in LTP induction because LTP was not altered in the presence of either a GABA(A)- (bicuculline) or a GABA(B)- (CGP 55845) receptor antagonist. However, the dopamine D1 receptor antagonist SCH 23390, but not the dopamine D2 receptor antagonist sulpiride, impaired LTP. The dopamine reuptake blocker nomifensine also inhibited LTP induction. We found that group I metabotropic glutamate receptors (mGluRs) contribute to LTP induction because the mGluR1 antagonist LY 367385, or the mGluR5 antagonist MPEP, blocked LTP induction. Furthermore, the glutamate reuptake blocker DL-TBOA also impaired LTP. The present results demonstrate that dopamine and glutamate play critical roles in the mechanisms of induction of LTP in the NAc through the activation of dopamine D1 receptors and group I mGluRs. However, LTP is negatively regulated when endogenous levels of dopamine or glutamate are elevated.

Presynaptic nicotinic receptors: a dynamic and diverse cholinergic filter of striatal dopamine neurotransmission

The effects of nicotine on dopamine transmission from mesostriatal dopamine neurons are central to its reinforcing properties. Only recently however, has the influence of presynaptic nicotinic receptors (nAChRs) on dopaminergic axon terminals within striatum begun to be understood. Here, rather than simply enhancing (or inhibiting) dopamine release, nAChRs perform the role of a presynaptic filter, whose influence on dopamine release probability depends on presynaptic activity in dopaminergic as well as cholinergic neurons. Both mesostriatal dopaminergic neurons and striatal cholinergic interneurons play key roles in motivational and sensorimotor processing by the basal ganglia. Moreover, it appears that the striatal influence of dopamine and ACh cannot be fully appreciated without an understanding of their reciprocal interactions. We will review the powerful filtering by nAChRs of striatal dopamine release and discuss its dependence on activity in dopaminergic and cholinergic neurons. We will also review how nicotine, acting via nAChR desensitization, promotes the sensitivity of dopamine synapses to activity. This filtering action might provide a mechanism through which nicotine promotes how burst activity in dopamine neurons facilitates goal-directed behaviour and reinforcement processing. More generally, it indicates that we should not restrict our view of presynaptic nAChRs to simply enhancing neurotransmitter release. We will also summarize current understanding of the forms and functions of the diverse nAChRs purported to exist on dopaminergic axons. A greater understanding of nAChR form and function is imperative to guide the design of ligands with subtype-selective efficacy for improved therapeutic interventions in nicotine addiction as well as Parkinson's disease.

What is reinforced by phasic dopamine signals?

The basal ganglia have been associated with processes of reinforcement learning. A strong line of supporting evidence comes from the recording of dopamine (DA) neurones in behaving monkeys. Unpredicted, biologically salient events, including rewards cause a stereotypic short-latency (70-100 ms), short-duration (100-200 ms) burst of DA activity - the phasic response. This response is widely considered to represent reward prediction errors used as teaching signals in appetitive learning to promote actions that will maximise future reward acquisition. For DA signalling to perform this function, sensory processing afferent to DA neurones should discriminate unpredicted reward-related events. However, the comparative response latencies of DA neurones and orienting gaze-shifts indicate that phasic DA responses are triggered by pre-attentive sensory processing. Consequently, in circumstances where biologically salient events are both spatially and temporally unpredictable, it is unlikely their identity will be known at the time of DA signalling. The limited quality of afferent sensory processing and the precise timing of phasic DA signals, suggests that they may play a less direct role in 'Law of Effect' appetitive learning. Rather, the 'time-stamp' nature of the phasic response, in conjunction with the other signals likely to be present in the basal ganglia at the time of phasic DA input, suggests it may reinforce the discovery of unpredicted sensory events for which the organism is responsible. Furthermore, DA-promoted repetition of preceding actions/movements should enable the system to converge on those aspects of context and behavioural output that lead to the discovery of novel actions.

The GTP-binding protein Rhes modulates dopamine signalling in striatal medium spiny neurons

Rhes is a small GTP-binding protein prominently localized in the striatum. Previous findings obtained in cell culture systems demonstrated an involvement of Rhes in cAMP/PKA signalling pathway, at a level proximal to the activation of heterotrimeric G-protein complex. However, its role in the striatum has been, so far, only supposed. Here we studied the involvement of Rhes in dopaminergic signalling, by employing mice with a null mutation in the Rhes gene. We demonstrated that the absence of Rhes modulates cAMP/PKA signalling in both striatopallidal and striatonigral projection neurons by increasing Golf protein levels and, in turn, influencing motor responses challenged by dopaminergic agonist/antagonist. Interestingly, we also show that Rhes is required for a correct dopamine-mediated GTP binding, a function mainly associated to stimulation of dopamine D2 receptors. Altogether, our results indicate that Rhes is an important modulator of dopaminergic transmission in the striatum.

Dopaminergic mechanisms in actions and habits

Recent studies suggest new ways to interpret dopaminergic actions in goal-directed performance and habitual responding. In the early stages of learning dopamine plays an essential role, but with extended training dopamine appears to play a decreasing role in response expression. Experimental manipulation of dopamine levels alters the correlation of cortical and striatal neural activity in behaving animals, and these dopamine-dependent changes in corticostriatal correlations may be reflected in changes in action selection in the basal ganglia. Consistent with this hypothesis, changes in dopamine signaling brought about by sensitization with amphetamine mimic the transition from goal-directed to habit-based instrumental performance. At the cellular level, dopamine-dependent synaptic plasticity may be important initially, and subsequently lead to more persistent changes that no longer require dopamine. The locus of these actions within the cortical and corticostriatal circuitry is a focus on ongoing research.

Ethanol reverses the direction of long-term synaptic plasticity in the dorsomedial striatum

The striatum is a critical structure for the control of voluntary behaviour, and striatal synaptic plasticity has been implicated in instrumental learning. As ethanol consumption can cause impairments in cognition, learning, and action selection, it is important to understand the effects of this drug on striatal function. In this study we examined the effects of ethanol on long-term synaptic plasticity in the dorsomedial striatum (DMS), a striatal subregion that plays a central role in the acquisition and selection of goal-directed actions. Ethanol was found to impair N-methyl-d-aspartic acid receptor (NMDAR)-dependent long-term potentiation (LTP) dose-dependently in the DMS, and to promote long-term depression (LTD) at the highest concentration (50 mm) used. These results suggest that ethanol, at a concentration usually associated with mild intoxication, could significantly change experience-dependent modification of corticostriatal circuits underlying the learning of goal-directed instrumental actions.