Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning

Cell-Specific Single Viral Vector CRISPR/Cas9 Editing and Genetically Encoded Tool Delivery in the Central and Peripheral Nervous Systems

CRISPR/Cas9 gene editing represents an exciting avenue to study genes of unknown function and can be combined with genetically encoded tools such as fluorescent proteins, channelrhodopsins, DREADDs, and various biosensors to more deeply probe the function of these genes in different cell types. However, current strategies to also manipulate or visualize edited cells are challenging due to the large size of Cas9 proteins and the limited packaging capacity of adeno-associated viruses (AAVs). To overcome these constraints, we developed an alternative gene editing strategy using a single AAV vector and mouse lines that express Cre-dependent Cas9 to achieve efficient cell-type specific editing across the nervous system. Expressing Cre-dependent Cas9 from a genomic locus affords space to package guide RNAs for gene editing together with Cre-dependent, genetically encoded tools to manipulate, map, or monitor neurons using a single virus. We validated this strategy with three common tools in neuroscience: ChRonos, a channelrhodopsin, for studying synaptic transmission using optogenetics, GCaMP8f for recording Ca2+ transients using photometry, and mCherry for tracing axonal projections. We tested these tools in multiple brain regions and cell types, including GABAergic neurons in the nucleus accumbens, glutamatergic neurons projecting from the ventral pallidum to the lateral habenula, dopaminergic neurons in the ventral tegmental area, and proprioceptive neurons in the periphery. This flexible approach could help identify and test the function of novel genes affecting synaptic transmission, circuit activity, or morphology with a single viral injection.

Putative neural mechanisms underlying release-mode-specific abnormalities in dopamine neural activity in a schizophrenia-like model: The distinct roles of glutamate and serotonin in the impaired regulation of dopamine neurons

Abnormalities in dopamine function might be related to psychiatric disorders such as schizophrenia. Even at the same concentration, dopamine exerts opposite effects on information processing in the prefrontal cortex depending on independent dopamine release modes known as tonic and phasic releases. This duality of dopamine prevents a blanket interpretation of the implications of dopamine abnormalities for diseases on the basis of absolute dopamine levels. Moreover, the mechanisms underlying the mode-specific dopamine abnormalities are not clearly understood. Here, I show that the two modes of dopamine release in the prefrontal cortex of a schizophrenia-like model are disrupted by different mechanisms. In the schizophrenia-like model established by perinatal exposure to inflammatory cytokine, epidermal growth factor, tonic release was enhanced and phasic release was decreased in the prefrontal cortex. I examined the activity of dopamine neurons in the ventral tegmental area (VTA), which sends dopamine projections to the prefrontal cortex, under anaesthesia. The activation of VTA dopamine neurons during excitatory stimulation (local application of glutamate or N-methyl-d-aspartic acid [NMDA]), which is associated with phasic activity, was blunt in this model. Dopaminergic neuronal activity in the resting state related to tonic release was increased by disinhibition of the dopamine neurons due to the impairment of 5HT2 (5HT2A) receptor-regulated GABAergic inputs. Moreover, chronic administration of risperidone ameliorated this disinhibition of dopaminergic neurons. These results provide an idea about the mechanism of dopamine disturbance in schizophrenia and may be informative in explaining the effects of atypical antipsychotics as distinct from those of typical drugs.

Dorsal raphe stimulation relays a reward signal to the ventral tegmental area via GluN2C NMDA receptors

BACKGROUND

Glutamate relays a reward signal from the dorsal raphe (DR) to the ventral tegmental area (VTA). However, the role of the different subtypes of N-methyl-D-aspartate (NMDA) receptors is complex and not clearly understood. Therefore, we measured NMDA receptors subunits expression in limbic brain areas. In addition, we studied the effects of VTA down-regulation of GluN2C NMDA receptor on the reward signal that arises from DR electrical stimulation.

METHODS

Using qPCR, we identified the relative composition of the different Grin2a-d subunits of the NMDA receptors in several brain areas. Then, we used fluorescent in situ hybridization (FISH) to evaluate the colocalization of Grin2c and tyrosine hydroxylase (TH) mRNA in VTA neurons. To assess the role of GluN2C in brain stimulation reward, we downregulated this receptor using small interfering RNA (siRNA) in rats self-stimulating for electrical pulses delivered to the DR. To delineate further the specific role of GluN2C in relaying the reward signal, we pharmacologically altered the function of VTA NMDA receptors by bilaterally microinjecting the NMDA receptor antagonist PPPA.

RESULTS

We identified GluN2C as the most abundant subunit of the NMDA receptor expressed in the VTA. FISH revealed that about 50% of TH-positive neurons colocalize with Grin2c transcript. siRNA manipulation produced a selective down-regulation of the GluN2C protein subunit and a significant reduction in brain stimulation reward. Interestingly, PPPA enhanced brain stimulation reward, but only in rats that received the nonactive RNA sequence.

CONCLUSION

The present results suggest that VTA glutamate neurotransmission relays a reward signal initiated by DR stimulation by acting on GluN2C NMDA receptors.

Cell specific single viral vector CRISPR/Cas9 editing and genetically encoded tool delivery in the central and peripheral nervous systems

Gene manipulation strategies using germline knockout, conditional knockout, and more recently CRISPR/Cas9 are crucial tools for advancing our understanding of the nervous system. However, traditional gene knockout approaches can be costly and time consuming, may lack cell-type specificity, and can induce germline recombination. Viral gene editing presents and an exciting alternative to more rapidly study genes of unknown function; however, current strategies to also manipulate or visualize edited cells are challenging due to the large size of Cas9 proteins and the limited packaging capacity of adeno-associated viruses (AAVs). To overcome these constraints, we have developed an alternative gene editing strategy using a single AAV vector and mouse lines that express Cre-dependent Cas9 to achieve efficient cell-type specific editing across the nervous system. Expressing Cre-dependent Cas9 in specific cell types in transgenic mouse lines affords more space to package guide RNAs for gene editing together with Cre-dependent, genetically encoded tools to manipulate, map, or monitor neurons using a single virus. We validated this strategy with three commonly used tools in neuroscience: ChRonos, a channelrhodopsin, for manipulating synaptic transmission using optogenetics; GCaMP8f for recording Ca2+ transients using fiber photometry, and mCherry for anatomical tracing of axonal projections. We tested these tools in multiple brain regions and cell types, including GABAergic neurons in the nucleus accumbens (NAc), glutamatergic neurons projecting from the ventral pallidum (VP) to the lateral habenula (LHb), dopaminergic neurons in the ventral tegmental area (VTA), and parvalbumin (PV)-positive proprioceptive neurons in the periphery. This flexible approach should be useful to identify novel genes that affect synaptic transmission, circuit activity, or morphology with a single viral injection.

Cellular bases for reward-related dopamine actions

Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.

Mesolimbic dopamine adapts the rate of learning from action

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions^1-3. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction⁴; however, so far there has been little consideration of how direct policy learning might inform our understanding⁵. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning⁶.

An action potential initiation mechanism in distal axons for the control of dopamine release

Information flow in neurons proceeds by integrating inputs in dendrites, generating action potentials near the soma, and releasing neurotransmitters from nerve terminals in the axon. We found that in the striatum, acetylcholine-releasing neurons induce action potential firing in distal dopamine axons. Spontaneous activity of cholinergic neurons produced dopamine release that extended beyond acetylcholine-signaling domains, and traveling action potentials were readily recorded from dopamine axons in response to cholinergic activation. In freely moving mice, dopamine and acetylcholine covaried with movement direction. Local inhibition of nicotinic acetylcholine receptors impaired dopamine dynamics and affected movement. Our findings uncover an endogenous mechanism for action potential initiation independent of somatodendritic integration and establish that this mechanism segregates the control of dopamine signaling between axons and somata.

Dissociable contributions of phasic dopamine activity to reward and prediction

Sensory cues that precede reward acquire predictive (expected value) and incentive (drive reward-seeking action) properties. Mesolimbic dopamine neurons' responses to sensory cues correlate with both expected value and reward-seeking action. This has led to the proposal that phasic dopamine responses may be sufficient to inform value-based decisions, elicit actions, and/or induce motivational states; however, causal tests are incomplete. Here, we show that direct dopamine neuron stimulation, both calibrated to physiological and greater intensities, at the time of reward can be sufficient to induce and maintain reward seeking (reinforcing) although replacement of a cue with stimulation is insufficient to induce reward seeking or act as an informative cue. Stimulation of descending cortical inputs, one synapse upstream, are sufficient for reinforcement and cues to future reward. Thus, physiological activation of mesolimbic dopamine neurons can be sufficient for reinforcing properties of reward without being sufficient for the predictive and incentive properties of cues.

Spatial and temporal scales of dopamine transmission

Dopamine is a prototypical neuromodulator that controls circuit function through G protein-coupled receptor signalling. Neuromodulators are volume transmitters, with release followed by diffusion for widespread receptor activation on many target cells. Yet, we are only beginning to understand the specific organization of dopamine transmission in space and time. Although some roles of dopamine are mediated by slow and diffuse signalling, recent studies suggest that certain dopamine functions necessitate spatiotemporal precision. Here, we review the literature describing dopamine signalling in the striatum, including its release mechanisms and receptor organization. We then propose the domain-overlap model, in which release and receptors are arranged relative to one another in micrometre-scale structures. This architecture is different from both point-to-point synaptic transmission and the widespread organization that is often proposed for neuromodulation. It enables the activation of receptor subsets that are within micrometre-scale domains of release sites during baseline activity and broader receptor activation with domain overlap when firing is synchronized across dopamine neuron populations. This signalling structure, together with the properties of dopamine release, may explain how switches in firing modes support broad and dynamic roles for dopamine and may lead to distinct pathway modulation.

Serotonergic inhibition of responding for conditioned but not primary reinforcers

Serotonin is widely implicated as a modulator of brain reward function. However, laboratory studies have not yielded a consensus on which specific reward-related processes are influenced by serotonin and in what manner. Here we explored the role of serotonin in cue-reward learning in mice. In a first series of experiments, we found that acute administration of the serotonin reuptake inhibitors citalopram, fluoxetine, or duloxetine all reduced lever pressing reinforced on an FR1 schedule with presentation of a cue that had been previously paired with delivery of food. However, citalopram had no effect on responding that was reinforced with both cue and food on an FR1 schedule. Furthermore, citalopram did not affect nose poke responses that produced no auditory, visual, or proprioceptive cues but were reinforced with food pellets on a progressive ratio schedule. We next performed region-specific knock out of tryptophan hydroxylase-2 (Tph2), the rate-limiting enzyme in serotonin synthesis. Viral delivery of Cre recombinase was targeted to dorsal or median raphe nuclei (DRN, MRN), the major sources of ascending serotonergic projections. MRN but not DRN knockouts were impaired in development of cue-elicited approach during Pavlovian conditioning; both groups were subsequently hyper-responsive when lever pressing for cue presentation. The inhibitory effect of citalopram was attenuated in DRN but not MRN knockouts. Our findings are in agreement with prior studies showing serotonin to suppress responding for conditioned reinforcers. Furthermore, these results suggest an inhibitory role of MRN serotonin neurons in the initial attribution of motivational properties to a reward-predictive cue, but not in its subsequent maintenance. In contrast, the DRN appears to promote the reduction of motivational value attached to a cue when it is presented repeatedly in the absence of primary reward.

Neurobiology of reward-related learning

A major goal in psychology is to understand how environmental stimuli associated with primary rewards come to function as conditioned stimuli, acquiring the capacity to elicit similar responses to those elicited by primary rewards. Our neurobiological model is predicated on the Hebbian idea that concurrent synaptic activity on the primary reward neural substrate-proposed to be ventral tegmental area (VTA) dopamine (DA) neurons-strengthens the synapses involved. We propose that VTA DA neurons receive both a strong unconditioned stimulus signal (acetylcholine stimulation of DA cells) from the primary reward capable of unconditionally activating DA cells and a weak stimulus signal (glutamate stimulation of DA cells) from the neutral stimulus. Through joint stimulation the weak signal is potentiated and capable of activating the VTA DA cells, eliciting a conditioned response. The learning occurs when this joint stimulation initiates intracellular second-messenger cascades resulting in enhanced glutamate-DA synapses. In this review we present evidence that led us to propose this model and the most recent evidence supporting it.

Dopamine and Addiction

Addiction is commonly identified with habitual nonmedical self-administration of drugs. It is usually defined by characteristics of intoxication or by characteristics of withdrawal symptoms. Such addictions can also be defined in terms of the brain mechanisms they activate; most addictive drugs cause elevations in extracellular levels of the neurotransmitter dopamine. Animals unable to synthesize or use dopamine lack the conditioned reflexes discussed by Pavlov or the appetitive behavior discussed by Craig; they have only unconditioned consummatory reflexes. Burst discharges (phasic firing) of dopamine-containing neurons are necessary to establish long-term memories associating predictive stimuli with rewards and punishers. Independent discharges of dopamine neurons (tonic or pacemaker firing) determine the motivation to respond to such cues. As a result of habitual intake of addictive drugs, dopamine receptors expressed in the brain are decreased, thereby reducing interest in activities not already stamped in by habitual rewards.

Hippocampal Hyperactivity as a Druggable Circuit-Level Origin of Aberrant Salience in Schizophrenia

The development of current neuroleptics was largely aiming to decrease excessive dopaminergic signaling in the striatum. However, the notion that abnormal dopamine creates psychotic symptoms by causing an aberrant assignment of salience that drives maladaptive learning chronically during disease development suggests a therapeutic value of early interventions that correct salience-related neural processing. The mesolimbic dopaminergic output is modulated by several interconnected brain-wide circuits centrally involving the hippocampus and key relays like the ventral and associative striatum, ventral pallidum, amygdala, bed nucleus of the stria terminalis, nucleus reuniens, lateral and medial septum, prefrontal and cingulate cortex, among others. Unraveling the causal relationships between these circuits using modern neuroscience techniques holds promise for identifying novel cellular-and ultimately molecular-treatment targets for reducing transition to psychosis and symptoms of schizophrenia. Imaging studies in humans have implicated a hyperactivity of the hippocampus as a robust and early endophenotype in schizophrenia. Experiments in rodents, in turn, suggested that the activity of its output region-the ventral subiculum-may modulate dopamine release from ventral tegmental area (VTA) neurons in the ventral striatum. Even though these observations suggested a novel circuit-level target for anti-psychotic action, no therapy has yet been developed along this rationale. Recently evaluated treatment strategies-at least in part-target excess glutamatergic activity, e.g. N-acetyl-cysteine (NAC), levetiracetam, and mGluR2/3 modulators. We here review the evidence for the central implication of the hippocampus-VTA axis in schizophrenia-related pathology, discuss its symptom-related implications with a particular focus on aberrant assignment of salience, and evaluate some of its short-comings and prospects for drug discovery.

A Gut Feeling about Dopamine

In this issue of Neuron, Fernandes et al. (2020) compare intra-gastric sugar and non-caloric sweetener to investigate how post-ingestive effects can be reinforcing, revealing a role for the hepatic vagus nerve in transforming sugar sensing by the gut into behavioral reinforcement via midbrain dopamine neuron responses.

Anatomic resolution of neurotransmitter-specific projections to the VTA reveals diversity of GABAergic inputs

The ventral tegmental area (VTA) is important for reward processing and motivation. The anatomic organization of neurotransmitter-specific inputs to the VTA remains poorly resolved. In the present study, we mapped the major neurotransmitter projections to the VTA through cell-type-specific retrograde and anterograde tracing. We found that glutamatergic inputs arose from a variety of sources and displayed some connectivity biases toward specific VTA cell types. The sources of GABAergic projections were more widespread, displayed a high degree of differential innervation of subregions in the VTA and were largely biased toward synaptic contact with local GABA neurons. Inactivation of GABA release from the two major sources, locally derived versus distally derived, revealed distinct roles for these projections in behavioral regulation. Optogenetic manipulation of individual distal GABAergic inputs also revealed differential behavioral effects. These results demonstrate that GABAergic projections to the VTA are a major contributor to the regulation and diversification of the structure.

Postingestive Modulation of Food Seeking Depends on Vagus-Mediated Dopamine Neuron Activity

Postingestive nutrient sensing can induce food preferences. However, much less is known about the ability of postingestive signals to modulate food-seeking behaviors. Here we report a causal connection between postingestive sucrose sensing and vagus-mediated dopamine neuron activity in the ventral tegmental area (VTA), supporting food seeking. The activity of VTA dopamine neurons increases significantly after administration of intragastric sucrose, and deletion of the NMDA receptor in these neurons, which affects bursting and plasticity, abolishes lever pressing for postingestive sucrose delivery. Furthermore, lesions of the hepatic branch of the vagus nerve significantly impair postingestive-dependent VTA dopamine neuron activity and food seeking, whereas optogenetic stimulation of left vagus nerve neurons significantly increases VTA dopamine neuron activity. These data establish a necessary role of vagus-mediated dopamine neuron activity in postingestive-dependent food seeking, which is independent of taste signaling.

Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.

Synergy of Distinct Dopamine Projection Populations in Behavioral Reinforcement

Dopamine neurons of the ventral tegmental area (VTA) regulate reward association and motivation. It remains unclear whether there are distinct dopamine populations to mediate these functions. Using mouse genetics, we isolated two populations of dopamine-producing VTA neurons with divergent projections to the nucleus accumbens (NAc) core and shell. Inhibition of VTA-core-projecting neurons disrupted Pavlovian reward learning, and activation of these cells promoted the acquisition of an instrumental response. VTA-shell-projecting neurons did not regulate Pavlovian reward learning and could not facilitate acquisition of an instrumental response, but their activation could drive robust responding in a previously learned instrumental task. Both populations are activated simultaneously by cues, actions, and rewards, and this co-activation is required for robust reinforcement of behavior. Thus, there are functionally distinct dopamine populations in the VTA for promoting motivation and reward association, which operate on the same timescale to optimize behavioral reinforcement.

Differential regulation of phasic dopamine release in the forebrain by the VTA noradrenergic receptor signaling

Phasic dopamine (DA) release from the ventral tegmental area (VTA) into forebrain structures is implicated in associative learning and conditional stimulus (CS)-evoked behavioral responses. Mounting evidence points to noradrenaline signaling in the VTA as an important regulatory input. Accordingly, adrenergic receptor (AR) blockade in the VTA has been shown to modulate CS-dependent behaviors. Here, we hypothesized that α₁ - and α₂ -AR (but not β-AR) activity preferentially modulates phasic, in contrast to tonic, DA release. In addition, these effects could differ between forebrain targets. We used fast-scan cyclic voltammetric measurements in rats to assess the effects of intra-VTA microinfusion of terazosin, a selective α₁ -AR antagonist, on electrically evoked phasic DA release in the nucleus accumbens (NAc) core and medial prefrontal cortex (mPFC). Terazosin dose-dependently attenuated phasic, but not tonic, DA release in the NAc core, but not in the mPFC. Next, we measured the effects of intra-VTA administration of the α₂ -AR selective antagonist RX-821002 on evoked DA in the NAc core. Similar to the effects of α₁ -AR blockade, intra-VTA α₂ -AR blockade with RX-0821002 strongly and dose-dependently attenuated phasic, but not tonic, DA release. In contrast, no regulation by RX-821002 was observed in the mPFC. This effect was sensitive to intra-VTA blockade of D2 receptors with raclopride. Finally, the β-AR antagonist propranolol ineffectively modulated DA release in the NAc core. These findings revealed both α₁ - and α₂ -ARs in the VTA as selective regulators of phasic DA release. Importantly, we demonstrated that AR blockade modulated mesolimbic, in contrast to mesocortical, DA release in previously unstudied heterogeneity in AR regulation of forebrain phasic DA.

NMDA receptor deletion on dopamine neurons disrupts visual discrimination and reversal learning

The dopamine (DA) system is critical for various forms of learning about salient environmental stimuli. Prior work has shown that deletion of the obligatory NR1 subunit of the N-methyl-_D-aspartate (NMDA) receptor on neurons expressing the DA transporter (DAT) in mice results in reduced phasic release from DA-containing neurons. To further investigate the contribution of phasic DA release to reward-related learning and cognitive flexibility, the current study evaluated DAT-NR1 null mutant mice in a touchscreen-based pairwise visual discrimination and reversal learning paradigm. Results showed that these mutants were slower to attain a high level of choice accuracy on the discrimination task, but showed improved late reversal performance on sessions where correct choice was above chance. A number of possible interpretations are offered for this pattern of effects, including the opposing possibilities that discrimination memory was either stronger by the completion of training (overtraining effect) or weaker (learning deficit), both of which could potentially produce faster reversal. These data add to the extensive literature ascribing a critical role for DAergic neurotransmission in cognitive functions and the regulation of reward-related behaviors of relevance to addictions.

Ablation of NMDA receptors in dopamine neurons disrupts attribution of incentive salience to reward-paired stimuli

Midbrain dopamine (DA) neurons play a crucial role in the formation of conditioned associations between environmental cues and appetitive events. Activation of N-methyl-d-aspartate (NMDA) receptors is a key mechanism responsible for the generation of conditioned responses of DA neurons to reward cues. Here, we tested the effects of the cell type-specific inactivation of NMDA receptors in DA neurons in adult mice on stimulus-reward learning. Animals were trained in a Pavlovian learning paradigm in which they had to learn the predictive value of two conditioned stimuli, one of which (CS+) was paired with the delivery of a water reward. Over the course of conditioning, mutant mice learned that the CS+ predicted reward availability, and they approached the reward receptacle more frequently during CS+ trials than CS- trials. However, conditioned responses to the CS+ were weaker in the mutant mice, possibly indicating that they did not attribute incentive salience to the CS+. To further assess whether the attribution of incentive salience was impaired by the mutation, animals were tested in a conditioned reinforcement test. The test revealed that mutant mice made fewer instrumental responses paired with CS+ presentation, confirming that the CS+ had a weaker incentive value. Taken together, these results indicate that reward prediction learning does occur in the absence of NMDA receptors in DA neurons, but the ability of reward-paired cues to invigorate and reinforce behavior is attenuated.

Contributions of nucleus accumbens dopamine to cognitive flexibility

There is a compelling evidence that midbrain dopamine (DA) neurons and their projections to the ventral striatum provide a mechanism for motivating reward-seeking behavior, and for utilizing information about unexpected reward prediction errors (RPEs) to guide behavior based on current, rather than historical, outcomes. When this mechanism is compromised in addictions, it may produce patterns of maladaptive behavior that remain obdurate in the face of contrary information and even adverse consequences. Nonetheless, DAergic contributions to performance on behavioral tasks that rely on the ability to flexibly update stimulus-reward relationships remains incompletly understood. In the current study, we used a discrimination and reversal paradigm to monitor subsecond DA release in mouse NAc core (NAc) using in vivo fast-scan cyclic voltammetry (FSCV). We observed post-choice elevations in phasic NAc DA release; however, increased DA transients were only evident during early reversal when mice made responses at the newly rewarded stimulus. Based on this finding, we used in vivo optogenetic (eNpHR) photosilencing and (Channelrhodopsin2 [ChR2]) photostimulation to assess the effects of manipulating VTA-DAergic fibers in the NAc on reversal performance. Photosilencing the VTA → NAc DAergic pathway during early reversal increased errors, while photostimulation did not demonstrably affect behavior. Taken together, these data provide additional evidence of the importance of NAc DA release as a neural substrate supporting adjustments in learned behavior after a switch in expected stimulus-reward contingencies. These findings have possible implications for furthering understanding the role of DA in persistent, maladaptive decision-making characterizing addictions.

Selective Effects of the Loss of NMDA or mGluR5 Receptors in the Reward System on Adaptive Decision-Making

Selecting the most advantageous actions in a changing environment is a central feature of adaptive behavior. The midbrain dopamine (DA) neurons along with the major targets of their projections, including dopaminoceptive neurons in the frontal cortex and basal ganglia, play a key role in this process. Here, we investigate the consequences of a selective genetic disruption of NMDA receptor and metabotropic glutamate receptor 5 (mGluR5) in the DA system on adaptive choice behavior in mice. We tested the effects of the mutation on performance in the probabilistic reinforcement learning and probability-discounting tasks. In case of the probabilistic choice, both the loss of NMDA receptors in dopaminergic neurons or the loss mGluR5 receptors in D1 receptor-expressing dopaminoceptive neurons reduced the probability of selecting the more rewarded alternative and lowered the likelihood of returning to the previously rewarded alternative (win-stay). When observed behavior was fitted to reinforcement learning models, we found that these two mutations were associated with a reduced effect of the expected outcome on choice (i.e., more random choices). None of the mutations affected probability discounting, which indicates that all animals had a normal ability to assess probability. However, in both behavioral tasks animals with targeted loss of NMDA receptors in dopaminergic neurons or mGluR5 receptors in D1 neurons were significantly slower to perform choices. In conclusion, these results show that glutamate receptor-dependent signaling in the DA system is essential for the speed and accuracy of choices, but at the same time probably is not critical for correct estimation of probable outcomes.

Genetic inhibition of neurotransmission reveals role of glutamatergic input to dopamine neurons in high-effort behavior

Midbrain dopamine neurons are crucial for many behavioral and cognitive functions. As the major excitatory input, glutamatergic afferents are important for control of the activity and plasticity of dopamine neurons. However, the role of glutamatergic input as a whole onto dopamine neurons remains unclear. Here we developed a mouse line in which glutamatergic inputs onto dopamine neurons are specifically impaired, and utilized this genetic model to directly test the role of glutamatergic inputs in dopamine-related functions. We found that while motor coordination and reward learning were largely unchanged, these animals showed prominent deficits in effort-related behavioral tasks. These results provide genetic evidence that glutamatergic transmission onto dopaminergic neurons underlies incentive motivation, a willingness to exert high levels of effort to obtain reinforcers, and have important implications for understanding the normal function of the midbrain dopamine system.

Inhibiting Mesolimbic Dopamine Neurons Reduces the Initiation and Maintenance of Instrumental Responding

Mesolimbic dopamine perturbations modulate performance of reward-seeking behavior, with tasks requiring high effort being especially vulnerable to disruption of dopamine signaling. Previous work primarily investigated long-term perturbations such as receptor antagonism and dopamine depletion, which constrain the ability to assess dopamine contributions to effort expenditure in isolation from other behavior events, such as reward consumption. Also unclear is if dopamine is required for both initiation and maintenance when a sequence of multiple instrumental responses is required. Here we used optogenetic inhibition of midbrain TH+  neurons to probe the role of dopamine neuron activity during instrumental responding for reward by varying the time epoch of neural inhibition relative to the time of response initiation. Within a fixed-ratio procedure, requiring eight nosepoke responses per reinforcer delivery, or a progressive ratio (PR) procedure, in which within-session response requirements increased exponentially, inhibiting dopamine neurons while mice were engaged in response bouts decreased the probability of continued responding. If inhibition occurred during each attempted bout, the effect was to decrease total responses, and thus amount of rewards earned, over a session. In contrast, if inhibition was applied only during some bouts, mice increased the number of bouts initiated to earn control levels of reward. Inhibiting dopamine neurons while mice were not responding decreased the probability of initiating an instrumental response but had no effect on the amount of effort exerted over the entire session. We conclude that midbrain dopamine signaling promotes initiation of instrumental responding and maintains motivation to continue ongoing bouts of effortful responses.

Neurogranin in the nucleus accumbens regulates NMDA receptor tolerance and motivation for ethanol seeking

Dysfunction of N-methyl-d-aspartate receptor (NMDAR) signaling in the nucleus accumbens (NAc) has been implicated in the pathophysiology of alcohol use disorders (AUD). Neurogranin (Ng), a calmodulin-binding protein, is exclusively expressed in the post-synapse, and mediates NMDAR driven synaptic plasticity by regulating the calcium-calmodulin (Ca²⁺-CaM) pathway. To study the functional role of Ng in AUD, we administrated behavior tests including Pavlovian instrument transfer (PIT), operant conditioning, and rotarod test using Ng null mice (Ng^-/- mice). We used adeno-associated virus (AAV)-mediated Ng expression and pharmacological manipulation to validate behavioral responses in Ng^-/- mice. The results from our multidisciplinary approaches demonstrated that deficit of Ng increases tolerance to NMDAR inhibition and elicit faster cue reactivity during PIT without changes in ethanol reward. Operant conditioning results demonstrated that Ng^-/- mice self-administered significantly more ethanol and displayed reduced sensitivity to aversive motivation. We identified that ethanol exposure decreases mGluR5 (metabotropic glutamate receptor 5) expression in the NAc of Ng^-/- mice and pharmacological inhibition of mGluR5 reverses NMDAR desensitization in Ng^-/- mice. Together these findings specifically suggest that accumbal Ng plays an essential role in the counterbalance between NMDAR and mGluR5 signaling; which alters NMDAR resistance, and thereby altering aversive motivation for ethanol and may ultimately contribute to susceptibility for alcohol addiction.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with "motivational value" or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.

Emergence of visually-evoked reward expectation signals in dopamine neurons via the superior colliculus in V1 lesioned monkeys

Responses of midbrain dopamine (DA) neurons reflecting expected reward from sensory cues are critical for reward-based associative learning. However, critical pathways by which reward-related visual information is relayed to DA neurons remain unclear. To address this question, we investigated Pavlovian conditioning in macaque monkeys with unilateral primary visual cortex (V1) lesions (an animal model of ‘blindsight’). Anticipatory licking responses to obtain juice drops were elicited in response to visual conditioned stimuli (CS) in the affected visual field. Subsequent pharmacological inactivation of the superior colliculus (SC) suppressed the anticipatory licking. Concurrent single unit recordings indicated that DA responses reflecting the reward expectation could be recorded in the absence of V1, and that these responses were also suppressed by SC inactivation. These results indicate that the subcortical visual circuit can relay reward-predicting visual information to DA neurons and integrity of the SC is necessary for visually-elicited classically conditioned responses after V1 lesion.

DOI:http://dx.doi.org/10.7554/eLife.24459.001

To survive and thrive, animals must learn to approach cues in their environment that are likely to lead to a desirable outcome and avoid those that might lead them to harm. A group of brain regions known as the midbrain dopamine system helps many animals to achieve this. Dopamine is the brain’s reward signal. Cues that predict rewards, such as the sight or smell of food, activate midbrain dopamine neurons. However, the details of this process remained unclear.

Takakuwa et al. have now examined how visual information that signals reward reaches the midbrain dopamine neurons. The anatomy of the visual system suggests two main possibilities. Information may travel directly from the eyes to an area of the midbrain called the superior colliculus, and then onto the dopamine neurons. Alternatively, information may travel to the midbrain indirectly via a pathway that includes additional processing in the brain’s outer layer, the visual cortex.

To distinguish between these routes, Takakuwa et al. studied monkeys in which the indirect pathway via the visual cortex had been damaged. Some people with damage to this pathway have a disorder called blindsight. They are able to detect the movement or location of stimuli, but they cannot consciously see those stimuli. The monkeys with damage to visual cortex were able to learn that an image on a screen predicted the delivery of fruit juice. After repeated trials, the monkeys began to lick the spout dispensing the juice whenever the image appeared, even if no juice was delivered. The monkeys’ midbrain dopamine neurons also sent more signals in response to the images, and showed greater activity when the images predicted large rewards than small ones. Takakuwa et al. next inactivated the superior colliculus with a drug and showed that this prevented both the licking behavior and the increased signaling.

Together the findings show that visual information about potential rewards can reach midbrain dopamine neurons via a direct route through the superior colliculus, without needing to pass via the visual cortex. The next step is to determine how and when the visual cortex may get involved in this process to help animals maximize rewards.

DOI:http://dx.doi.org/10.7554/eLife.24459.002

Contrasting Regulation of Catecholamine Neurotransmission in the Behaving Brain: Pharmacological Insights from an Electrochemical Perspective

Catecholamine neurotransmission plays a key role in regulating a variety of behavioral and physiologic processes, and its dysregulation is implicated in both neurodegenerative and neuropsychiatric disorders. Over the last four decades, in vivo electrochemistry has enabled the discovery of contrasting catecholamine regulation in the brain. These rapid and spatially resolved measurements have been conducted in brain slices, and in anesthetized and freely behaving animals. In this review, we describe the methods enabling in vivo measurements of dopamine and norepinephrine, and subsequent findings regarding their release and regulation in intact animals. We thereafter discuss key studies in awake animals, demonstrating that these catecholamines are not only differentially regulated, but are released in opposition of each other during appetitive and aversive stimuli.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.

Pontomesencephalic Tegmental Afferents to VTA Non-dopamine Neurons Are Necessary for Appetitive Pavlovian Learning

The ventral tegmental area (VTA) receives phenotypically distinct innervations from the pedunculopontine tegmental nucleus (PPTg). While PPTg-to-VTA inputs are thought to play a critical role in stimulus-reward learning, direct evidence linking PPTg-to-VTA phenotypically distinct inputs in the learning process remains lacking. Here, we used optogenetic approaches to investigate the functional contribution of PPTg excitatory and inhibitory inputs to the VTA in appetitive Pavlovian conditioning. We show that photoinhibition of PPTg-to-VTA cholinergic or glutamatergic inputs during cue presentation dampens the development of anticipatory approach responding to the food receptacle during the cue. Furthermore, we employed in vivo optetrode recordings to show that photoinhibition of PPTg cholinergic or glutamatergic inputs significantly decreases VTA non-dopamine (non-DA) neural activity. Consistently, photoinhibition of VTA non-DA neurons disrupts the development of cue-elicited anticipatory approach responding. Taken together, our study reveals a crucial regulatory mechanism by PPTg excitatory inputs onto VTA non-DA neurons during appetitive Pavlovian conditioning.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Reappraising striatal D1- and D2-neurons in reward and aversion

The striatum has been involved in complex behaviors such as motor control, learning, decision-making, reward and aversion. The striatum is mainly composed of medium spiny neurons (MSNs), typically divided into those expressing dopamine receptor D1, forming the so-called direct pathway, and those expressing D2 receptor (indirect pathway). For decades it has been proposed that these two populations exhibit opposing control over motor output, and recently, the same dichotomy has been proposed for valenced behaviors. Whereas D1-MSNs mediate reinforcement and reward, D2-MSNs have been associated with punishment and aversion. In this review we will discuss pharmacological, genetic and optogenetic studies that indicate that there is still controversy to what concerns the role of striatal D1- and D2-MSNs in this type of behaviors, highlighting the need to reconsider the early view that they mediate solely opposing aspects of valenced behaviour.

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.

Failure of Standard Training Sets in the Analysis of Fast-Scan Cyclic Voltammetry Data

The use of principal component regression, a multivariate calibration method, in the analysis of in vivo fast-scan cyclic voltammetry data allows for separation of overlapping signal contributions, permitting evaluation of the temporal dynamics of multiple neurotransmitters simultaneously. To accomplish this, the technique relies on information about current-concentration relationships across the scan-potential window gained from analysis of training sets. The ability of the constructed models to resolve analytes depends critically on the quality of these data. Recently, the use of standard training sets obtained under conditions other than those of the experimental data collection (e.g., with different electrodes, animals, or equipment) has been reported. This study evaluates the analyte resolution capabilities of models constructed using this approach from both a theoretical and experimental viewpoint. A detailed discussion of the theory of principal component regression is provided to inform this discussion. The findings demonstrate that the use of standard training sets leads to misassignment of the current-concentration relationships across the scan-potential window. This directly results in poor analyte resolution and, consequently, inaccurate quantitation, which may lead to erroneous conclusions being drawn from experimental data. Thus, it is strongly advocated that training sets be obtained under the experimental conditions to allow for accurate data analysis.

N-methyl-D-aspartate receptors in the ventral tegmental area mediate the excitatory influence of Pavlovian stimuli on instrumental performance

Pavlovian stimuli predictive of food can markedly amplify instrumental responding for food. This effect is termed Pavlovian-instrumental transfer (PIT). The ventral tegmental area (VTA) plays a key role in mediating PIT, however, it is yet unknown whether N-methyl-D-aspartate (NMDA)-type glutamate receptors in the VTA are involved in PIT. Here, we examined the effects of an NMDA-receptor blockade in the VTA on PIT. Immediately prior to PIT testing, rats were subjected to intra-VTA infusions of vehicle or of the NMDA-receptor antagonist 2-amino-5-phosphonopentanoic acid (AP-5) (1, 5 µg/side). In rats that received AP-5 at the lower dose, the PIT effect was intact, i.e. presentation of the Pavlovian stimulus enhanced instrumental responding. By contrast, in rats that received AP-5 at the higher dose, the PIT effect was blocked. The data suggest that NMDA receptors in the VTA mediate the activating effects of Pavlovian stimuli on instrumental responding.

Construction of Training Sets for Valid Calibration of in Vivo Cyclic Voltammetric Data by Principal Component Analysis

Principal component regression, a multivariate calibration technique, is an invaluable tool for the analysis of voltammetric data collected in vivo with acutely implanted microelectrodes. This method utilizes training sets to separate cyclic voltammograms into contributions from multiple electroactive species. The introduction of chronically implanted microelectrodes permits longitudinal measurements at the same electrode and brain location over multiple recordings. The reliability of these measurements depends on a consistent calibration methodology. One published approach has been the use of training sets built with data from separate electrodes and animals to evaluate neurochemical signals in multiple subjects. Alternatively, responses to unpredicted rewards have been used to generate calibration data. This study addresses these approaches using voltammetric data from three different experiments in freely moving rats obtained with acutely implanted microelectrodes. The findings demonstrate critical issues arising from the misuse of principal component regression that result in significant underestimates of concentrations and improper statistical model validation that, in turn, can lead to inaccurate data interpretation. Therefore, the calibration methodology for chronically implanted microelectrodes needs to be revisited and improved before measurements can be considered reliable.

Neuronal Reward and Decision Signals: From Theories to Data

Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

Compromised NMDA/Glutamate Receptor Expression in Dopaminergic Neurons Impairs Instrumental Learning, But Not Pavlovian Goal Tracking or Sign Tracking

Behavior is shaped to a dramatic degree by the occurrence of rewards, through both pavlovian and instrumental conditioning processes; these mechanisms give rise to both normal and abnormal behavior. It is crucial to understand the neural mechanisms that give rise to normal actions and how they lead to pathological behaviors, such as overeating and drug addictions.

Two theories regarding the role for dopamine neurons in learning include the concepts that their activity serves as a (1) mechanism that confers incentive salience onto rewards and associated cues and/or (2) contingency teaching signal reflecting reward prediction error. While both theories are provocative, the causal role for dopamine cell activity in either mechanism remains controversial. In this study mice that either fully or partially lacked NMDARs in dopamine neurons exclusively, as well as appropriate controls, were evaluated for reward-related learning; this experimental design allowed for a test of the premise that NMDA/glutamate receptor (NMDAR)-mediated mechanisms in dopamine neurons, including NMDA-dependent regulation of phasic discharge activity of these cells, modulate either the instrumental learning processes or the likelihood of pavlovian cues to become highly motivating incentive stimuli that directly attract behavior. Loss of NMDARs in dopamine neurons did not significantly affect baseline dopamine utilization in the striatum, novelty evoked locomotor behavior, or consumption of a freely available, palatable food solution. On the other hand, animals lacking NMDARs in dopamine cells exhibited a selective reduction in reinforced lever responses that emerged over the course of instrumental learning. Loss of receptor expression did not, however, influence the likelihood of an animal acquiring a pavlovian conditional response associated with attribution of incentive salience to reward-paired cues (sign tracking). These data support the view that reductions in NMDAR signaling in dopamine neurons affect instrumental reward-related learning but do not lend support to hypotheses that suggest that the behavioral significance of this signaling includes incentive salience attribution.

Central role for the insular cortex in mediating conditioned responses to anticipatory cues

Reward-related circuits are fundamental for initiating feeding on the basis of food-predicting cues, whereas gustatory circuits are believed to be involved in the evaluation of food during consumption. However, accumulating evidence challenges such a rigid separation. The insular cortex (IC), an area largely studied in rodents for its role in taste processing, is involved in representing anticipatory cues. Although IC responses to anticipatory cues are well established, the role of IC cue-related activity in mediating feeding behaviors is poorly understood. Here, we examined the involvement of the IC in the expression of cue-triggered food approach in mice trained with a Pavlovian conditioning paradigm. We observed a significant change in neuronal firing during presentation of the cue. Pharmacological silencing of the IC inhibited food port approach. Such a behavior could be recapitulated by temporally selective inactivation during the cue. These findings represent the first evidence, to our knowledge, that cue-evoked neuronal activity in the mouse IC modulates behavioral output, and demonstrate a causal link between cue responses and feeding behaviors.

Sampling phasic dopamine signaling with fast-scan cyclic voltammetry in awake, behaving rats

Fast-scan cyclic voltammetry (FSCV) is an electrochemical technique that permits the in vivo measurement of extracellular fluctuations in multiple chemical species. The technique is frequently utilized to sample sub-second (phasic) concentration changes of the neurotransmitter dopamine in awake and behaving rats. Phasic dopamine signaling is implicated in reinforcement, goal-directed behavior, and locomotion, and FSCV has been used to investigate how rapid changes in striatal dopamine concentration contribute to these and other behaviors. This unit describes the instrumentation and construction, implantation, and use of components required to sample and analyze dopamine concentration changes in awake rats with FSCV.

Sustained N-methyl-d-aspartate receptor hypofunction remodels the dopamine system and impairs phasic signaling

Chronic N-methyl-d-aspartate receptor (NMDAR) hypofunction has been proposed as a contributing factor to symptoms of schizophrenia. However, it is unclear how sustained NMDAR hypofunction throughout development affects other neurotransmitter systems that have been implicated in the disease. Dopamine neuron biochemistry and activity were examined to determine whether sustained NMDAR hypofunction causes a state of hyperdopaminergia. We report that a global, genetic reduction in NMDARs led to a remodeling of dopamine neurons, substantially affecting two key regulators of dopamine homeostasis, i.e., tyrosine hydroxylase and the dopamine transporter. In NR1 knockdown mice, dopamine synthesis and release were attenuated, and dopamine clearance was increased. Although these changes would have the effect of reducing dopamine transmission, we demonstrated that a state of hyperdopaminergia existed in these mice because dopamine D2 autoreceptors were desensitized. In support of this conclusion, NR1 knockdown dopamine neurons have higher tonic firing rates. Although the tonic firing rates are higher, phasic signaling is impaired, and dopamine overflow cannot be achieved with exogenous high-frequency stimulation that models phasic firing. Through the examination of several parameters of dopamine neurotransmission, we provide evidence that chronic NMDAR hypofunction leads to a state of elevated synaptic dopamine. Compensatory mechanisms to attenuate hyperdopaminergia also impact the ability to generate dopamine surges through phasic firing.

Dopamine dependency for acquisition and performance of Pavlovian conditioned response

During Pavlovian conditioning, pairing of a neutral conditioned stimulus (CS) with a reward leads to conditioned reward-approach responses (CRs) that are elicited by presentation of the CS. CR behaviors can be sign tracking, in which animals engage the CS, or goal tracking, in which animals go to the reward location. We investigated CR behaviors in mice with only ∼5% of normal dopamine in the striatum using a Pavlovian conditioning paradigm. These mice had severely impaired acquisition of the CR, which was ameliorated by pharmacological restoration of dopamine synthesis with l-dopa. Surprisingly, after they had learned the CR, its expression decayed only gradually in following sessions that were conducted without l-dopa treatment. To assess specific contributions of dopamine signaling in the dorsal or ventral striatum, we performed virus-mediated restoration of dopamine synthesis in completely dopamine-deficient (DD) mice. Mice with dopamine signaling only in the dorsal striatum did not acquire a CR, whereas mice with dopamine signaling only in in the ventral striatum acquired a CR. The CR in mice with dopamine signaling only in the dorsal striatum was restored by subjecting the mice to instrumental training in which they had to interact with the CS to obtain rewards. We conclude that dopamine is essential for learning and performance of CR behavior that is predominantly goal tracking. Furthermore, although dopamine signaling in the ventral striatum is sufficient to support a CR, dopamine signaling only in the dorsal striatum can also support a CR under certain circumstances.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Ventral tegmental area α6β2 nicotinic acetylcholine receptors modulate phasic dopamine release in the nucleus accumbens core

RATIONALE

Phasic dopamine (DA) signaling underlies reward learning. Cholinergic and glutamatergic inputs into the ventral tegmental area (VTA) are crucial for modulating burst firing activity and subsequent phasic DA release in the nucleus accumbens (NAc), but the specific VTA nicotinic receptor subtypes that regulate phasic DA release have not been identified.

OBJECTIVE

The goal was to determine the role of VTA N-methyl-D-aspartate receptors (NMDARs) and specific subtypes of nicotinic acetylcholine receptors (nAChRs) in regulating phasic DA release in the NAc core.

METHODS

Fast-scan cyclic voltammetry in anesthetized rats was combined with intra-VTA micro-infusion to evaluate the ability of glutamatergic and cholinergic drugs to modulate stimulated phasic DA release in the NAc core.

RESULTS

VTA NMDAR blockade with AP-5 decreased, while VTA NMDAR activation with NMDA increased NAc peak phasic DA release. Intra-VTA administration of the nonspecific nAChR antagonist mecamylamine produced a persistent decrease in phasic DA release. Infusion of the α6-selective antagonist α-conotoxin MII (α-ctx MII) produced a robust, but transient decrease in phasic DA, whereas infusion of selective doses of either the α4β2-selective antagonist, dihydro-beta-erythroidine, or the α7 antagonist, methyllycaconitine, had no effect. Co-infusion of AP-5 and α-ctx MII produced a similar phasic DA decrease as either drug alone, with no additive effect.

CONCLUSIONS

The results suggest that VTA α6β2 nAChRs, but not α4β2 or α7 nAChRs, regulate phasic DA release in the NAc core and that VTA α6β2 nAChRs and NMDA receptors act at a common site or target to regulate NAc phasic DA signaling.

Genetic reconstruction of dopamine D1 receptor signaling in the nucleus accumbens facilitates natural and drug reward responses

The dopamine D1 receptor (D1R) facilitates reward acquisition and its alteration leads to profound learning deficits. However, its minimal functional circuit requirement is unknown. Using conditional reconstruction of functional D1R signaling in D1R knock-out mice, we define distinct requirements of D1R in subregions of the nucleus accumbens (NAc) for specific dimensions of reward. We demonstrate that D1R expression in the core region of the NAc (NAc(Core)), but not the shell (NAc(Shell)), enhances selectively a unique form of pavlovian conditioned approach and mediates D1R-dependent cocaine sensitization. However, D1R expression in either the NAc(Core) or the NAc(Shell) improves instrumental responding for reward. In contrast, neither NAc(Core) nor NAc(Shell) D1R is sufficient to promote motivation to work for reward in a progressive ratio task or for motor learning. These results highlight dissociated circuit requirements of D1R for dopamine-dependent behaviors.