Compromised NMDA/Glutamate Receptor Expression in Dopaminergic Neurons Impairs Instrumental Learning, But Not Pavlovian Goal Tracking or Sign Tracking

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

Neurobiology of reward-related learning

A major goal in psychology is to understand how environmental stimuli associated with primary rewards come to function as conditioned stimuli, acquiring the capacity to elicit similar responses to those elicited by primary rewards. Our neurobiological model is predicated on the Hebbian idea that concurrent synaptic activity on the primary reward neural substrate-proposed to be ventral tegmental area (VTA) dopamine (DA) neurons-strengthens the synapses involved. We propose that VTA DA neurons receive both a strong unconditioned stimulus signal (acetylcholine stimulation of DA cells) from the primary reward capable of unconditionally activating DA cells and a weak stimulus signal (glutamate stimulation of DA cells) from the neutral stimulus. Through joint stimulation the weak signal is potentiated and capable of activating the VTA DA cells, eliciting a conditioned response. The learning occurs when this joint stimulation initiates intracellular second-messenger cascades resulting in enhanced glutamate-DA synapses. In this review we present evidence that led us to propose this model and the most recent evidence supporting it.

Sex-dependent alterations in behavior, drug responses and dopamine transporter expression in heterozygous DAT-Cre mice

Heterozygous mice that express Cre-recombinase under the dopamine transporter promoter (DAT-Cre knock in mice, or KI) are widely used for targeting midbrain dopamine neurons, under the assumption that their constitutive physiology is not affected. We report here that these mice display striking sex-dependent behavioral and molecular differences in relation to wildtypes (WT). Male and female KI mice were constitutively hyperactive, and male KI mice showed attenuated hyperlocomotor responses to amphetamine. In contrast, female KIs displayed a marked reduction in locomotion ("calming" effect) in response to the same dose of amphetamine. Furthermore, male and female DAT-Cre KI mice showed opposing differences in reinforcement learning, with females showing faster conditioning and males showing slower extinction. Other behavioral variables, including working memory and novelty preference, were not changed compared to WT. These effects were paralleled by differences in striatal DAT expression that disproportionately affected female KI mice. Our findings reveal clear limitations of the DAT-Cre line that must be considered when using this model.

NMDA receptor deletion on dopamine neurons disrupts visual discrimination and reversal learning

The dopamine (DA) system is critical for various forms of learning about salient environmental stimuli. Prior work has shown that deletion of the obligatory NR1 subunit of the N-methyl-_D-aspartate (NMDA) receptor on neurons expressing the DA transporter (DAT) in mice results in reduced phasic release from DA-containing neurons. To further investigate the contribution of phasic DA release to reward-related learning and cognitive flexibility, the current study evaluated DAT-NR1 null mutant mice in a touchscreen-based pairwise visual discrimination and reversal learning paradigm. Results showed that these mutants were slower to attain a high level of choice accuracy on the discrimination task, but showed improved late reversal performance on sessions where correct choice was above chance. A number of possible interpretations are offered for this pattern of effects, including the opposing possibilities that discrimination memory was either stronger by the completion of training (overtraining effect) or weaker (learning deficit), both of which could potentially produce faster reversal. These data add to the extensive literature ascribing a critical role for DAergic neurotransmission in cognitive functions and the regulation of reward-related behaviors of relevance to addictions.

Ablation of NMDA receptors in dopamine neurons disrupts attribution of incentive salience to reward-paired stimuli

Midbrain dopamine (DA) neurons play a crucial role in the formation of conditioned associations between environmental cues and appetitive events. Activation of N-methyl-d-aspartate (NMDA) receptors is a key mechanism responsible for the generation of conditioned responses of DA neurons to reward cues. Here, we tested the effects of the cell type-specific inactivation of NMDA receptors in DA neurons in adult mice on stimulus-reward learning. Animals were trained in a Pavlovian learning paradigm in which they had to learn the predictive value of two conditioned stimuli, one of which (CS+) was paired with the delivery of a water reward. Over the course of conditioning, mutant mice learned that the CS+ predicted reward availability, and they approached the reward receptacle more frequently during CS+ trials than CS- trials. However, conditioned responses to the CS+ were weaker in the mutant mice, possibly indicating that they did not attribute incentive salience to the CS+. To further assess whether the attribution of incentive salience was impaired by the mutation, animals were tested in a conditioned reinforcement test. The test revealed that mutant mice made fewer instrumental responses paired with CS+ presentation, confirming that the CS+ had a weaker incentive value. Taken together, these results indicate that reward prediction learning does occur in the absence of NMDA receptors in DA neurons, but the ability of reward-paired cues to invigorate and reinforce behavior is attenuated.

Selective Effects of the Loss of NMDA or mGluR5 Receptors in the Reward System on Adaptive Decision-Making

Selecting the most advantageous actions in a changing environment is a central feature of adaptive behavior. The midbrain dopamine (DA) neurons along with the major targets of their projections, including dopaminoceptive neurons in the frontal cortex and basal ganglia, play a key role in this process. Here, we investigate the consequences of a selective genetic disruption of NMDA receptor and metabotropic glutamate receptor 5 (mGluR5) in the DA system on adaptive choice behavior in mice. We tested the effects of the mutation on performance in the probabilistic reinforcement learning and probability-discounting tasks. In case of the probabilistic choice, both the loss of NMDA receptors in dopaminergic neurons or the loss mGluR5 receptors in D1 receptor-expressing dopaminoceptive neurons reduced the probability of selecting the more rewarded alternative and lowered the likelihood of returning to the previously rewarded alternative (win-stay). When observed behavior was fitted to reinforcement learning models, we found that these two mutations were associated with a reduced effect of the expected outcome on choice (i.e., more random choices). None of the mutations affected probability discounting, which indicates that all animals had a normal ability to assess probability. However, in both behavioral tasks animals with targeted loss of NMDA receptors in dopaminergic neurons or mGluR5 receptors in D1 neurons were significantly slower to perform choices. In conclusion, these results show that glutamate receptor-dependent signaling in the DA system is essential for the speed and accuracy of choices, but at the same time probably is not critical for correct estimation of probable outcomes.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with "motivational value" or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.

Loss of NMDA receptors in dopamine neurons leads to the development of affective disorder-like symptoms in mice

The role of changes in dopamine neuronal activity during the development of symptoms in affective disorders remains controversial. Here, we show that inactivation of NMDA receptors on dopaminergic neurons in adult mice led to the development of affective disorder-like symptoms. The loss of NMDA receptors altered activity and caused complete NMDA-insensitivity in dopamine-like neurons. Mutant mice exhibited increased immobility in the forced swim test and a decrease in social interactions. Mutation also led to reduced saccharin intake, however the preference of sweet taste was not significantly decreased. Additionally, we found that while mutant mice were slower to learn instrumental tasks, they were able to reach the same performance levels, had normal sensitivity to feedback and showed similar motivation to exert effort as control animals. Taken together these results show that inducing the loss of NMDA receptor-dependent activity in dopamine neurons is associated with development of affective disorder-like symptoms.

Pontomesencephalic Tegmental Afferents to VTA Non-dopamine Neurons Are Necessary for Appetitive Pavlovian Learning

The ventral tegmental area (VTA) receives phenotypically distinct innervations from the pedunculopontine tegmental nucleus (PPTg). While PPTg-to-VTA inputs are thought to play a critical role in stimulus-reward learning, direct evidence linking PPTg-to-VTA phenotypically distinct inputs in the learning process remains lacking. Here, we used optogenetic approaches to investigate the functional contribution of PPTg excitatory and inhibitory inputs to the VTA in appetitive Pavlovian conditioning. We show that photoinhibition of PPTg-to-VTA cholinergic or glutamatergic inputs during cue presentation dampens the development of anticipatory approach responding to the food receptacle during the cue. Furthermore, we employed in vivo optetrode recordings to show that photoinhibition of PPTg cholinergic or glutamatergic inputs significantly decreases VTA non-dopamine (non-DA) neural activity. Consistently, photoinhibition of VTA non-DA neurons disrupts the development of cue-elicited anticipatory approach responding. Taken together, our study reveals a crucial regulatory mechanism by PPTg excitatory inputs onto VTA non-DA neurons during appetitive Pavlovian conditioning.