A food-associated CS activates c-Fos in VTA DA neurons and elicits conditioned approach

Exogenous Cannabinoids Impair Effort-Related Decision-Making via Affecting Neural Synchronization between the Anterior Cingulate Cortex and Nucleus Accumbens

Humans and animals frequently make an endeavor-based choice based on assessing reinforcement value and response costs. The cortical-limbic-striatal pathway mediates endeavor-based choice behavior, including the nucleus accumbens (NAc) and the anterior cingulate cortex (ACC). Furthermore, cannabinoid agonists demonstratively impairs decision-making processes. In this study, neural synchronization and functional connectivity between the NAc and ACC while endeavor-related decision-making and reaching reward were evaluated. The effect of exogenous cannabinoids on this synchronization was then assessed. A T-maze decision-making task with a differential expense (low vs. high endeavor) and remuneration (low vs. high remuneration) was performed and local field potentials (LFP) from the ACC and NAc were registered simultaneously. Results showed functional connectivity during endeavor-related decision-making while the animals chose the high endeavor/high remuneration in both regions’ delta/beta (1–4 and 13–30 Hertz) frequency bands. Furthermore, functional connectivity existed between both areas in delta/theta (1–4 and 4–12) frequencies while reaching a remuneration. However, neural simultaneity was not observed while the animals received cannabinoid agonists, making a decision and reaching remuneration. The obtained results demonstrated that functional connectivity and neural simultaneity between the NAc and ACC in delta/beta and delta/theta frequencies have a role in endeavor-related decision-making and reaching remuneration, respectively. The effect of exogenous cannabinoids on decision-making impairment is relevant to changes in the ACC and NAC brain wave frequencies.

Muscarinic and NMDA Receptors in the Substantia Nigra Play a Role in Reward-Related Learning

BACKGROUND

Reward-related learning, where animals form associations between rewards and stimuli (i.e., conditioned stimuli [CS]) that predict or accompany those rewards, is an essential adaptive function for survival.

METHODS

In this study, we investigated the mechanisms underlying the acquisition and performance of conditioned approach learning with a focus on the role of muscarinic acetylcholine (mACh) and NMDA glutamate receptors in the substantia nigra (SN), a brain region implicated in reward and motor processes.

RESULTS

Using RNAscope in situ hybridization assays, we found that dopamine neurons of the SN express muscarinic (mACh5), NMDA2a, NMDA2b, and NMDA2d receptor mRNA but not mACh4. NMDA, but not mACh5, receptor mRNA was also found on SN GABA neurons. In a conditioned approach paradigm, rats were exposed to 3 or 7 conditioning sessions during which light/tone (CS) presentations were paired with delivery of food pellets, followed by a test session with CS-only presentations. Intra-SN microinjections of scopolamine (a mACh receptor antagonist) or AP-5 (a NMDA receptor antagonist) were made either prior to each conditioning session (to test their effects on acquisition) or prior to the CS-only test (to test their effects on expression of the learned response). Scopolamine and AP-5 produced dose-dependent significant reductions in the acquisition, but not performance, of conditioned approach.

CONCLUSIONS

These results suggest that SN mACh and NMDA receptors are key players in the acquisition, but not the expression, of reward-related learning. Importantly, these findings redefine the role of the SN, which has traditionally been known for its involvement in motor processes, and suggest that the SN possesses attributes consistent with a function as a hub of integration of primary reward and CS signals.

Photostimulation of Ventral Tegmental Area-Insular Cortex Dopaminergic Inputs Enhances the Salience to Consolidate Aversive Taste Recognition Memory via D1-Like Receptors

Taste memory involves storing information through plasticity changes in the neural network of taste, including the insular cortex (IC) and ventral tegmental area (VTA), a critical provider of dopamine. Although a VTA-IC dopaminergic pathway has been demonstrated, its role to consolidate taste recognition memory remains poorly understood. We found that photostimulation of dopaminergic neurons in the VTA or VTA-IC dopaminergic terminals of TH-Cre mice improves the salience to consolidate a subthreshold novel taste stimulus regardless of its hedonic value, without altering their taste palatability. Importantly, the inhibition of the D1-like receptor into the IC impairs the salience to facilitate consolidation of an aversive taste recognition memory. Finally, our results showed that VTA photostimulation improves the salience to consolidate a conditioned taste aversion memory through the D1-like receptor into the IC. It is concluded that the dopamine activity from the VTA into IC is required to increase the salience enabling the consolidation of a taste recognition memory. Notably, the D1-like receptor activity into the IC is required to consolidate both innate and learned aversive taste memories but not appetitive taste memory.

Cocaine- and amphetamine-regulated transcript peptide- and dopamine-containing systems interact in the ventral tegmental area of the zebra finch, Taeniopygia guttata, during dynamic changes in energy status

The mesolimbic dopamine (DA)-pathway regulates food-reward, feeding-related behaviour and energy balance. Evidence underscores the importance of feeding-related neuropeptides in modulating activity of these DA neurons. The neuropeptide, CART, a crucial regulator of energy balance, modulates DA-release, and influences the activity of ventral tegmental area (VTA) DAergic neurons in the mammalian brain. Whether CART- and DA-containing systems interact at the level of VTA to regulate energy balance, however, is poorly understood. We explored the interaction between CART- and DA-containing systems in midbrain of the zebra finch, Taeniopygia guttata, an interesting model to study dynamic changes in energy balance due to higher BMR/daytime body temperature, and rapid responsiveness of the feeding-related neuropeptides to changes in energy state. Further, its midbrain DA-neurons share similarities with those in mammals. In the midbrain, tyrosine hydroxylase-immunoreactive (TH-i) neurons were seen in the substantia nigra (SN) and VTA [anterior (VTAa), mid (VTAm) and caudal (VTAc)]; those in VTA were smaller. In the VTA, CART-immunoreactive (CART-i)-fibers densely innervated TH-i neurons, and both CART-immunoreactivity (CART-ir) and TH-immunoreactivity (TH-ir) responded to energy status-dependent changes. Compared to fed and fasted birds, refeeding dramatically enhanced TH-ir and the percentage of TH-i neurons co-expressing FOS in the VTA. Increased prepro-CART-mRNA, CART-ir and a transient appearance of CART-i neurons was observed in VTAa of fasted, but not fed birds. To test the functional interaction between CART- and DA-containing systems, ex-vivo superfused midbrain-slices were treated with CART-peptide and changes in TH-ir analysed. Compared to control tissues, CART-treatment increased TH-ir in VTA but not SN. We propose that CART is a potential regulator of VTA DA-neurons and energy balance in T. guttata.

Neurobiology of reward-related learning

A major goal in psychology is to understand how environmental stimuli associated with primary rewards come to function as conditioned stimuli, acquiring the capacity to elicit similar responses to those elicited by primary rewards. Our neurobiological model is predicated on the Hebbian idea that concurrent synaptic activity on the primary reward neural substrate-proposed to be ventral tegmental area (VTA) dopamine (DA) neurons-strengthens the synapses involved. We propose that VTA DA neurons receive both a strong unconditioned stimulus signal (acetylcholine stimulation of DA cells) from the primary reward capable of unconditionally activating DA cells and a weak stimulus signal (glutamate stimulation of DA cells) from the neutral stimulus. Through joint stimulation the weak signal is potentiated and capable of activating the VTA DA cells, eliciting a conditioned response. The learning occurs when this joint stimulation initiates intracellular second-messenger cascades resulting in enhanced glutamate-DA synapses. In this review we present evidence that led us to propose this model and the most recent evidence supporting it.

CaMKII antagonism in the ventral tegmental area impairs acquisition of conditioned approach learning in rats

This study investigated the role of calcium2+/calmodulin-dependent protein kinase II (CaMKII), a protein in the second messenger pathway of NMDA receptors, in the ventral tegmental area (VTA) in the acquisition and performance of conditioned approach learning. Male Long-Evans rats (N = 79) were exposed to 3 (to test acquisition) or 7 (to test performance) conditioning sessions in which they received 30 paired presentations of a light stimulus (CS) and a food pellet (US) on a random time schedule. These conditioning sessions were then followed by one 30-min session without the CS or US and lastly by a CS-only test session, where only the light stimulus was presented (without food) according to the same schedule as the conditioning sessions. Bilateral intra-VTA injections of KN93 (vehicle, 3.0, 4.5 or 6.0 μg/0.5 μL), a CaMKII inhibitor, were administered prior to each conditioning session to test effects on the acquisition of conditioned approach or prior to the CS-only test session to test effects on the performance of conditioned approach. KN93, when given prior to conditioning sessions, significantly reduced the number of conditioned approach responses emitted during CS presentations in the CS-only test. When KN93 was given prior to the CS-only test it had no effect. These results suggest that CaMKII activation in the VTA is necessary for the acquisition, but not the performance, of reward-related learning.

Morphine selectively disinhibits glutamatergic input from mPFC onto dopamine neurons of VTA, inducing reward

Ventral tegmental area (VTA) dopamine (DA) neurons presynaptic glutamate release plays a very important role in the mechanism of morphine. Previously, a study from our lab found that morphine disinhibited glutamatergic input onto the VTA-DA neurons, which was an important mechanism for the morphine-induced increase in the VTA-DA neuron firing and related behaviors (Chen et al., 2015). However, what source of glutamatergic inputs is disinhibited by morphine remains to be elucidated. Using optogenetic strategy combined with whole-cell patch-clamp, qRT-PCR, immunofluorescence and chemical genetic approach combined with behavioral methods, our results show that: 1) morphine promotes glutamate release from glutamatergic terminals of medial prefrontal cortex (mPFC) neurons projecting to VTA-DA neurons but does not on those from glutamatergic terminals of the lateral hypothalamus (LH) neurons projecting to VTA-DA neurons; 2) different response of glutamatergic neurons projecting to VTA-DA neurons from the mPFC or the LH to morphine is related to the expression of GABA_B receptors at terminals of these neurons; 3) inhibition of projection neurons from the mPFC to the VTA significantly reduces morphine-induced locomotor activity increase and conditioned place preference but inhibition of projection neurons from the LH to the VTA does not. These results suggest that morphine selectively promotes glutamate release of the glutamatergic input from mPFC onto VTA-DA neurons by removing the inhibition of the GABA_B receptors in this glutamatergic input from mPFC.

Aberrations in Incentive Learning and Responding to Heroin in Male Rats After Adolescent or Adult Chronic Binge-Like Alcohol Exposure

BACKGROUND AND PURPOSE

Binge drinking is a serious problem among adolescents and young adults despite its adverse consequences on the brain and behavior. One area that remains poorly understood concerns the impact of chronic intermittent ethanol (CIE) exposure on incentive learning.

METHODS

Here, we examined the effects of CIE exposure during different developmental stages on conditioned approach and conditioned reward learning in rats experiencing acute or protracted withdrawal from alcohol. Two or 21 days after adolescent or adult CIE exposure, male rats were exposed to pairings of a light stimulus (CS) and food pellets for 3 consecutive daily sessions (30 CS-food pellet pairings per session). This was followed by conditioned approach testing measuring responses (food trough head entries) to the CS-only presentations and by conditioned reward testing measuring responses on a lever producing the CS and on another producing a tone. We then measured behavioral sensitization to repeated injections of heroin (2 mg/kg/d for 9 days).

RESULTS

Adolescent and adult alcohol-treated rats showed significantly impaired conditioned reward learning regardless of withdrawal period (acute or prolonged). We found no evidence of changes to conditioned approach learning after adolescent or adult exposure to CIE. Finally, in addition to producing long-term impairments in incentive learning, CIE exposure enhanced locomotor activity in response to heroin and had no effect on behavioral sensitization to heroin regardless of age and withdrawal period.

CONCLUSIONS

Our work sets a framework for identifying CIE-induced alterations in incentive learning and inducing susceptibility to subsequent opioid effects.

The strength of reward-related learning depends on the degree of activation of ventral tegmental area dopamine neurons

We tested whether (1) the capacity of a reward-associated conditioned stimulus (CS) to cause conditioned activation of ventral tegmental area (VTA) dopamine (DA) neurons is associated with its capacity to elicit conditioned approach responses and (2) whether the acquisition of these capacities by a CS requires N-methyl-D-aspartate (NMDA) and muscarinic acetylcholine (mACh) receptor stimulation. Rats were trained to emit a conditioned approach response to a light CS that was previously paired with food and were treated systemically with scopolamine (a mACh receptor antagonist) or MK-801 (an NMDA receptor antagonist) either prior to each conditioning session (during which animals experienced paired CS and food presentations) or prior to the conditioned approach (CS-only) test. Brains were harvested after the CS-only test and processed for tyrosine hydroxylase (TH) (DA cells) and c-fos in the VTA. When animals received scopolamine or MK-801 treatment prior to conditioning sessions we observed significantly fewer TH-labeled (i.e., DA) cells in the VTA that expressed c-fos and significantly less conditioned approach responding during the CS-only test. Further analysis showed a correlation between the number of VTA DA cells activated and the number of conditioned approach responses. Treatments made prior to the CS-only test did not affect responding. Altogether these results suggest that the degree to which a CS elicits conditioned approach depends partially on the degree to which the CS activates VTA DA cells and that the acquisition of both of these capacities by a CS requires mACh and NMDA receptor stimulation.

Motor skill learning and reward consumption differentially affect VTA activation

Dopamine release from the ventral tegmental area (VTA) terminals in the primary motor cortex (M1) enables motor skill acquisition. Here, we test the hypothesis that dopaminergic VTA neurons projecting to M1 are activated when rewards are obtained during motor skill acquisition, but not during task execution at plateau performance, or by rewards obtained without performing skilled movements. Rats were trained to perform a skilled reaching task for 3 days (acquisition) or 7 days (plateau). In combination with retrograde labelling of VTA-to-M1 projection neurons, double immunofluorescence for c-fos and tyrosine hydroxylase (TH) was used to assess activation of dopaminergic and non-dopaminergic VTA neurons. Dopaminergic VTA-to-M1 projection neurons were indeed activated during successful motor skill acquisition, but not when rats failed to learn or had reached plateau performance, nor by food rewards alone. By contrast, dopaminergic VTA neurons that did not project to M1 were activated by both skilled reaching and food rewards. Non-dopaminergic neurons were found to be activated by motor task performance at plateau, but not during skill acquisition. These results indicate that distinct populations of VTA neurons are activated by motor skill acquisition and task performance. Moreover, this activation is not merely related to consumption of food rewards.

Blockade of NMDA receptors blocks the acquisition of cocaine conditioned approach in rats

Conditioned stimuli (CSs) exert motivational effects on both adaptive and pathological reward-related behaviors, including drug taking and seeking. We developed a paradigm that allows us to investigate the neuropharmacology by which previously neutral stimuli acquire the capacity to function as CSs and elicit (intravenous) cocaine conditioned approach and used this paradigm to test the role of NMDA receptor stimulation in the acquisition of cocaine conditioned approach. Rats were injected systemically with the NMDA receptor antagonist, MK-801, before the start of 4 consecutive conditioning sessions, each of which consisted of 20 randomly presented light/tone (CS) presentations paired with cocaine infusion contingent upon nose pokes. Rats later were subjected to a CS-only test. To test the role of NMDA receptor stimulation in the already established conditioned approach, rats were injected with MK-801 prior to the CS-only test that occurred after 18 CS-cocaine conditioning sessions. Blockade of NMDA receptors significantly impaired the acquisition of cocaine-conditioned approach as indicated by the emission of significantly fewer nose pokes and significantly longer latencies to nose poke during CS presentations. When MK-801 treatment was applied after the acquisition of conditioned approach responding it had no effect on these measures. These results suggest that NMDA receptor stimulation plays an important role in the acquisition of reward-related conditioned responses driven by intravenous cocaine-associated CSs.

Blockade of muscarinic acetylcholine receptors in the ventral tegmental area blocks the acquisition of reward-related learning

In the present study we investigated whether stimulation of muscarinic acetylcholine (mACh) receptors in the ventral tegmental area (VTA) plays a role in the acquisition of food-based conditioned approach learning. Rats were exposed to 3 (in Experiment 1) or 7 (in Experiment 2) conditioning sessions in which 30, randomly presented light (CS) presentations were paired with delivery of food pellets (US), followed by one session with no light or food and finally one CS-only test session with only light stimulus presentations. Bilateral microinjections of scopolamine (a mACh receptor antagonist) were made either prior to each conditioning session (Experiment 1; to test effects on acquisition) or prior to the CS-only test (Experiment 2; to test effects on performance of the learned response). Scopolamine produced a dose-related significant reduction in the acquisition of conditioned approach but had no effect on its performance. These results suggest that mACh receptor stimulation in the VTA plays a necessary role in the acquisition of reward-related learning.

Concurrent antagonism of NMDA and AMPA receptors in the ventral tegmental area reduces the expression of conditioned approach learning in rats

Conditioned stimuli (CSs) come to function as CSs by acquiring the capacity to activate the same mesocorticolimbic dopamine (DA) neurons activated by primary rewards, producing conditioned activation of these neurons and their associated motivational states. This model stipulates that CSs activate mesocorticolimbic DA systems through the activation of glutamate receptors on DA neurons in the ventral tegmental area (VTA). We tested the hypothesis that glutamate receptor stimulation in the VTA is necessary for the expression of conditioned approach. Rats were tested in a conditioned approach protocol that consisted of 7 consecutive conditioning sessions (light presentations and food were paired), one session with no light or food and one test session with only light stimulus (CS-only) presentations. The number of head entries during the CS and pre-CS (baseline) periods was used to calculate difference scores. Bilateral VTA microinjections of glutamate receptor antagonists were made prior to the CS-only session. Kynurenic acid (ionotropic glutamate receptor antagonist; 1.125-4.5 μg/0.5 μl) significantly reduced difference scores compared to vehicle (0 μg), whereas MCPG (metabotropic glutamate receptor antagonist; 1.875-7.5 μg), AP-5 (NMDA antagonist; 0.03125-2.0 μg), and NBQX (AMPA antagonist; 0.5-4.0 μg) had no effects. When AP-5 and NBQX were administered simultaneously at doses of 0.25/4.0 and 2.0/4.0 μg, respectively, the combination significantly reduced the difference scores compared to 0/0 μg, indicating a reduction in the expression of conditioned approach. These findings indicate that expression of conditioned approach learning requires NMDA or AMPA receptor stimulation in the VTA.

Anticipatory and foraging behaviors in response to palatable food reward in chickens: effects of dopamine D2 receptor blockade and domestication

Behaviors associated with anticipation and search for palatable food may provide information about dopaminergic reward processes and positive motivational affect in animals. The overall aim was to investigate the involvement of dopamine signaling in the regulation of cue-induced anticipation and search for palatable food reward in chicken, and whether domestication has affected expression of reward-related behaviors. The specific aims were to describe effects of mealworms (palatable food for hens) and haloperidol (a dopamine D2 antagonist) on foraging behaviors and cue-induced anticipatory behaviors in Red Junglefowl (RJF; the wild ancestor of modern laying hens) and a white layer hybrid (LSL). RJF (n=26) and LSL (n=20) were initially trained on a conditioning schedule to anticipate mealworms (unconditioned stimulus; US) 25s after exposure to a red light (conditioned stimulus; CS). For the experiment, hens received haloperidol or saline injections 30 min before exposure to one CS+US combination. Behavior was registered 10 min before CS and 10 min after US (foraging behaviors), and during the CS-US interval (anticipatory behaviors). Higher frequencies of CS-induced anticipatory head movements, faster approach to rewards, and higher frequency of foraging behaviors were found in LSL compared to RJF. Haloperidol suppressed CS-induced head movements in both breeds, and the frequency of foraging behaviors after reward delivery. The results support a role of dopamine signaling in the regulation of reward processes in chickens, and suggest that domestication has changed the threshold for perceiving food incentives and/or for expressing reward-related behaviors that may be indicative of positive motivational affect in hens.