Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats

Dopamine-mediated formation of a memory module in the nucleus accumbens for goal-directed navigation

Spatial memories guide navigation efficiently toward desired destinations. However, the neuronal and circuit mechanisms underlying the encoding of goal locations and its translation into goal-directed navigation remain unclear. Here we demonstrate that mice rapidly form a spatial memory of a shelter during shelter experiences, guiding escape behavior toward the goal location-a shelter-when under threat. Dopaminergic neurons in the ventral tegmental area and their projection to the nucleus accumbens (NAc) encode safety signals associated with the shelter. Optogenetically induced phasic dopamine signals are sufficient to create a place memory that directs escape navigation. Converging dopaminergic and hippocampal glutamatergic inputs to the NAc mediate the formation of a goal-related memory within a subpopulation of NAc neurons during shelter experiences. Artificial co-activation of this goal-related NAc ensemble with neurons in the dorsal periaqueductal gray was sufficient to trigger memory-guided, rather than random, escape behavior. These findings provide causal evidence of cognitive circuit modules linking memory with goal-directed action.

Dopamine transmission at D1 and D2 receptors in the nucleus accumbens contributes to the expression of incubation of cocaine craving

Relapse represents a consistent clinical problem for individuals with substance use disorder. In the incubation of craving model of persistent craving and relapse, cue-induced drug seeking progressively intensifies or "incubates" during the first weeks of abstinence from drug self-administration and then remains high for months. Previously, we and others have demonstrated that expression of incubated cocaine craving requires strengthening of excitatory synaptic transmission in the nucleus accumbens core (NAcc). However, despite the importance of dopaminergic signaling in the NAcc for motivated behavior, little is known about the role that dopamine (DA) plays in the incubation of cocaine craving. Here we used fiber photometry to measure DA transients in the NAcc of male and female rats during cue-induced seeking tests conducted in early abstinence from cocaine self-administration, prior to incubation, and late abstinence, after incubation of craving has plateaued. We observed DA transients time-locked to cue-induced responding but their magnitude did not differ significantly when measured during early versus late abstinence seeking tests. Next, we tested for a functional role of these DA transients by injecting DA receptor antagonists into the NAcc just before the cue-induced seeking test. Blockade of either D1 or D2 DA receptors reduced cue-induced cocaine seeking after but not before incubation. We found no main effect of sex or significant interaction of sex with other factors in our experiments. These results suggest that DA contributes to incubated cocaine seeking but the emergence of this role reflects changes in postsynaptic responsiveness to DA rather than presynaptic alterations.

Dopamine transmission at D1 and D2 receptors in the nucleus accumbens contributes to the expression of incubation of cocaine craving

Relapse represents a consistent clinical problem for individuals with substance use disorder. In the incubation of craving model of persistent craving and relapse, cue-induced drug seeking progressively intensifies or 'incubates' during the first weeks of abstinence from drug self-administration and then remains high for months. Previously, we and others have demonstrated that expression of incubated cocaine craving requires strengthening of excitatory synaptic transmission in the nucleus accumbens core (NAcc). However, despite the importance of dopaminergic signaling in the NAcc for motivated behavior, little is known about the role that dopamine (DA) plays in the incubation of cocaine craving. Here we used fiber photometry to measure DA transients in the NAcc of male and female rats during cue-induced seeking tests conducted in early abstinence from cocaine self-administration, prior to incubation, and late abstinence, after incubation of craving has plateaued. We observed DA transients time-locked to cue-induced responding but their magnitude did not differ significantly when measured during early versus late abstinence seeking tests. Next, we tested for a functional role of these DA transients by injecting DA receptor antagonists into the NAcc just before the cue-induced seeking test. Blockade of either D1 or D2 DA receptors reduced cue-induced cocaine seeking after but not before incubation. We found no main effect of sex in our experiments. These results suggest that DA contributes to incubated cocaine seeking but the emergence of this role reflects changes in postsynaptic responsiveness to DA rather than presynaptic alterations.

Activation of Kv7 channels normalizes hyperactivity of the VTA-NAcLat circuit and attenuates methamphetamine-induced conditioned place preference and sensitization in mice

The brain circuit projecting from the ventral tegmental area (VTA) to the nucleus accumbens lateral shell (NAcLat) has a key role in methamphetamine (MA) addiction. As different dopamine (DA) neuron subpopulations in the VTA participate in different neuronal circuits, it is a challenge to isolate these DA neuron subtypes. Using retrograde tracing and Patch-seq, we isolated DA neurons in the VTA-NAcLat circuit in MA-treated mice and performed gene expression profiling. Among the differentially expressed genes, KCNQ genes were dramatically downregulated. KCNQ genes encode Kv7 channel proteins, which modulate neuronal excitability. Injection of both the Kv7.2/3 agonist ICA069673 and the Kv7.4 agonist fasudil into the VTA attenuated MA-induced conditioned place preference and locomotor sensitization and decreased neuronal excitability. Increasing Kv7.2/3 activity decreased neural oscillations, synaptic plasticity and DA release in the VTA-NacLat circuit in MA-treated mice. Furthermore, overexpression of only Kv7.3 channels in the VTA-NacLat circuit was sufficient to attenuate MA-induced reward behavior and decrease VTA neuron excitability. Activation of Kv7 channels in the VTA may become a novel treatment strategy for MA abuse.

Intermittent cocaine self-administration has sex-specific effects on addiction-like behaviors in rats

Intermittent access (IntA) models of cocaine self-administration were developed to better model in rodents how cocaine is used by human drug users. Compared to traditional continuous access (ContA) models, IntA has been shown to enhance several pharmacological and behavioral effects of cocaine, but few studies have examined sex differences in IntA. Moreover, no one has examined the efficacy of cue extinction to reduce cocaine seeking in the IntA model, which has previously shown to be ineffective in other models that promote habit-like cocaine seeking. Therefore, rats were implanted with jugular vein catheters and dorsolateral striatum (DLS) cannulae and trained to self-administer cocaine paired with an audiovisual cue with ContA or IntA. In subsets of rats, we evaluated: the ability of Pavlovian cue extinction to reduce cue-induced drug seeking; motivation for cocaine using a progressive ratio procedure; punishment-resistant cocaine taking by pairing cocaine infusions with footshocks; and dependence of drug-seeking on DLS dopamine (a measure of habit-like behavior) with the dopamine antagonist cis-flupenthixol. Overall, cue extinction reduced cue-induced drug seeking after ContA or IntA. Compared to ContA, IntA resulted in increased motivation for cocaine exclusively in females, but IntA facilitated punished cocaine self-administration exclusively in males. After 10 days of IntA training, but not fewer, drug-seeking was dependent on DLS dopamine most notably in males. Our results suggest that IntA may be valuable for identifying sex differences in the early stages of drug use and provide a foundation for the investigation of the mechanisms involved.

Cocaine's effects on the reactivity of the medial prefrontal cortex to ventral tegmental area stimulation: optical imaging study in mice

BACKGROUND AND AIMS

The prefrontal cortex (PFC) is modulated by dopaminergic and glutamatergic neurons that project from the ventral tegmental area (VTA) and disruption of this modulation might facilitate impulsive behaviors during cocaine intoxication. Here, we assessed the effects of acute cocaine (30 mg/kg, i.p.) on the reactivity of the PFC to VTA stimulation.

METHODS

Using a genetically encoded calcium indicator (GCaMP6f), we optically imaged the neuronal Ca2+ reactance in medial PFC (mPFC) in response to 'tonic-like' (5 Hz) and 'phasic-like' (50 Hz) electrical VTA stimulation. The high temporal and spatial resolutions of our optical system allowed us to capture single Ca2+ neuronal transients from individual stimuli with 'tonic-like' stimulation and to visualize single neuronal activation evoked by 'phasic-like' VTA stimulation.

RESULTS

'Tonic-like' VTA stimulation induced a rapid increase in mean neuronal Ca2+ in mPFC followed by a plateau and recovery upon termination of stimulation. After cocaine, the mPFC sensitivity to 'tonic-like' VTA stimulation was attenuated, with a 50.4% reduction (P = 0.03) in the number of Ca2+ transients corresponding to single electrical stimuli but the recovery time was lengthened (4.30 ± 0.25 sec to 5.41 ± 0.24 sec, P = 0.03). 'Phasic-like' stimulation evoked a rapid Ca2+ fluorescence increase in mPFC with an immediate decay process, and while cocaine did not affect the peak response (7.17 ± 1.07% versus 7.13 ± 0.96%, P = 0.98) it shortened the recovery time to baseline (3.27 ± 0.11 sec versus 2.38 ± 0.23 sec, P = 0.005).

CONCLUSIONS

Acute cocaine impairs reactivity of medial prefrontal cortex (mPFC) to ventral tegmental area stimulation, decreasing its sensitivity to 'tonic-like' stimulation and lengthening the recovery time to return to baseline while shortening it for phasic stimulation. These changes in mPFC might contribute to cocaine binging during intoxication.

A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli

Dopamine signals in the striatum are critical for motivated behavior. However, their regional specificity and precise information content are actively debated. Dopaminergic projections to the striatum are topographically organized. Thus, we quantified dopamine release in response to motivational stimuli and associated predictive cues in six principal striatal regions of unrestrained, behaving rats. Absolute signal size and its modulation by stimulus value and by subjective state of the animal were interregionally heterogeneous on a medial to lateral gradient. In contrast, dopamine-concentration direction of change was homogeneous across all regions: appetitive stimuli increased and aversive stimuli decreased dopamine concentration. Although cues predictive of such motivational stimuli acquired the same influence over dopamine homogeneously across all regions, dopamine-mediated prediction-error signals were restricted to the ventromedial, limbic striatum. Together, our findings demonstrate a nuanced striatal landscape of unidirectional but not uniform dopamine signals, topographically encoding distinct aspects of motivational stimuli and their prediction.

Regional and sex differences in spontaneous striatal dopamine transmission

Striatal dopamine release is key for learning and motivation and is composed of subregions including the dorsal striatum (DS), nucleus accumbens core, and the nucleus accumbens shell. Spontaneously occurring dopamine release was compared across these subregions. Dopamine release/uptake dynamics differ across striatal subregions, with dopamine transient release amplitude and release frequency greatest in male mice, and the largest signals observed in the DS. Surprisingly, female mice exhibited little regional differences in dopamine release for DS and nucleus accumbens core regions, but lower release in the nucleus accumbens shell. Blocking voltage-gated K+ channel (Kv channels) with 4-aminopyridine enhanced dopamine detection without affecting reuptake. The 4-aminopyridine effects were greatest in ventral regions of female mice, suggesting regional differences in Kv channel expression. The dopamine transporter blocker cocaine also enhanced detection across subregions in both sexes, with greater overall increased release in females than males. Thus, sex differences in dopamine transmission are apparent and likely include differences in the Kv channel and dopamine transporter function. The lack of regional differences in dopamine release observed in females indicates differential regulation of spontaneous and evoked dopamine release.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

The role of withdrawal in mesocorticolimbic drug cue reactivity in opioid use disorder

Opioid use disorder (OUD) is characterized by heightened cognitive, physiological, and neural responses to opioid-related cues that are mediated by mesocorticolimbic brain pathways. Craving and withdrawal are key symptoms of addiction that persist during physiological abstinence. The present study evaluated the relationship between the brain response to drug cues in OUD and baseline levels of craving and withdrawal. We used functional magnetic resonance imaging (fMRI) to examine brain responses to opioid-related pictures and control pictures in 29 OUD patients. Baseline measures of drug use severity, opioid craving, and withdrawal symptoms were assessed prior to cue exposure and correlated with subsequent brain responses to drug cues. Mediation analysis was conducted to test the indirect effect of drug use severity on brain cue reactivity through craving and withdrawal symptoms. We found that baseline drug use severity and opioid withdrawal symptoms, but not craving, were positively associated with the neural response to drug cues in the nucleus accumbens, orbitofrontal cortex, and amygdala. Withdrawal, but not craving, mediated the effect of drug use severity on the nucleus accumbens' response to drug cues. We did not find similar effects for the neural responses to stimuli unrelated to drugs. Our findings emphasize the central role of withdrawal symptoms as the mediator between the clinical severity of OUD and the brain correlates of sensitization to opioid-related cues. They suggest that in OUD, baseline withdrawal symptoms signal a high vulnerability to drug cues.

Dopamine Inputs from the Ventral Tegmental Area into the Medial Prefrontal Cortex Modulate Neuropathic Pain-Associated Behaviors in Mice

The medial prefrontal cortex (mPFC) is a brain region involved in the affective components of pain and undergoes plasticity during the development of chronic pain. Dopamine (DA) is a key neuromodulator in the mesocortical circuit and modulates working memory and aversion. Although DA inputs into the mPFC are known to modulate plasticity, whether and how these inputs affect pain remains incompletely understood. By using optogenetics, we find that phasic activation of DA inputs from the ventral tegmental area (VTA) into the mPFC reduce mechanical hypersensitivity during neuropathic pain states. Mice with neuropathic pain exhibit a preference for contexts paired with photostimulation of DA terminals in the mPFC. Fiber photometry-based calcium imaging reveals that DA increases the activity of mPFC neurons projecting to the ventrolateral periaqueductal gray (vlPAG). Together, our findings indicate an important role of mPFC DA signaling in pain modulation.

Neural Substrates and Circuits of Drug Addiction

Drug addiction is a chronic relapsing disorder, and a significant amount of research has been devoted to understand the factors that contribute to the development, loss of control, and persistence of compulsive addictive behaviors. In this review, we provide an overview of various theories of addiction to drugs of abuse and the neurobiology involved in elements of the addiction cycle. Specific focus is devoted to the role of the mesolimbic pathway in acute drug reinforcement and occasional drug use, the role of the mesocortical pathway and associated areas (e.g., the dorsal striatum) in escalation/dependence, and the contribution of these pathways and associated circuits to conditioned responses, drug craving, and loss of behavioral control that may underlie drug relapse. By enhancing the understanding of the neurobiological factors that mediate drug addiction, continued preclinical and clinical research will aid in the development of novel therapeutic interventions that can serve as effective long-term treatment strategies for drug-dependent individuals.

Differential Impact of Inhibitory G-Protein Signaling Pathways in Ventral Tegmental Area Dopamine Neurons on Behavioral Sensitivity to Cocaine and Morphine

Drugs of abuse engage overlapping but distinct molecular and cellular mechanisms to enhance dopamine (DA) signaling in the mesocorticolimbic circuitry. DA neurons of the ventral tegmental area (VTA) are key substrates of drugs of abuse and have been implicated in addiction-related behaviors. Enhanced VTA DA neurotransmission evoked by drugs of abuse can engage inhibitory G-protein-dependent feedback pathways, mediated by GABA_B receptors (GABA_BRs) and D₂ DA receptors (D₂Rs). Chemogenetic inhibition of VTA DA neurons potently suppressed baseline motor activity, as well as the motor-stimulatory effect of cocaine and morphine, confirming the critical influence of VTA DA neurons and inhibitory G-protein signaling in these neurons on this addiction-related behavior. To resolve the relative influence of GABA_BR-dependent and D₂R-dependent signaling pathways in VTA DA neurons on behavioral sensitivity to drugs of abuse, we developed a neuron-specific viral CRISPR/Cas9 approach to ablate D₂R and GABA_BR in VTA DA neurons. Ablation of GABA_BR or D₂R did not impact baseline physiological properties or excitability of VTA DA neurons, but it did preclude the direct somatodendritic inhibitory influence of GABA_BR or D₂R activation. D₂R ablation potentiated the motor-stimulatory effect of cocaine in male and female mice, whereas GABA_BR ablation selectively potentiated cocaine-induced activity in male subjects only. Neither D₂R nor GABA_BR ablation impacted morphine-induced motor activity. Collectively, our data show that cocaine and morphine differ in the extent to which they engage inhibitory G-protein-dependent feedback pathways in VTA DA neurons and highlight key sex differences that may impact susceptibility to various facets of addiction.

Regulation of dopamine-dependent transcription and cocaine action by Gadd45b

Exposure to drugs of abuse produces robust transcriptional and epigenetic reorganization within brain reward circuits that outlives the direct effects of the drug and may contribute to addiction. DNA methylation is a covalent epigenetic modification that is altered following stimulant exposure and is critical for behavioral and physiological adaptations to drugs of abuse. Although activity-related loss of DNA methylation requires the Gadd45 (Growth arrest and DNA-damage-inducible) gene family, very little is known about how this family regulates activity within the nucleus accumbens or behavioral responses to drugs of abuse. Here, we combined genome-wide transcriptional profiling, pharmacological manipulations, electrophysiological measurements, and CRISPR tools with traditional knockout and behavioral approaches in rodent model systems to dissect the role of Gadd45b in dopamine-dependent epigenetic regulation and cocaine reward. We show that acute cocaine administration induces rapid upregulation of Gadd45b mRNA in the rat nucleus accumbens, and that knockout or site-specific CRISPR/Cas9 gene knockdown of Gadd45b blocks cocaine conditioned place preference. In vitro, dopamine treatment in primary striatal neurons increases Gadd45b mRNA expression through a dopamine receptor type 1 (DRD1)-dependent mechanism. Moreover, shRNA-induced Gadd45b knockdown decreases expression of genes involved in psychostimulant addiction, blocks induction of immediate early genes by DRD1 stimulation, and prevents DRD1-mediated changes in DNA methylation. Finally, we demonstrate that Gadd45b knockdown decreases striatal neuron action potential burst duration in vitro, without altering other electrophysiological characteristics. These results suggest that striatal Gadd45b functions as a dopamine-induced gene that is necessary for cocaine reward memory and DRD1-mediated transcriptional activity.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

High density carbon fiber arrays for chronic electrophysiology, fast scan cyclic voltammetry, and correlative anatomy

OBJECTIVE

Multimodal measurements at the neuronal level allow for detailed insight into local circuit function. However, most behavioral studies focus on one or two modalities and are generally limited by the available technology.

APPROACH

Here, we show a combined approach of electrophysiology recordings, chemical sensing, and histological localization of the electrode tips within tissue. The key enabling technology is the underlying use of carbon fiber electrodes, which are small, electrically conductive, and sensitive to dopamine. The carbon fibers were functionalized by coating with Parylene C, a thin insulator with a high dielectric constant, coupled with selective re-exposure of the carbon surface using laser ablation.

MAIN RESULTS

We demonstrate the use of this technology by implanting 16 channel arrays in the rat nucleus accumbens. Chronic electrophysiology and dopamine signals were detected 1 month post implant. Additionally, electrodes were left in the tissue, sliced in place during histology, and showed minimal tissue damage.

SIGNIFICANCE

Our results validate our new technology and methods, which will enable a more comprehensive circuit level understanding of the brain.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Preadolescent dopamine receptor antagonism increases postadolescent reward-related operant behaviors that may depend on dopamine receptor hypersensitivity

The dopaminergic system has a long history of being associated with reward-related activities but the developmental consequences of blocking dopamine receptor function on reward-based associative learning has been less studied. To this end, male, Long Evans rats were systemically (i.p.) treated with the dopamine receptor (DAr) antagonist, flupenthixol (0.25 mg/kg), or saline, from postnatal day (P)18 - 24 (preadolescence) then trained on an operant conditioning task from P41 - P45 (postadolescent) without drug treatment. The preadolescent flupenthixol group showed elevated active lever responses and locomotor activity during the drug-free test. Another group of rats was given flupenthixol prior to each acquisition session from P41 - 45 which significantly suppressed both active lever presses and locomotor activity. Separate groups of rats were treated with flupenthixol or saline from P18 - 24 then treated with apomorphine or saline on P41 followed by assessment of c-Fos labeling in the nucleus accumbens. Early flupenthixol treatment was associated with more apomorphine-induced c-Fos labeling in the nucleus accumbens shell than the early saline-apomorphine group, indicating a sensitized response. These findings suggest that preadolescent dopamine receptor blockade may lead to a sensitized postadolescent dopaminergic response that underlies enhanced behavioral responses in the presence of rewarding stimuli.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Accelerated development of cocaine-associated dopamine transients and cocaine use vulnerability following traumatic stress

Post-traumatic stress disorder and cocaine use disorder are highly co-morbid psychiatric conditions. The onset of post-traumatic stress disorder generally occurs prior to the development of cocaine use disorder, and thus it appears that the development of post-traumatic stress disorder drives cocaine use vulnerability. We recently characterized a rat model of post-traumatic stress disorder with segregation of rats as susceptible and resilient based on anxiety-like behavior in the elevated plus maze and context avoidance. We paired this model with in vivo fast scan cyclic voltammetry in freely moving rats to test for differences in dopamine signaling in the nucleus accumbens core at baseline, in response to a single dose of cocaine, and in response to cocaine-paired cues. Further, we examined differences in the acquisition of cocaine self-administration across groups. Results indicate that susceptibility to traumatic stress is associated with alterations in phasic dopamine signaling architecture that increase the rate at which dopamine signals entrain to cocaine-associated cues and increase the magnitude of persistent cue-evoked dopamine signals following training. These changes in phasic dopamine signaling correspond with increases in the rate at which susceptible rats develop excessive cocaine-taking behavior. Together, our studies demonstrate that susceptibility to traumatic stress is associated with a cocaine use-vulnerable phenotype and suggests that differences in phasic dopamine signaling architecture may contribute to the process by which this vulnerability occurs.

Opposite environmental gating of the experienced utility ('liking') and decision utility ('wanting') of heroin versus cocaine in animals and humans: implications for computational neuroscience

BACKGROUND

In this paper, we reviewed translational studies concerned with environmental influences on the rewarding effects of heroin versus cocaine in rats and humans with substance use disorder. These studies show that both experienced utility ('liking') and decision utility ('wanting') of heroin and cocaine shift in opposite directions as a function of the setting in which these drugs were used. Briefly, rats and humans prefer using heroin at home but cocaine outside the home. These findings appear to challenge prevailing theories of drug reward, which focus on the notion of shared substrate of action for drug of abuse, and in particular on their shared ability to facilitate dopaminergic transmission.

AIMS

Thus, in the second part of the paper, we verified whether our findings could be accounted for by available computational models of reward. To account for our findings, a model must include a component that could mediate the substance-specific influence of setting on drug reward RESULTS: It appears of the extant models that none is fully compatible with the results of our studies.

CONCLUSIONS

We hope that this paper will serve as stimulus to design computational models more attuned to the complex mechanisms responsible for the rewarding effects of drugs in real-world contexts.

Dopaminergic cellular and circuit contributions to kappa opioid receptor mediated aversion

Neural circuits that enable an organism to protect itself by promoting escape from immediate threat and avoidance of future injury are conceptualized to carry an "aversive" signal. One of the key molecular elements of these circuits is the kappa opioid receptor (KOR) and its endogenous peptide agonist, dynorphin. In many cases, the aversive response to an experimental manipulation can be eliminated by selective blockade of KOR function, indicating its necessity in transmitting this signal. The dopamine system, through its contributions to reinforcement learning, is also involved in processing of aversive stimuli, and KOR control of dopamine in the context of aversive behavioral states has been intensely studied. In this review, we have discussed the multiple ways in which the KORs regulate dopamine dynamics with a central focus on dopamine neurons and projections from the ventral tegmental area. At the neuronal level, KOR agonists inhibit dopamine neurons both in the somatodendritic region as well as at terminal release sites, through various signaling pathways and ion channels, and these effects are specific to different synaptic sites. While the dominant hypotheses are that aversive states are driven by decreases in dopamine and increases in dynorphin, reported exceptions to these patterns indicate these ideas require refinement. This is critical given that KOR is being considered as a target for development of new therapeutics for anxiety, depression, pain, and other psychiatric disorders.

Mode of Sucrose Delivery Alters Reward-Related Phasic Dopamine Signals in Nucleus Accumbens

In studies of appetitive Pavlovian conditioning, rewards are often delivered to subjects in a manner that confounds several processes. For example, delivery of a sugar pellet to a rodent requires movement to collect the pellet and is associated with sensory stimuli such as the sight and sound of the pellet arrival. Thus, any neurochemical events occurring in proximity to the reward may be related to multiple coincident phenomena. We used fast-scan cyclic voltammetry in rats to compare nucleus accumbens dopamine responses to two different modes of delivery: sucrose pellets, which require goal-directed action for their collection and are associated with sensory stimuli, and intraoral infusions of sucrose, which are passively received and not associated with external stimuli. We found that when rewards were unpredicted, both pellets and infusions evoked similar dopamine release. However, when rewards were predicted by distinct cues, greater dopamine release was evoked by pellet cues than infusion cues. Thus, dopamine responses to pellets, infusions as well as predictive cues suggest a nuanced role for dopamine in both reward seeking and reward evaluation.

Response dynamics of midbrain dopamine neurons and serotonin neurons to heroin, nicotine, cocaine, and MDMA

Heroin, nicotine, cocaine, and MDMA are abused by billions of people. They are believed to target midbrain dopamine neurons and/or serotonin neurons, but their effects on the dynamic neuronal activity remain unclear in behaving states. By combining cell-type-specific fiber photometry of Ca²⁺ signals and intravenous drug infusion, here we show that these four drugs of abuse profoundly modulate the activity of mouse midbrain dopamine neurons and serotonin neurons with distinct potency and kinetics. Heroin strongly activates dopamine neurons, and only excites serotonin neurons at higher doses. Nicotine activates dopamine neurons in merely a few seconds, but produces minimal effects on serotonin neurons. Cocaine and MDMA cause long-lasting suppression of both dopamine neurons and serotonin neurons, although MDMA inhibits serotonin neurons more profoundly. Moreover, these inhibitory effects are mediated through the activity of dopamine and serotonin autoreceptors. These results suggest that the activity of dopamine neurons and that of serotonin neurons are more closely associated with the drug's reinforcing property and the drug's euphorigenic property, respectively. This study also shows that our methodology may facilitate further in-vivo interrogation of neural dynamics using animal models of drug addiction.

Heterogeneous dopamine signals support distinct features of motivated actions: implications for learning and addiction

Despite decades of research, investigations into effective neural and pharmacological therapies for many drugs of abuse, such as cocaine, have produced no FDA-approved approaches. This difficulty derives from the complexity of substance use disorders, which encompass a variety of behavioral, psychological, and neural circuit-based changes that occur as a result of repeated experience with the drug. Dopamine signaling has been demonstrated to play a key role in several aspects of drug abuse—from mediating its reinforcing properties and drug-seeking to triggering relapse—while also mediating a number of important aspects of normal (nondrug related) motivated behaviors and actions. Real-time recording methods such as in vivo voltammetry, electrophysiology, and calcium imaging demonstrate that the signaling properties of dopamine for motivationally relevant stimuli are highly dynamic and spatiotemporally circumscribed within afferent target regions. In this review, we identify the origins and functional consequences of heterogeneous dopamine release in the limbic system, and how these properties are persistently altered in the drug-experienced brain. We propose that these spatiotemporally parallel dopaminergic signals are simultaneously available to the animal, but that these circuits are impaired following prolonged drug experience by disrupting the location and content of dopamine signals in afferent target regions. These findings are discussed in the context of relapse and pathways to discovering new treatments for addiction disorders.

Chronic ethanol exposure increases inhibition of optically targeted phasic dopamine release in the nucleus accumbens core and medial shell ex vivo

Dopamine signaling encodes reward learning and motivated behavior through modulation of synaptic signaling in the nucleus accumbens, and aberrations in these processes are thought to underlie obsessive behaviors associated with alcohol abuse. The nucleus accumbens is divided into core and shell sub-regions with overlapping but also divergent contributions to behavior. Here we optogenetically targeted dopamine projections to the accumbens allowing us to isolate stimulation of dopamine terminals ex vivo. We applied 5 pulse (phasic) light stimulations to probe intrinsic differences in dopamine release parameters across regions. Also, we exposed animals to 4weeks of chronic intermittent ethanol vapor and measured phasic release. We found that initial release probability, uptake rate and autoreceptor inhibition were greater in the accumbens core compared to the shell, yet the shell showed greater phasic release ratios. Following chronic ethanol, uptake rates were increased in the core but not the shell, suggesting region-specific neuronal adaptations. Conversely, kappa opioid receptor function was upregulated in both regions to a similar extent, suggesting a local mechanism of kappa opioid receptor regulation that is generalized across the nucleus accumbens. These data suggest that dopamine axons in the nucleus accumbens core and shell display differences in intrinsic release parameters, and that ethanol-induced adaptations to dopamine neuron terminal fields may not be homogeneous. Also, chronic ethanol exposure induces an upregulation in kappa opioid receptor function, providing a mechanism for potential over-inhibition of accumbens dopamine signaling which may negatively impact downstream synaptic function and ultimately bias choice towards previously reinforced alcohol use behaviors.

Distinctive Modulation of Dopamine Release in the Nucleus Accumbens Shell Mediated by Dopamine and Acetylcholine Receptors

Nucleus accumbens (NAc) shell shows unique dopamine (DA) signals in vivo and plays a unique role in DA-dependent behaviors such as reward-motivated learning and the response to drugs of abuse. A disynaptic mechanism for DA release was reported and shown to require synchronized firing of cholinergic interneurons (CINs) and activation of nicotinic acetylcholine (ACh) receptors (nAChRs) in DA neuron (DAN) axons. The properties of this disynaptic mechanism of DA transmission are not well understood in the NAc shell. In this study, in vitro fast-scan cyclic voltammetry was used to examine the modulation of DA transmission evoked by CINs firing in the shell of mice and compared with other striatal regions. We found that DA signals in the shell displayed significant degree of summation in response to train stimulation of CINs, contrary to core and dorsal striatum. The summation was amplified by a D2-like receptor antagonist and experiments with mice with targeted deletion of D2 receptors to DANs or CINs revealed that D2 receptors in CINs mediate a fast inhibition observed within 100 ms of the first pulse, whereas D2 autoreceptors in DAN terminals are engaged in a slower inhibition that peaks at ∼500 ms. ACh also contributes to the use-dependent inhibition of DA release through muscarinic receptors only in the shell, where higher activity of acetylcholinesterase minimizes nAChR desensitization and promotes summation. These findings show that DA signals are modulated differentially by endogenous DA and ACh in the shell, which may underlie the unique features of shell DA signals in vivoSIGNIFICANCE STATEMENT The present study reports that dopamine (DA) release evoked by activation of cholinergic interneurons displays a high degree of summation in the shell and shows unique modulation by endogenous DA and acetylcholine. Desensitization of nicotinic receptors, which is a prevailing mechanism for use-dependent inhibition in the nucleus accumbens core and dorsal striatum, is also minimal in the shell in part due to elevated acetylcholinesterase activity. This distinctive modulation of DA transmission in the shell may have functional implications in the acquisition of reward-motivated behaviors and reward seeking.

Hypocretin receptor 1 blockade produces bimodal modulation of cocaine-associated mesolimbic dopamine signaling

RATIONALE

Cocaine addiction is a chronic psychiatric disorder characterized by pathological motivation to obtain cocaine and behavioral and neurochemical hypersensitivity to cocaine-associated cues. These features of cocaine addiction are thought to be driven by aberrant phasic dopamine signaling. We previously demonstrated that blockade of the hypocretin receptor 1 (HCRTr1) attenuates cocaine self-administration and reduces cocaine-induced enhancement of dopamine signaling. Despite this evidence, the effects of HCRTr1 blockade on endogenous phasic dopamine release are unknown.

OBJECTIVE

In the current studies, we assessed whether blockade of HCRTr1 alters spontaneous and cue-evoked dopamine release in the nucleus accumbens core of freely moving rats.

METHODS

We first validated the behavioral and neurochemical effects of the novel, highly selective, HCRTr1 antagonist RTIOX-276 using cocaine self-administration and fast-scan cyclic voltammetry (FSCV) in anesthetized rats. We then used FSCV in freely moving rats to examine whether RTIOX-276 impacts spontaneous and cue-evoked dopamine release. Finally, we used ex vivo slice FSCV to determine whether the effects of RTIOX-276 on dopamine signaling involve dopamine terminal adaptations.

RESULTS

Doses of RTIOX-276 that attenuate the motivation for cocaine reduce spontaneous dopamine transient amplitude and cue-evoked dopamine release. Further, these doses attenuated cocaine-induced dopamine uptake inhibition at the level of dopamine terminals.

CONCLUSION

Our results provide support for the standing hypothesis that HCRTr1 blockade suppresses endogenous phasic dopamine signals, likely via actions at dopamine cell bodies. These results also elucidate a second process through which HCRTr1 blockade attenuates the effects of cocaine by reducing cocaine sensitivity at dopamine terminals.

Central GLP-1 receptor activation modulates cocaine-evoked phasic dopamine signaling in the nucleus accumbens core

Drugs of abuse increase the frequency and magnitude of brief (1-3s), high concentration (phasic) dopamine release events in terminal regions. These are thought to be a critical part of drug reinforcement and ultimately the development of addiction. Recently, metabolic regulatory peptides, including the satiety signal glucagon-like peptide-1 (GLP-1), have been shown to modulate cocaine reward-driven behavior and sustained dopamine levels after cocaine administration. Here, we use fast-scan cyclic voltammetry (FSCV) to explore GLP-1 receptor (GLP-1R) modulation of dynamic dopamine release in the nucleus accumbens (NAc) during cocaine administration. We analyzed dopamine release events in both the NAc shell and core, as these two subregions are differentially affected by cocaine and uniquely contribute to motivated behavior. We found that central delivery of the GLP-1R agonist Exendin-4 suppressed the induction of phasic dopamine release events by intravenous cocaine. This effect was selective for dopamine signaling in the NAc core. Suppression of phasic signaling in the core by Exendin-4 could not be attributed to interference with cocaine binding to one of its major substrates, the dopamine transporter, as cocaine-induced increases in reuptake were unaffected. The results suggest that GLP-1R activation, instead, exerts its suppressive effects by altering dopamine release - possibly by suppressing the excitability of dopamine neurons. Given the role of NAc core dopamine in the generation of conditioned responses based on associative learning, suppression of cocaine-induced dopamine signaling in this subregion by GLP-1R agonism may decrease the reinforcing properties of cocaine. Thus, GLP-1Rs remain viable targets for the treatment and prevention of cocaine seeking, taking and relapse.

Rapid induction of dopamine sensitization in the nucleus accumbens shell induced by a single injection of cocaine

Repeated intermittent exposure to cocaine results in the neurochemical sensitization of dopamine (DA) transmission within the nucleus accumbens (NAc). Indeed, the excitability of DA neurons in the ventral tegmental area (VTA) is enhanced within hours of initial psychostimulant exposure. However, it is not known if this is accompanied by a comparably rapid change in the ability of cocaine to increase extracellular DA concentrations in the ventral striatum. To address this question we used fast-scan cyclic voltammetry (FSCV) in awake-behaving rats to measure DA responses in the NAc shell following an initial intravenous cocaine injection, and then again 2-h later. Both injections quickly elevated DA levels in the NAc shell, but the second cocaine infusion produced a greater effect than the first, indicating sensitization. This suggests that a single injection of cocaine induces sensitization-related plasticity very rapidly within the mesolimbic DA system.

Regional influence of cocaine on evoked dopamine release in the nucleus accumbens core: A role for the caudal brainstem

Cocaine increases dopamine concentration in the nucleus accumbens through competitive binding to the dopamine transporter (DAT). However, it also increases the frequency of dopamine release events, a finding that cannot be explained by action at the DAT alone. Rather, this effect may be mediated by cocaine-induced modulation of brain regions that project to dopamine neurons. To explore regional contributions of cocaine to dopamine signaling, we administered cocaine to the lateral or fourth ventricles and compared the effects on dopamine release in the nucleus accumbens evoked by electrical stimulation of the ventral tegmental area to that of systemically-delivered cocaine. Stimulation trains caused a sharp rise in dopamine followed by a slower return to baseline. The magnitude of dopamine release ([DA]max) as well as the latency to decay to fifty percent of the maximum (t(1/2); index of DAT activity) by each stimulation train were recorded. All routes of cocaine delivery caused an increase in [DA]max; only systemic cocaine caused an increase in t(1/2). Importantly, these data are the first to show that hindbrain (fourth ventricle)-delivered cocaine modulates phasic dopamine signaling. Fourth ventricular cocaine robustly increased cFos immunoreactivity in the nucleus of the solitary tract (NTS), suggesting a neural substrate for hindbrain cocaine-mediated effects on [DA]max. Together, the data demonstrate that cocaine-induced effects on phasic dopamine signaling are mediated via actions throughout the brain including the hindbrain.

Dopamine D3 Receptor Antagonists as Potential Therapeutics for the Treatment of Neurological Diseases

D3 receptors represent a major focus of current drug design and development of therapeutics for dopamine-related pathological states. Their close homology with the D2 receptor subtype makes the development of D3 selective antagonists a challenging task. In this review, we explore the relevance and therapeutic utility of D3 antagonists or partial agonists endowed with multireceptor affinity profile in the field of central nervous system disorders such as schizophrenia and drug abuse. In fact, the peculiar distribution and low brain abundance of D3 receptors make them a valuable target for the development of drugs devoid of motor side effects classically elicited by D2 antagonists. Recent research efforts were devoted to the conception of chemical templates possibly endowed with a multi-target profile, especially with regards to other G-protein-coupled receptors (GPCRs). A comprehensive overview of the recent literature in the field is herein provided. In particular, the evolution of the chemical templates has been tracked, according to the growing advancements in both the structural information and the refinement of the key pharmacophoric elements. The receptor/multireceptor affinity and functional profiles for the examined compounds have been covered, together with their most significant pharmacological applications.

Dopamine and opioid systems interact within the nucleus accumbens to maintain monogamous pair bonds

Prairie vole breeder pairs form monogamous pair bonds, which are maintained through the expression of selective aggression toward novel conspecifics. Here, we utilize behavioral and anatomical techniques to extend the current understanding of neural mechanisms that mediate pair bond maintenance. For both sexes, we show that pair bonding up-regulates mRNA expression for genes encoding D1-like dopamine (DA) receptors and dynorphin as well as enhances stimulated DA release within the nucleus accumbens (NAc). We next show that D1-like receptor regulation of selective aggression is mediated through downstream activation of kappa-opioid receptors (KORs) and that activation of these receptors mediates social avoidance. Finally, we also identified sex-specific alterations in KOR binding density within the NAc shell of paired males and demonstrate that this alteration contributes to the neuroprotective effect of pair bonding against drug reward. Together, these findings suggest motivational and valence processing systems interact to mediate the maintenance of social bonds.

Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination

Phasic dopamine (DA) release is believed to guide associative learning. Most studies have focused on projections from the ventral tegmental area (VTA) to the striatum, and the action of DA in other VTA target regions remains unclear. Using optogenetic activation of VTA projections, we examined DA function in the medial prefrontal cortex (mPFC). We found that mice perceived optogenetically induced DA release in mPFC as neither rewarding nor aversive, and did not change their previously learned behavior in response to DA transients. However, repetitive temporal pairing of an auditory conditioned stimulus (CS) with mPFC DA release resulted in faster learning of a subsequent task involving discrimination of the same CS against unpaired stimuli. Similar results were obtained using both appetitive and aversive unconditioned stimuli, supporting the notion that DA transients in mPFC do not represent valence. Using extracellular recordings, we found that CS-DA pairings increased firing of mPFC neurons in response to CSs, and administration of D1 or D2 DA-receptor antagonists in mPFC during learning impaired stimulus discrimination. We conclude that DA transients tune mPFC neurons for the recognition of behaviorally relevant events during learning.

Intranasal Dopamine Reduces In Vivo [(123)I]FP-CIT Binding to Striatal Dopamine Transporter: Correlation with Behavioral Changes and Evidence for Pavlovian Conditioned Dopamine Response

Purpose: Dopamine (DA), which does not cross the blood-brain barrier, has central and behavioral effects when administered via the nasal route. Neither the mechanisms of central action of intranasal dopamine (IN-DA), nor its mechanisms of diffusion and transport into the brain are well understood. We here examined whether IN-DA application influences dopamine transporter (DAT) binding in the dorsal striatum and assessed the extent of binding in relation to motor and exploratory behaviors. We hypothesized that, based on the finding of increased extracellular DA in the striatum induced by application of IN-DA, binding of [¹²³I]FP-CIT to the DAT should be decreased due to competition at the receptor.

Methods: Rats were administered 3 mg/kg IN-DA and vehicle (VEH), with IN-DA injection either preceding or following VEH. Then motor and exploratory behaviors (traveled distance, velocity, center time, sitting, rearing, head-shoulder motility, grooming) were assessed for 30 min in an open field prior to administration of [¹²³I]FP-CIT. DAT binding after IN-DA and VEH was measured with small animal SPECT 2 h following administration of the radioligand.

Results: (1) After IN-DA application, striatal DAT binding was significantly lower as compared to VEH, indicating that the nasally delivered DA had central action and increased DA levels comparable to that found previously with L-DOPA administration; and (2) DAT binding in response to intranasal VEH was lower when IN-DA application preceded VEH treatment. This finding is suggestive of Pavlovian conditioning of DA at the level of the DAT, since the DA treatment modified (decreased) the binding in response to the subsequent VEH treatment. VEH treatment also reduced motor and exploratory behaviors more when applied before, as compared to when it followed IN-DA application, also indicative of behavioral Pavlovian conditioning akin to that found upon application of various psychostimulant drugs.

Conclusions: The results: (a) demonstrate a direct central action of intranasally applied DA on the DAT in the dorsal striatum, indicating enhanced DA availability; and (b) provide first evidence of a Pavlovian conditioned DA response at the DAT. The latter results have relevance to understanding neurochemical mechanisms that underlie placebo action in the treatment of Parkinsonian patients.

A selective D3 receptor antagonist YQA14 attenuates methamphetamine-induced behavioral sensitization and conditioned place preference in mice

AIM

We have reported that a selective dopamine D3 receptor antagonist YQA14 attenuates cocaine reward and relapse to drug-seeking in mice. In the present study, we investigated whether YQA14 could inhibit methamphetamine (METH)-induced locomotor sensitization and conditioned place preference (CPP) in mice.

METHODS

Locomotor activity was monitored in mice treated with METH (1 mg/kg, ip) daily on d 4-13, followed by a challenge with METH (0.5 mg/kg) on d 21. CPP was examined in mice that were administered METH (1 mg/kg) or saline alternately on each other day for 8 days (METH conditioning). YQA14 was injected intraperitoneally 20 min prior to METH or saline.

RESULTS

Both repetitive (daily on d 4-13) and a single injection (on the day of challenge) of YQA14 (6.25, 12.5 and 25 mg/kg) dose-dependently inhibited the acquisition and expression of METH-induced locomotor sensitization. However, repetitive injection of YQA14 (daily during the METH conditioning) did not alter the acquisition of METH-induced CPP, whereas a single injection of YQA14 (prior to CPP test) dose-dependently attenuated the expression of METH-induced CPP. In addition, the repetitive injection of YQA14 dose-dependently facilitated the extinction and decreased the reinstatement of METH-induced CPP.

CONCLUSION

Brain D3 receptors are critically involved in the reward and psychomotor-stimulating effects of METH. Thus, YQA14 deserves further study as a potential medication for METH addiction.

Mesolimbic dopamine signals the value of work

Dopamine cell firing can encode errors in reward prediction, providing a learning signal to guide future behavior. Yet dopamine is also a key modulator of motivation, invigorating current behavior. Existing theories propose that fast (phasic) dopamine fluctuations support learning, whereas much slower (tonic) dopamine changes are involved in motivation. We examined dopamine release in the nucleus accumbens across multiple time scales, using complementary microdialysis and voltammetric methods during adaptive decision-making. We found that minute-by-minute dopamine levels covaried with reward rate and motivational vigor. Second-by-second dopamine release encoded an estimate of temporally discounted future reward (a value function). Changing dopamine immediately altered willingness to work and reinforced preceding action choices by encoding temporal-difference reward prediction errors. Our results indicate that dopamine conveys a single, rapidly evolving decision variable, the available reward for investment of effort, which is employed for both learning and motivational functions.

Self-reported cue-induced physical symptoms of craving as an indicator of cocaine dependence

BACKGROUND

The presence of cocaine dependence is under-recognized by cocaine users and requires a careful standardized interview to be ascertained by clinicians.

OBJECTIVE

To test if past experiences of cue-induced physical symptoms of craving (nausea, vomiting, sweating, shaking, nervousness) before cocaine use could be a useful way to boost the diagnosis of cocaine dependence.

METHODS

A cross-sectional study of 221 cocaine users from several outpatient addiction treatment services in France, addressing the most severe period of cocaine use. DSM-IV cocaine dependence was determined with the MINI International Neuropsychiatric Interview (MINI). Physical symptoms before using cocaine were retrospectively assessed with a single item rated on a 0-5 scale.

RESULTS

The prevalence of DSM-IV cocaine dependence was 84.6%. The mean score on the physical symptoms item was 1.3 (SD 1.3). A cut-off score of ≥ 1 on this item alone resulted in a sensitivity of 62%, a specificity of 88.2%, a positive predictive value of 96.6% and a negative predictive value of 29.7% to detect DSM IV cocaine dependence in this sample. Adding this item to a model with the frequency of cocaine use significantly increased the predictive power: Nagelkerke's R(2) increased from .149 to .326 (p < .001).

DISCUSSION AND CONCLUSION

Recalling past experiences of cue-induced physical signs of cocaine craving is associated with a clinical diagnosis of lifetime cocaine dependence and could be a simple way to improve its detection in clinical settings.

Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation

Mesolimbic dopamine (DA) is phasically released during appetitive behaviors, though there is substantive disagreement about the specific purpose of these DA signals. For example, prediction error (PE) models suggest a role of learning, while incentive salience (IS) models argue that the DA signal imbues stimuli with value and thereby stimulates motivated behavior. However, within the nucleus accumbens (NAc) patterns of DA release can strikingly differ between subregions, and as such, it is possible that these patterns differentially contribute to aspects of PE and IS. To assess this, we measured DA release in subregions of the NAc during a behavioral task that spatiotemporally separated sequential goal-directed stimuli. Electrochemical methods were used to measure subsecond NAc dopamine release in the core and shell during a well learned instrumental chain schedule in which rats were trained to press one lever (seeking; SL) to gain access to a second lever (taking; TL) linked with food delivery, and again during extinction. In the core, phasic DA release was greatest following initial SL presentation, but minimal for the subsequent TL and reward events. In contrast, phasic shell DA showed robust release at all task events. Signaling decreased between the beginning and end of sessions in the shell, but not core. During extinction, peak DA release in the core showed a graded decrease for the SL and pauses in release during omitted expected rewards, whereas shell DA release decreased predominantly during the TL. These release dynamics suggest parallel DA signals capable of supporting distinct theories of appetitive behavior.

SIGNIFICANCE STATEMENT

Dopamine signaling in the brain is important for a variety of cognitive functions, such as learning and motivation. Typically, it is assumed that a single dopamine signal is sufficient to support these cognitive functions, though competing theories disagree on how dopamine contributes to reward-based behaviors. Here, we have found that real-time dopamine release within the nucleus accumbens (a primary target of midbrain dopamine neurons) strikingly varies between core and shell subregions. In the core, dopamine dynamics are consistent with learning-based theories (such as reward prediction error) whereas in the shell, dopamine is consistent with motivation-based theories (e.g., incentive salience). These findings demonstrate that dopamine plays multiple and complementary roles based on discrete circuits that help animals optimize rewarding behaviors.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Estradiol, dopamine and motivation

The gonadal hormone estradiol modulates mesolimbic dopamine systems in the female rat. This modulatory effect is thought to be responsible for the observed effects of estradiol on motivated behaviors. Dopamine acting in the nucleus accumbens is thought to be important for the attribution of incentive motivational properties to cues that predict reward delivery, while dopamine in the striatum is associated with the expression of repetitive or stereotyped behaviors. Elevated concentrations of estradiol are associated with increased motivation for sex or cues associated with access to a mate, while simultaneously attenuating motivation for food. This shift in motivational salience is important for adaptive choice behavior in the natural environment. Additionally, estradiol's adaptive effects on motivation can be maladaptive when increasing motivation for non-natural reinforcers, such as drugs of abuse. Here we discuss the effect of estradiol on mesotelencephalic dopamine transmission and subsequent effects on motivated behaviors.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Role of Dopamine Neurons in Reward and Aversion: A Synaptic Plasticity Perspective

The brain is wired to predict future outcomes. Experience-dependent plasticity at excitatory synapses within dopamine neurons of the ventral tegmental area, a key region for a broad range of motivated behaviors, is thought to be a fundamental cellular mechanism that enables adaptation to a dynamic environment. Thus, depending on the circumstances, dopamine neurons are capable of processing both positive and negative reinforcement learning strategies. In this review, we will discuss how changes in synaptic plasticity of dopamine neurons may affect dopamine release, as well as behavioral adaptations to different environmental conditions falling at opposite ends of a saliency spectrum ranging from reward to aversion.

Examination of Rapid Dopamine Dynamics with Fast Scan Cyclic Voltammetry During Intra-oral Tastant Administration in Awake Rats

Rapid, phasic dopamine (DA) release in the mammalian brain plays a critical role in reward processing, reinforcement learning, and motivational control. Fast scan cyclic voltammetry (FSCV) is an electrochemical technique with high spatial and temporal (sub-second) resolution that has been utilized to examine phasic DA release in several types of preparations. In vitro experiments in single-cells and brain slices and in vivo experiments in anesthetized rodents have been used to identify mechanisms that mediate dopamine release and uptake under normal conditions and in disease models. Over the last 20 years, in vivo FSCV experiments in awake, freely moving rodents have also provided insight of dopaminergic mechanisms in reward processing and reward learning. One major advantage of the awake, freely moving preparation is the ability to examine rapid DA fluctuations that are time-locked to specific behavioral events or to reward or cue presentation. However, one limitation of combined behavior and voltammetry experiments is the difficulty of dissociating DA effects that are specific to primary rewarding or aversive stimuli from co-occurring DA fluctuations that mediate reward-directed or other motor behaviors. Here, we describe a combined method using in vivo FSCV and intra-oral infusion in an awake rat to directly investigate DA responses to oral tastants. In these experiments, oral tastants are infused directly to the palate of the rat--bypassing reward-directed behavior and voluntary drinking behavior--allowing for direct examination of DA responses to tastant stimuli.

Increased latencies to initiate cocaine self-administration following laterodorsal tegmental nucleus lesions

Cholinergic input to the ventral tegmental area (VTA), origin of the mesocorticolimbic dopamine system that is critical for cocaine reward, is important for both cocaine seeking and cocaine taking. The laterodorsal tegmental nucleus (LDTg) provides one of the two major sources of excitatory cholinergic input to the VTA, but little is known of the role of the LDTg in cocaine reward. LDTg cholinergic cells express urotensin-II receptors and here we used local microinjections of a conjugate of the endogenous ligand for these receptors with diphtheria toxin (Dtx::UII) to lesion the cholinergic cells of the LDTg in rats previously trained to self-administer cocaine (1mg/kg/infusion, i.v.). Lesioned rats showed long latencies to initiate cocaine self-administration after treatment with the toxin, which resulted in a reduction in cocaine intake per session. Priming injections reduced latencies to initiate responding for cocaine in lesioned rats, and once they began to respond the rats regulated their moment-to-moment cocaine intake within normal limits. Thus we conclude that while LDTg cholinergic cell loss does not significantly alter the rewarding effects of cocaine, LDTg lesions can reduce the rat's responsiveness to cocaine-predictive stimuli.

Regional variation in phasic dopamine release during alcohol and sucrose self-administration in rats

While dopamine input to the dorsal striatum is well-known to be critical for action selection, including alcohol-motivated behaviors, it is unknown whether changes in phasic dopamine accompany these behaviors. Long-term alcohol abuse is believed to promote alterations in the neurocircuitry of reward learning in both ventral and dorsal striatum, potentially through increasing dopamine release. Using fast-scan cyclic voltammetry, we measured phasic dopamine release in the dorsal and ventral striatum during alcoholic and nonalcoholic reward-seeking behavior and reward-related cues in rats trained on a variable-interval schedule of reinforcement. We observed robust phasic dopamine release in the dorsolateral striatum after reinforced lever presses and inconsistent dopamine release in the dorsomedial striatum. Contrary to our expectations, alcohol did not enhance dopamine release in rats drinking alcoholic rewards. Cue-induced dopamine release was also observed in the nucleus accumbens core of rats drinking the reward solutions. These data demonstrate that alcoholic and nonalcoholic reward self-administration on a variable-interval schedule of reinforcement in rats is accompanied by phasic dopamine release time-locked to reinforcement in the dorsolateral striatum and the nucleus accumbens, but not the dorsomedial striatum.

A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature

Survival is dictated by an organism's fitness in approaching positive stimuli and avoiding harm. While a rich literature outlines a role for mesolimbic dopamine in reward and appetitive behaviors, dopamine's involvement in aversion and avoidance behaviors remains controversial. Debate surrounding dopamine's function in the processing of negative stimuli likely stems from conflicting results reported by single-unit electrophysiological studies. Indeed, a number of studies suggest that midbrain dopaminergic cells are inhibited by the presentation of negative or fearful stimuli, while others report no change, or even an increase, in their activity. These disparate results may be due to population heterogeneity. Recent evidence demonstrates that midbrain dopamine neurons are heterogeneous in their projection targets, responses to environmental stimuli, pharmacology, and influences on motivated behavior. Thus, in order to assemble an accurate account of dopamine function during aversive stimulus experience and related behavior, it is necessary to examine the functional output of dopamine neural activity at mesolimbic terminal regions. This Review presents a growing body of evidence that dopamine release in the nucleus accumbens encodes not only reward, but also aversion. For example, our laboratory recently utilized fast-scan cyclic voltammetry to show that real-time changes in accumbal dopamine release are detected when animals are presented with predictors of aversion and its avoidance. These data, along with other reports, support a considerably more nuanced view of dopamine neuron function, wherein accumbal dopamine release is differentially modulated by positive and negative affective stimuli to promote adaptive behaviors.

Sampling phasic dopamine signaling with fast-scan cyclic voltammetry in awake, behaving rats

Fast-scan cyclic voltammetry (FSCV) is an electrochemical technique that permits the in vivo measurement of extracellular fluctuations in multiple chemical species. The technique is frequently utilized to sample sub-second (phasic) concentration changes of the neurotransmitter dopamine in awake and behaving rats. Phasic dopamine signaling is implicated in reinforcement, goal-directed behavior, and locomotion, and FSCV has been used to investigate how rapid changes in striatal dopamine concentration contribute to these and other behaviors. This unit describes the instrumentation and construction, implantation, and use of components required to sample and analyze dopamine concentration changes in awake rats with FSCV.