Phasic mesolimbic dopamine release tracks reward seeking during expression of Pavlovian-to-instrumental transfer

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

High fat diet allows food-predictive stimuli to energize action performance in the absence of hunger, without distorting insulin signaling on accumbal cholinergic interneurons

Obesity can disrupt how food-predictive stimuli control action performance and selection. These two forms of control recruit cholinergic interneurons (CIN) located in the nucleus accumbens core (NAcC) and shell (NAcS), respectively. Given that obesity is associated with insulin resistance in this region, we examined whether interfering with CIN insulin signaling disrupts how food-predictive stimuli control actions. To interfere with insulin signaling we used a high-fat diet (HFD) or genetic excision of insulin receptor (InsR) from cholinergic cells. HFD left intact the capacity of food-predictive stimuli to energize performance of an action earning food when mice were tested hungry. However, it allowed this energizing effect to persist when the mice were tested sated. This persistence was linked to NAcC CIN activity but was not associated with distorted CIN insulin signaling. Accordingly, InsR excision had no effect on how food-predicting stimuli control action performance. Next, we found that neither HFD nor InsR excision altered the capacity of food-predictive stimuli to guide action selection. Yet, this capacity was associated with changes in NAcS CIN activity. These results indicate that insulin signaling on accumbal CIN does not modulate how food-predictive stimuli control action performance and selection. However, they show that HFD allows food-predictive stimuli to energize performance of an action earning food in the absence of hunger.

Hierarchical cue control of cocaine seeking in the face of cost

RATIONALE

Addiction is characterized by intermittent drug seeking despite rising costs. This behavior is heavily influenced by environmental stimuli that signal drug availability and reinforce drug seeking.

OBJECTIVE

To establish the relationship between three key aspects of human drug use in rats: the intermittent, binge nature of drug intake, the motivational conflict of drug seeking in the face of escalating negative costs, and the ability of different drug cues to interact to modulate relapse.

METHODS

Male and female rats were trained to self-administer cocaine on an intermittent access schedule, where brief drug-availability states were signaled by a shift in the ambient lighting of the environment, and cocaine infusions were signaled by a separate proximal discrete cue. Rats then went through a conflict procedure, where foot shock intensity associated with cocaine seeking was escalated until intake was suppressed. We then completed relapse tests where the drug-delivery cue was noncontingently presented alone, or in the context of dynamic drug-availability state transitions.

RESULTS

Intermittent access spurred psychomotor sensitization and binge-like cocaine intake. The intensity of binge-like drug taking during training was predictive of later drug seeking despite escalating costs during conflict. In relapse tests, the ability of a proximal discrete drug cue to trigger relapse was gated by the presence of a global cue signaling drug-availability state transitions.

CONCLUSIONS

Our results suggest that the pattern of drug intake plays a role in many features of addiction, including modifying an individual's willingness to endure high costs associated with drug seeking. Furthermore, our studies indicate that drug-related sensory information can be hierarchically organized to exert a dynamic modulating influence on drug-seeking motivation.

The role of the bed nucleus of the stria terminalis in the motivational control of instrumental action

We review recent studies assessing the role of the bed nucleus of the stria terminalis (BNST) in the motivational control of instrumental conditioning. This evidence suggests that the BNST and central nucleus of the amygdala (CeA) form a circuit that modulates the ventral tegmental area (VTA) input to the nucleus accumbens core (NAc core) to control the influence of Pavlovian cues on instrumental performance. In support of these claims, we found that activity in the oval region of BNST was increased by instrumental conditioning, as indexed by phosphorylated ERK activity (Experiment 1), but that this increase was not due to exposure to the instrumental contingency or to the instrumental outcome per se (Experiment 2). Instead, BNST activity was most significantly incremented in a test conducted when the instrumental outcome was anticipated but not delivered, suggesting a role for BNST in the motivational effects of anticipated outcomes on instrumental performance. To test this claim, we examined the effect of NMDA-induced cell body lesions of the BNST on general Pavlovian-to-instrumental transfer (Experiment 3). These lesions had no effect on instrumental performance or on conditioned responding during Pavlovian conditioning to either an excitory conditioned stimulus (CS) or a neutral CS (CS0) but significantly attenuated the excitatory effect of the Pavlovian CS on instrumental performance. These data are consistent with the claim that the BNST mediates the general excitatory influence of Pavlovian cues on instrumental performance and suggest BNST activity may be central to CeA-BNST modulation of a VTA-NAc core circuit in incentive motivation.

Right Unilateral Spatial Neglect Improves with Intrinsic Motivation

Background. In the acute phase of stroke, it is well known that the incidence and severity of unilateral spatial neglect (USN) are more significant in the right hemisphere injuries. Still, the detection of USN in left hemisphere injuries has been increasing in recent years. This trend is because behavioral assessments have prevented the exclusion of patients who are difficult to assess for USN or apathy using conventional paper-and-pencil tests (e.g., aphasia). Right USN and post-stroke apathy share many common lesions. Therefore, clinical symptoms may overlap, but little validation considers this. Case Study. A man (62 years old) determined to have the right USN and apathy was treated for six weeks in 3 terms. In the first term (weeks 1 to 2), the patient was treated for the right USN by conventional therapy. In the second term (3–4 weeks), treatment for right USN and apathy by goal-directed therapy based on affinity behavior was implemented. In the third term (5–6 weeks), goal-directed therapy based on affinity behavior was discontinued, and treatment was returned to conventional therapy only. In the second term (goal-directed therapy based on affinity behavior), the improvement in patients' apathy (clinical assessment for spontaneity) was more significant than the effect size in the third term (conventional therapy). There were no significant differences in USN (catherine bergego scale) and intrinsic motivation (pittsburgh rehabilitation participation scale). However, the effect size in the second term tended to be larger than in the third term (conventional therapy). Clinical Rehabilitation Impact. This report aims to demonstrate the limitations of current treatment for cases determined to have both right USN and apathy. Second, to assess the extent to which this new intervention can complement the limitations of current treatment.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Nucleus accumbens D1-receptors regulate and focus transitions to reward-seeking action

It is well established that dopamine transmission is integral in mediating the influence of reward expectations on reward-seeking actions. However, the precise causal role of dopamine transmission in moment-to-moment reward-motivated behavioral control remains contentious, particularly in contexts where it is necessary to refrain from responding to achieve a beneficial outcome. To examine this, we manipulated dopamine transmission pharmacologically as rats performed a Go/No-Go task that required them to either make or withhold action to gain either a small or large reward. D1R Stimulation potentiated cue-driven action initiation, including fast impulsive actions on No-Go trials. By contrast, D1R blockade primarily disrupted the successful completion of Go trial sequences. Surprisingly, while after global D1R blockade this was characterized by a general retardation of reward-seeking actions, nucleus accumbens core (NAcC) D1R blockade had no effect on the speed of action initiation or impulsive actions. Instead, fine-grained analyses showed that this manipulation decreased the precision of animals' goal-directed actions, even though they usually still followed the appropriate response sequence. Strikingly, such "unfocused" responding could also be observed off-drug, particularly when only a small reward was on offer. These findings suggest that the balance of activity at NAcC D1Rs plays a key role in enabling the rapid activation of a focused, reward-seeking state to enable animals to efficiently and accurately achieve their goal.

Applying a Fast-Scan Cyclic Voltammetry to Explore Dopamine Dynamics in Animal Models of Neuropsychiatric Disorders

Progress in the development of technologies for the real-time monitoring of neurotransmitter dynamics has provided researchers with effective tools for the exploration of etiology and molecular mechanisms of neuropsychiatric disorders. One of these powerful tools is fast-scan cyclic voltammetry (FSCV), a technique which has progressively been used in animal models of diverse pathological conditions associated with alterations in dopamine transmission. Indeed, for several decades FSCV studies have provided substantial insights into our understanding of the role of abnormal dopaminergic transmission in pathogenetic mechanisms of drug and alcohol addiction, Parkinson’s disease, schizophrenia, etc. Here we review the applications of FSCV to research neuropsychiatric disorders with particular attention to recent technological advances.

Phasic stimulation in the nucleus accumbens enhances learning after traumatic brain injury

Traumatic brain injury (TBI) is a significant cause of morbidity and mortality worldwide. Despite improvements in survival, treatments that improve functional outcome remain lacking. There is, therefore, a pressing need to develop novel treatments to improve functional recovery. Here, we investigated task-matched deep-brain stimulation of the nucleus accumbens (NAc) to augment reinforcement learning in a rodent model of TBI. We demonstrate that task-matched deep brain stimulation (DBS) of the NAc can enhance learning following TBI. We further demonstrate that animals receiving DBS exhibited greater behavioral improvement and enhanced neural proliferation. Treated animals recovered to an uninjured behavioral baseline and showed retention of improved performance even after stimulation was stopped. These results provide encouraging early evidence for the potential of NAc DBS to improve functional outcomes following TBI and that its effects may be broad, with alterations in neurogenesis and synaptogenesis.

Effort-motivated behavior resolves paradoxes in appetitive conditioning

Motivated behavior has long been studied by psychologists, ethologists, and neuroscientists. To date, many scientists agree with the view that cue and reward attraction is the product of a dopamine-dependent unconscious process called incentive salience or "wanting". This process allows the influence of multiple factors such as hunger and odors on motivational attraction. In some cases, however, the resulting motivated behavior differs from what the incentive salience hypothesis would predict. I argue that seeking behavior under reward uncertainty illustrates this situation: Organisms do not just "want" (appetite-based attraction) cues that are inconsistent or associated with reward occasionally, they "hope" that those cues will consistently predict reward procurement in the ongoing trial. Said otherwise, they become motivated to invest time and energy to find consistent cue-reward associations despite no guarantee of success (effort-based attraction). A multi-test comparison of performance between individuals trained under uncertainty and certainty reveals behavioral paradoxes suggesting that the concept of incentive salience cannot fully account for responding to inconsistent cues. A mathematical model explains how appetite-based and effort-based attractions might combine their effects.

Reactivating a positive feedback loop VTA-BLA-NAc circuit associated with positive experience ameliorates the attenuated reward sensitivity induced by chronic stress

Both genetic predisposition and life events, particularly life stress, are thought to increase the risk for depression. Reward sensitivity appears to be attenuated in major depressive disorder (MDD), suggesting deficits in reward processing in these patients. We identified the VTA-BLA-NAc circuit as being activated by sex reward, and the VTA neurons that respond to sex reward are mostly dopaminergic. Acute or chronic reactivation of this circuit ameliorates the reward insensitivity induced by chronic restraint stress. Our histological and electrophysiological results show that the VTA neuron subpopulation responding to restraint stress, predominantly GABAergic neurons, inhibits the responsiveness of VTA dopaminergic neurons to reward stimuli, which is probably the mechanism by which stress modulates the reward processing neural circuits and subsequently disrupts reward-related behaviours. Furthermore, we found that the VTA-BLA-NAc circuit is a positive feedback loop. Blocking the projections from the BLA to the NAc associated with sex reward increases the excitability of VTA GABAergic neurons and decreases the excitability of VTA dopaminergic neurons, while activating this pathway decreases the excitability of VTA GABAergic neurons and increases the excitability of VTA dopaminergic neurons, which may be the cellular mechanism by which the VTA-BLA-NAc circuit associated with sex reward ameliorates the attenuated reward sensitivity induced by chronic stress.

Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder

Purpose of Review

Current theories of alcohol use disorders (AUD) highlight the importance of Pavlovian and instrumental learning processes mainly based on preclinical animal studies. Here, we summarize available evidence for alterations of those processes in human participants with AUD with a focus on habitual versus goal-directed instrumental learning, Pavlovian conditioning, and Pavlovian-to-instrumental transfer (PIT) paradigms.

Recent Findings

The balance between habitual and goal-directed control in AUD participants has been studied using outcome devaluation or sequential decision-making procedures, which have found some evidence of reduced goal-directed/model-based control, but little evidence for stronger habitual responding. The employed Pavlovian learning and PIT paradigms have shown considerable differences regarding experimental procedures, e.g., alcohol-related or conventional reinforcers or stimuli.

Summary

While studies of basic learning processes in human participants with AUD support a role of Pavlovian and instrumental learning mechanisms in the development and maintenance of drug addiction, current studies are characterized by large variability regarding methodology, sample characteristics, and results, and translation from animal paradigms to human research remains challenging. Longitudinal approaches with reliable and ecologically valid paradigms of Pavlovian and instrumental processes, including alcohol-related cues and outcomes, are warranted and should be combined with state-of-the-art imaging techniques, computational approaches, and ecological momentary assessment methods.

Acute and chronic bupropion treatment does not prevent morphine-induced conditioned place preference in mice

A substantial barrier to the treatment of Opioid Use Disorder (OUD) is the elevated relapse rates in affected patients, and a significant contributor to these events of relapse is exposure to cues and contexts that are intensely associated with prior drug abuse. The neurotransmitter dopamine plays a key role in reward-related behaviors, and previous studies have illustrated that dopamine hypofunction in periods of abstinence serves to prompt drug craving and seeking. We hypothesized that restoration of dopaminergic signaling could attenuate drug-seeking behaviors. Therefore, we investigated whether use of an FDA-approved drug, bupropion, an inhibitor of the dopamine transporter (DAT), or a dopamine uptake inhibitor with high affinity for DAT, JHW 007, was able to decrease preference for a drug-paired context. In these experiments, mice underwent 5 days of non-contingent morphine (10 mg/kg) exposure in a conditioned place preference (CPP) paradigm. We found that systemic injection of bupropion (20 mg/kg, i. p.) or intracranial injection of JHW 007 into the nucleus accumbens shell did not prevent the expression of morphine CPP. We then investigated whether chronic bupropion treatment (via implanted osmotic pumps) would influence morphine CPP. We observed that chronic bupropion treatment for 21 days following morphine conditioning did not attenuate the prolonged preference for morphine-paired contexts. Overall, with our dose and paradigm, neither acute nor chronic bupropion diminishes morphine CPP. Continued studies should address FDA-approved medications and their potential for recovery in OUD patients.

Dopamine promotes instrumental motivation, but reduces reward-related vigour

We can be motivated when reward depends on performance, or merely by the prospect of a guaranteed reward. Performance-dependent (contingent) reward is instrumental, relying on an internal action-outcome model, whereas motivation by guaranteed reward may minimise opportunity cost in reward-rich environments. Competing theories propose that each type of motivation should be dependent on dopaminergic activity. We contrasted these two types of motivation with a rewarded saccade task, in patients with Parkinson’s disease (PD). When PD patients were ON dopamine, they had greater response vigour (peak saccadic velocity residuals) for contingent rewards, whereas when PD patients were OFF medication, they had greater vigour for guaranteed rewards. These results support the view that reward expectation and contingency drive distinct motivational processes, and can be dissociated by manipulating dopaminergic activity. We posit that dopamine promotes goal-directed motivation, but dampens reward-driven vigour, contradictory to the prediction that increased tonic dopamine amplifies reward expectation.

(-)-Stepholidine blocks expression, but not development, of cocaine conditioned place preference in rats

The purpose of this study was to investigate the effects of (-)-stepholidine (SPD), a compound with dopamine D1 partial agonist and D2/D3 antagonist properties, on the development and expression of cocaine conditioned place preference (CPP). Subjects (N = 65; male Long Evans rats) were tested using a CPP procedure consisting of 3 phases: (1) a 15-min pre-exposure session where animals could explore each compartment freely, (2) eight 30-min conditioning sessions where animals were restricted to one side or the other with cocaine (10 mg/kg) or saline, respectively, on alternating days and (3) a 15-minute preference test session where animals could explore each compartment freely. To test the effects of SPD on expression of cocaine CPP, rats were administered vehicle (distilled water with 20 % DMSO), 10, 15 or 20 mg/kg SPD (intraperitoneally) 30 min prior to the test session. We found that 20 mg/kg of SPD significantly blocked the expression of cocaine CPP. To test the effects of SPD on the development of CPP, 0 (vehicle), 10, 15 or 20mg/kg SPD were administered 30 min prior to each cocaine conditioning session and vehicle before each saline conditioning session; no treatment was given prior to the test session. A preference test showed that each SPD group maintained a CPP similar to the vehicle group. These data indicate that SPD can block the expression of a cocaine CPP but has no effect on its development, suggesting that it inhibits the effects of cocaine cues on cocaine incentive motivated behavior. These results suggest that SPD may be a potential treatment for cue-driven aspects of cocaine use disorder.

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

The striatal dopamine system has long been studied in the context of reward learning, motivation, and movement. Given the prominent role dopamine plays in a variety of adaptive behavioral states, as well as diseases like addiction, it is essential to understand the full complexity of dopamine neurons and the striatal systems they target. A growing number of studies are uncovering details of the heterogeneity in dopamine neuron subpopulations. Here, we review that work to synthesize current understanding of dopamine system heterogeneity across three levels, anatomical organization, functions in behavior, and modes of action, wherein we focus on signaling profiles and local mechanisms for modulation of dopamine release. Together, these studies reveal new and emerging dimensions of the striatal dopamine system, informing its contribution to dynamic motivational and decision-making processes.

Opposite Consequences of Tonic and Phasic Increases in Accumbal Dopamine on Alcohol-Seeking Behavior

Despite many years of work on dopaminergic mechanisms of alcohol addiction, much of the evidence remains mostly correlative in nature. Fortunately, recent technological advances have provided the opportunity to explore the causal role of alterations in neurotransmission within circuits involved in addictive behaviors. Here, we address this critical gap in our knowledge by integrating an optogenetic approach and an operant alcohol self-administration paradigm to assess directly how accumbal dopamine (DA) release dynamics influences the appetitive (seeking) component of alcohol-drinking behavior. We show that appetitive reward-seeking behavior in rats trained to self-administer alcohol can be shaped causally by ventral tegmental area-nucleus accumbens (VTA-NAc) DA neurotransmission. Our findings reveal that phasic patterns of DA release within this circuit enhance a discrete measure of alcohol seeking, whereas tonic patterns of stimulation inhibit this behavior. Moreover, we provide mechanistic evidence that tonic-phasic interplay within the VTA-NAc DA circuit underlies these seemingly paradoxical effects.

•

VTA-NAc DA transmission can bidirectionally modulate motivated behavior

•

Optogenetic increases in phasic DA release in the NAc enhance alcohol seeking

•

Optogenetic increases in tonic DA release in the NAc inhibit alcohol seeking

•

Phasic DA release can be decreased by the concurrent tonic activation

Reward sensitivity predicts dopaminergic response in spatial neglect

It has recently been revealed that spatial neglect can be modulated by motivational factors including anticipated monetary reward. A number of dopaminergic agents have been evaluated as treatments for neglect, but the results have been mixed, with no clear anatomical or cognitive predictors of dopaminergic responsiveness. Given that the effects of incentive motivation are mediated by dopaminergic pathways that are variably damaged in stroke, we tested the hypothesis that the modulatory influences of reward and dopaminergic drugs on neglect are themselves related. We employed a single-dose, double-blind, crossover design to compare the effects of Co-careldopa and placebo on a modified visual cancellation task in patients with neglect secondary to right hemisphere stroke. Whilst confirming that reward improved visual search in this group, we showed that dopaminergic stimulation only enhances visual search in the absence of reward. When patients were divided into REWARD-RESPONDERs and REWARD-NON-RESPONDERs, we found an interaction, such that only REWARD-NON-RESPONDERs showed a positive response to reward after receiving Co-careldopa, whereas REWARD-RESPONDERs were not influenced by drug. At a neuroanatomical level, responsiveness to incentive motivation was most associated with intact dorsal striatum. These findings suggest that dopaminergic modulation of neglect follows an 'inverted U' function, is dependent on integrity of the reward system, and can be measured as a behavioural response to anticipated reward.

Nucleus Accumbens Cholinergic Interneurons Oppose Cue-Motivated Behavior

BACKGROUND

Environmental reward-predictive stimuli provide a major source of motivation for adaptive reward pursuit behavior. This cue-motivated behavior is known to be mediated by the nucleus accumbens (NAc) core. The cholinergic interneurons in the NAc are tonically active and densely arborized and thus well suited to modulate NAc function. However, their causal contribution to adaptive behavior remains unknown. Here we investigated the function of NAc cholinergic interneurons in cue-motivated behavior.

METHODS

We used chemogenetics, optogenetics, pharmacology, and a translationally analogous Pavlovian-to-instrumental transfer behavioral task designed to assess the motivating influence of a reward-predictive cue over reward-seeking actions in male and female rats.

RESULTS

The data show that NAc cholinergic interneuron activity critically opposes the motivating influence of appetitive cues. Chemogenetic inhibition of NAc cholinergic interneurons augmented cue-motivated behavior. Optical stimulation of acetylcholine release from NAc cholinergic interneurons prevented cues from invigorating reward-seeking behavior, an effect that was mediated by activation of β2-containing nicotinic acetylcholine receptors.

CONCLUSIONS

NAc cholinergic interneurons provide a critical regulatory influence over adaptive cue-motivated behavior and therefore are a potential therapeutic target for the maladaptive cue-motivated behavior that marks many psychiatric conditions, including addiction and depression.

Pavlovian-To-Instrumental Transfer and Alcohol Consumption in Young Male Social Drinkers: Behavioral, Neural and Polygenic Correlates

In animals and humans, behavior can be influenced by irrelevant stimuli, a phenomenon called Pavlovian-to-instrumental transfer (PIT). In subjects with substance use disorder, PIT is even enhanced with functional activation in the nucleus accumbens (NAcc) and amygdala. While we observed enhanced behavioral and neural PIT effects in alcohol-dependent subjects, we here aimed to determine whether behavioral PIT is enhanced in young men with high-risk compared to low-risk drinking and subsequently related functional activation in an a-priori region of interest encompassing the NAcc and amygdala and related to polygenic risk for alcohol consumption. A representative sample of 18-year old men (n = 1937) was contacted: 445 were screened, 209 assessed: resulting in 191 valid behavioral, 139 imaging and 157 genetic datasets. None of the subjects fulfilled criteria for alcohol dependence according to the Diagnostic and Statistical Manual of Mental Disorders-IV-TextRevision (DSM-IV-TR). We measured how instrumental responding for rewards was influenced by background Pavlovian conditioned stimuli predicting action-independent rewards and losses. Behavioral PIT was enhanced in high-compared to low-risk drinkers (b = 0.09, SE = 0.03, z = 2.7, p < 0.009). Across all subjects, we observed PIT-related neural blood oxygen level-dependent (BOLD) signal in the right amygdala (t = 3.25, p_SVC = 0.04, x = 26, y = -6, z = -12), but not in NAcc. The strength of the behavioral PIT effect was positively correlated with polygenic risk for alcohol consumption (r_s = 0.17, p = 0.032). We conclude that behavioral PIT and polygenic risk for alcohol consumption might be a biomarker for a subclinical phenotype of risky alcohol consumption, even if no drug-related stimulus is present. The association between behavioral PIT effects and the amygdala might point to habitual processes related to out PIT task. In non-dependent young social drinkers, the amygdala rather than the NAcc is activated during PIT; possible different involvement in association with disease trajectory should be investigated in future studies.

A role for the CD38 rs3796863 polymorphism in alcohol and monetary reward: evidence from CD38 knockout mice and alcohol self-administration, [11C]-raclopride binding, and functional MRI in humans

Background: Cluster of differentiation 38 (CD38) is a transmembrane protein expressed in dopaminergic reward pathways in the brain, including the nucleus accumbens (NAc). The GG genotype of a common single nucleotide polymorphism (SNP) within CD38, rs3796863, is associated with increased social reward.Objective: Examine whether CD38 rs3796863 and Cd38 knockout (KO) are associated with reward-related neural and behavioral phenotypes.Methods: Data from four independent human studies were used to test whether rs3796863 genotype is associated with: (1) intravenous alcohol self-administration (n = 64, 30 females), (2) alcohol-stimulated dopamine (DA) release measured using ¹¹C-raclopride positron emission tomography (n = 22 men), (3) ventral striatum (VS) response to positive feedback measured using a card guessing functional magnetic resonance imaging (fMRI) paradigm (n = 531, 276 females), and (4) resting state functional connectivity (rsfc) of the VS (n = 51, 26 females). In a fifth study, we used a mouse model to examine whether cd38 knockout influences stimulated DA release in the NAc core and dorsal striatum using fast-scanning cyclic voltammetry.Results: Relative to T allele carriers, G homozygotes at rs3796863 within CD38 were characterized by greater alcohol self-administration, alcohol-stimulated dopamine release, VS response to positive feedback, and rsfc between the VS and anterior cingulate cortex. High-frequency stimulation reduced DA release among Cd38 KO mice had reduced dopamine release in the NAc.Conclusion: Converging evidence suggests that CD38 rs3796863 genotype may increase DA-related reward response and alcohol consumption.

A Free-Operant Reward-Tracking Paradigm to Study Neural Mechanisms and Neurochemical Modulation of Adaptive Behavior in Rats

The ability to respond flexibly to changing environmental circumstances is a hallmark of goal-directed behavior, and compromised flexibility is associated with a wide range of psychiatric conditions in humans, such as addiction and stress-related disorders. To identify neural circuits and transmitter systems implicated in the provision of cognitive flexibility, suitable animal paradigms are needed. Ideally, such models should be easy to implement, allow for rapid task acquisition, provide multiple behavioral readouts, and permit combination with physiological and pharmacological testing and manipulation. Here, we describe a paradigm meeting these requirements and employ it to investigate the neural substrates and neurochemical modulation of adaptive behavior. Water-restricted rats learned to emit operant responses for positive reinforcement (water reward) within minutes in a free-operant conditioning environment. Without further training, animals were able to track changes in the reward schedule. Given prior evidence that the medial prefrontal cortex (mPFC) and the dopaminergic system are required for flexible behavior, we aimed to assess both in more detail. Silencing of mPFC compromised flexible behavior when avoidance of punishment was required. Systemic injections of the D2-receptor agonist quinpirole and the D2-receptor antagonist eticlopride had complex, differential impacts on reward seeking and adaptive behavior.

Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats

Efficient foraging requires an ability to coordinate discrete reward-seeking and reward-retrieval behaviors. We used pathway-specific chemogenetic inhibition to investigate how rats’ mesolimbic and mesocortical dopamine circuits contribute to the expression and modulation of reward seeking and retrieval. Inhibiting ventral tegmental area dopamine neurons disrupted the tendency for reward-paired cues to motivate reward seeking, but spared their ability to increase attempts to retrieve reward. Similar effects were produced by inhibiting dopamine inputs to nucleus accumbens, but not medial prefrontal cortex. Inhibiting dopamine neurons spared the suppressive effect of reward devaluation on reward seeking, an assay of goal-directed behavior. Attempts to retrieve reward persisted after devaluation, indicating they were habitually performed as part of a fixed action sequence. Our findings show that complete bouts of reward seeking and retrieval are behaviorally and neurally dissociable from bouts of reward seeking without retrieval. This dichotomy may prove useful for uncovering mechanisms of maladaptive behavior.

Dopamine Signaling Is Critical for Supporting Cue-Driven Behavioral Control

Mesolimbic dopamine has been implicated in reward learning. Fischbach-Weiss and Janak (this issue) use optogenetics to attenuate dopamine signaling and study its role in cue-driven motivated behavior.

Distinct cortical-amygdala projections drive reward value encoding and retrieval

The value of an anticipated rewarding event is a crucial component of the decision to engage in its pursuit. But little is known of the networks responsible for encoding and retrieving this value. By using biosensors and pharmacological manipulations, we found that basolateral amygdala (BLA) glutamatergic activity tracks and mediates encoding and retrieval of the state-dependent incentive value of a palatable food reward. Projection-specific, bidirectional chemogenetic and optogenetic manipulations revealed that the orbitofrontal cortex (OFC) supports the BLA in these processes. Critically, the function of ventrolateral and medial OFC→BLA projections is doubly dissociable. Whereas lateral OFC→BLA projections are necessary and sufficient for encoding of the positive value of a reward, medial OFC→BLA projections are necessary and sufficient for retrieving this value from memory. These data reveal a new circuit for adaptive reward valuation and pursuit and provide insight into the dysfunction in these processes that characterizes myriad psychiatric diseases.

Incentive hope: A default psychological response to multiple forms of uncertainty

Our target article proposes that a new concept - incentive hope - is necessary in the behavioral sciences to explain animal foraging under harsh environmental conditions. Incentive hope refers to a specific motivational mechanism in the brain - considered only in mammals and birds. But it can also be understood at a functional level, as an adaptive behavioral strategy that contributes to improve survival. Thus, this concept is an attempt to bridge across different research fields such as behavioral psychology, reward neuroscience, and behavioral ecology. Many commentaries suggest that incentive hope even could help understand phenomena beyond these research fields, including food wasting and food sharing, mental energy conservation, diverse psychopathologies, irrational decisions in invertebrates, and some aspects of evolution by means of sexual selection. We are favorable to such extensions because incentive hope denotes an unconscious process capable of working against many forms of adversity; organisms do not need to hope as a subjective feeling, but to behave as if they had this feeling. In our response, we carefully discuss each suggestion and criticism and reiterate the importance of having a theory accounting for motivation under reward uncertainty.

Ablation of NMDA receptors in dopamine neurons disrupts attribution of incentive salience to reward-paired stimuli

Midbrain dopamine (DA) neurons play a crucial role in the formation of conditioned associations between environmental cues and appetitive events. Activation of N-methyl-d-aspartate (NMDA) receptors is a key mechanism responsible for the generation of conditioned responses of DA neurons to reward cues. Here, we tested the effects of the cell type-specific inactivation of NMDA receptors in DA neurons in adult mice on stimulus-reward learning. Animals were trained in a Pavlovian learning paradigm in which they had to learn the predictive value of two conditioned stimuli, one of which (CS+) was paired with the delivery of a water reward. Over the course of conditioning, mutant mice learned that the CS+ predicted reward availability, and they approached the reward receptacle more frequently during CS+ trials than CS- trials. However, conditioned responses to the CS+ were weaker in the mutant mice, possibly indicating that they did not attribute incentive salience to the CS+. To further assess whether the attribution of incentive salience was impaired by the mutation, animals were tested in a conditioned reinforcement test. The test revealed that mutant mice made fewer instrumental responses paired with CS+ presentation, confirming that the CS+ had a weaker incentive value. Taken together, these results indicate that reward prediction learning does occur in the absence of NMDA receptors in DA neurons, but the ability of reward-paired cues to invigorate and reinforce behavior is attenuated.

Nucleus Accumbens Modulation in Reward and Aversion

The nucleus accumbens (NAc) is a key node of the brain’s circuitry that is responsible for translating motivation into action. It has been implicated in playing critical roles in virtually all forms of adaptive and pathological motivated behaviors. It is subject to modulation by a broad array of inputs that influence NAc activity in complex ways that are still poorly understood. Here, we briefly review current knowledge about the behavioral consequences of NAc modulation, focusing on recent studies that use novel techniques developed and implemented over the last decade.

Contributions of nucleus accumbens dopamine to cognitive flexibility

There is a compelling evidence that midbrain dopamine (DA) neurons and their projections to the ventral striatum provide a mechanism for motivating reward-seeking behavior, and for utilizing information about unexpected reward prediction errors (RPEs) to guide behavior based on current, rather than historical, outcomes. When this mechanism is compromised in addictions, it may produce patterns of maladaptive behavior that remain obdurate in the face of contrary information and even adverse consequences. Nonetheless, DAergic contributions to performance on behavioral tasks that rely on the ability to flexibly update stimulus-reward relationships remains incompletly understood. In the current study, we used a discrimination and reversal paradigm to monitor subsecond DA release in mouse NAc core (NAc) using in vivo fast-scan cyclic voltammetry (FSCV). We observed post-choice elevations in phasic NAc DA release; however, increased DA transients were only evident during early reversal when mice made responses at the newly rewarded stimulus. Based on this finding, we used in vivo optogenetic (eNpHR) photosilencing and (Channelrhodopsin2 [ChR2]) photostimulation to assess the effects of manipulating VTA-DAergic fibers in the NAc on reversal performance. Photosilencing the VTA → NAc DAergic pathway during early reversal increased errors, while photostimulation did not demonstrably affect behavior. Taken together, these data provide additional evidence of the importance of NAc DA release as a neural substrate supporting adjustments in learned behavior after a switch in expected stimulus-reward contingencies. These findings have possible implications for furthering understanding the role of DA in persistent, maladaptive decision-making characterizing addictions.

Oxygen responses within the nucleus accumbens are associated with individual differences in effort exertion in rats

Goal‐directed motivated behaviour is crucial for everyday life. Such behaviour is often measured, in rodents, under a progressive ratio (PR) schedule of reinforcement. Previous studies have identified a few brain structures critical for supporting PR performance. However, the association between neural activity within these regions and individual differences in effort‐related behaviour is not known. Presently, we used constant potential in vivo oxygen amperometry, a surrogate for functional resonance imaging in rodents, to assess changes in tissue oxygen levels within the nucleus accumbens (NAc) and orbitofrontal cortex (OFC) in male Wistar rats performing a PR task. Within both regions, oxygen responses to rewards increased as the effort exerted to obtain the rewards was larger. Furthermore, higher individual breakpoints were associated with greater magnitude NAc oxygen responses. This association could not be explained by temporal confounds and remained significant when controlling for the different number of completed trials. Animals with higher breakpoints also showed greater magnitude NAc oxygen responses to rewards delivered independently of any behaviour. In contrast, OFC oxygen responses were not associated with individual differences in behavioural performance. The present results suggest that greater NAc oxygen responses following rewards, through a process of incentive motivation, may allow organisms to remain on task for longer and to overcome greater effort costs.

Depression is associated with enhanced aversive Pavlovian control over instrumental behaviour

The dynamic modulation of instrumental behaviour by conditioned Pavlovian cues is an important process in decision-making. Patients with major depressive disorder (MDD) are known to exhibit mood-congruent biases in information processing, which may occur due to Pavlovian influences, but this hypothesis has never been tested directly in an unmedicated sample. To address this we tested unmedicated MDD patients and healthy volunteers on a computerized Pavlovian-Instrumental Transfer (PIT) task designed to separately examine instrumental approach and withdrawal actions in the context of Pavlovian appetitive and aversive cues. This design allowed us to directly measure the degree to which Pavlovian cues influence instrumental responding. Depressed patients were profoundly influenced by aversive Pavlovian stimuli, to a significantly greater degree than healthy volunteers. This was the case for instrumental behaviour both in the approach condition (in which aversive Pavlovian cues inhibited ‘go’ responses), and in the withdrawal condition (in which aversive Pavlovian cues facilitated ‘go’ responses). Exaggerated aversive PIT provides a potential cognitive mechanism for biased emotion processing in major depression. This finding also has wider significance for the understanding of disrupted motivational processing in neuropsychiatric disorders.

Repeated cocaine exposure dysregulates cognitive control over cue-evoked reward-seeking behavior during Pavlovian-to-instrumental transfer

Drug-paired cues acquire powerful motivational properties, but only lead to active drug-seeking behavior if they are potent enough to overwhelm the cognitive control processes that serve to suppress such urges. Studies using the Pavlovian-to-instrumental transfer (PIT) task have shown that rats pretreated with cocaine or amphetamine exhibit heightened levels of cue-motivated food-seeking behavior, suggesting that exposure to these drugs sensitizes the incentive motivational system. However, the PIT testing protocol can also create conflict between two competing behavioral responses to the reward-paired cue: active reward seeking (e.g., lever pressing) and passive conditioned food-cup approach behavior. We therefore investigated whether repeated cocaine exposure alters the way in which rats use cue-based reward expectations to resolve such conflict. In-depth analysis of previously published and new research confirmed that when drug-naïve rats are given a cue that signals the timing of a delayed noncontingent reward, they adaptively transition from reward seeking to conditioned approach behavior, facilitating efficient collection of the predicted reward. In contrast, cocaine-exposed rats exhibit pronounced behavioral dysregulation, increasing, rather than suppressing, their reward-seeking behavior over time, disrupting their ability to passively collect reward. Such findings speak to the important and sometimes overlooked role that cognitive control plays in determining the motivational impact of cues associated with drug and nondrug rewards.

Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties

Environmental cues, through Pavlovian learning, become conditioned stimuli that guide animals toward the acquisition of rewards (for example, food) that are necessary for survival. We tested the fundamental role of midbrain dopamine neurons in conferring predictive and motivational properties to cues, independent of external rewards. We found that brief phasic optogenetic excitation of dopamine neurons, when presented in temporal association with discrete sensory cues, was sufficient to instantiate those cues as conditioned stimuli that subsequently both evoked dopamine neuron activity on their own and elicited cue-locked conditioned behavior. Notably, we identified highly parcellated functions for dopamine neuron subpopulations projecting to different regions of striatum, revealing dissociable dopamine systems for the generation of incentive value and conditioned movement invigoration. Our results indicate that dopamine neurons orchestrate Pavlovian conditioning via functionally heterogeneous, circuit-specific motivational signals to create, gate, and shape cue-controlled behaviors.

Challenges to Body Fluid Homeostasis Differentially Recruit Phasic Dopamine Signaling in a Taste-Selective Manner

The internal environment of an organism must remain stable to ensure optimal performance and ultimately survival. The generation of motivated behaviors is an adaptive mechanism for defending homeostasis. Although physiological state modulates motivated behaviors, the influence of physiological state on phasic dopamine signaling, an underlying neurobiological substrate of reward-driven behavior, is underexplored. Here, we use sodium depletion and water restriction, manipulations of body fluid homeostasis, to determine the flexibility and specificity of dopamine responses. Changes in dopamine concentration were measured using fast-scan cyclic voltammetry in the nucleus accumbens shell of male rats in response to intraoral infusions of fluids that either satisfied or did not satisfy homeostatic need. Increases in dopamine concentration during intraoral infusions were observed only under conditions of physiological deficit. Furthermore, dopamine increases were selective and limited to those that satisfied the need state of the animal. Thus, dopamine neurons track fluid balance and respond to salt and water stimuli in a state- and taste-dependent manner. Using Fluoro-Gold tracing and immunohistochemistry for c-Fos and Foxp2, a marker of sodium-deprivation responsive neurons, we revealed brainstem populations of neurons that are activated by sodium depletion and project directly to the ventral tegmental area. The identified projections may modulate dopamine neuron excitability and consequently the state-specific dopamine release observed in our experiments. This work illustrates the impact of physiological state on mesolimbic dopamine signaling and a potential circuit by which homeostatic disruptions are communicated to mesolimbic circuitry to drive the selective reinforcement of biologically-required stimuli under conditions of physiological need.SIGNIFICANCE STATEMENT Motivated behaviors arise during physiological need and are highly selective for homeostasis-restoring stimuli. Although phasic dopamine signaling has been shown to contribute to the generation of motivated behaviors, the state and stimulus specificity of phasic dopamine signaling is less clear. These studies use thirst and sodium appetite to show that dopamine neurons dynamically track body fluid homeostasis and respond to water and salt stimuli in a state- and taste-dependent manner. We also identify hindbrain sodium deprivation-responsive neurons that project directly to the ventral tegmental area, where dopamine neuron cell bodies reside. This work demonstrates command of homeostasis over dopamine signaling and proposes a circuit by which physiological need drives motivated behavior by state- and taste-selective recruitment of phasic dopamine signaling.

Contributions of Pavlovian incentive motivation to cue-potentiated feeding

Cues signaling the availability of palatable food acquire the ability to potentiate food seeking and consumption. The current study employed a combination of behavioral, pharmacological, and analytical techniques to probe the role of Pavlovian incentive motivation in cue-potentiated feeding. We show that a cue paired with sucrose solution (CS+) can transfer its control over feeding to stimulate sucrose consumption at a new receptacle, and that this effect depends on activation of D1 dopamine receptors, which is known to modulate other forms of cue-motivated behavior but not taste palatability. Microstructural analyses of sucrose-licking behavior revealed that the CS+ tended to increase the frequency with which rats engaged in active bouts of licking behavior without having a reliable effect on the duration of those licking bouts, a measure that was instead associated with sucrose palatability. Furthermore, we found that individual differences in CS+ elicited increases in bout frequency were associated with total sucrose intake at test, supporting the view that this process was related to meaningful dysregulation of eating behavior. The current study, therefore, (1) demonstrates that a dopamine-dependent Pavlovian incentive motivational process can mediate cue-potentiated feeding, and (2) lays out an experimental and analytical approach for parsing this aspect of behavior.

Prior Cocaine Experience Impairs Normal Phasic Dopamine Signals of Reward Value in Accumbens Shell

Dopamine signals have repeatedly been linked to associative learning and motivational processes. However, there is considerably less agreement on a role for dopamine in reward processing, and therefore whether neuroplastic changes in dopamine function following chronic exposure to drugs of abuse such as cocaine may impair appropriate valuation of rewarding stimuli. To quantify this, we voltammetrically measured real-time dopamine release in the nucleus accumbens (NAc) core or shell while rats received unsignaled deliveries of either a small (1 pellet) or large (2 pellets) reward. In drug-naive controls, core dopamine signals did not discriminate between reward size at any point, while in the shell dopamine encoded magnitude differences only in a slower postpeak period. Despite this lack of discrimination between rewards by the peak DA response, controls easily discriminated between reward options in a subsequent choice task. In contrast, phasic dopamine reward signals were strongly altered by cocaine experience; core dopamine decreased peak response but increased discrimination between reward magnitudes while shell lost phasic responses to reward receipt altogether. Notably, animals with cocaine-associated alterations in dopamine signals for reward magnitude failed to subsequently discriminate between reward options. These findings suggest that cocaine self-administration alters the ability for dopamine signals to appropriately assign value to rewards and thus may in part contribute to later deficits in behaviors that depend on appropriate outcome valuation.

Modulation of cue-triggered reward seeking by cholinergic signaling in the dorsomedial striatum

The dorsomedial striatum (DMS) has been strongly implicated in flexible, outcome-based decision making, including the outcome-specific Pavlovian-to-instrumental transfer effect (PIT), which measures the tendency for a reward-predictive cue to preferentially motivate actions that have been associated with the predicted reward over actions associated with different rewards. Although the neurochemical underpinnings of this effect are not well understood, there is growing evidence that striatal acetylcholine signaling may play an important role. This study investigated this hypothesis by assessing the effects of intra-DMS infusions of the nicotinic antagonist mecamylamine or the muscarinic antagonist scopolamine on expression of specific PIT in rats. These treatments produced dissociable behavioral effects. Mecamylamine infusions enhanced rats' tendency to use specific cue-elicited outcome expectations to select whichever action was trained with the predicted outcome, relative to their performance when tested after vehicle infusions. In contrast, scopolamine infusions appeared to render instrumental performance insensitive to this motivational influence of reward-paired cues. These drug treatments had no detectable effect on conditioned food cup approach behavior, indicating that they selectively perturbed cue-guided action selection without producing more wide-ranging alterations in behavioral control. Our findings reveal an important role for DMS acetylcholine signaling in modulating the impact of cue-evoked reward expectations on instrumental action selection.

Nucleus Accumbens Acetylcholine Receptors Modulate Dopamine and Motivation

Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.

Reassessing wanting and liking in the study of mesolimbic influence on food intake

Humans and animals such as rats and mice tend to overconsume calorie-dense foods, a phenomenon that likely contributes to obesity. One often-advanced explanation for why we preferentially consume sweet and fatty foods is that they are more "rewarding" than low-calorie foods. "Reward" has been subdivided into three interdependent psychological processes: hedonia (liking a food), reinforcement (formation of associations among stimuli, actions, and/or the food), and motivation (wanting the food). Research into these processes has focused on the mesolimbic system, which comprises both dopamine neurons in the ventral tegmental area and neurons in their major projection target, the nucleus accumbens. The mesolimbic system and closely connected structures are commonly referred to as the brain's "reward circuit." Implicit in this title is the assumption that "rewarding" experiences are generally the result of activity in this circuit. In this review, I argue that food intake and the preference for calorie-dense foods can be explained without reference to subjective emotions. Furthermore, the contribution of mesolimbic dopamine to food intake and preference may not be a general one of promoting or coordinating behaviors that result in the most reward or caloric intake but may instead be limited to the facilitation of a specific form of neural computation that results in conditioned approach behavior. Studies on the neural mechanisms of caloric intake regulation must address how sensory information about calorie intake affects not just the mesolimbic system but also many other forms of computation that govern other types of food-seeking and food-oriented behaviors.

Unmasking the Effects of L-DOPA on Rapid Dopamine Signaling with an Improved Approach for Nafion Coating Carbon-Fiber Microelectrodes

L-DOPA has been the gold standard for symptomatic treatment of Parkinson's disease. However, its efficacy wanes over time as motor complications develop. Very little is known about how L-DOPA therapy affects the dynamics of fluctuating dopamine concentrations in the striatum on a rapid time scale (seconds). Electrochemical studies investigating the effects of L-DOPA treatment on electrically evoked dopamine release have reported conflicting results with significant variability. We hypothesize that the uncertainty in the electrochemical data is largely due to electrode fouling caused by polymerization of L-DOPA and endogenous catecholamines on the electrode surface. Thus, we have systematically optimized the procedure for fabricating cylindrical, Nafion-coated, carbon-fiber microelectrodes. This has enabled rapid and reliable detection of L-DOPA's effects on striatal dopamine signaling in intact rat brain using fast-scan cyclic voltammetry. An acute dose of 5 mg/kg L-DOPA had no significant effect on dopamine dynamics, demonstrating the highly efficient regulatory mechanisms at work in the intact brain. In contrast, administration of 200 mg/kg L-DOPA significantly increased the amplitude of evoked dopamine release by ∼200%. Overall, this work describes a reliable tool that allows a better measure of L-DOPA augmented dopamine release in vivo, measured using fast-scan cyclic voltammetry. It provides a methodology that improves the stability and performance of the carbon-fiber microelectrode when studying the molecular mechanisms underlying L-DOPA therapy and also promises to benefit a wide variety of studies because Nafion is so commonly used in electroanalytical chemistry.

Dopamine antagonism does not impair learning of Pavlovian conditioned approach to manipulable or non-manipulable cues but biases responding towards goal tracking

Dopamine's (DA) role in reward-processing is currently discussed as either providing a teaching signal to guide learning or mediating the transfer of incentive salience (i.e. motivational aspects) from unconditioned stimuli (US) to conditioned stimuli (CS). We used a Pavlovian conditioned approach (PCA) procedure to further investigate DAs contribution to these processes. Experiment 1 assessed the acquisition of PCA to a manipulable lever cue for 7days under DA-blockade with Flupenthixol (FLU; 225μg/kg) or Saline (SAL) treatment, followed by 6-days off-drug testing. FLU decreased the number of conditioned responses (CR) during the treatment phase, but cessation of treatment resulted in an immediate increase in CR to levels comparable to SAL controls; notably, CR in FLU-treated rats were restricted to goal tracking behaviour. During continued off-drug testing, rats from the FLU group developed sign tracking with a similar temporal pattern as controls. In experiment 2, acquisition of PCA to a non-manipulable auditory cue was investigated. FLU reduced the number of CR during treatment, and removing DA antagonism resulted in a similar rapid increase of CR as seen in experiment 1. These data complement other reports by demonstrating that, independently from the physical properties of the CS, DA is not required for learning predictive aspects of a CS-US relationship but for the development of behaviour (namely sign tracking) which is based on the motivational aspects of a CS-US relationship.

Optogenetically-induced tonic dopamine release from VTA-nucleus accumbens projections inhibits reward consummatory behaviors

Recent optogenetic studies demonstrated that phasic dopamine release in the nucleus accumbens may play a causal role in multiple aspects of natural and drug reward-related behaviors. The role of tonic dopamine release in reward consummatory behavior remains unclear. The current study used a combinatorial viral-mediated gene delivery approach to express ChR2 on mesolimbic dopamine neurons in rats. We used optical activation of this dopamine circuit to mimic tonic dopamine release in the nucleus accumbens and to explore the causal relationship between this form of dopamine signaling within the ventral tegmental area (VTA)-nucleus accumbens projection and consumption of a natural reward. Using a two bottle choice paradigm (sucrose vs. water), the experiments revealed that tonic optogenetic stimulation of mesolimbic dopamine transmission significantly decreased reward consummatory behaviors. Specifically, there was a significant decrease in the number of bouts, licks and amount of sucrose obtained during the drinking session. Notably, activation of VTA dopamine cell bodies or dopamine terminals in the nucleus accumbens resulted in identical behavioral consequences. No changes in water intake were evident under the same experimental conditions. Collectively, these data demonstrate that tonic optogenetic stimulation of VTA-nucleus accumbens dopamine release is sufficient to inhibit reward consummatory behavior, possibly by preventing this circuit from engaging in phasic activity that is thought to be essential for reward-based behaviors.

Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence

In detoxified alcohol-dependent patients, alcohol-related stimuli can promote relapse. However, to date, the mechanisms by which contextual stimuli promote relapse have not been elucidated in detail. One hypothesis is that such contextual stimuli directly stimulate the motivation to drink via associated brain regions like the ventral striatum and thus promote alcohol seeking, intake and relapse. Pavlovian-to-Instrumental-Transfer (PIT) may be one of those behavioral phenomena contributing to relapse, capturing how Pavlovian conditioned (contextual) cues determine instrumental behavior (e.g. alcohol seeking and intake). We used a PIT paradigm during functional magnetic resonance imaging to examine the effects of classically conditioned Pavlovian stimuli on instrumental choices in n = 31 detoxified patients diagnosed with alcohol dependence and n = 24 healthy controls matched for age and gender. Patients were followed up over a period of 3 months. We observed that (1) there was a significant behavioral PIT effect for all participants, which was significantly more pronounced in alcohol-dependent patients; (2) PIT was significantly associated with blood oxygen level-dependent (BOLD) signals in the nucleus accumbens (NAcc) in subsequent relapsers only; and (3) PIT-related NAcc activation was associated with, and predictive of, critical outcomes (amount of alcohol intake and relapse during a 3 months follow-up period) in alcohol-dependent patients. These observations show for the first time that PIT-related BOLD signals, as a measure of the influence of Pavlovian cues on instrumental behavior, predict alcohol intake and relapse in alcohol dependence.