On the motivational properties of reward cues: Individual differences

Inter-individual differences in decision-making, flexible and goal-directed behaviors: novel insights within the prefronto-striatal networks

Inflexible behavior is a hallmark of several decision-making-related disorders such as ADHD and addiction. As in humans, a subset of healthy rats makes poor decisions and prefers immediate larger rewards despite suffering large losses in a rat gambling task (RGT). They also display a combination of traits reminiscent of addiction, notably inflexible behavior and perseverative responses. The goal of the present work was twofold: (1) to elucidate if behavioral inflexibility of poor decision-makers could be related to a lower quality of goal-directed behavior (action-outcome associations); (2) to uncover the neural basis of inter-individual differences in goal-directed behavior. We specifically assessed inter-individual differences in decision-making in the RGT, flexibility in the RGT-reversed version and goal-directed behavior in a contingency degradation test, i.e., response adaptation when dissociating reward delivery from the animal's action. The contributions of the medial prefrontal cortex and the dorsal striatum to action-outcome associations were assessed using Zif268 immunodetection. Inflexible behavior was related to a lower sensitivity to contingency degradation in all poor decision-makers and only in a few good decision-makers. This poorer sensitivity was associated with a lower immunoreactivity in prelimbic and infralimbic cortices and a higher one in the dorsomedial and dorsolateral striatum. These findings suggest that an imbalanced prefronto-striatal activity could underlie inaccurate goal representation in changing environments and may promote maladaptive habit formation among poor decision-makers. These data strengthen our previous work identifying biomarkers of vulnerability to develop psychiatric disorders and demonstrate the relevance of inter-individual differences to model maladaptive behaviors.

Cdh13 and AdipoQ gene knockout alter instrumental and Pavlovian drug conditioning

Genome-wide association studies in humans have suggested that variants of the cadherin-13 (CDH13) gene are associated with substance use disorder, subjective response to amphetamine, and attention deficit hyperactivity disorder. To examine the role of the Cdh13 and its peptide ligand adiponectin (AdipoQ) in addiction-related behaviors, we assessed Cdh13 knockout (KO) rats and AdipoQ KO mice using intravenous cocaine self-administration and conditioned place preference (CPP) paradigms. During intravenous cocaine self-administration, male Cdh13 heterozygous (+/-) and KO (-/-) rats showed increased cue-induced reinstatement compared with wild-type (WT) rats when presented with a cocaine-paired stimulus, whereas female Cdh13 rats showed no differences across genotype. Cdh13 -/- rats showed higher responding for a saccharin reinforcer and learned the choice reaction time (RT) task more slowly than WTs. However, we found no differences between Cdh13 -/- and +/+ rats in responding for sensory reinforcement, number of premature responses in the RT task, tendency to approach a Pavlovian food cue, CPP and locomotor activation to cocaine (10 or 20 mg/kg). In AdipoQ -/- mice, there was a significant increase in CPP to methamphetamine (1 mg/kg) but not to a range of d-amphetamine doses (0.5, 1, 2 and 4 mg/kg). Taken together, these data suggest that Cdh13 and AdipoQ regulate sensitivity to psychomotor stimulants and palatable rewards without producing major changes in other behaviors. In humans, these two genes may regulate sensitivity to natural and drug rewards, thus influencing susceptibility to the conditioned drug effects and relapse.

Hypocretin receptor 1 blockade produces bimodal modulation of cocaine-associated mesolimbic dopamine signaling

RATIONALE

Cocaine addiction is a chronic psychiatric disorder characterized by pathological motivation to obtain cocaine and behavioral and neurochemical hypersensitivity to cocaine-associated cues. These features of cocaine addiction are thought to be driven by aberrant phasic dopamine signaling. We previously demonstrated that blockade of the hypocretin receptor 1 (HCRTr1) attenuates cocaine self-administration and reduces cocaine-induced enhancement of dopamine signaling. Despite this evidence, the effects of HCRTr1 blockade on endogenous phasic dopamine release are unknown.

OBJECTIVE

In the current studies, we assessed whether blockade of HCRTr1 alters spontaneous and cue-evoked dopamine release in the nucleus accumbens core of freely moving rats.

METHODS

We first validated the behavioral and neurochemical effects of the novel, highly selective, HCRTr1 antagonist RTIOX-276 using cocaine self-administration and fast-scan cyclic voltammetry (FSCV) in anesthetized rats. We then used FSCV in freely moving rats to examine whether RTIOX-276 impacts spontaneous and cue-evoked dopamine release. Finally, we used ex vivo slice FSCV to determine whether the effects of RTIOX-276 on dopamine signaling involve dopamine terminal adaptations.

RESULTS

Doses of RTIOX-276 that attenuate the motivation for cocaine reduce spontaneous dopamine transient amplitude and cue-evoked dopamine release. Further, these doses attenuated cocaine-induced dopamine uptake inhibition at the level of dopamine terminals.

CONCLUSION

Our results provide support for the standing hypothesis that HCRTr1 blockade suppresses endogenous phasic dopamine signals, likely via actions at dopamine cell bodies. These results also elucidate a second process through which HCRTr1 blockade attenuates the effects of cocaine by reducing cocaine sensitivity at dopamine terminals.

Long-lasting contribution of dopamine in the nucleus accumbens core, but not dorsal lateral striatum, to sign-tracking

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

Diverse Roads to Relapse: A Discriminative Cue Signaling Cocaine Availability Is More Effective in Renewing Cocaine Seeking in Goal Trackers Than Sign Trackers and Depends on Basal Forebrain Cholinergic Activity

Stimuli associated with taking drugs are notorious instigators of relapse. There is, however, considerable variation in the motivational properties of such stimuli, both as a function of the individual and the nature of the stimulus. The behavior of some individuals (sign trackers, STs) is especially influenced by cues paired with reward delivery, perhaps because they are prone to process information via dopamine-dependent, cue-driven, incentive salience systems. Other individuals (goal trackers, GTs) are better able to incorporate higher-order contextual information, perhaps because of better executive/attentional control over behavior, which requires frontal cortical cholinergic activity. We hypothesized, therefore, that a cue that "sets the occasion" for drug taking (a discriminative stimulus, DS) would reinstate cocaine seeking more readily in GTs than STs and that this would require intact cholinergic neurotransmission. To test this, male STs and GTs were trained to self-administer cocaine using an intermittent access schedule with periods of cocaine availability and unavailability signaled by a DS+ and a DS-, respectively. Thereafter, half of the rats received an immunotoxic lesion that destroyed 40-50% of basal forebrain cholinergic neurons and later, after extinction training, were tested for the ability of noncontingent presentations of the DS+ to reinstate cocaine seeking behavior. The DS+ was much more effective in reinstating cocaine seeking in GTs than STs and this effect was abolished by cholinergic losses despite the fact that all rats continued to orient to the DS+ We conclude that vulnerability to relapse involves interactions between individual cognitive-motivational biases and the form of the drug cue encountered.SIGNIFICANCE STATEMENT The most predictable outcome of a diagnosis of addiction is a high chance for relapse. When addicts encounter cues previously associated with drug, their attention may be unduly attracted to such cues and these cues can evoke motivational states that instigate and maintain drug-seeking behavior. Although sign-tracking rats were previously demonstrated to exhibit greater relapse vulnerability to Pavlovian drug cues paired with drug delivery, here, we demonstrate that their counterparts, the goal trackers, are more vulnerable if the drug cue acts to signal drug availability and that the forebrain cholinergic system mediates such vulnerability. Given the importance of contextual cues for triggering relapse and the human cognitive-cholinergic capacity for the processing of such cues, goal trackers model essential aspects of relapse vulnerability.

Incentive salience attribution is not the sole determinant of suboptimal choice in rats: Conditioned inhibition matters

Previous research has identified clear differences between pigeons and rats in the suboptimal choice procedure. Pigeons behave suboptimally, preferring an alternative with discriminative stimuli and a smaller probability of reinforcement, over another with a higher probability of reinforcement, but without discriminative stimuli. In contrast, rats behave optimally showing the opposite preference. It has been proposed that these dissimilarities are consequence of a higher sensitivity to conditioned inhibition in rats than in pigeons. Alternatively, recent research suggests that differences in optimality can be accounted for by a differential incentive salience of the stimuli employed as discriminative stimuli, and that both species are suboptimal when such stimuli have high incentive salience; specifically, rats were found to be suboptimal when levers were used as discriminative stimuli. However, in the evaluation of this hypothesis, a conditioned inhibitor was not employed. In the present report, eight rats were exposed to a choice procedure that integrated both variables discussed above: a conditioned inhibitor was associated with the discriminative alternative and the stimuli had high incentive salience. A clear preference for the optimal alternative was found, suggesting that the conditioned inhibitor had a considerable impact on rats' preference, and that species-differences remain even in procedures in which the discriminative stimuli have incentive salience.

Adolescent cocaine exposure enhances goal-tracking behavior and impairs hippocampal cell genesis selectively in adult bred low-responder rats

RATIONALE

Environmental challenges during adolescence, such as drug exposure, can cause enduring behavioral and molecular changes that contribute to life-long maladaptive behaviors, including addiction. Selectively bred high-responder (bHR) and low-responder (bLR) rats represent a unique model for assessing the long-term impact of adolescent environmental manipulations, as they inherently differ on a number of addiction-related traits. bHR rats are considered "addiction-prone," whereas bLR rats are "addiction-resilient," at least under baseline conditions. Moreover, relative to bLRs, bHR rats are more likely to attribute incentive motivational value to reward cues, or to "sign-track."

OBJECTIVES

We utilized bHR and bLR rats to determine whether adolescent cocaine exposure can alter their inborn behavioral and neurobiological profiles, with a specific focus on Pavlovian conditioned approach behavior (i.e., sign- vs. goal-tracking) and hippocampal neurogenesis.

METHODS

bHR and bLR rats were administered cocaine (15 mg/kg) or saline for 7 days during adolescence (postnatal day, PND 33-39) and subsequently tested for Pavlovian conditioned approach behavior in adulthood (PND 62-75), wherein an illuminated lever (conditioned stimulus) was followed by the response-independent delivery of a food pellet (unconditioned stimulus). Behaviors directed toward the lever and the food cup were recorded as sign- and goal-tracking, respectively. Hippocampal cell genesis was evaluated on PND 77 by immunohistochemistry.

RESULTS

Adolescent cocaine exposure impaired hippocampal cell genesis (proliferation and survival) and enhanced the inherent propensity to goal-track in adult bLR, but not bHR, rats.

CONCLUSIONS

Adolescent cocaine exposure elicits long-lasting changes in stimulus-reward learning and enduring deficits in hippocampal neurogenesis selectively in adult bLR rats.

Liking, wanting, and the incentive-sensitization theory of addiction

Rewards are both "liked" and "wanted," and those 2 words seem almost interchangeable. However, the brain circuitry that mediates the psychological process of "wanting" a particular reward is dissociable from circuitry that mediates the degree to which it is "liked." Incentive salience or "wanting," a form of motivation, is generated by large and robust neural systems that include mesolimbic dopamine. By comparison, "liking," or the actual pleasurable impact of reward consumption, is mediated by smaller and fragile neural systems, and is not dependent on dopamine. The incentive-sensitization theory posits the essence of drug addiction to be excessive amplification specifically of psychological "wanting," especially triggered by cues, without necessarily an amplification of "liking." This is because of long-lasting changes in dopamine-related motivation systems of susceptible individuals, called "neural sensitization." A quarter-century after its proposal, evidence has continued to grow in support the incentive-sensitization theory. Further, its scope is now expanding to include diverse behavioral addictions and other psychopathologies. (PsycINFO Database Record

Unresponsive Choline Transporter as a Trait Neuromarker and a Causal Mediator of Bottom-Up Attentional Biases

Some rats [sign-trackers (STs)] are prone to attribute incentive salience to reward cues, which can manifest as a propensity to approach and contact pavlovian cues, and for addiction-like behavior. STs also exhibit poor attentional performance, relative to goal-trackers (GTs), which is associated with attenuated acetylcholine (ACh) levels in prefrontal cortex (Paolone et al., 2013). Here, we demonstrate a cellular mechanism, linked to ACh synthesis, that accounts for attenuated cholinergic capacity in STs. First, we found that electrical stimulation of the basal forebrain increased cortical choline transporter (CHT)-mediated choline transport in GTs, paralleled by a redistribution of CHTs to the synaptic plasma membrane. Neither increases in choline uptake nor translocation of CHTs occurred in STs. Second, and consistent with uptake/translocation alterations, STs demonstrated a reduced ability to support cortical ACh release in vivo compared with GTs after reverse-dialysis to elevate extracellular potassium levels. Third, rats were significantly more likely to develop sign-tracking behavior if treated systemically before pavlovian conditioned approach training with the CHT inhibitor VU6001221. Consistent with its proposed mechanisms, administration of VU6001221 attenuated potassium-evoked ACh levels in prefrontal cortex measured with in vivo microdialysis. We propose that loss of CHT-dependent activation of cortical cholinergic activity in STs degrades top-down executive control over behavior, producing a bias for bottom-up or stimulus-driven attention. Such an attentional bias contributes to nonadaptive reward processing and thus identifies a novel mechanism that can support psychopathology, including addiction.SIGNIFICANCE STATEMENT The vulnerability for addiction-like behavior has been associated with psychological traits, such as the propensity to attribute incentive salience to reward cues that is modeled in rats by sign-tracking behavior. Sign-trackers tend to approach and contact cues associated with reward, whereas their counterparts, the goal-trackers, have a preference for approaching the location of the reward. Here, we show that the capacity of presynaptic cholinergic synapses to respond to stimulation by elevating presynaptic choline uptake and releasing acetylcholine is attenuated in sign-trackers. Furthermore, pharmacological inhibition of choline transport induced sign-tracking behavior. Our findings suggest that reduced levels of cholinergic neuromodulation can mediate an attentional bias toward reward-related cues, thereby allowing such cues to exert relatively greater control over behavior.

Individual differences in food cue responsivity are associated with acute and repeated cocaine-induced vocalizations, but not cue-induced vocalizations

RATIONALE

Individuals prone to attribute incentive salience to food-associated stimuli ("cues") are also more sensitive to cues during drug seeking and drug taking. This may be due in part to a difference in sensitivity to the affective or other stimulus properties of the drug. In rats, these properties are associated with 50-kHz ultrasonic vocalizations (USVs), in that they are elicited during putative positive affective and motivational states, including in response to drugs of abuse.

OBJECTIVES

We sought to determine whether individual differences in the tendency to attribute incentive salience to a food cue (as measured by approach) were associated with differences in cocaine-induced USVs. We also tested whether the food cue would elicit USVs and if this response was related to approach to the food cue.

METHODS

In experiment 1, rats underwent Pavlovian conditioned approach (PavCA) training where they learned to associate a cue (an illuminated lever) with the delivery of a food pellet into a food cup. Subjects were categorized based on their approach to the cue ("sign-trackers") or to the food cup ("goal-trackers"). Rats subsequently underwent nine testing days in which they were given saline or cocaine (10 mg/kg i.p) and placed into a locomotor chamber. In experiment 2, rats were first tested in the locomotor chambers for one saline-treated day followed by one cocaine-treated day and then trained in PavCA. USVs were recorded from a subset of individuals during the last day of PavCA to determine if the food cue would elicit USVs.

RESULTS

Sign-trackers produced 5-24 times more cocaine-induced 50 kHz USVs compared to goal-trackers for all days of experiment 1, and this response sensitized with repeated cocaine, only in sign-trackers. Similarly in experiment 2, individuals that produced the most cocaine-induced USVs on a single exposure also showed the greatest tendency to sign-track during PavCA. Lastly, while sign-trackers produced more USVs during PavCA generally, the cue itself did not elicit additional USVs in sign- or goal-trackers.

CONCLUSIONS

These results indicate a robust and consistent relationship between approach to a food cue and cocaine-induced USV production. Thus, these USVs may index the neurobiological differences underlying the behavioral distinctions of sign- and goal-trackers.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.

Food-Predicting Stimuli Differentially Influence Eye Movements and Goal-Directed Behavior in Normal-Weight, Overweight, and Obese Individuals

Obese individuals have been shown to exhibit abnormal sensitivity to rewards and reward-predicting cues as for example food-associated cues frequently used in advertisements. It has also been shown that food-associated cues can increase goal-directed behavior but it is currently unknown, whether this effect differs between normal-weight, overweight, and obese individuals. Here, we investigate this question by using a Pavlovian-to-instrumental transfer (PIT) task in normal-weight (N = 20), overweight (N = 17), and obese (N = 17) individuals. Furthermore, we applied eye tracking during Pavlovian conditioning to measure the participants' conditioned response as a proxy of the incentive salience of the predicted reward. Our results show that the goal-directed behavior of overweight individuals was more strongly influenced by food-predicting cues (i.e., stronger PIT effect) than that of normal-weight and obese individuals (p < 0.001). The weight groups were matched for age, gender, education, and parental education. Eye movements during Pavlovian conditioning also differed between weight categories (p < 0.05) and were used to categorize individuals based on their fixation style into "high eye index" versus "low eye index" as well. Our main finding was that the fixation style exhibited a complex interaction with the weight category. Furthermore, we found that normal-weight individuals of the group "high eye index" had higher body mass index within the healthy range than individuals of the group "low eye index" (p < 0.001), but this relationship was not found within in the overweight or obese groups (p > 0.646). Our findings are largely consistent with the incentive sensitization theory predicting that overweight individuals are more susceptible to food-related cues than normal-weight controls. However, this hypersensitivity might be reduced in obese individuals, possibly due to habitual/compulsive overeating or differences in reward valuation.

A Decade of Orexin/Hypocretin and Addiction: Where Are We Now?

One decade ago, our laboratory provided the first direct evidence linking orexin/hypocretin signaling with drug seeking by showing that activation of these neurons promotes conditioned morphine-seeking behavior. In the years since, contributions from many investigators have revealed roles for orexins in addiction for all drugs of abuse tested, but only under select circumstances. We recently proposed that orexins play a fundamentally unified role in coordinating "motivational activation" under numerous behavioral conditions, and here we unpack this hypothesis as it applies to drug addiction. We describe evidence collected over the past 10 years that elaborates the role of orexin in drug seeking under circumstances where high levels of effort are required to obtain the drug, or when motivation for drug reward is augmented by the presence of external stimuli like drug-associated cues/contexts or stressors. Evidence from studies using traditional self-administration and reinstatement models, as well as behavioral economic analyses of drug demand elasticity, clearly delineates a role for orexin in modulating motivational, rather than the primary reinforcing aspects of drug reward. We also discuss the anatomical interconnectedness of the orexin system with wider motivation and reward circuits, with a particular focus on how orexin modulates prefrontal and other glutamatergic inputs onto ventral tegmental area dopamine neurons. Last, we look ahead to the next decade of the research in this area, highlighting the recent FDA approval of the dual orexin receptor antagonist suvorexant (Belsomra®) for the treatment of insomnia as a promising sign of the potential clinical utility of orexin-based therapies for the treatment of addiction.

Effects of sex and remifentanil dose on rats' acquisition of responding for a remifentanil-conditioned reinforcer

Opioid-conditioned reinforcement is thought to exacerbate opioid abuse and dependence. Sex/gender can influence opioid abuse behaviors, but the effects of sex/gender on opioid-conditioned reinforcement, specifically, are unclear. In this study, we compared new-response acquisition with opioid-conditioned reinforcement in male and female rats. First, separate groups received response-independent remifentanil injections (0.0-32.0 μg/kg, intravenous) and presentations of a light-noise stimulus. In the experimental groups, injections and stimulus presentations always co-occurred [paired Pavlovian conditioning (PAV)]; in the control groups, the two occurred independently of each other (random PAV). Next, in the instrumental acquisition (ACQ) sessions, two novel nose-poke manipulanda were introduced. All animals (regardless of sex, dose, and PAV type) could respond in the active nose-poke, which produced the stimulus alone, or in the inactive nose-poke. Both males and females dose-dependently acquired nose-poke responding (active>inactive) after paired PAV, but not after random PAV. Therefore, the stimulus was a conditioned reinforcer. We identified three sex differences. First, only females acquired responding after paired PAV with 32.0 μg/kg remifentanil. Second, using a progressive ratio schedule for ACQ, both sexes acquired responding, but females made significantly more active responses. Third, when a single session of PAV was conducted, only males acquired responding. Thus, rats' sex interacts with pharmacological and environmental factors to determine opioid-conditioned reinforcement.

Age differences in appetitive Pavlovian conditioning and extinction in rats

Mounting evidence indicates that adolescents exhibit heightened sensitivity to rewards and reward-related cues compared to adults, and that adolescents are often unable to exert behavioral control in the face of such cues. Moreover, differences in reward processing during adolescence have been linked to heightened risk taking and impulsivity. However, little is known about the processes by which adolescents learn about the appetitive properties of environmental stimuli that signal reward. To address this, Pavlovian conditioning procedures were used to test for differences in excitatory conditioning between adult and adolescent rats using various schedules of reinforcement. Specifically, separate cohorts of adult and adolescent rats were trained under conditions of consistent (continuous) or intermittent (partial) reinforcement. We found that the acquisition of anticipatory responding to a continuously-reinforced cue proceeded similarly in adolescents and adults. In contrast, responding increased at a greater rate in adolescents compared to adults during presentations of a partially-reinforced cue. We subsequently compared the ability of adolescent and adult rats to dynamically adjust the representation of a reward-predictive cue during extinction trials, in which a secondary inhibitory representation is acquired for the previously-reinforced stimulus. We observed significant age differences in the ability to flexibly update cue representations during extinction, in that the appetitive properties of cues with a history of either continuous or partial reinforcement persisted to a greater extent in adolescents relative to adults.

The ability for cocaine and cocaine-associated cues to compete for attention

In humans, reward cues, including drug cues in individuals experiencing addiction, are especially effective in biasing attention towards them, so much so they can disrupt ongoing task performance. It is not known, however, whether this happens in rats. To address this question, we developed a behavioral paradigm to assess the capacity of an auditory drug (cocaine) cue to evoke cocaine-seeking behavior, thus distracting thirsty rats from performing a well-learned sustained attention task (SAT) to obtain a water reward. First, it was determined that an auditory cocaine cue (tone-CS) reinstated drug-seeking equally in sign-trackers (STs) and goal-trackers (GTs), which otherwise vary in the propensity to attribute incentive salience to a localizable drug cue. Next, we tested the ability of an auditory cocaine cue to disrupt performance on the SAT in STs and GTs. Rats were trained to self-administer cocaine intravenously using an Intermittent Access self-administration procedure known to produce a progressive increase in motivation for cocaine, escalation of intake, and strong discriminative stimulus control over drug-seeking behavior. When presented alone, the auditory discriminative stimulus elicited cocaine-seeking behavior while rats were performing the SAT, but it was not sufficiently disruptive to impair SAT performance. In contrast, if cocaine was available in the presence of the cue, or when administered non-contingently, SAT performance was severely disrupted. We suggest that performance on a relatively automatic, stimulus-driven task, such as the basic version of the SAT used here, may be difficult to disrupt with a drug cue alone. A task that requires more top-down cognitive control may be needed.

Neurobiology of comorbid post-traumatic stress disorder and alcohol-use disorder

Post-traumatic stress disorder (PTSD) and alcohol-use disorder (AUD) are highly comorbid in humans. Although we have some understanding of the structural and functional brain changes that define each of these disorders, and how those changes contribute to the behavioral symptoms that define them, little is known about the neurobiology of comorbid PTSD and AUD, which may be due in part to a scarcity of adequate animal models for examining this research question. The goal of this review is to summarize the current state-of-the-science on comorbid PTSD and AUD. We summarize epidemiological data documenting the prevalence of this comorbidity, review what is known about the potential neurobiological basis for the frequent co-occurrence of PTSD and AUD and discuss successes and failures of past and current treatment strategies. We also review animal models that aim to examine comorbid PTSD and AUD, highlighting where the models parallel the human condition, and we discuss the strengths and weaknesses of each model. We conclude by discussing key gaps in our knowledge and strategies for addressing them: in particular, we (1) highlight the need for better animal models of the comorbid condition and better clinical trial design, (2) emphasize the need for examination of subpopulation effects and individual differences and (3) urge cross-talk between basic and clinical researchers that is reflected in collaborative work with forward and reverse translational impact.

P3 event-related potential reactivity to smoking cues: Relations with craving, tobacco dependence, and alcohol sensitivity in young adult smokers

The current study tested whether the amplitude of the P3 event-related potential (ERP) elicited by smoking cues is (a) associated with the degree of self-reported craving reactivity, and (b) moderated by degree of tobacco dependence. Because alcohol and cigarettes are frequently used together, and given recent evidence indicating that individual differences in alcohol sensitivity influence reactivity to alcohol cues, we also investigated whether alcohol sensitivity moderated neural responses to smoking cues. ERPs were recorded from young adult smokers (N = 90) while they participated in an evaluative categorization oddball task involving 3 types of targets: neutral images, smoking-related images, and images of drinking straws. Participants showing larger P3 amplitudes to smoking cues and to straw cues (relative to neutral targets) reported greater increases in craving after cue exposure. Neither smoking status (daily vs. occasional use) nor psychometric measures of tobacco dependence consistently or specifically moderated P3 reactivity to smoking cues. Lower alcohol sensitivity was associated with larger P3 to smoking cues but not comparison straw cues (relative to neutral targets). This effect was further moderated by tobacco dependence, with the combination of lower sensitivity and higher dependence associated with especially pronounced P3 reactivity to smoking cues. The findings suggest the smoking-cue elicited P3 ERP component indexes an approach-oriented incentive motivational state accompanied by a subjective sense of cigarette craving. Self-reported low sensitivity to the pharmacologic effects of alcohol may represent a marker of drug cue reactivity and therefore deserves attention as a potential moderator in smoking cue exposure studies. (PsycINFO Database Record

Learning not to respond: Role of the hippocampus in withholding responses during omission training

Autoshaping is a Pavlovian learning paradigm in which rats experience pairings of a CS and a US independently of their behavior. When the CS is a lever inserted into the test cage and the US is food delivered to an adjacent magazine, many rats acquire a lever-pressing response called 'sign-tracking' even though that response has no effect on the occurrence of either the CS or the US. Since these lever presses are always followed by the US, it has been suggested that sign-tracking could be due to unintended reinforcement of the response. To eliminate the possibility of such instrumental learning the omission schedule, in which a response to the CS cancels the US, was introduced. Previous research has shown that training rats on autoshaping and switching them to an omission schedule generally reduces but does not eliminate sign-tracking, suggesting that it may be due to both Pavlovian and instrumental learning. In the present study naive rats trained on an omission schedule sign-tracked less than a control group exposed to random, unpaired CS and US presentations, suggesting that they learned to withhold the lever press response because of the negative contingency between that response and the US. In a second experiment rats with dorsal hippocampus lesions sign-tracked more than sham-lesioned rats on omission schedules, suggesting that this case of learning not to respond is hippocampus-based. This conclusion is consistent with many previous findings on the inability of hippocampal rats to withhold or suppress responding, and with studies suggesting that one form of extinction of learned responses in normal rats is due to competition from hippocampus-based learning not to respond.

The sensory features of a food cue influence its ability to act as an incentive stimulus and evoke dopamine release in the nucleus accumbens core

The sensory properties of a reward-paired cue (a conditioned stimulus; CS) may impact the motivational value attributed to the cue, and in turn influence the form of the conditioned response (CR) that develops. A cue with multiple sensory qualities, such as a moving lever-CS, may activate numerous neural pathways that process auditory and visual information, resulting in CRs that vary both within and between individuals. For example, CRs include approach to the lever-CS itself (rats that “sign-track”; ST), approach to the location of reward delivery (rats that “goal-track”; GT), or an “intermediate” combination of these behaviors. We found that the multimodal sensory features of the lever-CS were important to the development and expression of sign-tracking. When the lever-CS was covered, and thus could only be heard moving, STs not only continued to approach the lever location but also started to approach the food cup during the CS period. While still predictive of reward, the auditory component of the lever-CS was a much weaker conditioned reinforcer than the visible lever-CS. This plasticity in behavioral responding observed in STs closely resembled behaviors normally seen in rats classified as “intermediates.” Furthermore, the ability of both the lever-CS and the reward-delivery to evoke dopamine release in the nucleus accumbens was also altered by covering the lever—dopamine signaling in STs resembled neurotransmission observed in rats that normally only GT. These data suggest that while the visible lever-CS was attractive, wanted, and had incentive value for STs, when presented in isolation, the auditory component of the cue was simply predictive of reward, lacking incentive salience. Therefore, the specific sensory features of cues may differentially contribute to responding and ensure behavioral flexibility.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Premature responding is associated with approach to a food cue in male and female heterogeneous stock rats

RATIONALE

Disorders of behavioral regulation, including attention deficit hyperactivity disorder (ADHD) and drug addiction, are in part due to poor inhibitory control, attentional deficits, and hyper-responsivity to reward-associated cues.

OBJECTIVES

To determine whether these traits are related, we tested genetically variable male and female heterogeneous stock rats in the choice reaction time (CRT) task and Pavlovian conditioned approach (PavCA). Sex differences in the response to methylphenidate during the CRT were also assessed.

METHODS

In the CRT task, rats were required to withhold responding until one of two lights indicated whether responses into a left or right port would be reinforced with water. Reaction time on correct trials and premature responses were the operational definitions of attention and response inhibition, respectively. Rats were also pretreated with oral methylphenidate (0, 2, 4 mg/kg) during the CRT task to determine whether this drug would improve performance. Subsequently, during PavCA, presentation of an illuminated lever predicted the delivery of a food pellet into a food-cup. Lever-directed approach (sign-tracking) and food-cup approach (goal-tracking) were the primary measures, and rats were categorized as "sign-trackers" and "goal-trackers" using an index based on these measures.

RESULTS

Sign-trackers made more premature responses than goal-trackers but showed no differences in reaction time. There were sex differences in both tasks, with females having higher sign-tracking, completing more CRT trials, and making more premature responses after methylphenidate administration.

CONCLUSIONS

These results indicate that response inhibition is related to reward-cue responsivity, suggesting that these traits are influenced by common genetic factors.

Anticipation-related brain connectivity in bipolar and unipolar depression: a graph theory approach

Bipolar disorder is often misdiagnosed as major depressive disorder, which leads to inadequate treatment. Depressed individuals versus healthy control subjects, show increased expectation of negative outcomes. Due to increased impulsivity and risk for mania, however, depressed individuals with bipolar disorder may differ from those with major depressive disorder in neural mechanisms underlying anticipation processes. Graph theory methods for neuroimaging data analysis allow the identification of connectivity between multiple brain regions without prior model specification, and may help to identify neurobiological markers differentiating these disorders, thereby facilitating development of better therapeutic interventions. This study aimed to compare brain connectivity among regions involved in win/loss anticipation in depressed individuals with bipolar disorder (BDD) versus depressed individuals with major depressive disorder (MDD) versus healthy control subjects using graph theory methods. The study was conducted at the University of Pittsburgh Medical Center and included 31 BDD, 39 MDD, and 36 healthy control subjects. Participants were scanned while performing a number guessing reward task that included the periods of win and loss anticipation. We first identified the anticipatory network across all 106 participants by contrasting brain activation during all anticipation periods (win anticipation + loss anticipation) versus baseline, and win anticipation versus loss anticipation. Brain connectivity within the identified network was determined using the Independent Multiple sample Greedy Equivalence Search (IMaGES) and Linear non-Gaussian Orientation, Fixed Structure (LOFS) algorithms. Density of connections (the number of connections in the network), path length, and the global connectivity direction ('top-down' versus 'bottom-up') were compared across groups (BDD/MDD/healthy control subjects) and conditions (win/loss anticipation). These analyses showed that loss anticipation was characterized by denser top-down fronto-striatal and fronto-parietal connectivity in healthy control subjects, by bottom-up striatal-frontal connectivity in MDD, and by sparse connectivity lacking fronto-striatal connections in BDD. Win anticipation was characterized by dense connectivity of medial frontal with striatal and lateral frontal cortical regions in BDD, by sparser bottom-up striatum-medial frontal cortex connectivity in MDD, and by sparse connectivity in healthy control subjects. In summary, this is the first study to demonstrate that BDD and MDD with comparable levels of current depression differed from each other and healthy control subjects in density of connections, connectivity path length, and connectivity direction as a function of win or loss anticipation. These findings suggest that different neurobiological mechanisms may underlie aberrant anticipation processes in BDD and MDD, and that distinct therapeutic strategies may be required for these individuals to improve coping strategies during expectation of positive and negative outcomes.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Frontostriatal Circuit Dynamics Correlate with Cocaine Cue-Evoked Behavioral Arousal during Early Abstinence

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network.

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network. Here we introduce a behavioral assay of conditioned arousal to cocaine cues involving pupillometry in awake head-restrained mice. After just 24 h of drug abstinence, brief exposures to olfactory stimuli previously paired with cocaine injections led to a transient dilation of the pupil, which was greater than the dilation effect to neutral cues. In contrast, there was no cue-selective change in locomotion, as measured by the rotation of a circular treadmill. The behavioral assay was combined with simultaneous recordings from dozens of electrophysiologically identified units in the medial prefrontal cortex (mPFC) and ventral striatum (VS). We found significant relationships between cocaine cue-evoked pupil dilation and the proportion of inhibited principal cells in the mPFC and VS. Additionally, LFP coherence analysis revealed a significant correlation between pupillary response and synchrony in the 25–45 Hz frequency band. Together, these results show that pupil dilation is sensitive to drug-associated cues during acute stages of abstinence, and that individual animal differences in this behavioral arousal response can be explained by two complementary measures of frontostriatal network activity.

Motivational state, reward value, and Pavlovian cues differentially affect skilled forelimb grasping in rats

Motor skills represent high-precision movements performed at optimal speed and accuracy. Such motor skills are learned with practice over time. Besides practice, effects of motivation have also been shown to influence speed and accuracy of movements, suggesting that fast movements are performed to maximize gained reward over time as noted in previous studies. In rodents, skilled motor performance has been successfully modeled with the skilled grasping task, in which animals use their forepaw to grasp for sugar pellet rewards through a narrow window. Using sugar pellets, the skilled grasping task is inherently tied to motivation processes. In the present study, we performed three experiments modulating animals’ motivation during skilled grasping by changing the motivational state, presenting different reward value ratios, and displaying Pavlovian stimuli. We found in all three studies that motivation affected the speed of skilled grasping movements, with the strongest effects seen due to motivational state and reward value. Furthermore, accuracy of the movement, measured in success rate, showed a strong dependence on motivational state as well. Pavlovian cues had only minor effects on skilled grasping, but results indicate an inverse Pavlovian-instrumental transfer effect on movement speed. These findings have broad implications considering the increasing use of skilled grasping in studies of motor system structure, function, and recovery after injuries.

Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

Pavlovian cues for rewards can become attractive incentives: approached and 'wanted' as the rewards themselves. The motivational attractiveness of a previously learned cue is not fixed, but can be dynamically amplified during re-encounter by simultaneous activation of brain limbic circuitry. Here it was reported that opioid or dopamine microinjections in the dorsolateral quadrant of the neostriatum (DLS) of rats selectively amplify attraction toward a previously learned Pavlovian cue in an individualized fashion, at the expense of a competing cue. In an autoshaping (sign-tracking vs. goal-tracking) paradigm, microinjection of the mu opioid receptor agonist (DAMGO) or dopamine indirect agonist (amphetamine) in the DLS of sign-tracker individuals selectively enhanced their sign-tracking attraction toward the reward-predictive lever cue. By contrast, DAMGO or amphetamine in the DLS of goal-trackers selectively enhanced prepotent attraction toward the reward-proximal cue of sucrose dish. Amphetamine also enhanced goal-tracking in some sign-tracker individuals (if they ever defected to the dish even once). That DLS enhancement of cue attraction was due to stronger motivation, not stronger habits, was suggested by: (i) sign-trackers flexibly followed their cue to a new location when the lever was suddenly moved after DLS DAMGO microinjection; and (ii) DAMGO in the DLS also made sign-trackers work harder on a new instrumental nose-poke response required to earn presentations of their Pavlovian lever cue (instrumental conditioned reinforcement). Altogether, the current results suggest that DLS circuitry can enhance the incentive salience of a Pavlovian reward cue, selectively making that cue a stronger motivational magnet.

Intranasal Dopamine Reduces In Vivo [(123)I]FP-CIT Binding to Striatal Dopamine Transporter: Correlation with Behavioral Changes and Evidence for Pavlovian Conditioned Dopamine Response

Purpose: Dopamine (DA), which does not cross the blood-brain barrier, has central and behavioral effects when administered via the nasal route. Neither the mechanisms of central action of intranasal dopamine (IN-DA), nor its mechanisms of diffusion and transport into the brain are well understood. We here examined whether IN-DA application influences dopamine transporter (DAT) binding in the dorsal striatum and assessed the extent of binding in relation to motor and exploratory behaviors. We hypothesized that, based on the finding of increased extracellular DA in the striatum induced by application of IN-DA, binding of [¹²³I]FP-CIT to the DAT should be decreased due to competition at the receptor.

Methods: Rats were administered 3 mg/kg IN-DA and vehicle (VEH), with IN-DA injection either preceding or following VEH. Then motor and exploratory behaviors (traveled distance, velocity, center time, sitting, rearing, head-shoulder motility, grooming) were assessed for 30 min in an open field prior to administration of [¹²³I]FP-CIT. DAT binding after IN-DA and VEH was measured with small animal SPECT 2 h following administration of the radioligand.

Results: (1) After IN-DA application, striatal DAT binding was significantly lower as compared to VEH, indicating that the nasally delivered DA had central action and increased DA levels comparable to that found previously with L-DOPA administration; and (2) DAT binding in response to intranasal VEH was lower when IN-DA application preceded VEH treatment. This finding is suggestive of Pavlovian conditioning of DA at the level of the DAT, since the DA treatment modified (decreased) the binding in response to the subsequent VEH treatment. VEH treatment also reduced motor and exploratory behaviors more when applied before, as compared to when it followed IN-DA application, also indicative of behavioral Pavlovian conditioning akin to that found upon application of various psychostimulant drugs.

Conclusions: The results: (a) demonstrate a direct central action of intranasally applied DA on the DAT in the dorsal striatum, indicating enhanced DA availability; and (b) provide first evidence of a Pavlovian conditioned DA response at the DAT. The latter results have relevance to understanding neurochemical mechanisms that underlie placebo action in the treatment of Parkinsonian patients.

An omission procedure reorganizes the microstructure of sign-tracking while preserving incentive salience

Appetitive sign-tracking, in which reward-paired cues elicit approach that can result in cue interaction, demonstrates how cues acquire motivational value. For example, rats will approach and subsequently interact with a lever insertion cue that signals food delivery upon its retraction. However, lever deflections are rapidly reduced once rats are trained on an omission schedule in which lever interactions cancel food delivery. Here we evaluated the change in sign-tracking response topography in rats exposed to such an omission procedure. Lever deflections dropped precipitously when they canceled reward. However, rats that were on an omission schedule continued to approach, sniff, and contact the lever without pressing it, and did so at comparable rates to rats that were not under an omission schedule. Thus, sign-tracking was maintained, albeit in a different manner, following omission. Such findings show that the motivational attraction to reward cues can be expressed with remarkable persistence and flexibility.

L-type Ca²⁺ channel blockade with antihypertensive medication disrupts VTA synaptic plasticity and drug-associated contextual memory

Drug addiction is driven, in part, by powerful and enduring memories of sensory cues associated with drug intake. As such, relapse to drug use during abstinence is frequently triggered by an encounter with drug-associated cues, including the drug itself. L-type Ca(2+) channels (LTCCs) are known to regulate different forms of synaptic plasticity, the major neural substrate for learning and memory, in various brain areas. Long-term potentiation (LTP) of NMDA receptor (NMDAR)-mediated glutamatergic transmission in the ventral tegmental area (VTA) may contribute to the increased motivational valence of drug-associated cues triggering relapse. In this study, using rat brain slices, we found that isradipine, a general LTCC antagonist used as antihypertensive medication, not only blocks the induction of NMDAR LTP but also promotes the reversal of previously induced LTP in the VTA. In behaving rats, isradipine injected into the VTA suppressed the acquisition of cocaine-paired contextual cue memory assessed using a conditioned place preference (CPP) paradigm. Furthermore, administration of isradipine or a CaV1.3 subtype-selective LTCC antagonist (systemic or intra-VTA) before a single extinction or reinstatement session, while having no immediate effect at the time of administration, abolished previously acquired cocaine and alcohol (ethanol) CPP on subsequent days. Notably, CPP thus extinguished cannot be reinstated by drug re-exposure, even after 2 weeks of withdrawal. These results suggest that LTCC blockade during exposure to drug-associated cues may cause unlearning of the increased valence of those cues, presumably via reversal of glutamatergic synaptic plasticity in the VTA.

DREADDS: Use and application in behavioral neuroscience

Technological advances over the last decade are changing the face of behavioral neuroscience research. Here we review recent work on the use of one such transformative tool in behavioral neuroscience research, chemogenetics (or Designer Receptors Exclusively Activated by Designer Drugs, DREADDS). As transformative technologies such as DREADDs are introduced, applied, and refined, their utility in addressing complex questions about behavior and cognition becomes clear and exciting. In the behavioral neuroscience field, remarkable new findings now regularly appear as a result of the ability to monitor and intervene in neural processes with high anatomical precision as animals behave in complex task environments. As these new tools are applied to behavioral questions, individualized procedures for their use find their way into diverse labs. Thus, "tips of the trade" become important for wide dissemination not only for laboratories that are using the tools but also for those who are interested in incorporating them into their own work. Our aim is to provide an up-to-date perspective on how the DREADD technique is being used for research on learning and memory, decision making, and goal-directed behavior, as well as to provide suggestions and considerations for current and future users based on our collective experience. (PsycINFO Database Record

Examining the role of dopamine D2 and D3 receptors in Pavlovian conditioned approach behaviors

Elucidating the neurobiological mechanisms underlying individual differences in the extent to which reward cues acquire the ability to act as incentive stimuli may contribute to the development of successful treatments for addiction and related disorders. We used the sign-tracker/goal-tracker animal model to examine the role of dopamine D2 and D3 receptors in the propensity to attribute incentive salience to reward cues. Following Pavlovian training, wherein a discrete lever-cue was paired with food reward, rats were classified as sign- or goal-trackers based on the resultant conditioned response. We examined the effects of D2/D3 agonists, 7-OH-DPAT (0.01-0.32mg/kg) or pramipexole (0.032-0.32mg/kg), the D2/D3 antagonist raclopride (0.1mg/kg), and the selective D3 antagonist, SB-277011A (6 or 24mg/kg), on the expression of sign- and goal-tracking conditioned responses. The lever-cue acquired predictive value and elicited a conditioned response for sign- and goal-trackers, but only for sign-trackers did it also acquire incentive value. Following administration of either 7-OH-DPAT, pramipexole, or raclopride, the performance of the previously acquired conditioned response was attenuated for both sign- and goal-trackers. For sign-trackers, the D2/D3 agonist, 7-OH-DPAT, also attenuated the conditioned reinforcing properties of the lever-cue. The selective D3 antagonist did not affect either conditioned response. Alterations in D2/D3 receptor signaling, but not D3 signaling alone, transiently attenuate a previously acquired Pavlovian conditioned response, regardless of whether the response is a result of incentive motivational processes. These findings suggest activity at the dopamine D2 receptor is critical for a reward cue to maintain either its incentive or predictive qualities.

Individual variation in incentive salience attribution and accumbens dopamine transporter expression and function

Cues (conditioned stimuli; CSs) associated with rewards can come to motivate behavior, but there is considerable individual variation in their ability to do so. For example, a lever-CS that predicts food reward becomes attractive and wanted, and elicits reward-seeking behavior, to a greater extent in some rats ('sign-trackers'; STs) than others ('goal-trackers'; GTs). Variation in dopamine (DA) neurotransmission in the nucleus accumbens (NAc) core is thought to contribute to such individual variation. Given that the DA transporter (DAT) exerts powerful regulation over DA signaling, we characterized the expression and function of the DAT in the accumbens of STs and GTs. STs showed greater DAT surface expression in ventral striatal synaptosomes than GTs, and ex vivo fast-scan cyclic voltammetry recordings of electrically evoked DA release confirmed enhanced DAT function in STs, as indicated by faster DA uptake, specifically in the NAc core. Consistent with this, systemic amphetamine (AMPH) produced greater inhibition of DA uptake in STs than in GTs. Furthermore, injection of AMPH directly into the NAc core enhanced lever-directed approach in STs, presumably by amplifying the incentive value of the CS, but had no effect on goal-tracking behavior. On the other hand, there were no differences between STs and GTs in electrically-evoked DA release in slices, or in total ventral striatal DA content. We conclude that greater DAT surface expression may facilitate the attribution of incentive salience to discrete reward cues. Investigating this variability in animal sub-populations may help explain why some people abuse drugs while others do not.

Roles of "Wanting" and "Liking" in Motivating Behavior: Gambling, Food, and Drug Addictions

The motivation to seek out and consume rewards has evolutionarily been driven by the urge to fulfill physiological needs. However in a modern society dominated more by plenty than scarcity, we tend to think of motivation as fueled by the search for pleasure. Here, we argue that two separate but interconnected subcortical and unconscious processes direct motivation: "wanting" and "liking." These two psychological and neuronal processes and their related brain structures typically work together, but can become dissociated, particularly in cases of addiction. In drug addiction, for example, repeated consumption of addictive drugs sensitizes the mesolimbic dopamine system, the primary component of the "wanting" system, resulting in excessive "wanting" for drugs and their cues. This sensitizing process is long-lasting and occurs independently of the "liking" system, which typically remains unchanged or may develop a blunted pleasure response to the drug. The result is excessive drug-taking despite minimal pleasure and intense cue-triggered craving that may promote relapse long after detoxification. Here, we describe the roles of "liking" and "wanting" in general motivation and review recent evidence for a dissociation of "liking" and "wanting" in drug addiction, known as the incentive sensitization theory (Robinson and Berridge 1993). We also make the case that sensitization of the "wanting" system and the resulting dissociation of "liking" and "wanting" occurs in both gambling disorder and food addiction.

Complex Living Conditions Impair Behavioral Inhibition but Improve Attention in Rats

Rapid adaptation to changes, while maintaining a certain level of behavioral inhibition is an important feature in every day functioning. How environmental context and challenges in life can impact on the development of this quality is still unknown. In the present study, we examined the effect of a complex rearing environment during adolescence on attention and behavioral inhibition in adult male rats. We also tested whether these effects were affected by an adverse early life challenge, maternal deprivation (MD). We found that animals that were raised in large, two floor Marlau^TM cages, together with 10 conspecifics, showed improved attention, but impaired behavioral inhibition in the 5-choice serial reaction time task. The early life challenge of 24 h MD on postnatal day 3 led to a decline in bodyweight during adolescence, but did not by itself influence responses in the 5-choice task in adulthood, nor did it moderate the effects of complex housing. Our data suggest that a complex rearing environment leads to a faster adaptation to changes in the environment, but at the cost of lower behavioral inhibition.

Sign Tracking, but Not Goal Tracking, is Resistant to Outcome Devaluation

During Pavlovian conditioning, a conditioned stimulus (CS) may act as a predictor of a reward to be delivered in another location. Individuals vary widely in their propensity to engage with the CS (sign tracking) or with the site of eventual reward (goal tracking). It is often assumed that sign tracking involves the association of the CS with the motivational value of the reward, resulting in the CS acquiring incentive value independent of the outcome. However, experimental evidence for this assumption is lacking. In order to test the hypothesis that sign tracking behavior does not rely on a neural representation of the outcome, we employed a reward devaluation procedure. We trained rats on a classic Pavlovian paradigm in which a lever CS was paired with a sucrose reward, then devalued the reward by pairing sucrose with illness in the absence of the CS. We found that sign tracking behavior was enhanced, rather than diminished, following reward devaluation; thus, sign tracking is clearly independent of a representation of the outcome. In contrast, goal tracking behavior was decreased by reward devaluation. Furthermore, when we divided rats into those with high propensity to engage with the lever (sign trackers) and low propensity to engage with the lever (goal trackers), we found that nearly all of the effects of devaluation could be attributed to the goal trackers. These results show that sign tracking and goal tracking behavior may be the output of different associative structures in the brain, providing insight into the mechanisms by which reward-associated stimuli—such as drug cues—come to exert control over behavior in some individuals.

Seeking behavior, place conditioning, and resistance to conditioned suppression of feeding in rats intermittently exposed to palatable food

Binge eating disorder is characterized by excessive consumption of highly palatable food within short periods of time accompanied by loss of control over eating. Extensive evidence provides support for the consideration of binge eating disorder as an addiction-like disorder. In this study, we wanted to determine whether rats undergoing an operant binge-like eating procedure could develop maladaptive forms of conditioned feeding behaviors. For this purpose, we trained male rats to self-administer either a sugary, highly palatable diet ("Palatable" rats) or a chow diet ("Chow" rats) for 1 hour a day. After escalation and stabilization of palatable food intake, we tested Chow and Palatable rats in (a) a conditioned place preference test, (b) a second-order schedule of reinforcement, (c) a cue-induced suppression of feeding test. In the conditioned place preference task, Palatable rats spent significantly more time in the compartment that was previously paired with the palatable food, compared to Chow controls. Furthermore, in the second-order schedule of reinforcement task, Palatable rats exhibited active lever responding 4- to 6-fold higher than Chow control rats. Finally, in the cue-induced suppression of feeding test, although Chow control subjects reduced responding by 32% in the presence of the conditioned punishment, Palatable rats persevered in responding despite the aversive cue. These results further characterize this animal model of binge-like eating and provide additional evidence for the addictive properties of highly palatable food.

Boundary conditions of methamphetamine craving

Methamphetamine use has increased significantly and become a global health concern. Craving is known to predict methamphetamine use and relapse following abstinence. Some have suggested that cravings are automatic, generalized, and uncontrollable, but experimental work addressing these claims is lacking. In 2 exploratory studies, we tested the boundary conditions of methamphetamine craving by asking: (a) is craving specific to users' preferred route of administration?, and (b) can craving be regulated by cognitive strategies? Two groups of methamphetamine users were recruited. In Study 1, participants were grouped by their preferred route of administration (intranasal vs. smoking), and rated their craving in response to photographs and movies depicting methamphetamine use (via the intranasal vs. smoking route). In Study 2, methamphetamine smokers implemented cognitive regulation strategies while viewing photographs depicting methamphetamine smoking. Strategies involved either focusing on the positive aspects of smoking methamphetamine or the negative consequences of doing so-the latter strategy based on treatment protocols for addiction. In Study 1, we found a significant interaction between group and route of administration, such that participants who preferred to smoke methamphetamine reported significantly stronger craving for smoking stimuli, whereas those who preferred the intranasal route reported stronger craving for intranasal stimuli. In Study 2, participants reported significantly lower craving when focusing on the negative consequences associated with methamphetamine use. Taken together, these findings suggest that strength of craving for methamphetamine is moderated by users' route of administration and can be reduced by cognitive strategies. This has important theoretical, methodological, and clinical implications.

Heterogeneity in brain reactivity to pleasant and food cues: evidence of sign-tracking in humans

Aberrant brain reward responses to food-related cues are an implied characteristic of human obesity; yet, findings are inconsistent. To explain these inconsistencies, we aimed to uncover endophenotypes associated with heterogeneity in attributing incentive salience to food cues in the context of other emotionally salient cues; a phenomenon described as sign- vs goal tracking in preclinical models. Data from 64 lean and 88 obese adults who were 35.5 ± 9.4 years old and predominantly women (79%) were analyzed. Participants viewed food-related, pleasant, neutral and unpleasant images while recording electroencephalograph. Late positive potentials were used to assess incentive salience attributed to the visual stimuli. Eating and affective traits were also assessed. Findings demonstrated that obese individuals, in general, do not demonstrate aberrant brain reward responses to food-related cues. As hypothesized, latent profile analysis of the late positive potential uncovered two distinct groups. 'Sign-trackers' showed greater responses to food-related cues (P < 0.001) but lower responses to pleasant stimuli (P < 0.001) compared with 'goal-trackers'. There were proportionally more obese than lean 'sign-trackers' (P = 0.03). Obese 'sign-trackers' reported significantly higher levels of emotional eating and food craving (P < 0.001). By examining the heterogeneity in brain reactivity to various emotional stimuli, this translational study highlights the need to consider important neurobehavioral endophenotypes of obesity.

Cocaine choice procedures in animals, humans, and treatment-seekers: Can we bridge the divide?

Individuals with cocaine use disorder chronically self-administer cocaine to the detriment of other rewarding activities, a phenomenon best modeled in laboratory drug-choice procedures. These procedures can evaluate the reinforcing effects of drugs versus comparably valuable alternatives under multiple behavioral arrangements and schedules of reinforcement. However, assessing drug-choice in treatment-seeking or abstaining humans poses unique challenges: for ethical reasons, these populations typically cannot receive active drugs during research studies. Researchers have thus needed to rely on alternative approaches that approximate drug-choice behavior or assess more general forms of decision-making, but whether these alternatives have relevance to real-world drug-taking that can inform clinical trials is not well-understood. In this mini-review, we (A) summarize several important modulatory variables that influence cocaine choice in nonhuman animals and non-treatment seeking humans; (B) discuss some of the ethical considerations that could arise if treatment-seekers are enrolled in drug-choice studies; (C) consider the efficacy of alternative procedures, including non-drug-related decision-making and 'simulated' drug-choice (a choice is made, but no drug is administered) to approximate drug choice; and (D) suggest opportunities for new translational work to bridge the current divide between preclinical and clinical research.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers

RATIONALE

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs).

OBJECTIVES

We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer.

RESULTS

In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs.

CONCLUSIONS

We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction.