Individual variation in the motivational properties of cocaine

Implementations of sign- and goal-tracking behavior in humans: A scoping review

Animal research has identified two major phenotypes in the tendency to attribute incentive salience to a reward-associated cue. Individuals called "sign-trackers" (STs) preferentially approach the cue, assigning both predictive and incentive values to it. In contrast, individuals called "goal-trackers" (GTs) preferentially approach the location of the upcoming reward, assigning only a predictive value to the cue. The ST/GT model has been shown to be relevant to understanding addiction vulnerability and other pathological behaviors in animals. Therefore, recent studies tried to implement this animal model in the human population. This scoping review aimed to identify and map evidence of human sign- and goal-tracking. Studies that explicitly measured human sign- and goal-tracking or related phenomena (e.g., attentional bias induced by reward-related cues), using paradigms in line with the animal model, were eligible for this review. We searched for published, unpublished, and gray literature (PhD theses, posters, conference papers) through the following databases: MEDLINE, Scopus, PsycINFO, Embase, OSF, and Google Scholar. The JBI scoping review methodology was adopted. Screening and extraction were carried out by three reviewers, in pairs. A total of 48 studies were identified. These studies used various experimental paradigms and used the term "sign-tracking" inconsistently, sometimes implicitly or not at all. We conclude that the literature on human sign-tracking is very heterogeneous on many levels. Overall, evidence supports the existence of sign- and goal-tracking behaviors in humans, although further validated research is crucially needed.

Resting-state brain activation patterns and network topology distinguish human sign and goal trackers

The "Sign-tracker/Goal-tracker" (ST/GT) is an animal model of individual differences in learning and motivational processes attributable to distinctive conditioned responses to environmental cues. While GT rats value the reward-predictive cue as a mere predictor, ST rats attribute it with incentive salience, engaging in aberrant reward-seeking behaviors that mirror those of impulse control disorders. Given its potential clinical value, the present study aimed to map such model onto humans and investigated resting state functional magnetic resonance imaging correlates of individuals categorized as more disposed to sign-tracking or goal-tracking behavior. To do so, eye-tracking was used during a translationally informed Pavlovian paradigm to classify humans as STs (n = 36) GTs (n = 35) or as Intermediates (n = 33), depending on their eye-gaze towards the reward-predictive cue or the reward location. Using connectivity and network-based approach, measures of resting state functional connectivity and centrality (role of a node as a hub) replicated preclinical findings, suggesting a major involvement of subcortical areas in STs, and dominant cortical involvement in GTs. Overall, the study strengthens the translational value of the ST/GT model, with important implications for the early identification of vulnerable phenotypes for psychopathological conditions such as substance use disorder.

Individual differences in decision-making shape how mesolimbic dopamine regulates choice confidence and change-of-mind

Nucleus accumbens dopamine signaling is an important neural substrate for decision-making. Dominant theories generally discretize and homogenize decision-making, when it is in fact a continuous process, with evaluation and re-evaluation components that extend beyond simple outcome prediction into consideration of past and future value. Extensive work has examined mesolimbic dopamine in the context of reward prediction error, but major gaps persist in our understanding of how dopamine regulates volitional and self-guided decision-making. Moreover, there is little consideration of individual differences in value processing that may shape how dopamine regulates decision-making. Here, using an economic foraging task in mice, we found that dopamine dynamics in the nucleus accumbens core reflected decision confidence during evaluation of decisions, as well as both past and future value during re-evaluation and change-of-mind. Optogenetic manipulations of mesolimbic dopamine release selectively altered evaluation and re-evaluation of decisions in mice whose dopamine dynamics and behavior reflected future value.

Understanding the shift to compulsion in addiction: insights from personality traits, social factors, and neurobiology

Compulsion stands as a central symptom of drug addiction; however, only a small fraction of individuals who use drugs exhibit compulsive characteristics. Differences observed in Sign-trackers (ST) and Goal-trackers (GT) during Pavlovian conditioning may shed light on individual variances in drug addiction. Here, we focus on the behavioral attributes, formation processes, and neural mechanisms underlying ST and how they drive addiction toward compulsivity in humans. We will explore addiction from three interconnected levels: individual personality traits, social factors, and neurobiology. Furthermore, we distinguish between the processes of sensitization and habituation within ST. These nuanced distinctions across various aspects of addiction will contribute to our understanding of the addiction development process and the formulation of targeted preventive strategies.

A large-scale c-Fos brain mapping study on extinction of cocaine-primed reinstatement

Individuals with cocaine addiction can experience many craving episodes and subsequent relapses, which represents the main obstacle to recovery. Craving is often favored when abstinent individuals ingest a small dose of cocaine, encounter cues associated with drug use or are exposed to stressors. Using a cocaine-primed reinstatement model in rat, we recently showed that cocaine-conditioned interoceptive cues can be extinguished with repeated cocaine priming in the absence of drug reinforcement, a phenomenon we called extinction of cocaine priming. Here, we applied a large-scale c-Fos brain mapping approach following extinction of cocaine priming in male rats to identify brain regions implicated in processing the conditioned interoceptive stimuli of cocaine priming. We found that cocaine-primed reinstatement is associated with increased c-Fos expression in key brain regions (e.g., dorsal and ventral striatum, several prefrontal areas and insular cortex), while its extinction mostly disengages them. Moreover, while reinstatement behavior was correlated with insular and accumbal activation, extinction of cocaine priming implicated parts of the ventral pallidum, the mediodorsal thalamus and the median raphe. These brain patterns of activation and inhibition suggest that after repeated priming, interoceptive signals lose their conditioned discriminative properties and that action-outcome associations systems are mobilized in search for new contingencies, a brain state that may predispose to rapid relapse.

Increased risky choice during forced abstinence from fentanyl on the cued rat gambling task

RATIONALE

The use of illicit opioids has arguably never been more risky; street drug potency can be dangerously high, is often unknown to the consumer, and results in multiple daily fatalities worldwide. Furthermore, substance use disorder (SUD) is associated with increased maladaptive, risky decisions in laboratory-based gambling tasks. Animal studies can help determine whether this decision-making deficit is a cause or consequence of drug use. However, most experiments have only assessed psychostimulant drugs.

OBJECTIVES

To assess differences in decision-making strategies both before, during, and after self-administration of fentanyl in male and female Long Evans rats.

METHODS

Male and female Long Evans rats were trained to perform the rat gambling task (rGT), loosely based on the Iowa Gambling Task (IGT) used clinically, and/or self-administer fentanyl. We used the cued version of the rGT, in which sound and light stimuli signal sugar pellet rewards, as cocaine self-administration has the greatest effects on decision making in this task variant.

RESULTS

After training on the cued rGT, female rats self-administered fentanyl more readily, an effect that was most apparent in optimal decision-makers. Contrary to previous reports using cocaine self-administration, decision-making was unaffected during fentanyl self-administration training in either sex. However, risky decision-making increased throughout forced abstinence from fentanyl in males.

CONCLUSIONS

These findings complement those from human subjects, in whom preference for uncertain outcomes increased before relapse. These data highlight an abstinence-induced change in cognition that is unique to opiates as compared to psychostimulants, and which may critically contribute to the maintenance of addiction and relapse.

Sign-tracking to non-drug reward is related to severity of alcohol-use problems in a sample of individuals seeking treatment

BACKGROUND

A prominent neuroscientific theory of drug addiction is the incentive sensitization model. Individual differences in the tendency to ascribe motivational salience to cues that predict reward, and involuntary "sign-tracking" (orientation towards) such cues have been identified as potentially important in understanding vulnerability to addiction and relapse. However, to date this behaviour has not been assessed in a treatment-seeking clinical population, who typically represent those most susceptible to alcohol-related harms and episodes of relapse. This highlights a significant gap in the literature pertaining to incentive sensitization and drug dependence.

METHODS

Individuals accessing inpatient drug and alcohol services with alcohol as primary drug of concern were recruited to participate in a Cognitive Bias Modification (CBM) intervention. At the baseline assessment, participants completed various self-report measures (including the Alcohol Use Disorders Identification Test; AUDIT) in addition to a visual search task measuring sign-tracking to cues signalling monetary reward. At 3-month follow up, abstinence from alcohol was the primary outcome measure. All analyses and hypotheses were pre-registered.

RESULTS

At baseline (57 participants), AUDIT scores correlated with sign-tracking to signals of monetary reward. In a subsequent regression analysis sign-tracking, gender and self-reported alcohol craving predicted abstinence at 3-month follow up (41 participants).

CONCLUSIONS

Our work demonstrates that involuntary sign-tracking to cues signalling non-drug reward is associated with problematic alcohol use and return to use at 3-month follow up, in a treatment-seeking sample. Whether this automatic prioritisation of cues signalling reward is a consequence or vulnerability for problematic alcohol use remains to be investigated.

Cortico-striatal action control inherent of opponent cognitive-motivational styles

Turning on cue or stopping at a red light requires the detection of such cues to select action sequences, or suppress action, in accordance with cue-associated action rules. Cortico-striatal projections are an essential part of the brain's attention-motor interface. Glutamate-sensing microelectrode arrays were used to measure glutamate transients in the dorsomedial striatum (DMS) of male and female rats walking a treadmill and executing cued turns and stops. Prelimbic-DMS projections were chemogenetically inhibited to determine their behavioral necessity and the cortico-striatal origin of cue-evoked glutamate transients. Furthermore, we investigated rats exhibiting preferably goal-directed (goal trackers, GTs) versus cue-driven attention (sign trackers, STs), to determine the impact of such cognitive-motivational biases on cortico-striatal control. GTs executed more cued turns and initiated such turns more slowly than STs. During turns, but not missed turns or cued stops, cue-evoked glutamate concentrations were higher in GTs than in STs. In conjunction with turn cue-evoked glutamate spike levels, the presence of a single spike rendered GTs to be almost twice as likely to turn than STs. In contrast, multiple glutamate spikes predicted GTs to be less likely to turn than STs. In GTs, but not STs, inhibition of prelimbic-DMS projections attenuated turn rates, turn cue-evoked glutamate peaks, and increased the number of spikes. These findings suggest that turn cue-evoked glutamate release in GTs is tightly controlled by cortico-striatal neuronal activity. In contrast, in STs, glutamate release from DMS glutamatergic terminals may be regulated by other striatal circuitry, preferably mediating cued suppression of action and reward tracking.

Mesocorticolimbic system reactivity to alcohol use-related visual cues as a function of alcohol sensitivity phenotype: A pilot fMRI study

Low sensitivity (LS) to alcohol is a risk factor for alcohol use disorder (AUD). Compared to peers with high sensitivity (HS), LS individuals drink more, report more problems, and exhibit potentiated alcohol cue reactivity (ACR). Heightened ACR suggests LS confers AUD risk via incentive sensitization, which is thought to take place in the mesocorticolimbic system. This study examined neural ACR in LS and HS individuals. Young adults (N = 32, M age=20.3) were recruited based on the Alcohol Sensitivity Questionnaire (HS: n = 16; LS: n = 16; 9 females/group). Participants completed an event-related fMRI ACR task. Group LS had higher ACR in left ventrolateral prefrontal cortex than group HS. In group LS, ACR in left caudomedial orbitofrontal cortex or left putamen was low at low alcohol use levels and high at heavier or more problematic alcohol use levels, whereas the opposite was true in group HS. Alcohol use level also was associated with the level of ACR in left substantia nigra among males in group LS. Taken together, results suggest elevated mesocorticolimbic ACR among LS individuals, especially those using alcohol at hazardous levels. Future studies with larger samples are warranted to determine the neurobiological loci underlying LS-based amplified ACR and AUD risk.

Genomic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues; both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1,645 genetically diverse heterogeneous stock (HS) rats. We tested HS rats in a Pavlovian conditioned approach task, in which we characterized the individual responses to food-associated stimuli ("cues"). Rats exhibited either cue-directed "sign-tracking" behavior or food-cup directed "goal-tracking" behavior. We then used the conditioned reinforcement procedure to determine whether rats would perform a novel operant response for unrewarded presentations of the cue. We found that these measures were moderately heritable (SNP heritability, h2 = .189-.215). GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits we examined. Interval sizes of these QTLs varied widely. 7 traits shared a QTL on chromosome 1 that contained a few genes (e.g. Tenm4, Mir708) that have been associated with substance use disorders and other mental health traits in humans. Other candidate genes (e.g. Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on other behavioral measures in HS rats and found that regions containing QTLs on chromosome 1 were also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive salience and provide further support for a relationship between attribution of incentive salience and drug abuse-related traits.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

Environmental enrichment promotes adaptive responding during tests of behavioral regulation in male heterogeneous stock rats

Organisms must regulate their behavior flexibly in the face of environmental challenges. Failure can lead to a host of maladaptive behavioral traits associated with a range of neuropsychiatric disorders, including attention deficit hyperactivity disorder, autism, and substance use disorders. This maladaptive dysregulation of behavior is influenced by genetic and environmental factors. For example, environmental enrichment produces beneficial neurobehavioral effects in animal models of such disorders. The present study determined the effects of environmental enrichment on a range of measures related to behavioral regulation using a large cohort of male, outbred heterogeneous stock (HS) rats as subjects. Subjects were reared from late adolescence onwards either in pairs in standard housing with minimal enrichment (n = 200) or in groups of 16 in a highly enriched environment consisting of a large multi-level cage filled with toys, running wheels, and shelters (n = 64). Rats were subjected to a battery of tests, including: (i) locomotor response to novelty, (ii) light reinforcement, (iii) social reinforcement, (iv) reaction time, (v) a patch-depletion foraging test, (vi) Pavlovian conditioned approach, (vii) conditioned reinforcement, and (viii) cocaine conditioned cue preference. Results indicated that rats housed in the enriched environment were able to filter out irrelevant stimuli more effectively and thereby regulate their behavior more efficiently than standard-housing rats. The dramatic impact of environmental enrichment suggests that behavioral studies using standard housing conditions may not generalize to more complex environments that may be more ethologically relevant.

Inhibition of Dopamine Neurons Prevents Incentive Value Encoding of a Reward Cue: With Revelations from Deep Phenotyping

The survival of an organism is dependent on its ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the NAc is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats, it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCutTM revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient toward and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.SIGNIFICANCE STATEMENT Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCutTM revealed that cue-directed behaviors do not emerge without dopamine neuron activity in the VTA. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of dopamine neuron activity in the VTA during cue presentation to encode the incentive value of reward cues.

Nucleus accumbens core acetylcholine receptors modulate the balance of flexible and inflexible cue-directed motivation

Sign-tracking is a conditioned response where animals interact with reward-predictive cues due to the cues having motivational value, or incentive salience. The nucleus accumbens core (NAc) has been implicated in mediating the sign-tracking response. Additionally, acetylcholine (ACh) transmission throughout the striatum has been attributed to both incentive motivation and behavioral flexibility. Here, we demonstrate a role for NAc ACh receptors in the flexibility of sign-tracking. Sign-tracking animals were exposed to an omission contingency, in which vigorous sign-tracking was punished by reward omission. Animals rapidly adjusted their behavior, but they maintained sign-tracking in a less vigorous manner that did not cancel reward. Within this context of sign-tracking being persistent yet flexible in structure, blockade of NAc nicotinic receptors (nAChRs) led to a persistence in the initial sign-tracking response during omission followed by a period of change in the makeup of sign-tracking, whereas blockade of muscarinic receptors (mAChRs) oppositely enhanced the omission-related development of the new sign-tracking behaviors. Later, once omission learning had occurred, nAChR blockade uniquely led to reduced sign-tracking and elevated reward-directed behaviors instead. These results indicate that NAc ACh receptors have opposing roles in maintaining learned patterns of sign-tracking, with nAChRs having a special involvement in regulating the structure of the sign-tracking response.

Motor impulsivity but not risk-related impulsive choice is associated to drug intake and drug-primed relapse

Introduction

Motor impulsivity and risk-related impulsive choice have been proposed as vulnerability factors for drug abuse, due to their high prevalence in drug abusers. However, how these two facets of impulsivity are associated to drug abuse remains unclear. Here, we investigated the predictive value of both motor impulsivity and risk-related impulsive choice on characteristics of drug abuse including initiation and maintenance of drug use, motivation for the drug, extinction of drug-seeking behavior following drug discontinuation and, finally, propensity to relapse.

Methods

We used the Roman High- (RHA) and Low- Avoidance (RLA) rat lines, which display innate phenotypical differences in motor impulsivity, risk-related impulsive choice, and propensity to self-administer drugs. Individual levels of motor impulsivity and risk-related impulsive choice were measured using the rat Gambling task. Then, rats were allowed to self-administer cocaine (0.3 mg/kg/infusion; 14 days) to evaluate acquisition and maintenance of cocaine self-administration, after which motivation for cocaine was assessed using a progressive ratio schedule of reinforcement. Subsequently, rats were tested for their resistance to extinction, followed by cue-induced and drug-primed reinstatement sessions to evaluate relapse. Finally, we evaluated the effect of the dopamine stabilizer aripiprazole on reinstatement of drug-seeking behaviors.

Results

We found that motor impulsivity and risk-related impulsive choice were positively correlated at baseline. Furthermore, innate high levels of motor impulsivity were associated with higher drug use and increased vulnerability to cocaine-primed reinstatement of drug-seeking. However, no relationships were observed between motor impulsivity and the motivation for the drug, extinction or cue-induced reinstatement of drug-seeking. High levels of risk-related impulsive choice were not associated to any aspects of drug abuse measured in our study. Additionally, aripiprazole similarly blocked cocaine-primed reinstatement of drug-seeking in both high- and low-impulsive animals, suggesting that aripiprazole acts as a D_2/3R antagonist to prevent relapse independently of the levels of impulsivity and propensity to self-administer drugs.

Discussion

Altogether, our study highlights motor impulsivity as an important predictive factor for drug abuse and drug-primed relapse. On the other hand, the involvement of risk-related impulsive choice as a risk factor for drug abuse appears to be limited.

Inhibition of dopamine neurons prevents incentive value encoding of a reward cue: With revelations from deep phenotyping

The survival of an organism is dependent on their ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the nucleus accumbens is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCut revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient towards and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.

Significance Statement

Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCut revealed that cue-directed behaviors do not emerge without VTA dopamine. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of VTA dopamine during cue presentation to encode the incentive value of reward cues.

Neuro-Immune Modulation of Cholinergic Signaling in an Addiction Vulnerability Trait

Sign-tracking (ST) describes the propensity to approach and contact a Pavlovian reward cue. By contrast, goal-trackers (GTs) respond to such a cue by retrieving the reward. These behaviors index the presence of opponent cognitive-motivational traits, with STs exhibiting attentional control deficits, behavior dominated by incentive motivational processes, and vulnerability for addictive drug taking. Attentional control deficits in STs were previously attributed to attenuated cholinergic signaling, resulting from deficient translocation of intracellular choline transporters (CHTs) into synaptosomal plasma membrane. Here, we investigated a posttranslational modification of CHTs, poly-ubiquitination, and tested the hypothesis that elevated cytokine signaling in STs contributes to CHT modification. We demonstrated that intracellular CHTs, but not plasma membrane CHTs, are highly ubiquitinated in male and female sign-tracking rats when compared with GTs. Moreover, levels of cytokines measured in cortex and striatum, but not spleen, were higher in STs than in GTs. Activation of the innate immune system by systemic administration of the bacterial endotoxin lipopolysaccharide (LPS) elevated ubiquitinated CHT levels in cortex and striatum of GTs only, suggesting ceiling effects in STs. In spleen, LPS increased levels of most cytokines in both phenotypes. In cortex, LPS particularly robustly increased levels of the chemokines CCL2 and CXCL10. Phenotype-specific increases were restricted to GTs, again suggesting ceiling effects in STs. These results indicate that interactions between elevated brain immune modulator signaling and CHT regulation are essential components of the neuronal underpinnings of the addiction vulnerability trait indexed by sign-tracking.

Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking

RATIONALE

The medial subregion of the orbitofrontal cortex (mOFC) is thought to play an important role representing the expected outcome of a given course of action, as lesioning or inactivating this cortical region results in the adoption of choice strategies based more on observable (rather than previously learned) information. Despite this, its role in mediating basic associative learning remains to be fully clarified.

OBJECTIVE

The present series of experiments examined the role of the mOFC in (1) Pavlovian conditioned approach, (2) conditioned reinforcement, (3) extinction, and (4) cue-induced reinstatement of food-seeking behavior.

METHODS

Separate cohorts of rats went through Pavlovian or instrumental training. Intra-mOFC infusions of either saline or GABA agonists (to temporarily inactivate neural activity) were given prior to Pavlovian approach, conditioned reinforcement, first or second day of instrumental extinction training, or cue-induced reinstatement test days.

RESULTS

mOFC inactivation increased lever-CS contacts in Pavlovian conditioned approach and (2) had no effect on conditioned reinforcement. These manipulations (3) accelerated within-session instrumental extinction during the initial extinction session, but impaired subsequent extinction learning on drug-free days. (4) mOFC inactivation induced differential effects on reinstatement that depended on baseline performance. mOFC inactivation abolished reinstatement in "Reinstater" rats (who displayed robust responding under control conditions) and robustly increased reinstatement in "Non-Reinstater" rats (who showed little reinstatement under control conditions) suggesting that individual differences in reinstatement may be supported by differences in mOFC mediated representations of expected outcomes.

CONCLUSIONS

These findings have important implications for understanding how the mOFC uses stimulus-outcome and action-outcome expectancies to guide behavior, and how dysfunction within this region may contribute to pathological patterns of reward seeking.

Alcohol craving in the natural environment: Moderating roles of cue exposure, drinking, and alcohol sensitivity

Effects of cue exposure and alcohol consumption (e.g., priming doses) on craving for alcohol have been examined in largely separate literature, limiting what is known about their potential interaction. Individuals with low alcohol sensitivity, a known risk factor for alcohol use disorder (AUD), exhibit stronger cue-elicited craving than their higher-sensitivity (HS) peers in both laboratory and real-world contexts. Here, underage drinkers (N = 155) completed a 21-day ecological momentary assessment (EMA) protocol in which they recorded exposure to alcohol cues and levels of craving during both nondrinking and postdrinking moments. Multilevel modeling detected a significant interaction of cue exposure and postdrinking status on craving. Cue-induced craving was increased in postdrinking moments compared to nondrinking moments. Contrary to prediction, cue-elicited increase in craving during nondrinking moments was stronger in participants reporting higher sensitivity to alcohol. In the presence of cues, lower sensitivity was robustly related to craving intensity in the postdrinking state but unrelated to craving during nondrinking moments. Craving during drinking episodes in the natural environment is magnified by the presence of alcohol cues, potentially contributing to the maintenance or acceleration of drinking episodes. Moreover, lower-sensitivity drinkers may be particularly susceptible to the combined effects of cue exposure and postdrinking status on alcohol craving. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goal-tracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states.SIGNIFICANCE STATEMENT Model-free and model-based computations that guide instrumental decision-making processes may also be recruited in pavlovian-based behavioral procedures. Here, we used a within-subject design to test the hypothesis that both pavlovian and instrumental learning processes were driven by common reinforcement-learning mechanisms. Sign-tracking and goal-tracking behaviors were assessed in rats using a pavlovian conditioned approach task, and then instrumental behavior was characterized using an MSDM task. We report that sign-tracking behavior was associated with greater model-free, but not model-based, learning in the MSDM task. These data suggest that pavlovian and instrumental behaviors may be driven by conserved reinforcement-learning mechanisms.

A mechanical task for measuring sign- and goal-tracking in humans: A proof-of-concept study

Cue-based associative learning (i.e., Pavlovian conditioning) is a foundational component of behavior in almost all forms of animal life and may provide insight into individual differences in addiction liability. Cues can take on incentive-motivational properties (i.e., incentive salience) through Pavlovian learning. Extensive testing with non-human animals (primarily rats) has demonstrated significant variation among individuals in the behaviors this type of learning evokes. So-named "sign-trackers" and "goal-trackers" have been examined in many studies of non-human animals, but this work in humans is still a nascent area of research. In the present proof-of-concept study, we used a Pavlovian conditioned approach task to investigate human sign- and goal-tracking in emerging adults. Conditioned behaviors that developed over the course of the task were directed toward the reward-cue and toward the reward location. Participants' eye-gaze and behavior during the task were submitted to a latent profile analysis, which revealed three groups defined as sign-trackers (n = 10), goal-trackers (n = 4), and intermediate responders (n = 36). Impulsivity was a significant predictor of the sign-tracking group relative to the goal-tracking group. The present study provides preliminary evidence that a simple procedure can produce learned Pavlovian conditioned approach behavior in humans. Though further investigation is required, findings provide a promising step toward the long-term goal of translating important insights gleaned from basic research into treatment strategies that can be applied to clinical populations.

Estradiol and progesterone in female reward-learning, addiction, and therapeutic interventions

Sex steroid hormones like estradiol (E2) and progesterone (P4) guide the sexual organization and activation of the developing brain and control female reproductive behavior throughout the lifecycle; importantly, these hormones modulate functional activity of not just the endocrine system, but most of the nervous system including the brain reward system. The effects of E2 and P4 can be seen in the processing of and memory for rewarding stimuli and in the development of compulsive reward-seeking behaviors like those seen in substance use disorders. Women are at increased risk of developing substance use disorders; however, the origins of this sex difference are not well understood and therapeutic interventions targeting ovarian hormones have produced conflicting results. This article reviews the contribution of the E2 and P4 in females to functional modulation of the brain reward system, their possible roles in origins of addiction vulnerability, and the development and treatment of compulsive reward-seeking behaviors.

The incentive amplifying effects of nicotine: Roles in alcohol seeking and consumption

Nicotine has a unique profile among drugs of abuse. To the noninitiated user, nicotine has powerful aversive effects and its relatively weak euphorigenic effects undergo rapid tolerance. Despite this, nicotine is commonly abused despite negative heath consequences, and nicotine users have enormous difficulty quitting. Further, nicotine is one of the most commonly co-abused substances, in that it is often taken in combination with other drugs. One explanation of this polydrug use is that nicotine has multiple appetitive and consummatory conditioning effects. For example, nicotine is a reinforcement enhancer in that it can potently increase the incentive value of other stimuli, including those surrounding drugs of abuse such as alcohol. In addition, nicotine also has a unique profile of neurobiological effects that alter regulation of alcohol intake and interoception. This review discusses the psychological and biological mechanisms surrounding nicotine's appetitive conditioning and consummatory effects, particularly its interactions with alcohol.

Acute nicotine treatment enhances compulsive-like remifentanil self-administration that persists despite contextual punishment

Opioid use disorder (OUD) and opioid-related deaths remain a significant public health crisis having reached epidemic status globally. OUDs are defined as chronic, relapsing conditions often characterized by compulsive drug seeking despite the deleterious consequences of drug taking. The use of nicotine-containing products has been linked to increased likelihood of prescription opioid misuse, and there exists a significant comorbidity between habitual nicotine use and opioid dependence. In rodent models, nicotine administration nearly doubles the amount of opioids taken in intravenous self-administration paradigms. Here, we examined the effect of acute systemic nicotine administration in male rats on responding for the synthetic opioid remifentanil (RMF) in a contextual punishment paradigm using either an exteroceptive punisher (foot-shock) or an interoceptive punisher (histamine). Nicotine administration, relative to saline, increased RMF intake in both unpunished and punished contexts, regardless of form of punishment, and resulted in significantly higher motivation to obtain RMF in the previously punished context, as measured by progressive ratio breakpoint. Additionally, regardless of context, nicotine-treated rats were slower to extinguish RMF responding following drug removal and displayed higher levels of cue-induced reinstatement than saline-treated controls. Furthermore, these data support that, compared with histamine adulteration, contingent foot-shock is a more potent form of punishment, as histamine punishment failed to support contextual discrimination between the unpunished and punished contexts. In contrast to RMF administration, augmentation of responding for an audiovisual cue by nicotine pretreatment was lost following contextual punishment. In conclusion, acute nicotine administration in adult male rats significantly enhances compulsive-like responding for RMF that persists despite contingent punishment of drug-directed responding.

Investigating individual differences in opioid-taking and opioid-seeking behavior in male rats

RATIONALE

Understanding the behavioral and neurobiological factors that render some individuals more susceptible than others to opioid addiction will be critical in combatting the opioid crisis.

OBJECTIVE

The purpose of the current study was to determine if behavioral traits associated with an increased likelihood to take and seek cocaine are the same traits that render one more susceptible to opioid-taking and opioid-seeking behavior. Individual differences in the acquisition of remifentanil self-administration and subsequent cue-induced reinstatement of remifentanil-seeking behavior were investigated using two animal models: the high-responder (HR)/low-responder (LR) and sign-tracker (ST)/goal-tracker (GT) models. Relative to LR rats, HR rats show increased novelty-induced locomotion or "sensation-seeking" behavior, and are more likely to acquire cocaine-taking behavior and do so at a faster rate. Relative to GT rats, ST rats attribute greater incentive motivational value to reward cues and are more likely to exhibit reinstatement of cocaine-seeking behavior.

RESULTS

In contrast to previous work using cocaine, we did not observe individual differences with respect to the acquisition of remifentanil self-administration- or cue-induced reinstatement of remifentanil-seeking behavior within the context of either the HR/LR or ST/GT model. Thus, neither the sensation-seeking trait nor the propensity to attribute incentive motivational value to reward cues predicts remifentanil-taking or remifentanil-seeking behavior.

CONCLUSIONS

These findings suggest that different traits may confer the initiation of opioid- vs. cocaine-taking behavior, and the propensity to relapse to opioid- vs. cocaine-seeking. Additional studies are needed to identify which neurobehavioral constructs confer liability to opioid use and relapse.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats

RATIONALE

Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues.

OBJECTIVES

The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity.

RESULTS

Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement.

CONCLUSIONS

These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

DNA Epigenetics in Addiction Susceptibility

Addiction is a chronically relapsing neuropsychiatric disease that occurs in some, but not all, individuals who use substances of abuse. Relatively little is known about the mechanisms which contribute to individual differences in susceptibility to addiction. Neural gene expression regulation underlies the pathogenesis of addiction, which is mediated by epigenetic mechanisms, such as DNA modifications. A growing body of work has demonstrated distinct DNA epigenetic signatures in brain reward regions that may be associated with addiction susceptibility. Furthermore, factors that influence addiction susceptibility are also known to have a DNA epigenetic basis. In the present review, we discuss the notion that addiction susceptibility has an underlying DNA epigenetic basis. We focus on major phenotypes of addiction susceptibility and review evidence of cell type-specific, time dependent, and sex biased effects of drug use. We highlight the role of DNA epigenetics in these diverse processes and propose its contribution to addiction susceptibility differences. Given the prevalence and lack of effective treatments for addiction, elucidating the DNA epigenetic mechanism of addiction vulnerability may represent an expeditious approach to relieving the addiction disease burden.

Sign- and goal-tracking score does not correlate with addiction-like behavior following prolonged cocaine self-administration

RATIONALE

In classical conditioning, sign-tracking reflects behavior directed toward a conditioned stimulus (CS) in expectation of a reward (unconditioned stimulus, US); in contrast, goal-tracking describes behavior directed toward the location of delivery of a US. As cues previously paired with drugs of abuse promote drug-seeking and drug-taking behavior in both animals and humans and thus contribute to the severity of substance abuse, sign-tracking may represent a maladaptive cue-focused behavior that may increase addiction vulnerability as compared to goal-tracking. Recent studies do, in fact, support this possibility. Previous work in this area has focused primarily on paradigms using relatively limited exposure to drug rather than extended drug intake.

OBJECTIVES

Here, we used the DSM-IV-based 3-criteria (3-CRIT) model and examined whether a relationship exists between sign- or goal-tracking phenotypes and the prevalence of criteria associated with addiction-like behavior following extended cocaine self-administration as measured in this model.

METHODS

Forty-six male Sprague Dawley rats underwent a Pavlovian conditioned approach (PCA) procedure and were characterized along a continuum as goal-trackers (GTs), intermediates (INTs), or sign-trackers (STs). The animals were subsequently trained to intravenous self-administer cocaine during 45 self-administration (SA) sessions and characterized for the 3 criteria outlined in the model: persistence of drug-seeking, motivation for cocaine-taking, and resistance to punishment.

RESULTS

We performed correlational analyses on the traits measured, finding no relationships between PCA score and addiction-like characteristics measured using the 3-CRIT model of addiction. However, STs showed significantly greater resistance to punishment than GTs.

CONCLUSIONS

Phenotyping along a continuum of PCA scores may not be a valid predictor for identifying vulnerability to the addiction-like behaviors examined using the 3-CRIT model. However, PCA phenotype may predict a single feature of the 3-CRIT model, resistance to punishment, among those rats classified as either STs or GTs.

Interspecies Behavioral Variability of Medaka Fish Assessed by Comparative Phenomics

Recently, medaka has been used as a model organism in various research fields. However, even though it possesses several advantages over zebrafish, fewer studies were done in medaka compared to zebrafish, especially with regard to its behavior. Thus, to provide more information regarding its behavior and to demonstrate the behavioral differences between several species of medaka, we compared the behavioral performance and biomarker expression in the brain between four medaka fishes, Oryzias latipes, Oryzias dancena, Oryzias woworae, and Oryzias sinensis. We found that each medaka species explicitly exhibited different behaviors to each other, which might be related to the different basal levels of several biomarkers. Furthermore, by phenomics and genomic-based clustering, the differences between these medaka fishes were further investigated. Here, the phenomic-based clustering was based on the behavior results, while the genomic-based clustering was based on the sequence of the nd2 gene. As we expected, both clusterings showed some resemblances to each other in terms of the interspecies relationship between medaka and zebrafish. However, this similarity was not displayed by both clusterings in the medaka interspecies comparisons. Therefore, these results suggest a re-interpretation of several prior studies in comparative biology. We hope that these results contribute to the growing database of medaka fish phenotypes and provide one of the foundations for future phenomics studies of medaka fish.

Male Goal-Tracker and Sign-Tracker Rats Do Not Differ in Neuroendocrine or Behavioral Measures of Stress Reactivity

Environmental cues attain the ability to guide behavior via learned associations. As predictors, cues can elicit adaptive behavior and lead to valuable resources (e.g., food). For some individuals, however, cues are transformed into incentive stimuli and elicit motivational states that can be maladaptive. The goal-tracker (GT)/sign-tracker (ST) animal model captures individual differences in cue-motivated behaviors, with reward-associated cues serving as predictors of reward for both phenotypes but becoming incentive stimuli to a greater degree for STs. While these distinct phenotypes are characterized based on Pavlovian conditioned approach (PavCA) behavior, they exhibit differences on a number of behaviors relevant to psychopathology. To further characterize the neurobehavioral endophenotype associated with individual differences in cue-reward learning, neuroendocrine and behavioral profiles associated with stress and anxiety were investigated in male GT, ST, and intermediate responder (IR) rats. It was revealed that baseline corticosterone (CORT) increases with Pavlovian learning, but to the same degree, regardless of phenotype. No significant differences in behavior were observed between GTs and STs during an elevated plus maze (EPM) or open field test (OFT), nor were there differences in CORT response to the OFT or physiological restraint. Upon examination of central markers associated with stress reactivity, we found that STs have greater glucocorticoid receptor (GR) mRNA expression in the ventral hippocampus, with no phenotypic differences in the dorsal hippocampus or prelimbic cortex (PrL). These findings demonstrate that GTs and STs do not differ on stress-related and anxiety-related behaviors, and suggest that differences in neuroendocrine measures between these phenotypes can be attributed to distinct cue-reward learning styles.

Sign Tracking in an Enriched Environment: A Potential Ecologically Relevant Animal Model of Adaptive Behavior Change

When an object conditioned stimulus (CS) is paired with a food unconditioned stimulus (US), anticipatory goal-directed action directed at the US location (goal tracking) is accompanied by behavior directed at the object CS (sign tracking). Sign-tracking behavior appears to be compulsive and habit-like and predicts increased vulnerability to the addictive potential of drugs in animal models. A large body of the literature also suggests that environmental enrichment protects against the development of addiction-prone phenotypes. Thus, we investigated whether compulsive-like sign tracking develops in environmentally enriched rats trained directly in their enriched home environment. We demonstrate that adolescent enriched-housed male Sprague-Dawley rats readily sign track a 5% ethanol bottle CS in their home environment and at a rate higher than adolescent standard-housed rats. We also show that enriched adolescent rats sign track less than enriched adult-trained rats and that acute isolation stress affects sign- and goal-tracking performance of adolescents and adults differently. Sign tracking increased more in the adult than the adolescent rats. Whereas the younger rats showed a decrease in goal tacking after the final stressor manipulation, the adults showed increased goal tracking. Our results are consistent with recent studies, which suggest that although sign tracking performance is compulsive-like, it is not as inflexible and habit-like as previously assumed. Testing in an enriched home environment with object CSs having greater affordance than "neutral" lever CSs may provide greater ecological relevance for investigating the development and expression of adaptive and compulsive-like behaviors in translational research.

A proposed role for glucocorticoids in mediating dopamine-dependent cue-reward learning

Learning to respond appropriately to one's surrounding environment is fundamental to survival. Importantly, however, individuals vary in how they respond to cues in the environment and this variation may be a key determinant of psychopathology. The ability of seemingly neutral cues to promote maladaptive behavior is a hallmark of several psychiatric disorders including, substance use disorder, post-traumatic stress disorder, eating disorders and obsessive-compulsive disorder. Thus, it is important to uncover the neural mechanisms by which such cues are able to attain inordinate control and promote psychopathological behavior. Here, we suggest that glucocorticoids play a critical role in this process. Glucocorticoids are primarily recognized as the main hormone secreted in response to stress but are known to exert their effects across the body and the brain, and to affect learning and memory, cognition and reward-related behaviors, among other things. Here we speculate that glucocorticoids act to facilitate a dopamine-dependent form of cue-reward learning that appears to be relevant to a number of psychiatric conditions. Specifically, we propose to utilize the sign-tracker/goal-tracker animal model as a means to capture individual variation in stimulus-reward learning and to isolate the role of glucocorticoid-dopamine interactions in mediating these individual differences. It is hoped that this framework will lead to the discovery of novel mechanisms that contribute to complex neuropsychiatric disorders and their comorbidity.

Sensitivity to food and cocaine cues are independent traits in a large sample of heterogeneous stock rats

Sensitivity to cocaine and its associated stimuli ("cues") are important factors in the development and maintenance of addiction. Rodent studies suggest that this sensitivity is related, in part, to the propensity to attribute incentive salience to food cues, which, in turn, contributes to the maintenance of cocaine self-administration, and cue-induced relapse of drug-seeking. Whereas each of these traits has established links to drug use, the relatedness between the individual traits themselves has not been well characterized in preclinical models. To this end, the propensity to attribute incentive salience to a food cue was first assessed in two distinct cohorts of 2716 outbred heterogeneous stock rats (HS; formerly N:NIH). We then determined whether each cohort was associated with performance in one of two paradigms (cocaine conditioned cue preference and cocaine contextual conditioning). These measure the unconditioned locomotor effects of cocaine, as well as conditioned approach and the locomotor response to a cocaine-paired floor or context. There was large individual variability and sex differences among all traits, but they were largely independent of one another in both males and females. These findings suggest that these traits may contribute to drug-use via independent underlying neuropsychological processes.

Behavioral determinants in the expression of the Kamin blocking effect: Implications for associative learning theory

Associative learning makes important contributions to our behavior and decisions. The Kamin blocking effect is an associative learning phenomenon that plays a central role in understanding of the psychological principles underlying associative learning. However, several recent failures to replicate the blocking effect suggest that the conditions necessary for blocking are poorly understood. To understand the conditions necessary for blocking, here we review studies into the expression of blocking in subjects that either approach and interact with the conditioned cue (sign trackers) or approach and interact with the reward location (goal trackers) during appetitive classical conditioning. Psychological theory and the neurophysiological correlates of appetitive classical conditioning make opposing predictions regarding the expression of blocking in sign and goal trackers. We reconcile these opposing predictions in a qualitative model using two parallel learning processes. Such models offer a better framework for understanding the psychological associative structures acquired during learning, their interactions contributing to the conditioned response, and how they affect subsequent learning and the expression of the Kamin blocking effect.

Neurons of the Ventral Tegmental Area Encode Individual Differences in Motivational "Wanting" for Reward Cues

It has been argued that the dopaminergic system is involved in the attribution of motivational value to reward predictive cues as well as prediction error. To evaluate, dopamine neurons were recorded from male rats performing a Pavlovian approach task containing cues that have both "predictive" and "incentive" properties. All animals learned the predictive nature of the cue (illuminated lever entry into cage), but some also found the cue to be attractive and were motivated toward it ("sign-trackers," STs). "Goal-trackers" (GTs) predominantly approached the location of reward receptacle. Rats were implanted with tetrodes for neural electrophysiological recordings in the ventral tegmental area. Cells were characterized by spike waveform shape and firing rate. Firing rates and magnitudes of responses in relation to Pavlovian behaviors, cue presentation, and reward delivery were assessed. We identified 103 dopamine and 141 nondopamine neurons. GTs and STs both showed responses to the initial lever presentation (CS1) and lever retraction (CS2). However, higher firing rates were sustained during the lever interaction period only in STs. Further, dopamine cells of STs showed a significantly higher proportion of cells responding to both CS1 and CS2. These are the first results to show that neurons from the VTA encode both predictive and incentive cues, support an important role for dopamine neurons in the attribution of incentive salience to reward-paired cues, and underscore the consequences of potential differences in motivational behavior between individuals.SIGNIFICANCE STATEMENT This project serves to determine whether dopamine neurons encode differences in cued approach behaviors and incentive salience. How neurons of the VTA affect signaling through the NAcc and subsequent dopamine release is still not well known. All cues that precede a reward are predictive in nature. Some, however, also have incentive value, in that they elicit approach toward them. We quantified the attribution of incentive salience through cue approach behavior and cue interaction, and the corresponding magnitude of VTA neural firing. We found dopamine neurons of the VTA encode strength of incentive salience of reward cues. This suggests that dopamine neurons specifically in the VTA encode motivation.

Effects of the cannabinoid receptor agonist CP-55,940 on incentive salience attribution

RATIONALE

Pavlovian conditioned approach paradigms are used to characterize the nature of motivational behaviors in response to stimuli as either directed toward the cue (i.e., sign-tracking) or the site of reward delivery (i.e., goal-tracking). Recent evidence has shown that activity of the endocannabinoid system increases dopaminergic activity in the mesocorticolimbic system, and other studies have shown that sign-tracking behaviors are dependent on dopamine.

OBJECTIVES

Therefore, we hypothesized that administration of a cannabinoid agonist would increase sign-tracking and decrease goal-tracking behaviors.

METHODS

Forty-seven adult male Sprague-Dawley rats were given a low, medium, or high dose of the cannabinoid agonist CP-55,940 (N = 12 per group) or saline (N = 11) before Pavlovian conditioned approach training. A separate group of rats (N = 32) were sacrificed after PCA training for measurement of cannabinoid receptor type 1 (CB1) and fatty acid amide hydrolase (FAAH) using in situ hybridization.

RESULTS

Contrary to our initial hypothesis, CP-55,940 dose-dependently decreased sign-tracking and increased goal-tracking behavior. CB1 expression was higher in sign-trackers compared with that in goal-trackers in the prelimbic cortex, but there were no significant differences in CB1 or FAAH expression in the infralimbic cortex, dorsal or ventral CA1, dorsal or ventral CA3, dorsal or ventral dentate gyrus, or amygdala.

CONCLUSIONS

These results demonstrate that cannabinoid signaling can specifically influence behavioral biases toward sign- or goal-tracking. Pre-existing differences in CB1 expression patterns, particularly in the prelimbic cortex, could contribute to individual differences in the tendency to attribute incentive salience to reward cues.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

Sign-tracking behavior is sensitive to outcome devaluation in a devaluation context-dependent manner: implications for analyzing habitual behavior

Motivationally attractive cues can draw in behavior in a phenomenon termed incentive salience. Incentive cue attraction is an important model for animal models of drug seeking and relapse. One question of interest is the extent to which the pursuit of motivationally attractive cues is related to the value of the paired outcome or can become unrelated and habitual. We studied this question using a sign-tracking (ST) paradigm in rats, in which a lever stimulus preceding food reward comes to elicit conditioned lever-interaction behavior. We asked whether reinforcer devaluation by means of conditioned taste aversion, a classic test of habitual behavior, can modify ST to incentive cues, and whether this depends upon the manner in which reinforcer devaluation takes place. In contrast to several recent reports, we conclude that ST is indeed sensitive to reinforcer devaluation. However, this effect depends critically upon the congruence between the context in which taste aversion is learned and the context in which it is tested. When the taste aversion successfully transfers to the testing context, outcome value strongly influences ST behavior, both when the outcome is withheld (in extinction) and when animals can learn from outcome feedback (reacquisition). When taste aversion does not transfer to the testing context, ST remains high. In total, the extent to which ST persists after outcome devaluation is closely related to the extent to which that outcome is truly devalued in the task context. We believe this effect of context on devaluation can reconcile contradictory findings about the flexibility/inflexibility of ST. We discuss this literature and relate our findings to the study of habits generally.

Mechanisms of Shared Vulnerability to Post-traumatic Stress Disorder and Substance Use Disorders

Psychoactive substance use is a nearly universal human behavior, but a significant minority of people who use addictive substances will go on to develop an addictive disorder. Similarly, though ~90% of people experience traumatic events in their lifetime, only ~10% ever develop post-traumatic stress disorder (PTSD). Substance use disorders (SUD) and PTSD are highly comorbid, occurring in the same individual far more often than would be predicted by chance given the respective prevalence of each disorder. Some possible reasons that have been proposed for the relationship between PTSD and SUD are self-medication of anxiety with drugs or alcohol, increased exposure to traumatic events due to activities involved in acquiring illegal substances, or addictive substances altering the brain's stress response systems to make users more vulnerable to PTSD. Yet another possibility is that some people have an intrinsic vulnerability that predisposes them to both PTSD and SUD. In this review, we integrate clinical and animal data to explore these possible etiological links between SUD and PTSD, with an emphasis on interactions between dopaminergic, adrenocorticotropic, GABAergic, and glutamatergic neurobehavioral mechanisms that underlie different emotional learning styles.

Addiction vulnerability and the processing of significant cues: Sign-, but not goal-, tracker perceptual sensitivity relies on cue salience

The identification of broadly defined psychological traits that bestow vulnerability for the manifestation of addiction-like behaviors can guide the discovery of the neuronal mechanisms underlying the propensity for drug taking. Sign-tracking behavior in rats (STs) signifies the presence of a trait that predicts a relatively greater behavioral control of Pavlovian drug and reward cues than in rats that exhibit goal-tracking behavior (GTs). We previously demonstrated that relatively poor cholinergic-attentional control in STs is an essential component of the trait indexed by sign-tracking and that this trait aspect contributes to the relatively greater power of drug cues to control the behavior of STs. Here we addressed the possibility that STs and GTs employ fundamentally different psychological mechanisms for the detection of cues in attention-demanding contexts. Rats were trained to perform an operant Sustained Attention Task. As task training advanced to the stage that taxed attentional control, the relative brightness of visual target signals significantly influenced detection performance in STs but not GTs. This finding suggests that STs, but not GTs, rely on bottom-up, cue salience-driven mechanisms to detect cues. GTs may be able to resist behavioral control by Pavlovian drug cues by utilizing goal-directed decisional processes that minimize the influence of the salience of drug cues. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Evidence for incentive salience sensitization as a pathway to alcohol use disorder

The incentive salience sensitization (ISS) theory of addiction holds that addictive behavior stems from the ability of drugs to progressively sensitize the brain circuitry that mediates attribution of incentive salience (IS) to reward-predictive cues and its behavioral manifestations. In this article, we establish the plausibility of ISS as an etiological pathway to alcohol use disorder (AUD). We provide a comprehensive and critical review of evidence for: (1) the ability of alcohol to sensitize the brain circuitry of IS attribution and expression; and (2) attribution of IS to alcohol-predictive cues and its sensitization in humans and non-human animals. We point out gaps in the literature and how these might be addressed. We also highlight how individuals with different alcohol subjective response phenotypes may differ in susceptibility to ISS as a pathway to AUD. Finally, we discuss important implications of this neuropsychological mechanism in AUD for psychological and pharmacological interventions attempting to attenuate alcohol craving and cue reactivity.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Using rodent models to understand interactions between gambling and substance use

Substance use is strongly associated with gambling, but the nature of this association can be difficult to determine. Rodents offer the opportunity to test causal models of these relationships through isolation of individual variables of interest. This review describes recent research in rodents showing: a) predisposing factors for both gambling-like behavior and substance use; b) exposure to drugs of abuse increasing gambling-like behavior; c) experience with gambling-like behavior increasing substance use; and d) links between gambling-like behavior and substance use in models of Parkinson's disease therapies. These findings reveal novel relationships between gambling and substance use, and highlight the utility of rodent models for future work in this area.

Sign-tracking behavior is difficult to extinguish and resistant to multiple cognitive enhancers

The attribution of incentive-motivational value to drug-related cues underlies relapse and craving in drug addiction. One method of addiction treatment, cue-exposure therapy, utilizes repeated presentations of drug-related cues in the absence of drug (i.e., extinction learning); however, its efficacy has been limited due to an incomplete understanding of extinction and relapse processes after cues have been imbued with incentive-motivational value. To investigate this, we used a Pavlovian conditioned approach procedure to screen for rats that attribute incentive-motivational value to reward-related cues (sign-trackers; STs) or those that do not (goal-trackers; GTs). In Experiment 1, rats underwent Pavlovian extinction followed by reinstatement and spontaneous recovery tests. For comparison, a separate group of rats underwent PCA training followed by operant conditioning, extinction, and tests of reinstatement and spontaneous recovery. In Experiment 2, three cognitive enhancers (sodium butyrate, D-cycloserine, and fibroblast growth factor 2) were administered following extinction training to facilitate extinction learning. STs but not GTs displayed enduring resistance to Pavlovian, but not operant, extinction and were more susceptible to spontaneous recovery. In addition, none of the cognitive enhancers tested affected extinction learning. These results expand our understanding of extinction learning by demonstrating that there is individual variation in extinction and relapse processes and highlight potential difficulties in applying extinction-based therapies to drug addiction treatment in the clinic.

Sign- and goal-tracking rats show differences in various executive functions: Authors

Sign tracking (ST) is a complex Pavlovian trait that is known to impact instrumental behaviour. Recent work suggests that this trait also correlates with altered top-down executive control relative to goal tracking (GT) rats. This raises the question as to the extent to which both phenotypes differ in executive functions. Moreover, it is unclear which cognitive processes might cause potential differences between ST and GT rats. We therefore compared the behaviour of ST and GT rats in several assays, such as outcome devaluation, attentional set shifting and reversal learning, conditional responding, as well as delayed alternation to measure different aspects of executive functioning. Goal-directed behaviour per se was not different between ST and GT rats in the outcome devaluation task. ST rats performed slightly better than GT rats in one condition of the set shifting task (place->cue shift) and the delayed alternation task, but did not perform as well in the conditional responding task. Thus, differential behavioural performance between ST and GT rats was dependent on the specific task context. Further, we found evidence that the differences in executive functions are likely related to increased incentive salience attribution and impulsive action in ST rats.