On the motivational properties of reward cues: Individual differences

Social isolation enhances cued-reinstatement of sucrose and nicotine seeking, but this is reversed by a return to social housing

Physical or perceived (i.e. loneliness) social isolation is increasing in Western cultures. Unfortunately, social isolation is associated with a range of negative physical and mental health outcomes, including increased incidence of obesity and smoking. Here we monitored the impact of social isolation on a range of physical measures, and then tested whether social isolation in adult rats changes how reward-related stimuli motivate sucrose- or nicotine-seeking. Socially isolated rats showed elevated baseline CORT, gained significantly less weight across the study, were more active in response to a novel or familiar environment. Isolated rats also acquired nose-poking for a food pellet more rapidly, and showed increased susceptibility to cue-, but not reward-induced reinstatement. Notably, these effects are partially mitigated by a return to group housing, suggesting that they are not necessarily permanent, and that a return to a social setting can quickly reverse any deficits or changes associated with social isolation. This study advances our understanding of altered reward-processing in socially isolated individuals and reiterates the importance of socialisation in the treatment of disorders such as overeating and addiction.

Insights into the Neurobiology of Craving in Opioid Use Disorder

Purpose of review

Opioids remain the most potent form of pain relief currently available, yet have a high abuse liability. Here we discuss underlying neurobiological changes in Opioid Use Disorder (OUD) that likely contribute to drug craving, which in turn drives continued drug use and relapse.

Recent findings

Craving has emerged as a strong indicator in drug-seeking and relapse. Studies have demonstrated a number of allostatic changes in circuitry that facilitate learning of drug-stimuli relationships, thereby augmenting cue-triggered drug use and relapse.

Summary

This review will focus on key neurobiological changes in underlying circuitry observed during the initial and continued exposure to opioids that result in an increase in neural-reactivity to drug-related intrinsic and extrinsic drug cues, and to enhanced learning of drug-context correlations. This sensitized learning state may be an indication of the underlying framework that drives craving and ultimately, motivates increased salience of drug cues and drives drug-seeking.

Effects of winning cues and relative payout on choice between simulated slot machines

BACKGROUND AND AIMS

Cues associated with winning may encourage gambling. We assessed the effects on risky choice of slot machine of: (1) neutral sounds paired with winning, (2) casino-related cues (such as the sound of coins dropping and pictures of dollar signs) and (3) relative payouts.

DESIGN

Experimental studies in which participants repeatedly chose between safer and riskier simulated slot machines. Safer slot machines paid the same amount regardless of which symbols lined up. Risky machines paid different amounts depending on which symbols lined up. Effects of initially neutral sounds paired with the best payout were assessed between-groups (experiment 1a) and within-participants (experiment 1b). In experiment 2, pairing of casino-related audiovisual cues with payout was assessed within participants, and cue timing was assessed between groups.

SETTING

A university research laboratory in Edmonton, Canada.

PARTICIPANTS

Undergraduate students (n = 630 across three experiments).

MEASUREMENTS

Preference for riskier over safer machines, preference between machines that differed in cues, payout recall and frequency estimates for payouts. Risky choice was calculated as the proportion of choices of the risky machine when presented with a fixed machine of the same expected value.

FINDINGS

In experiment 1a, risky choice was slightly increased by pairing a sound with the best payout compared with pairing the sound with a lower payout (P = 0.04, d = 0.28) but not compared with no sound [P = 0.36, d = 0.13, Bayes factors (BF)₁₀  = 0.22]. In experiment 1b, people did not prefer a machine with a best-payout sound over one with a lower-payout sound (P = 0.67, d = 0.03, BF₁₀  = 0.11). Relative payout affected choice: risky choices were higher for high- than low-payout decisions (P < 0.001, d = 0.53). In experiment 2, people preferred machines with casino-related cues paired with winning (P < 0.001, r²  = 0.11) and cue timing (at choice or concurrently with the win) had no effect (P = 0.95, r²  = 0.0, BF₁₀  = 0.05). Casino-related cues also enhanced payout memory (P = 0.013 and 0.006). Cue effects were not specific to risk: people also preferred fixed-payout machines with casino-related cues (P < 0.001, r²  = 0.16).

CONCLUSIONS

In a gambling simulation, student participants chose more risky slot machines when payouts were relatively higher and when casino-related cues were associated with payouts. Pairing a neutral sound with the best payout did not consistently affect slot machine choice, and the effect of casino cues did not depend on their timing. Casino-related cues enhanced payout memory.

Dose-dependent effects of alcohol injections on omission-contingency learning have an inverted-U pattern

Previous examinations of the long-term effects of alcohol exposure on omission-contingency learning have produced mixed results across different age or sex groups, with evidence for faster learning or no effect. However, none of these experiments made comparisons using the same exposure-dose across the age/sex groups. Here, we exposed rats to 6 weeks of alcohol injections (3 days/week, 1.75 or 3.5 g/kg/24-h, i.p. broken up into 2 injections/day) in adolescent/early adult males or females (PND27-66) or adult males (PND62-101). We then tested the rats in autoshaping and omission-contingency tasks. In contrast to our hypotheses, the low 1.75-g/kg/24-h dose led to slower omission learning and the higher 3.5-g/kg/24-h dose had no effect. There were no age- or sex-differences in omission learning. Additionally, during autoshaping training, rats exposed in adolescence/early adulthood had a faster shift to sign-tracking in their sign-tracking/goal-tracking ratios than rats exposed in adulthood, with no consistent effect of alcohol exposure or sex-differences. Our results suggest complex effects of alcohol on the neural substrates of omission-contingency learning at different doses, which will require future investigation.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

Corticosterone in the ventral hippocampus differentially alters accumbal dopamine output in drug-naïve and amphetamine-withdrawn rats

Dysregulation in glucocorticoid stress and accumbal dopamine reward systems can alter reward salience to increase motivational drive in control conditions while contributing to relapse during drug withdrawal. Amphetamine withdrawal is associated with dysphoria and stress hypersensitivity that may be mediated, in part, by enhanced stress-induced corticosterone observed in the ventral hippocampus. Electrical stimulation of the ventral hippocampus enhances accumbal shell dopamine release, establishing a functional connection between these two regions. However, the effects of ventral hippocampal corticosterone on this system are unknown. To address this, a stress-relevant concentration of corticosterone (0.24ng/0.5 μL) or vehicle were infused into the ventral hippocampus of urethane-anesthetized adult male rats in control and amphetamine withdrawn conditions. Accumbal dopamine output was assessed with in vivo chronoamperometry. Corticosterone infused into the ventral hippocampus rapidly enhanced accumbal dopamine output in control conditions, but produced a biphasic reduction of accumbal dopamine output in amphetamine withdrawal. Selectively blocking glucocorticoid-, mineralocorticoid-, or cytosolic receptors prevented the effects of corticosterone. Overall, these results suggest that the ability of corticosterone to alter accumbal dopamine output requires cooperative activation of mineralocorticoid and glucocorticoid receptors in the cytosol, which is dysregulated during amphetamine withdrawal. These findings implicate ventral hippocampal corticosterone in playing an important role in driving neural systems involved in positive stress coping mechanisms in healthy conditions, whereas dysregulation of this system may contribute to relapse during withdrawal.

Reward uncertainty attributes incentive value to reward proximal cues, while amphetamine sensitization reverts attention to more predictive reward distal cues

Slot-machine gambling incorporates numerous audiovisual cues prior to and during reward delivery (e.g. spinning wheels, flashing lights, celebratory sounds). Over time, these cues may motivate playing and even elicit cravings and relapse in those affected by gambling disorder. Animal studies suggest a heightened attraction to these cues despite diminished predictive ability under reward uncertainty, as evidenced by sign-tracking behavior in rats. Repeated amphetamine administration may also enhance the incentive value attributed to cues. Here, we explored the impact of reward uncertainty and prior amphetamine sensitization on the relative attractiveness and conditioned reinforcing properties of serial Pavlovian cues with different degrees of predictive and incentive value in rats. Animals were sensitized through repeated injections of amphetamine (1-4 mg/kg) or saline and then trained in a Pavlovian autoshaping task involving two sequential lever-auditory cue combinations (CS1, CS2) under Certain (100%-1) or Uncertain (50%-1-2-3) reward conditions. Subsequently, we evaluated the impact of acute amphetamine exposure on cue attraction. Our results suggest that Uncertainty alone enhanced attraction towards the reward-proximal CS2. However, combined sensitization and Uncertainty reversed cue preference relative to Uncertainty alone, enhancing attraction towards the more predictive reward-distal CS1. Both cues acquired conditioned reinforcing properties, despite the CS2 being otherwise ignored in all groups besides Uncertainty. However, combined sensitization and Uncertainty increased the reinforcing value of both cues and doubled the amount of interaction with the CS1 lever per presentation. Our results imply competitive mechanisms for attributing incentive value to gambling-related cues between reward uncertainty, prior amphetamine sensitization, and acute amphetamine administration.

The novel MAGL inhibitor MJN110 enhances responding to reward-predictive incentive cues by activation of CB1 receptors

CB1 receptor antagonists disrupt operant responding for food and drug reinforcers, and cue-induced reinstatement of cocaine and heroin seeking. Conversely, enhancing endocannabinoid signaling, particularly 2-arachidonyl glycerol (2-AG), by inhibition of monoacyl glycerol lipase (MAGL), may facilitate some aspects of reward seeking. To determine how endocannabinoid signaling affects responding to reward-predictive cues, we employed an operant task that allows us to parse the incentive motivational properties of cues. Rats were required to nosepoke during an intermittent audiovisual incentive cue (IC) to obtain a 10% sucrose reward. The CB1 receptor antagonist, rimonabant, dose-dependently decreased the response ratio (rewarded ICs/total presented) and active nosepokes per IC, while it increased the latency to respond to the cue and obtain the reward, indicating an overall decrease in both the choice and vigor of responding. Yet rats persisted in entering the reward cup. Using a modified version of the task, the novel MAGL inhibitor MJN110 increased the response ratio, decreased the latencies to respond to the IC and enhanced active nosepokes per IC, indicating a facilitation of cue-induced reward seeking. These effects were blocked by a subthreshold dose of rimonabant. Finally, MJN110 did not alter consumption of freely available sucrose within volumes obtained in the operant task. Together these data demonstrate blocking endocannabinoid tone at the CB1 receptor attenuates the ability of cues to induce reward seeking, while some aspects of motivation for the reward are retained. Conversely, enhancing 2-AG signaling at CB1 receptors facilitates IC responding and increases the motivational properties of the IC.

Evidence for incentive salience sensitization as a pathway to alcohol use disorder

The incentive salience sensitization (ISS) theory of addiction holds that addictive behavior stems from the ability of drugs to progressively sensitize the brain circuitry that mediates attribution of incentive salience (IS) to reward-predictive cues and its behavioral manifestations. In this article, we establish the plausibility of ISS as an etiological pathway to alcohol use disorder (AUD). We provide a comprehensive and critical review of evidence for: (1) the ability of alcohol to sensitize the brain circuitry of IS attribution and expression; and (2) attribution of IS to alcohol-predictive cues and its sensitization in humans and non-human animals. We point out gaps in the literature and how these might be addressed. We also highlight how individuals with different alcohol subjective response phenotypes may differ in susceptibility to ISS as a pathway to AUD. Finally, we discuss important implications of this neuropsychological mechanism in AUD for psychological and pharmacological interventions attempting to attenuate alcohol craving and cue reactivity.

Longitudinal changes in brain activation during anticipation of monetary loss in bipolar disorder

BACKGROUND

Individuals with bipolar disorder (BD) show aberrant brain activation patterns during reward and loss anticipation. We examined for the first time longitudinal changes in brain activation during win and loss anticipation to identify trait markers of aberrant anticipatory processing in BD.

METHODS

Thirty-four euthymic and depressed individuals with BD-I and 17 healthy controls (HC) were scanned using functional magnetic resonance imaging twice 6 months apart during a reward task.

RESULTS

HC, but not individuals with BD, showed longitudinal reductions in the right lateral occipital cortex (RLOC) activation during processing of cues predicting possible money loss (p-corrected <0.05). This result was not affected by psychotropic medication, mood state or the changes in depression/mania severity between the two scans in BD. Elevated symptoms of subthreshold hypo/mania at baseline predicted more aberrant longitudinal patterns of RLOC activation explaining 12.5% of variance in individuals with BD.

CONCLUSIONS

Increased activation in occipital cortex during negative outcome anticipation may be related to elevated negative emotional arousal during anticipatory cue processing. One interpretation is that, unlike HC, individuals with BD were not able to learn at baseline that monetary losses were smaller than monetary gains and were not able to reduce emotional arousal for negative cues 6 months later. Future research in BD should examine how modulating occipital cortical activation affects learning from experience in individuals with BD.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Dorsomedial prefrontal cortex neurons encode nicotine-cue associations

The role of medial prefrontal cortex (mPFC) in regulating nicotine taking and seeking remains largely unexplored. In this study we took advantage of the high time-resolution of optogenetic intervention by decreasing (Arch3.0) or increasing (ChR2) the activity of neurons in the dorsal and ventral mPFC during 5-s nicotine cue presentations in order to evaluate their contribution to cued nicotine seeking and taking. Wistar rats were trained to self-administer intravenous nicotine in 1 h self-administration sessions twice a day for a minimum of 10 days. Subsequently, dmPFC or vmPFC neuronal activity was modulated during or following presentation of the 5-s nicotine cue, both under extinction and self-administration conditions. We also used in vivo electrophysiology to record the activity of dmPFC neurons during nicotine self-administration and extinction tests. We show that optogenetic inhibition of dmPFC neurons during, but not following, response-contingent presentations of the nicotine cue increased nicotine seeking. We found no effect on nicotine self-administration or on food seeking in an extinction test. We also show that this effect is specific to dmPFC, because optogenetic inhibition of vmPFC had no effect on nicotine seeking and taking. In vivo recordings revealed that dmPFC network neuronal activity was modulated more strongly following nicotine cue presentation in extinction, compared to following nicotine self-administration. Our results strongly suggest that a population of neurons within the dmPFC is involved in encoding the incentive value of nicotine-associated cues.

Interactive Effects of Naturalistic Drinking Context and Alcohol Sensitivity on Neural Alcohol Cue-Reactivity Responses

BACKGROUND

Considerable evidence indicates that a low level of subjective response to alcohol's acute effects (i.e., low sensitivity) is associated with enhanced risk for alcohol use disorder (AUD). Recent work suggests that the highest risk response profile consists of blunted sensitivity to alcohol's sedation-like effects, coupled with enhanced sensitivity to alcohol's stimulation-like effects (i.e., differential sensitivity). A largely separate body of work indicates that enhanced reactivity to alcohol-related cues is associated with increased AUD risk.

AIMS

The current research examined the extent to which variability in alcohol response phenotypes is associated with enhanced P3 event-related potential (ERP) responses to alcohol-related pictures (ACR-P3), and whether this reactivity varies according to depicted drinking contexts.

METHODS

Eighty young adults (aged 18 to 33 years) completed a self-report measure of alcohol sensitivity (the Alcohol Sensitivity Questionnaire) and viewed images depicting drinking in naturalistic contexts, alcohol and nonalcohol beverages in isolation (devoid of naturalistic drinking context), and neutral nonbeverage control images while ERPs were recorded.

RESULTS

Results indicated that blunted sensitivity to alcohol's sedative-like effects was differentially associated with enhanced ACR-P3 but reduced P3 reactivity to nonalcohol cues. Variation in sensitivity to alcohol's stimulant-like effects was not associated with differential ACR-P3. Contrary to predictions, these effects were not potentiated by drinking contexts.

CONCLUSIONS

The current results replicate and extend previous work linking low alcohol sensitivity with enhanced incentive salience for alcohol-related cues and suggest that cues depicting drinking contexts are less likely to differentiate high-risk from low-risk drinkers.

Sex differences in nicotine-enhanced Pavlovian conditioned approach in rats

Background

Nicotine exposure enhances Pavlovian conditioned approach (PCA), or the learned approach to reward-predictive cues. While females show elevated approach to conditioned stimuli compared to males, potentially indicating heightened addiction vulnerability, it is unknown how sex may interact with nicotine to influence approach behavior. Additionally, brain-derived neurotrophic factor (BDNF) levels can be altered significantly after repeated nicotine exposure, suggesting a potential mechanism contributing to nicotine-induced behavioral phenotypes. The present study investigated the role of sex on nicotine-induced changes to stimulus-response behavior and associated BDNF protein levels.

Methods

Male and female rats were exposed to nicotine (0.4 mg/kg, subcutaneously) or saline 15 min prior to each PCA session. PCA training consisted of 29 sessions of 15 trials, in which a 30-s cue presentation ended concurrently with a sucrose reward (20% w/v in water, 100 μL), and a 120-s variable intertrial interval occurred between trials. Approach behavior to the cue and reward receptacle was recorded. Preference toward the reward receptacle indicated a goal-tracking phenotype, and preference toward the cue indicated a sign-tracking phenotype, demonstrating that the cue had gained incentive salience. Twenty-four hours after the last PCA session, brain tissue was collected and BDNF levels were measured in the basolateral amygdala, orbitofrontal cortex, and nucleus accumbens using Western blot analysis.

Results

Nicotine exposure enhanced both sign- and goal-tracking conditioned approach, and females showed elevated sign-tracking compared to males. There were no sex-by-drug interactions on conditioned approach. Day-to-day variability in conditioned approach was similar between sexes. In contrast to prior studies, neither repeated exposure to nicotine nor sex significantly affected BDNF expression.

Conclusions

Drug-naïve females exhibited heightened sign-tracking compared to males, and nicotine enhanced conditioned approach similarly in males and females. Further, non-significant changes to BDNF expression in brain regions highly associated with PCA indicate that BDNF is unlikely to drive nicotine-enhanced conditioned behavior.

Occasion setters attain incentive motivational value: implications for contextual influences on reward-seeking

The context in which reward-paired cues are encountered can resolve ambiguity and set the occasion for appropriate reward-seeking. The psychological processes by which contexts regulate reward-seeking remain unclear as contexts are diffuse and difficult to isolate from other stimuli. To overcome this, we modeled a context as a phasic and discrete event—an occasion setter (OS)—which allowed for control over its presentation and influence on cue-driven reward-seeking. This allowed us to directly assess how OSs regulate the predictive and motivational significance of Pavlovian cues. Male rats (n = 50) were trained in a Pavlovian procedure where the presentation of an ambiguous conditioned stimulus (CS) was reinforced only if preceded by an occasion setting cue. We assessed the motivational value of the OS and CS alone or in combination using tests of conditioned reinforcement. Rats enhanced conditioned approach to the reward port during the CS when it was preceded by the OS. When allowed the opportunity, rats responded more to obtain presentations of the CS in combination with the OS than the CS alone. Critically, rats also worked to obtain presentations of the OS alone more than the CS alone, and this was resistant to manipulations of the value of the OS. We conclude that occasion setting can act via incentive motivational mechanisms and that, apart from resolving predictive information about ambiguous reward-paired cues, OSs themselves generate states of appetitive motivation that can facilitate reward-seeking.

Rewards interact with repetition-dependent learning to enhance long-term retention of motor memories

The combination of behavioral experiences that enhance long-term retention remains largely unknown. Informed by neurophysiological lines of work, this study tested the hypothesis that performance-contingent monetary rewards potentiate repetition-dependent forms of learning, as induced by extensive practice at asymptote, to enhance long-term retention of motor memories. To this end, six groups of 14 participants (n = 84) acquired novel motor behaviors by adapting to a gradual visuomotor rotation while these factors were manipulated. Retention was assessed 24 h later. While all groups similarly acquired the novel motor behaviors, results from the retention session revealed an interaction indicating that rewards enhanced long-term retention, but only when practice was extended to asymptote. Specifically, the interaction indicated that this effect selectively occurred when rewards were intermittently available (i.e., 50%), but not when they were absent (i.e., 0%) or continuously available (i.e., 100%) during acquisition. This suggests that the influence of rewards on extensive practice and long-term retention is nonlinear, as continuous rewards did not further enhance retention as compared with intermittent rewards. One possibility is that rewards' intermittent availability allows to maintain their subjective value during acquisition, which may be key to potentiate long-term retention.

Trait anxiety on effort allocation to monetary incentives: a behavioral and high-density EEG study

Trait anxiety is an important phenotype in the prediction of stress-induced neuropsychiatric disorders. While the role of trait anxiety in mental effort and cognitive impairment is well documented, much less is known about its influence on motivated behaviors and physical effort. Here, we investigated trait anxiety-related differences in behavioral and neural responses in an effort-related monetary incentive delay task. Participants prompted with different incentive levels could exert handgrip responses to earn monetary rewards while a 256-channel electroencephalography (EEG) was recorded. Participants' performance was linearly dependent on incentive level, with higher stakes prompting better accuracy and higher grip force. Importantly, we found a striking association between trait anxiety and incentive-related grip force; effort exertion was related to incentive level only in high-anxious individuals. In analyses of neural efficiency associated with effort preparation involving Contingent-negative variation (CNV), we found that the CNV amplitude was sensitive to monetary incentive levels. Source imaging analyses of CNV indicated increased activity in the anterior cingulate cortex (ACC) for the highest incentive level. Importantly, we found a significant interaction between trait anxiety and incentive level on CNV modulation at the interval ranging from -2610 to -2510 ms, with greater CNV responses to the lower monetary incentive sizes in high anxiety. Subsequent mediation analyses supported a mediation of the ACC activation on the association between trait anxiety and incentive-selective grip force. Our study reveals a role for ACC in trait anxiety-related differences on incentive processing, when rewards are dependent on effortful performance.

Cued for risk: Evidence for an incentive sensitization framework to explain the interplay between stress and anxiety, substance abuse, and reward uncertainty in disordered gambling behavior

Gambling disorder is an impairing condition confounded by psychiatric co-morbidity, particularly with substance use and anxiety disorders. Yet, our knowledge of the mechanisms that cause these disorders to coalesce remains limited. The Incentive Sensitization Theory suggests that sensitization of neural "wanting" pathways, which attribute incentive salience to rewards and their cues, is responsible for the excessive desire for drugs and cue-triggered craving. The resulting hyper-reactivity of the "wanting' system is believed to heavily influence compulsive drug use and relapse. Notably, evidence for sensitization of the mesolimbic dopamine pathway has been seen across gambling and substance use, as well as anxiety and stress-related pathology, with stress playing a major role in relapse. Together, this evidence highlights a phenomenon known as cross-sensitization, whereby sensitization to stress, drugs, or gambling behaviors enhance the sensitivity and dopaminergic response to any of those stimuli. Here, we review the literature on how cue attraction and reward uncertainty may underlie gambling pathology, and examine how this framework may advance our understanding of co-mordidity with substance-use disorders (e.g., alcohol, nicotine) and anxiety disorders. We argue that reward uncertainty, as seen in slot machines and games of chance, increases dopaminergic activity in the mesolimbic pathway and enhances the incentive value of reward cues. We propose that incentive sensitization by reward uncertainty may interact with and predispose individuals to drug abuse and stress, creating a mechanism through which co-mordidity of these disorders may emerge.

Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats

Efficient foraging requires an ability to coordinate discrete reward-seeking and reward-retrieval behaviors. We used pathway-specific chemogenetic inhibition to investigate how rats’ mesolimbic and mesocortical dopamine circuits contribute to the expression and modulation of reward seeking and retrieval. Inhibiting ventral tegmental area dopamine neurons disrupted the tendency for reward-paired cues to motivate reward seeking, but spared their ability to increase attempts to retrieve reward. Similar effects were produced by inhibiting dopamine inputs to nucleus accumbens, but not medial prefrontal cortex. Inhibiting dopamine neurons spared the suppressive effect of reward devaluation on reward seeking, an assay of goal-directed behavior. Attempts to retrieve reward persisted after devaluation, indicating they were habitually performed as part of a fixed action sequence. Our findings show that complete bouts of reward seeking and retrieval are behaviorally and neurally dissociable from bouts of reward seeking without retrieval. This dichotomy may prove useful for uncovering mechanisms of maladaptive behavior.

Appetitive Pavlovian-to-Instrumental Transfer in Participants with Normal-Weight and Obesity

Altered eating behavior due to modern, food-enriched environments has a share in the recent obesity upsurge, though the exact mechanisms remain unclear. This study aims to assess whether higher weight or weight gain are related to stronger effects of external cues on motivation-driven behavior. 51 people with and without obesity completed an appetitive Pavlovian-to-Instrumental Transfer (PIT) paradigm. During training, button presses as well as presentation of fractal images resulted in three palatable and one neutral taste outcome. In the subsequent test phase, outcome-specific and general behavioral bias of the positively associated fractal images on deliberate button press were tested under extinction. While all participants showed signs of specific transfer, general transfer was not elicited. Contrary to our expectations, there was no main effect of weight group on PIT magnitude. Participants with obesity exhibited higher scores in the Three-Factor Eating Questionnaire Disinhibition scale, replicating a very robust effect from previous literature. Individual Restraint scores were able to predict body-mass index (BMI) change after a three-year period. Our data indicate that PIT is an important player in how our environment influences the initiation of food intake, but its effects alone cannot explain differences in-or future development of-individual weight.

Not all smokers appear to seek nicotine for the same reasons: implications for preclinical research in nicotine dependence

Tobacco use leads to 6 million deaths every year due to severe long-lasting diseases. The main component of tobacco, nicotine, is recognized as one of the most addictive drugs, making smoking cessation difficult, even when 70 percent of smokers wish to do so. Clinical and preclinical studies have demonstrated consistently that nicotine seeking is a complex behavior involving various psychopharmacological mechanisms. Evidence supports that the population of smokers is heterogeneous, particularly as regards the breadth of motives that determine the urge to smoke. Here, we review converging psychological, genetic and neurobiological data from clinical and preclinical studies supporting that the mechanisms controlling nicotine seeking may vary from individual to individual. It appears timely that basic neuroscience integrates this heterogeneity to refine our understanding of the neurobiology of nicotine seeking, as tremendous progress has been made in modeling the various psychopharmacological mechanisms driving nicotine seeking in rodents. For a better understanding of the mechanisms that drive nicotine seeking, we emphasize the need for individual-based research strategies in which nicotine seeking, and eventually treatment efficacy, are determined while taking into account individual variations in the mechanisms of nicotine seeking.

Individual differences in voluntary alcohol consumption are associated with conditioned fear in the fear incubation model

Previous research in male Long Evans rats has shown a relationship between low voluntary alcohol consumption and high conditioned fear after a single training session. Here, we determined whether chronic intermittent access (CIA) to alcohol during adolescence/early adulthood or during adulthood would alter or be associated with auditory-cued conditioned fear levels using an extended training fear incubation procedure. This training procedure leads to low fear soon after training that grows over one month. Rats received 6 weeks of CIA to 20% alcohol or water from PND 26-66. Ten or eleven days later, the rats began behavioral testing that included 10 sessions of tone-shock pairings. Rats then received 4 weeks of CIA exposure during the 1-month fear incubation period and were tested for conditioned fear 6 days after the end of alcohol access. We found no evidence that voluntary alcohol consumption during adolescence/early adulthood or adulthood altered fear expression. However, we found that rats that consumed more alcohol during early adulthood (PND 54-66) had lower fear than low-consumption rats on day 1 of conditioned fear training and in the day 2 and 1-month tests. This extends associations we previously found between individual differences in alcohol consumption and conditioned fear to a different fear conditioning procedure. Combined with our previous data that show that the rate of instrumental extinction is associated with both alcohol consumption and conditioned fear, these data provide further support for the generality and reliability of a pair of phenotypes that encompass a wide variety of learning traits.

Nicotine Produces a High-Approach, Low-Avoidance Phenotype in Response to Alcohol-Associated Cues in Male Rats

BACKGROUND

Nicotine and alcohol use are highly comorbid. Modulation of drug-paired extrinsic and intrinsic cues likely plays a role in this interaction, as cues can acquire motivational properties and augment drug seeking. The motivational properties of cues can be measured through Pavlovian conditioning paradigms, in which cues either elicit approach following pairing with the reinforcing properties of alcohol or elicit avoidance following pairing with the aversive consequences of alcohol. The present experiments tested whether nicotine would enhance the incentive properties of an appetitive ethanol (EtOH) cue and diminish the avoidance of an aversive EtOH cue in Pavlovian paradigms.

METHODS

In experiment 1, male Long-Evans rats with or without prior chronic intermittent access to EtOH were administered nicotine or saline injections prior to Pavlovian conditioned approach (PavCA) sessions, during which conditioned approach to the cue ("sign-tracking") or the EtOH delivery location ("goal-tracking") was measured. In experiment 2, male Long-Evans rats were administered nicotine or saline injections prior to pairing a flavor cue with increasing doses of EtOH (i.p.) in an adaptation of the conditioned taste avoidance (CTA) paradigm.

RESULTS

Results from PavCA indicate that, regardless of EtOH exposure, nicotine enhanced responding elicited by EtOH-paired cues with no effect on a similar cue not explicitly paired with EtOH. Furthermore, nicotine reduced sensitivity to EtOH-induced CTA, as indicated by a rightward shift in the dose-response curve of passively administered EtOH. The ED₅₀ , or the dose of EtOH that produced a 50% reduction in intake relative to baseline, was significantly higher in nicotine-treated rats compared to saline-treated rats.

CONCLUSIONS

We conclude that nicotine increases the approach and diminishes the avoidance elicited by Pavlovian cues paired, respectively, with the reinforcing and aversive properties of EtOH consumption in male rats. As such, nicotine may enhance alcoholism liability by engendering an attentional bias toward cues that predict the reinforcing outcomes of drinking.

Basal forebrain chemogenetic inhibition disrupts the superior complex movement control of goal-tracking rats

Sign- and goal-tracking behavior signifies the influence of opposed cognitive-motivational styles, with the former being characterized by a tendency for approaching and contacting reward cues, including a readiness for attending, bottom-up, to salient cues, and a relatively greater vulnerability for developing and maintaining addiction-like behaviors. We previously demonstrated that these styles also impact the cognitive-motor interactions that are taxed during traversal of dynamic surfaces, with goal-trackers (GTs) making less movement errors and falling less frequently than sign-trackers (STs). The present experiment tested the hypothesis that complex movement control in GTs, but not STs, depends on activation of the basal forebrain projection system to telencephalic regions. Chemogenetic inhibition of the basal forebrain increased movement errors and falls in GTs during traversal of a rotating zigzag rod but had no significant effect on the relatively lower performance of STs. Neurochemical evidence confirmed the efficacy of the inhibitory designer receptor exclusively activated by designer drug (DREADD). Administration of clozapine-N-oxide (CNO) had no significant effect in GTs not expressing the DREADD. These results indicate that GTs, but not STs, activate the basal forebrain projection system to mediate their relatively superior ability for complex movement control. STs may also serve as an animal model in research on the role of basal forebrain systems in aging- and Parkinson's disease-associated falls. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Sign Tracking and Goal Tracking Are Characterized by Distinct Patterns of Nucleus Accumbens Activity

During Pavlovian conditioning, if a cue (e.g., lever extension) predicts reward delivery in a different location (e.g., a food magazine), some individuals will come to approach and interact with the cue, a behavior known as sign tracking (ST), and others will approach the site of reward, a behavior known as goal tracking (GT). In rats, the acquisition of ST versus GT behavior is associated with distinct profiles of dopamine release in the nucleus accumbens (NAc), but it is unknown whether it is associated with different patterns of accumbens neural activity. Therefore, we recorded from individual neurons in the NAc core during the acquisition, maintenance, and extinction of ST and GT behavior. Even though NAc dopamine is specifically important for the acquisition and expression of ST, we found that cue-evoked excitatory responses encode the vigor of both ST and GT behavior. In contrast, among sign trackers only, there was a prominent decrease in reward-related activity over the course of training, which may reflect the decreasing reward prediction error encoded by phasic dopamine. Finally, both behavior and cue-evoked activity were relatively resistant to extinction in sign trackers, as compared with goal trackers, although a subset of neurons in both groups retained their cue-evoked responses. Overall, the results point to the convergence of multiple forms of reward learning in the NAc.

Cortical neural modulation by previous trial outcome differentiates fast- from slow-learning rats on a visuomotor directional choice task

To better understand the neural cortical underpinnings that explain behavioral differences in learning rate, we recorded single-unit activity in primary motor (M1) and secondary motor (M2) areas while rats learned to perform a directional (left or right) operant visuomotor association task. Analysis of neural activity during the early portion of the cue period showed that neural modulation in the motor cortex was most strongly associated with two task factors: the previous trial outcome (success or error) and the current trial's directional choice (left or right). Furthermore, the fast learners, defined as those who had steeper learning curves and required fewer learning sessions to reach criterion performance, encoded the previous trial outcome factor more strongly than the directional choice factor. Conversely, the slow learners encoded directional choice more strongly than previous trial outcome. These differences in task factor encoding were observed in both the percentage of neurons and the neural modulation depth. These results suggest that fast learning is accompanied by a stronger component of previous trial outcome in the modulation representation present in motor cortex, which therefore may be a contributing factor to behavioral differences in learning rate. NEW & NOTEWORTHY We chronically recorded neural activity as rats learned a visuomotor directional choice task from a naive state. Learning rates varied. Single-unit neural modulation of two motor areas revealed that the fast learners encoded previous trial outcome more strongly than directional choice, whereas the reverse was true for slow learners. This finding provides novel evidence that rat learning rate is strongly correlated with the strength of neural modulation by previous trial outcome in motor cortex.

Disrupting reconsolidation: memory erasure or blunting of emotional/motivational value?

When memories are retrieved they become labile, and subject to alteration by a process known as reconsolidation. Disruption of memory reconsolidation decreases the performance of learned responses, which is often attributed to erasure of the memory; in the case of Pavlovian learning, to a loss of the association between a conditioned stimulus (CS) and unconditioned stimulus (US). However, an alternative interpretation is that disrupting reconsolidation does not erase memories, but blunts their emotional/motivational impact. It is difficult to parse the predictive vs. emotional/motivational value of CSs in non-human animals, but studies on variation in the form of conditioned responses (CRs) in a Pavlovian conditioned approach task suggest a way to do this. In this task a lever-CS paired with a food reward (US) acquires predictive value in all rats, but is attributed with emotional/motivational value to a greater extent in some rats (sign-trackers) than others (goal-trackers). We report that the post-retrieval administration of propranolol selectively attenuates a sign-tracking CR, and the associated neural activation of brain "motive circuits", while having no effect on conditioned orienting behavior in sign-trackers, or on goal-tracking CRs evoked by either a lever-CS or a tone-CS. We conclude that the disruption of reconsolidation by post-retrieval propranolol degrades the emotional/motivational impact of the CS, required for sign-tracking, but leaves the CS-US association intact. The possibility that post-retrieval interventions can reduce the emotional/motivational aspects of memories, without actually erasing them, has important implications for treating maladaptive memories that contribute to some psychiatric disorders.

Early life adversity potentiates expression of addiction-related traits

Many individuals sporadically and circumstantially sample addictive drugs, yet few become addicted. The individual vulnerabilities underlying the development of addiction are not well understood. Correlational findings show that early life adversity is associated with a greater propensity to develop drug addiction. However, the mechanisms by which early life adversity increases addiction vulnerability are unknown. Separate lines of research have found that several traits are associated with addiction. Here, we examined the effects of early life adversity on addiction-related traits in adulthood. We weaned male and female Sprague-Dawley rats (postnatal day - PND21) and randomly assigned them to either a non-adversity group (N-ADV) or an adversity group (ADV). ADV rats experienced adversity from PND 21-35, they were: a) singly housed, b) food restricted for 12h/day, c) subjected to forced-swim sessions, and d) restrained and exposed to predator odour (1h). As adults, rats were tested for impulsivity, anxiety-like behaviour, novelty preference, and attribution of incentive salience to a reward cue. ADV rats showed enhanced novelty preference and attributed greater incentive value to a reward cue. Compared to N-ADV rats, a greater proportion of ADV rats expressed multiple addiction risk traits. Furthermore, fewer ADV rats expressed no addiction risk traits. This effect was most evident in female ADV rats.

Differences in the dopaminergic reward system in rats that passively and actively behave in the Porsolt test

The aim of the study was to assess appetitive responses and central dopaminergic neurotransmission in passive and active rats divided according to their immobility time in the Porsolt swim test and exposed to restraint stress. Passive rats had more episodes of appetitive 50-kHz ultrasonic vocalization (USV) during rat encounter after social isolation and spent significantly more time in the amphetamine-associated context in conditioned place preference test, compared to active rats. Restraint stress decreased sucrose preference, but increased appetitive vocalization and reinforced the conditioned place preference only in passive animals that was associated with increased dopamine concentration in the amygdala. Restraint stress increased also the level of Cocaine- and Amphetamine Regulated Transcript (CART) peptide, a neuromodulator linked to dopamine neurotransmission, in the central nucleus of amygdala, while decreasing it the nucleus accumbens shell in passive rats. In the parvocellular region of paraventricular nucleus of the hypothalamus passive animals had a higher expression of CART compared to passive restraint rats and active control rats. The obtained results show that active and passive rats in the Porsolt test differ significantly in response to appetitive stimuli, which can be additionally changed under stress conditions. The underlying mechanisms are probably associated with differences in dopaminergic activity and CART signaling in reward system.

Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials

In active avoidance tasks, subjects have to learn to execute particular actions in order to avoid an aversive stimulus, such as a shock. Such paradigms pose a number of psychological and neural enigmas, and so have attracted substantial computational interest. However, the ratio of conjecture to confirmation remains high. Here, we perform a theoretical inquiry into a recent experiment by Gentry, Lee, and Roesch ('Phasic dopamine release in the rat nucleus accumbens predicts approach and avoidance performance', Nat. Commun., 7:13154) who measured phasic dopamine concentrations in the nucleus accumbens core of rats whilst they avoided shocks, acquired food, or acted to gain no programmed outcome. These last, neutral, trials turned out to be a perfect probe for the workings of avoidance, partly because of the substantial differences between subjects and sessions revealed in the experiment. We suggest a way to interpret this probe, gaining support for opponency-, safety-, and Pavlovian-influenced treatments of avoidance.

The hot 'n' cold of cue-induced drug relapse

Environmental cues associated with rewards can acquire motivational properties. However, there is considerable variation in the extent to which a reward cue gains motivational control over behavior, depending on the individual and the form of the cue. When a discrete cue is paired with food reward, it acquires greater control over motivated behavior in some rats (sign-trackers, STs) than others (goal-trackers, GTs) as indicated by the propensity to approach the cue, the willingness to work to obtain it, and its ability to reinstate reward-seeking behavior. Here, we review studies that employ this ST/GT animal model to investigate characteristics of individuals that are especially susceptible to reward cue-elicited behavior and the involvement of dopamine and acetylcholine neuromodulator systems in the susceptibility to cue-induced drug relapse. First, we discuss individual differences in the attribution of incentive salience to different forms of reward cues and the involvement of the mesolimbic dopamine system. We then discuss individual differences in cognitive/attentional control and the contributions of the cholinergic system in processing reward cues. It is suggested that in STs a propensity to attribute motivational properties to a drug cue is combined with poor attentional control in the face of these cues, making them particularly vulnerable to transition from casual/experimental patterns of drug use to addiction and to cue-induced relapse.

Moderation of alcohol craving reactivity to drinking-related contexts by individual differences in alcohol sensitivity: An ecological investigation

Laboratory cue exposure investigations have demonstrated that, relative to drinkers who report a high sensitivity to the pharmacologic effects of alcohol, low-sensitivity (LS) drinkers show exaggerated neurocognitive and behavioral reactivity to alcohol-related stimuli. The current study extends this line of work by testing whether LS drinkers report stronger cravings for alcohol in daily life. Data were from an ecological momentary assessment study in which participants (N = 403 frequent drinkers) carried a palmtop computer for 21 days and responded to questions regarding drinking behavior, alcohol craving, mood states, and situational context. Initial analyses identified subjective states (positive and negative mood, cigarette craving) and contextual factors (bar-restaurant location, weekend, time of day, presence of friend, recent smoking) associated with elevated craving states during nondrinking moments. Effects for nearly all these craving correlates were moderated by individual differences in alcohol sensitivity, such that the associations between situational factors and current alcohol craving were larger among LS individuals (as determined by a questionnaire completed at baseline). Complementary idiographic analyses indicated that self-reported craving increased when the constellation of situational factors more closely resembled individuals' observed drinking situations. Again, this effect was moderated by alcohol sensitivity, with greater craving response increases among LS drinkers. The findings align with predictions generated from theory and laboratory cue exposure investigations and should encourage further study of craving and incentive processes in LS drinkers. (PsycINFO Database Record

The role of glutamate signaling in incentive salience: second-by-second glutamate recordings in awake Sprague-Dawley rats

The attribution of incentive salience to reward-predictive stimuli has been shown to be associated with substance abuse-like behavior such as increased drug taking. Evidence suggests that glutamate neurotransmission and sequential N-methyl-D-aspartate (NMDA) activation are involved in the attribution of incentive salience. Here, we further explore the role of second-by-second glutamate neurotransmission in the attribution of incentive salience to reward-predictive stimuli by measuring sign-tracking behavior during a Pavlovian conditioned approach procedure using ceramic-based microelectrode arrays configured for sensitive measures of extracellular glutamate in awake behaving Sprague-Dawley rats. Specifically, we show that there is an increase in extracellular glutamate levels in the prelimbic cortex (PrL) and the nucleus accumbens core (NAcC) during sign-tracking behavior to a food-predictive conditioned stimulus (CS+) compared to the presentation of a non-predictive conditioned stimulus (CS-). Furthermore, the results indicate greater increases in extracellular glutamate levels in the PrL compared to NAcC in response to the CS+, including differences in glutamate release and signal decay. Taken together, the present research suggests that there is differential glutamate signaling in the NAcC and PrL during sign-tracking behavior to a food-predictive CS+.

Dynamic Encoding of Incentive Salience in the Ventral Pallidum: Dependence on the Form of the Reward Cue

Some rats are especially prone to attribute incentive salience to a cue (conditioned stimulus, CS) paired with food reward (sign-trackers, STs), but the extent they do so varies as a function of the form of the CS. Other rats respond primarily to the predictive value of a cue (goal-trackers, GTs), regardless of its form. Sign-tracking is associated with greater cue-induced activation of mesolimbic structures than goal-tracking; however, it is unclear how the form of the CS itself influences activity in neural systems involved in incentive salience attribution. Thus, our goal was to determine how different cue modalities affect neural activity in the ventral pallidum (VP), which is known to encode incentive salience attribution, as rats performed a two-CS Pavlovian conditioned approach task in which both a lever-CS and a tone-CS predicted identical food reward. The lever-CS elicited sign-tracking in some rats (STs) and goal-tracking in others (GTs), whereas the tone-CS elicited only goal-tracking in all rats. The lever-CS elicited robust changes in neural activity (sustained tonic increases or decreases in firing) throughout the VP in STs, relative to GTs. These changes were not seen when STs were exposed to the tone-CS, and in GTs there were no differences in firing between the lever-CS and tone-CS. We conclude that neural activity throughout the VP encodes incentive signals and is especially responsive when a cue is of a form that promotes the attribution of incentive salience to it, especially in predisposed individuals.

Sex differences in rat decision-making: The confounding role of extraneous feeder sampling between trials

Although male and female rats appear to perform differently in some tasks, a clear picture of sex differences in decision-making has yet to develop. This is in part due to significant variability arising from differences in strains and tasks. The aim of this study was to characterize the effects of sex on specific response elements in a reinforcement learning task so as to help identify potential explanations for this variability. We found that the primary difference between sexes was the propensity to approach feeders out of the task context. This extraneous feeder sampling affects choice on subsequent trials in both sexes by promoting a lose-shift response away from the last feeder sampled. Female rats, however, were more likely to engage in this extraneous feeder sampling, and therefore exhibited a greater rate of this effect. Once trials following extraneous sampling were removed, there were no significant sex differences in any of the tested measures. These data suggest that feeder approach outside of the task context, which is often not recorded, could produce a confound in sex-based differences of reinforcement sensitivity in some tasks.

Transient inactivation of the paraventricular nucleus of the thalamus enhances cue-induced reinstatement in goal-trackers, but not sign-trackers

RATIONALE

The paraventricular nucleus of the thalamus (PVT) has been shown to mediate cue-motivated behaviors, such as sign- and goal-tracking, as well as reinstatement of drug-seeking behavior. However, the role of the PVT in mediating individual variation in cue-induced drug-seeking behavior remains unknown.

OBJECTIVES

This study aimed to determine if inactivation of the PVT differentially mediates cue-induced drug-seeking behavior in sign-trackers and goal-trackers.

METHODS

Rats were characterized as sign-trackers (STs) or goal-trackers (GTs) based on their Pavlovian conditioned approach behavior. Rats were then exposed to 15 days of cocaine self-administration, followed by a 2-week forced abstinence period and then extinction training. Rats then underwent tests for cue-induced reinstatement and general locomotor activity, prior to which they received an infusion of either saline (control) or baclofen/muscimol (B/M) to inactivate the PVT.

RESULTS

Relative to control animals of the same phenotype, GTs show a robust increase in cue-induced drug-seeking behavior following PVT inactivation, whereas the behavior of STs was not affected. PVT inactivation did not affect locomotor activity in either phenotype.

CONCLUSION

In GTs, the PVT appears to inhibit the expression of drug-seeking, presumably by attenuating the incentive value of the drug cue. Thus, inactivation of the PVT releases this inhibition in GTs, resulting in an increase in cue-induced drug-seeking behavior. PVT inactivation did not affect cue-induced drug-seeking behavior in STs, suggesting that the role of the PVT in encoding the incentive motivational value of drug cues differs between STs and GTs.

Ventral pallidal encoding of reward-seeking behavior depends on the underlying associative structure

Despite its being historically conceptualized as a motor expression site, emerging evidence suggests the ventral pallidum (VP) plays a more active role in integrating information to generate motivation. Here, we investigated whether rat VP cue responses would encode and contribute similarly to the vigor of reward-seeking behaviors trained under Pavlovian versus instrumental contingencies, when these behavioral responses consist of superficially similar locomotor response patterns but may reflect distinct underlying decision-making processes. We find that cue-elicited activity in many VP neurons predicts the latency of instrumental reward seeking, but not of Pavlovian response latency. Further, disruption of VP signaling increases the latency of instrumental but not Pavlovian reward seeking. This suggests that VP encoding of and contributions to response vigor are specific to the ability of incentive cues to invigorate reward-seeking behaviors upon which reward delivery is contingent.

Sounds or other cues associated with receiving a reward can have a powerful effect on an individual’s behavior or emotions. For example, the sound of an ice cream truck might cause salivation and motivate an individual to stand in a long line. Cues may prompt specific actions necessary to receive a reward, for example, approaching the ice cream truck and paying to get an ice cream. This is called instrumental conditioning. Some cues predict reward delivery, without requiring a specific action. This is called Pavlovian conditioning. Pavlovian cues can still prompt actions, such as approaching the truck, even though the action is not required. But exactly what happens in the brain to generate these actions during the two types of learning, is unclear.

Learning more about these reward-driven brain mechanisms might help scientists to develop better treatments for people with addiction or other conditions that involve compulsive reward-seeking behavior. Currently, scientists do not know enough about how the brain triggers this kind of behavior or how these processes lead to relapse in individuals who have been abstinent. Basic studies on the brain mechanisms that trigger reward-seeking behavior are needed.

Now, Richard et al. show that a greater activity in neurons, or brain cells, in a part of the brain called the ventral pallidum predicts a faster response to a reward cue. In the experiments, some rats were trained to approach a certain location when they heard a particular sound in order to receive sugar water, a form of instrumental conditioning. Another group of rats underwent Pavlovian training and learned to expect sugar water every time they heard sound even if they did nothing. Both groups learned to approach the sugar water location when they heard the cue, despite the different training requirements.

Richard et al. measured the activity of neurons in the ventral pallidum when the rats in the two groups heard the reward-associated sound. The experiments showed that the amount of activity in the brain cells in this area predicted whether a rat would approach the sugar-water delivery area and how quickly they would approach the reward after hearing the cue. The predictions were most reliable for rats that had to do something to get the sugar water. When Richard et al. reduced the activity in these cells they found the rats took longer to approach the reward source, but only when this action was required to receive sugar water. The experiments show that the ventral pallidum may provide the motivation to undertake reward-seeking behavior.

The Winding Road to Relapse: Forging a New Understanding of Cue-Induced Reinstatement Models and Their Associated Neural Mechanisms

In drug addiction, cues previously associated with drug use can produce craving and frequently trigger the resumption of drug taking in individuals vulnerable to relapse. Environmental stimuli associated with drugs or natural reinforcers can become reliably conditioned to increase behavior that was previously reinforced. In preclinical models of addiction, these cues enhance both drug self-administration and reinstatement of drug seeking. In this review, we will dissociate the roles of conditioned stimuli as reinforcers from their modulatory or discriminative functions in producing drug-seeking behavior. As well, we will examine possible differences in neurobiological encoding underlying these functional differences. Specifically, we will discuss how models of drug addiction and relapse should more systematically evaluate these different types of stimuli to better understand the neurobiology underlying craving and relapse. In this way, behavioral and pharmacotherapeutic interventions may be better tailored to promote drug use cessation outcomes and long-term abstinence.

The neuroscience of cognitive-motivational styles: Sign- and goal-trackers as animal models

Cognitive-motivational styles describe predominant patterns of processing or biases that broadly influence human cognition and performance. Here we focus on the impact of cognitive-motivational styles on the response to cues predicting the availability of food or addictive drugs. An individual may preferably conduct an analysis of the motivational significance of reward cues, with the result that such cues per se are perceived as rewarding and worth approaching and working for. Alternatively, a propensity for a "cold" analysis of the behavioral utility of a reward cue may yield search behavior for food or drugs but not involve cue approach. Animal models for studying the neuronal mechanisms mediating such styles have originated from research concerning behavioral indices that predict differential vulnerability to addiction-like behaviors. Rats classified as sign- or goal-trackers (STs, GTs) were found to have opposed attentional biases (bottom-up or cue-driven attention vs. top-down or goal-driven attentional control) that are mediated primarily via relatively unresponsive versus elevated levels of cholinergic neuromodulation in the cortex. The capacity for cholinergic neuromodulation in STs is limited by a neuronal choline transporter (CHT) that fails to support increases in cholinergic activity. Moreover, in contrast to STs, the frontal dopamine system in GTs does not respond to the presence of drug cues and, thus, biases against cue-oriented behavior. The opponent cognitive-motivational styles that are indexed by sign- and goal-tracking bestow different cognitive-behavioral vulnerabilities that may contribute to the manifestation of a wide range of neuropsychiatric disorders. (PsycINFO Database Record

Sex-dependent impact of early-life stress and adult immobilization in the attribution of incentive salience in rats

Early life stress (ELS) induces long-term effects in later functioning and interacts with further exposure to other stressors in adulthood to shape our responsiveness to reward-related cues. The attribution of incentive salience to food-related cues may be modulated by previous and current exposures to stressors in a sex-dependent manner. We hypothesized from human data that exposure to a traumatic (severe) adult stressor will decrease the attribution of incentive salience to reward-associated cues, especially in females, because these effects are modulated by previous ELS. To study these factors in Long-Evans rats, we used as an ELS model of restriction of nesting material and concurrently evaluated maternal care. In adulthood, the offspring of both sexes were exposed to acute immobilization (IMO), and several days after, a Pavlovian conditioning procedure was used to assess the incentive salience of food-related cues. Some rats developed more attraction to the cue predictive of reward (sign-tracking) and others were attracted to the location of the reward itself, the food-magazine (goal-tracking). Several dopaminergic markers were evaluated by in situ hybridization. The results showed that ELS increased maternal care and decreased body weight gain (only in females). Regarding incentive salience, in absolute control animals, females presented slightly greater sign-tracking behavior than males. Non-ELS male rats exposed to IMO showed a bias towards goal-tracking, whereas in females, IMO produced a bias towards sign-tracking. Animals of both sexes not exposed to IMO displayed an intermediate phenotype. ELS in IMO-treated females was able to reduce sign-tracking and decrease tyrosine hydroxylase expression in the ventral tegmental area and dopamine D1 receptor expression in the accumbens shell. Although the predicted greater decrease in females in sign-tracking after IMO exposure was not corroborated by the data, the results highlight the idea that sex is an important factor in the study of the long-term impact of early and adult stressors.

Adolescent cannabinoid exposure effects on natural reward seeking and learning in rats

RATIONALE

Adolescence is characterized by endocannabinoid (ECB)-dependent refinement of neural circuits underlying emotion, learning, and motivation. As a result, adolescent cannabinoid receptor stimulation (ACRS) with phytocannabinoids or synthetic agonists like "Spice" cause robust and persistent changes in both behavior and circuit architecture in rodents, including in reward-related regions like medial prefrontal cortex and nucleus accumbens (NAc).

OBJECTIVES AND METHODS

Here, we examine persistent effects of ACRS with the cannabinoid receptor 1/2 specific agonist WIN55-212,2 (WIN; 1.2 mg/kg/day, postnatal day (PD) 30-43), on natural reward-seeking behaviors and ECB system function in adult male Long Evans rats (PD 60+).

RESULTS

WIN ACRS increased palatable food intake, and altered attribution of incentive salience to food cues in a sign-/goal-tracking paradigm. ACRS also blunted hunger-induced sucrose intake, and resulted in increased anandamide and oleoylethanolamide levels in NAc after acute food restriction not seen in controls. ACRS did not affect food neophobia or locomotor response to a novel environment, but did increase preference for exploring a novel environment.

CONCLUSIONS

These results demonstrate that ACRS causes long-term increases in natural reward-seeking behaviors and ECB system function that persist into adulthood, potentially increasing liability to excessive natural reward seeking later in life.

Machine Learning Based Classification of Deep Brain Stimulation Outcomes in a Rat Model of Binge Eating Using Ventral Striatal Oscillations

Neuromodulation-based interventions continue to be evaluated across an array of appetitive disorders but broader implementation of these approaches remains limited due to variable treatment outcomes. We hypothesize that individual variation in treatment outcomes may be linked to differences in the networks underlying these disorders. Here, Sprague-Dawley rats received deep brain stimulation separately within each nucleus accumbens (NAc) sub-region (core and shell) using a within-animal crossover design in a rat model of binge eating. Significant reductions in binge size were observed with stimulation of either target but with significant variation in effectiveness across individuals. When features of local field potentials (LFPs) recorded from the NAc were used to classify the pre-defined stimulation outcomes (response or non-response) from each rat using a machine-learning approach (lasso), stimulation outcomes could be classified with greater accuracy than expected by chance (effect sizes: core = 1.13, shell = 1.05). Further, these LFP features could be used to identify the best stimulation target for each animal (core vs. shell) with an effect size = 0.96. These data suggest that individual differences in underlying network activity may relate to the variable outcomes of circuit based interventions, and measures of network activity could have the potential to individually guide the selection of an optimal stimulation target to improve overall treatment response rates.

'Hot' vs. 'cold' behavioural-cognitive styles: motivational-dopaminergic vs. cognitive-cholinergic processing of a Pavlovian cocaine cue in sign- and goal-tracking rats

Discrete Pavlovian reward cues acquire more potent incentive motivational properties (incentive salience) in some animals (sign-trackers; STs) compared to others (goal-trackers; GTs). Conversely, GTs appear to be better than STs in processing more complex contextual cues, perhaps reflecting their relatively greater bias for goal-directed cue processing. Here, we investigated the activity of two major prefrontal neuromodulatory input systems, dopamine (DA) and acetylcholine (ACh), in response to a discrete Pavlovian cue that was previously paired with cocaine administration in STs and GTs. Rats underwent Pavlovian training in which light cue presentations were either paired or unpaired with an intravenous cocaine infusion. Following a 10-day abstinence period, prefrontal dialysates were collected in STs and GTs during cue presentations in the absence of cocaine. In STs, the cue previously paired with cocaine significantly increased prefrontal DA levels. DA levels remained elevated over baseline across multiple cue presentation blocks, and DA levels and approaches to the cue were significantly correlated. In STs, ACh levels were unaffected by cue presentations. In contrast, in GTs, presentations of the cocaine cue increased prefrontal ACh, but not DA, levels. GTs oriented towards the cue at rates similar to STs, but they did not approach it and elevated ACh levels did not correlate with conditioned orientation. The results indicate a double dissociation between the role of prefrontal DA and ACh in STs and GTs, and suggest that these phenotypes will be useful for studying the role of neuromodulator systems in mediating opponent behavioural-cognitive styles.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with "motivational value" or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.