Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat

Genomic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues; both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1,645 genetically diverse heterogeneous stock (HS) rats. We tested HS rats in a Pavlovian conditioned approach task, in which we characterized the individual responses to food-associated stimuli ("cues"). Rats exhibited either cue-directed "sign-tracking" behavior or food-cup directed "goal-tracking" behavior. We then used the conditioned reinforcement procedure to determine whether rats would perform a novel operant response for unrewarded presentations of the cue. We found that these measures were moderately heritable (SNP heritability, h2 = .189-.215). GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits we examined. Interval sizes of these QTLs varied widely. 7 traits shared a QTL on chromosome 1 that contained a few genes (e.g. Tenm4, Mir708) that have been associated with substance use disorders and other mental health traits in humans. Other candidate genes (e.g. Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on other behavioral measures in HS rats and found that regions containing QTLs on chromosome 1 were also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive salience and provide further support for a relationship between attribution of incentive salience and drug abuse-related traits.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

Repeated Cocaine Intake Differentially Impacts Striatal D2/3 Receptor Availability, Psychostimulant-Induced Dopamine Release, and Trait Behavioral Markers of Drug Abuse

Current research indicates that altered dopamine (DA) transmission in the striatum contributes to impulsivity and novelty-seeking, and it may mediate a link concerning a higher susceptibility to drug abuse. Whether increased susceptibility to drug abuse results from a hyperdopaminergic or hypodopaminergic state is still debated. Here, we simultaneously tracked changes in DA D2/3 receptor (D2/3R) availability and amphetamine-(AMPH)-induced DA release in relation to impulsivity and novelty-seeking prior to, and following, cocaine self-administration (SA) in Roman high- (RHA) and low- (RLA) avoidance rats. We found that high-impulsive/high novelty-seeking RHA rats exhibited lower D2/3R availabilities and higher AMPH-induced DA release in the striatum that predicted higher levels of cocaine intake compared with RLAs. Cocaine SA did not alter striatal D2/3R availability or impulsivity in RHA or RLA rats. Critically, cocaine exposure led to a baseline-dependent blunting of stimulated DA release in high-impulsive/high novelty-seeking RHA rats only, and to a baseline-dependent increase in novelty-seeking in low-impulsive/low novelty-seeking RLA rats only. Altogether, we propose that susceptibility to drug abuse results from an innate hyper-responsive DA system, promoting impulsive action and novelty-seeking, and producing stronger initial drug-reinforcing effects that contribute to the initiation and perpetuation of drug use. However, with repeated cocaine use, a tolerance to drug-induced striatal DA elevations develops, leading to a compensatory increase in drug consumption to overcome the reduced reward effects.

A mechanical task for measuring sign- and goal-tracking in humans: A proof-of-concept study

Cue-based associative learning (i.e., Pavlovian conditioning) is a foundational component of behavior in almost all forms of animal life and may provide insight into individual differences in addiction liability. Cues can take on incentive-motivational properties (i.e., incentive salience) through Pavlovian learning. Extensive testing with non-human animals (primarily rats) has demonstrated significant variation among individuals in the behaviors this type of learning evokes. So-named "sign-trackers" and "goal-trackers" have been examined in many studies of non-human animals, but this work in humans is still a nascent area of research. In the present proof-of-concept study, we used a Pavlovian conditioned approach task to investigate human sign- and goal-tracking in emerging adults. Conditioned behaviors that developed over the course of the task were directed toward the reward-cue and toward the reward location. Participants' eye-gaze and behavior during the task were submitted to a latent profile analysis, which revealed three groups defined as sign-trackers (n = 10), goal-trackers (n = 4), and intermediate responders (n = 36). Impulsivity was a significant predictor of the sign-tracking group relative to the goal-tracking group. The present study provides preliminary evidence that a simple procedure can produce learned Pavlovian conditioned approach behavior in humans. Though further investigation is required, findings provide a promising step toward the long-term goal of translating important insights gleaned from basic research into treatment strategies that can be applied to clinical populations.

Investigating discriminative stimulus modulation of opioid seeking after conflict-induced abstinence in sign- and goal-tracking rats

RATIONALE

Discriminative stimuli (DS) are cues that predict reward availability. DS are resistant to extinction and motivate drug seeking even after long periods of abstinence. Previous studies have demonstrated that sign-tracking (ST) and goal-tracking (GT) differences in Pavlovian approach predict distinct cue-modulated vulnerabilities to cocaine reinstatement. GT rats show heightened reinstatement to contextual and DS, while ST rats show heightened reinstatement to discrete stimuli. Here we examine whether DS modulate reinstatement after electric barrier-induced abstinence and whether tracking-related relapse vulnerabilities generalize to opioid relapse.

OBJECTIVES

We examine whether DS-modulated reinstatement to fentanyl seeking persists in the presence of reduced adverse consequences after electric barrier-induced abstinence. We also examine whether tracking differences predict the magnitude of DS-modulated reinstatement of fentanyl seeking after electric barrier-induced abstinence.

METHODS

We used Pavlovian lever autoshaping (PLA) training to determine sign-, goal-, and intermediate tracking groups in male and female Sprague Dawley rats. We then trained rats in a DS model of intermittent fentanyl self-administration, and extinguished drug seeking by imposing an electric barrier of increasing intensity. We then measured the level of DS-modulated reinstatement in the presence of a reduced electric barrier intensity.

RESULTS

We report that DS strongly modulate fentanyl seeking after electric barrier-induced abstinence. DS-modulation of fentanyl acquisition, electric barrier-induced abstinence, and reinstatement was similar for sign- and goal-tracking groups.

CONCLUSIONS

Discriminative stimuli powerfully motivate opioid seeking, despite continued aversive consequences. Pavlovian approach differences do not predict the level of DS-modulated reinstatement to fentanyl seeking after conflict-induced abstinence.

Novelty preference does not predict trait cocaine behaviors in male rats

Heightened novelty seeking is a risk factor for the initiation of drug use and development of substance use disorders. In rats, novelty seeking can be examined by assessing preference for a novel environment. Some evidence indicates that high novelty preferring (HNP) rats have higher drug intake compared to low novelty preferring (LNP) rats, although these data are mixed. Moreover, the extent to which the HNP phenotype can predict other initial drug behaviors, including economic demand for cocaine, has not been tested. Here, we screened a cohort (n=60) of male rats for novelty preference and several subsequent cocaine behaviors, including locomotor reactivity to a cocaine priming injection, acquisition of cocaine self-administration, as well as cocaine demand using a within-session behavioral economics procedure. Novelty preference did not correlate with cocaine behaviors, nor were there any differences between HNP and LNP rats identified using a median split strategy. Moreover, regression analyses indicated that novelty preference did not have predictive utility for any of the cocaine behaviors tested. Thus, the extent to which the novelty preference trait can predict initial cocaine-related behaviors in male rats may be limited. This is in contrast to the novel locomotor reactivity phenotype, which is strongly linked with initial cocaine intake, indicating that these traits are distinct and differentially predict cocaine behaviors in rats.

Diurnal rhythms in cholinergic modulation of rapid dopamine signals and associative learning in the striatum

Dysregulation of biological rhythms plays a role in a wide range of psychiatric disorders. We report mechanistic insights into the rhythms of rapid dopamine signals and cholinergic interneurons (CINs) working in concert in the rodent striatum. These rhythms mediate diurnal variation in conditioned responses to reward-associated cues. We report that the dopamine signal-to-noise ratio varies according to the time of day and that phasic signals are magnified during the middle of the dark cycle in rats. We show that CINs provide the mechanism for diurnal variation in rapid dopamine signals by serving as a gain of function to the dopamine signal-to-noise ratio that adjusts across time of day. We also show that conditioned responses to reward-associated cues exhibit diurnal rhythms, with cue-directed behaviors observed exclusively midway through the dark cycle. We conclude that the rapid dopamine signaling rhythm is mediated by a diurnal rhythm in CIN activity, which influences learning and motivated behaviors across the time of day.

Exploratory examination of the effects of d-amphetamine on active-state functional connectivity: Influence of impulsivity and sensation-seeking status

Recent advances in diagnostic research identified that individuals with higher impulsivity and sensation-seeking scores tend to report more positive subjective responses to stimulant drugs such as amphetamine. The current exploratory study hypothesized that differences in underlying mesocorticolimbic circuitry may mediate the relationship between personality and responses to stimulants due to its previously established implication in reward processes as well as the overlap between its dopaminergic projections and the pharmacodynamics of many stimulants. Forty participants (20 female) were recruited with relatively high- and low-impulsivity and sensation-seeking scores as defined by the Zuckerman-Kuhlman Personality Questionnaire (Form IIIR; Zuckerman, Kuhlman, Joireman, Teta, & Kraft, 1993) for a double-blind, placebo-controlled, intranasal amphetamine administration study conducted within an MRI scanner. Active state seed-to-voxel connectivity analyses assessed the effects of amphetamine, personality, subjective responses to amphetamine, and their interactions with mesocorticolimbic seeds on data collected during monetary incentive delay and go/no-go task performance. Results indicated that amphetamine administration largely disrupted brain activity as evidenced by connectivity values shifting toward no correlation among brain stem, striatal, and frontal cortex regions. Additionally, associations of impulsivity and connectivity between ventral tegmental and medial orbitofrontal as well as lateral orbitofrontal and putamen regions were inverted from negative to positive during the placebo and amphetamine conditions, respectively. Personality was unrelated to subjective responses to amphetamine. Results are interpreted as providing evidence of underlying differences in mesocorticolimbic circuitry being a potential target for requisite diagnostic and treatment strategies implicated with stimulant use disorders, but further research is needed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Melatonin attenuates morphine-induced conditioned place preference in Wistar rats

PURPOSE

Morphine is the predominantly used drug for postoperative and cancer pain management. However, the abuse potential of morphine is the primary disadvantage of using opioids in pain management. Melatonin is a neurohormone synthesized in the pineal gland and is involved in circadian rhythms in mammals, as well as other physiological functions. Melatonin provenly attenuates alcohol-seeking and relapse behaviors in rats. Therefore, we aimed to investigate the involvement of the melatonergic system in attenuating morphine dependence.

MATERIALS AND METHODS

Male Wistar rats were divided into three groups: control, morphine, and morphine + melatonin. Animals were habituated for 3 days, and the initial preference was evaluated. Following the initial preference, the control group received the vehicle and was placed for a 45-min session in the assigned chamber every day, alternating between the two chambers, for 8 days. The morphine group received a morphine injection (5 mg/kg, IP) and was placed for a 45-min session in the white chamber, for a total of four sessions. The morphine + melatonin group received the morphine injection (5 mg/kg, IP) for a total of four sessions over an 8-day period. In the posttest session, the control and morphine groups received a vehicle injection 30 min before placement in the conditioned place preference (CPP). The morphine + melatonin group received a single injection of melatonin (50 mg/kg, IP) 30 min before the preference test.

RESULTS

Statistical analysis revealed that repeated administration of morphine for four sessions produced a significant increase in the CPP score in the morphine group compared to the control group. However, a single melatonin injection administered 30 min before the posttest attenuated morphine-seeking behavior and reduced morphine-induced place preference.

CONCLUSION

These findings provide novel evidence for the role of the melatonergic system as a potential target in modulating morphine-seeking behavior.

Behavioral predictors of individual differences in opioid addiction vulnerability as measured using i.v. self-administration in rats

BACKGROUND

Like other forms of psychopathology, vulnerability to opioid addiction is subject to wide individual differences. Animal behavioral models are valuable in advancing our understanding of mechanisms underlying vulnerability to the disorder's development and amenability to treatment.

METHODS

This review provides an overview of preclinical work on behavioral predictors of opioid addiction vulnerability as measured using the intravenous (i.v.) self-administration (SA) model in rats. We also highlight several new approaches to studying individual differences in opioid addiction vulnerability in preclinical models that could have greater sensitivity and lead to more clinically relevant findings.

RESULTS AND CONCLUSIONS

Evidence for the relationship between various behavioral traits and opioid SA in the preclinical literature is limited. With the possible exceptions of sensitivity to opioid agonist/withdrawal effects and stress reactivity, predictors of individual differences in SA of other drugs of abuse (e.g. sensation-seeking, impulsivity) do not predict vulnerability to opioid SA in rats. Refinement of SA measures and the use of multivariate designs and statistics could help identify predictors of opioid SA and lead to more clinically relevant studies on opioid addiction vulnerability.

Novelty preferences and cocaine-associated cues influence regions associated with the salience network in juvenile female rats

Preferences for novel environments (novelty-seeking) is a risk factor for addiction, with little known about its underlying circuitry. Exposure to drug cues facilitates addiction maintenance, leading us to hypothesize that exposure to a novel environment activates a shared neural circuitry. Stimulation of the D1 receptor in the prelimbic cortex increases responsivity to drug-associated environments. Here, we use D1 receptor overexpression in the prelimbic cortex to probe brain responses to novelty-preferences (in a free-choice paradigm) and cocaine-associated odors following place conditioning. These same cocaine-conditioned odors were used to study neural circuitry with Blood Oxygen Level Dependent (BOLD) activity. D1 overexpressing females had deactivated BOLD signals related to novelty-preferences within the insula cortex and amygdala and activation in the frontal cortex and dopamine cell bodies. BOLD responses to cocaine cues were also sensitive to D1. Control females demonstrated a place preference for cocaine environments with no significant BOLD response, while D1 overexpressing females demonstrated a place aversion and weak BOLD responses to cocaine-conditioned odor cues within the insula cortex. For comparison, we provide data from an earlier study with juvenile males overexpressing D1 that show a strong preference for cocaine and elevated BOLD responses. The results support the use of a pharmacological manipulation (e.g., D1 overexpression) to probe the neural circuitry downstream from the prelimbic cortex.

Sensitivity to food and cocaine cues are independent traits in a large sample of heterogeneous stock rats

Sensitivity to cocaine and its associated stimuli ("cues") are important factors in the development and maintenance of addiction. Rodent studies suggest that this sensitivity is related, in part, to the propensity to attribute incentive salience to food cues, which, in turn, contributes to the maintenance of cocaine self-administration, and cue-induced relapse of drug-seeking. Whereas each of these traits has established links to drug use, the relatedness between the individual traits themselves has not been well characterized in preclinical models. To this end, the propensity to attribute incentive salience to a food cue was first assessed in two distinct cohorts of 2716 outbred heterogeneous stock rats (HS; formerly N:NIH). We then determined whether each cohort was associated with performance in one of two paradigms (cocaine conditioned cue preference and cocaine contextual conditioning). These measure the unconditioned locomotor effects of cocaine, as well as conditioned approach and the locomotor response to a cocaine-paired floor or context. There was large individual variability and sex differences among all traits, but they were largely independent of one another in both males and females. These findings suggest that these traits may contribute to drug-use via independent underlying neuropsychological processes.

Effects of Social Isolation on Perineuronal Nets in the Amygdala Following a Reward Omission Task in Female Rats

Negative urgency is a facet of impulsivity associated with negative affect and risky behavior that may involve the amygdala. The current study determined if social isolation during development alters negative urgency and c-Fos activity in the basolateral amygdala (BLA). Female Sprague-Dawley rats were raised in an isolated condition (IC), a standard social condition (SC), or an enriched condition (EC) and then were tested for locomotor activity, novelty place preference, and negative urgency using a reward omission task. Following performance on the reward omission task, the brains were analyzed for c-Fos expression in Ca2+/calmodulin kinase II (CaMKII) and calbindin (CB) neurons, as well as in parvalbumin (PV) neurons associated with perineuronal nets (PNNs) in BLA. IC rats exhibited enhanced locomotion compared with both SC and EC rats, as well as enhanced novelty place preference compared with EC rats; only IC rats showed increased responding following omission of an expected reward (negative urgency). Following completion of the reward omission task, IC rats also displayed increased percent of c-Fos neurons in BLA associated with CaMKII, CB, and PV neurons compared with SC and EC rats. In IC rats, c-Fos activation in BLA occurred following the omission of an expected reward. Finally, IC rats displayed reduced PNN intensity associated with PV neurons compared with EC rats, but the percent of these neurons co-expressing c-Fos was greater in IC rats; SC rats were intermediate between IC and EC rats. Negative urgency was observed in IC rats, but not SC or EC rats. While multiple mechanisms are likely involved, this behavioral effect was associated with an isolation-induced increase in activity of excitatory neurons in BLA, as well as decreased PNN intensity surrounding GABAergic neurons in the same region.

Effects of the cannabinoid receptor agonist CP-55,940 on incentive salience attribution

RATIONALE

Pavlovian conditioned approach paradigms are used to characterize the nature of motivational behaviors in response to stimuli as either directed toward the cue (i.e., sign-tracking) or the site of reward delivery (i.e., goal-tracking). Recent evidence has shown that activity of the endocannabinoid system increases dopaminergic activity in the mesocorticolimbic system, and other studies have shown that sign-tracking behaviors are dependent on dopamine.

OBJECTIVES

Therefore, we hypothesized that administration of a cannabinoid agonist would increase sign-tracking and decrease goal-tracking behaviors.

METHODS

Forty-seven adult male Sprague-Dawley rats were given a low, medium, or high dose of the cannabinoid agonist CP-55,940 (N = 12 per group) or saline (N = 11) before Pavlovian conditioned approach training. A separate group of rats (N = 32) were sacrificed after PCA training for measurement of cannabinoid receptor type 1 (CB1) and fatty acid amide hydrolase (FAAH) using in situ hybridization.

RESULTS

Contrary to our initial hypothesis, CP-55,940 dose-dependently decreased sign-tracking and increased goal-tracking behavior. CB1 expression was higher in sign-trackers compared with that in goal-trackers in the prelimbic cortex, but there were no significant differences in CB1 or FAAH expression in the infralimbic cortex, dorsal or ventral CA1, dorsal or ventral CA3, dorsal or ventral dentate gyrus, or amygdala.

CONCLUSIONS

These results demonstrate that cannabinoid signaling can specifically influence behavioral biases toward sign- or goal-tracking. Pre-existing differences in CB1 expression patterns, particularly in the prelimbic cortex, could contribute to individual differences in the tendency to attribute incentive salience to reward cues.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Individual variation in the attribution of incentive salience to social cues

Research on the attribution of incentive salience to drug cues has furthered our understanding of drug self-administration in animals and addiction in humans. The influence of social cues on drug-seeking behavior has garnered attention recently, but few studies have investigated how social cues gain incentive-motivational value. In the present study, a Pavlovian conditioned approach (PCA) procedure was used to identify rats that are more (sign-trackers; STs) or less (goal-trackers; GTs) prone to attribute incentive salience to food reward cues. In Experiment 1, a novel procedure employed social ‘peers’ to compare the tendency of STs and GTs to attribute incentive salience to social reward cues as well as form a social-conditioned place preference. In Experiment 2, social behavior of STs and GTs was compared using social interaction and choice tests. Finally, in Experiment 3, levels of plasma oxytocin were measured in STs and GTs seven days after the last PCA training session, because oxytocin is known to modulate the mesolimbic reward system and social behavior. Compared to GTs, STs attributed more incentive salience to social-related cues and exhibited prosocial behaviors (e.g., social-conditioned place preference, increased social interaction, and social novelty-seeking). No group differences were observed in plasma oxytocin levels. Taken together, these experiments demonstrate individual variation in the attribution of incentive salience to both food- and social-related cues, which has important implications for the pathophysiology of addiction.

Increased Goal Tracking in Adolescent Rats Is Goal-Directed and Not Habit-Like

When a cue is paired with reward in a different location, some animals will approach the site of reward during the cue, a behavior called goal tracking, while other animals will approach and interact with the cue itself: a behavior called sign tracking. Sign tracking is thought to reflect a tendency to transfer incentive salience from the reward to the cue. Adolescence is a time of heightened sensitivity to rewards, including environmental cues that have been associated with rewards, which may account for increased impulsivity and vulnerability to drug abuse. Surprisingly, however, studies have shown that adolescents are actually less likely to interact with the cue (i.e., sign track) than adult animals. We reasoned that adolescents might show decreased sign tracking, accompanied by increased apparent goal tracking, because they tend to attribute incentive salience to a more reward-proximal "cue": the food magazine. On the other hand, adolescence is also a time of enhanced exploratory behavior, novelty-seeking, and behavioral flexibility. Therefore, adolescents might truly express more goal-directed reward-seeking and less inflexible habit-like approach to a reward-associated cue. Using a reward devaluation procedure to distinguish between these two hypotheses, we found that adolescents indeed exhibit more goal tracking, and less sign tracking, than a comparable group of adults. Moreover, adolescents' goal tracking behavior is highly sensitive to reward devaluation and therefore goal-directed and not habit-like.

Toward isolating reward changes in diet-induced obesity: A demand analysis

Although hormonal and metabolic factors are well known to influence obesity, recent evidence suggests that obesity may be influenced also by changes in reward sensitivity akin to that seen in other 'reward pathologies', like substance use disorders. The current study sought to isolate changes in reward that may occur after the onset of diet-induced obesity by characterizing the economic demand for caloric (sucrose) and non-caloric (saccharin) reinforcers in a preclinical model of diet-induced obesity (DIO). We utilized economic demand analysis to measure baseline demand intensity (Q₀) and demand elasticity (α) for sucrose and saccharin reinforcers in rats. After baseline measures were collected, rats were assigned randomly to a high-fat (HF) diet or low-fat (LF) control diet. After 8-weeks of diet exposure, HF rats were divided into obesity-resistant (OR) or obesity-prone (OP) groups based on weight after the 8-week HF diet exposure. Post-DIO demand data for each reinforcer were reassessed. At baseline, rats had higher demand intensity and lower elasticity for sucrose compared to saccharin. After 8-weeks of the high-fat diet, OP rats had significantly greater weight gain and lower demand elasticity for sucrose and saccharin and higher demand intensity for saccharin. The changes in sucrose and saccharin elasticity suggest that DIO-induced changes in food-related behavior are associated with changes in reward processes. The changes in demand intensity for saccharin suggest that demand intensity, as a measure of 'set point', is not directly linked to metabolic processes. The current study shows that microeconomic theory and demand analysis is able to isolate independent aspects of diet-induced reward changes related to caloric and non-caloric reinforcers.

Repeated subcutaneous administration of PT150 has dose-dependent effects on sign tracking in male Japanese quail

A devastating feature of drug dependence is the susceptibility of relapse (40-60%) after stretches of abstinence. In both animal and human research, it has been demonstrated that cues (e.g., levers, paraphernalia) associated with drug reward can instigate renewed drug taking. Research has shown animals that attend to a cue that predicts reward more than the location of reward delivery when the cue is present (sign trackers) have an increase in corticosterone (CORT), a primary stress hormone when compared with animals that do not sign track. This interaction of sign tracking and CORT implicate CORT's effects as a possible pharmacological target for cue-induced relapse behaviors. PT150 is a novel glucocorticoid receptor antagonist that reduces the effects of CORT. Previous research has shown that oral administration of 40 mg/kg PT150 reduced sign tracking. To better understand dose-dependent effects and to control for more accurate doses, the current experiment hypothesized that PT150 (20/40/60 mg/kg) given by subcutaneous (SC) injection to male quail would reduce sign tracking to a keylight conditional stimulus that predicts a grain unconditioned stimulus dose dependently. Results showed that SC injection of 20 mg/kg PT150 reduced sign tracking, but 40 or 60 mg/kg did not. The main findings from the current study are that the glucocorticoid receptor antagonist PT150 reduces sign tracking behavior dose dependently, and SC administration may provide better bioavailability compared with our previous study that used an oral route of administration. The current findings support previous literature by suggesting that the glucocorticoid receptor may be a potential pharmacological target for reducing relapse-like behaviors. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Comparison of cigarette, little cigar, and waterpipe tobacco smoke condensate and e-cigarette aerosol condensate in a self-administration model

The pharmacological effects of tobacco products are primarily mediated by nicotine; however, research suggests that several non-nicotine tobacco constituents may alter the reinforcing effects of nicotine. This study evaluated the reinforcing effects of aqueous solutions of smoke/aerosol condensate from cigarettes, little cigars, electronic cigarettes (e-cigarettes), and waterpipe tobacco in a self-administration procedure to determine if abuse liability of these tobacco products differed. Adult male Sprague-Dawley rats (n = 64 total) were trained to self-administer intravenous nicotine (30 μg/kg/infusion) on a fixed ratio 5 schedule of reinforcement. Following nicotine dose-effect assessment (1, 7.5, 15, and 30 μg/kg/infusion), rats were given access to smoke/aerosol condensate derived from their assigned tobacco product. Rats responded for smoke/aerosol condensate containing 1, 7.5, 15, and 30 μg/kg/infusion nicotine, with the ratio of nicotine:non-nicotine constituents held constant across doses for each tobacco product. Responding for nicotine or smoke/aerosol condensate was also assessed on a progressive ratio schedule of reinforcement. Cigarette, little cigar, and e-cigarette smoke/aerosol condensates shifted the nicotine dose-effect curve leftward, whereas waterpipe tobacco smoke condensate shifted the dose-effect curve rightward. Smoke/aerosol condensate from all tobacco products produced similar levels of responding compared to nicotine alone during the progressive ratio phase. Results suggest that non-nicotine constituents in cigarettes, little cigars, and e-cigarettes differentially enhance nicotine's reinforcing potency. In contrast, waterpipe tobacco blunted nicotine's reinforcing potency, suggesting that it may contain unique constituents that dampen nicotine's reinforcing effects.

Time-dependent changes in cognitive flexibility performance during intermittent social stress: Relevance for motivation and reward-seeking behavior

Repeated exposure to stress produces cognitive impairments that can lead to psychiatric disorders. How and when these cognitive impairments occur during repeated exposure to stress is not well understood. The present study investigates the time course effects of the exposure to intermittent episodes of social stress on cognitive flexibility performance. Male rats were trained to perform a cognitive flexibility (set-shifting) task. Then they were submitted to intermittent social defeat stress, which consisted of exposing animals to social defeat once every three days for ten days (four stress episodes). Set-shifting performance was evaluated before and in between social stress episodes, and up to ten days after the end of the stress protocol. Plasma levels of corticosterone after tail-pinch were also measured after the last set-shifting session. Intermittent exposure to social stress did not impair cognitive flexibility but produced short-and long-term changes in set-shifting performance. After the third social defeat episode, stressed animals required significantly more time to respond to cues (instrumental action) and to poke in the food-trough when no food pellet was delivered. These effects were reversed ten days after stress and suggest a decrease in motivation to pursue rewards. In contrast, stressed animals responded more accurately to light cues that predicted rewards. This effect, which emerged ten days after stress, suggests an increase in the reactivity to salient cues in the long-term. These time-dependent behavioral changes might help to understand the transition from social stress to stress-related disorders including drug abuse.

VIPergic neurons of the infralimbic and prelimbic cortices control palatable food intake through separate cognitive pathways

The prefrontal cortex controls food reward seeking and ingestion, playing important roles in directing attention, regulating motivation towards reward pursuit, and the assignment of reward salience and value. The cell types that mediate these behavioral functions, however, are not well described. We report here that optogenetic activation of vasoactive peptide expressing (VIP) interneurons in both the infralimbic (IL) and prelimbic (PL) divisions of the medial prefrontal cortex in mice is sufficient to reduce acute, binge-like intake of high calorie palatable food in the absence of any effect on low calorie rodent chow intake in the sated animal. In addition, we discovered that the behavioral mechanisms associated with these changes in feeding differed between animals that underwent either IL or PL VIPergic stimulation. While IL VIP neurons showed the ability to reduce palatable food intake, this effect was dependent upon the novelty and relative value of the food source. In addition, IL VIP neuron activation significantly reduced novel object- and novel social investigative behavior. Activation of PL VIP neurons, however, produced a reduction in high calorie palatable food intake that was independent of food novelty. Neither IL nor PL VIP excitation changed motivation to obtain food reward. Our data show how neurochemically-defined populations of cortical interneurons can regulate specific aspects of food reward-driven behavior, resulting in a selective reduction in intake of highly valued food.

Incentive salience attribution, "sensation-seeking" and "novelty-seeking" are independent traits in a large sample of male and female heterogeneous stock rats

There are a number of traits that are thought to increase susceptibility to addiction, and some of these are modeled in preclinical studies. For example, "sensation-seeking" is predictive of the initial propensity to take drugs; whereas "novelty-seeking" predicts compulsive drug-seeking behavior. In addition, the propensity to attribute incentive salience to reward cues can predict the propensity to approach drug cues, and reinstatement or relapse, even after relatively brief periods of drug exposure. The question addressed here is the extent to which these three 'vulnerability factors' are related; that is, predictive of one another. Some relationships have been reported in small samples, but here a large sample of 1,598 outbred male and female heterogeneous stock rats were screened for Pavlovian conditioned approach behavior (to obtain an index of incentive salience attribution; 'sign-tracking'), and subsequently tested for sensation-seeking and novelty-seeking. Despite the large N there were no significant correlations between these traits, in either males or females. There were, however, novel relationships between multiple measures of incentive salience attribution and, based on these findings, we generated a new metric that captures "incentive value". Furthermore, there were sex differences on measures of incentive salience attribution and sensation-seeking behavior that were not previously apparent.

Modelling Differential Vulnerability to Substance Use Disorder in Rodents: Neurobiological Mechanisms

Despite the prevalence of drug use within society, only a subset of individuals actively taking addictive drugs lose control over their intake and develop compulsive drug-seeking and intake that typifies substance use disorder (SUD). Although research in this field continues to be an important and dynamic discipline, the specific neuroadaptations that drive compulsive behaviour in humans addicted to drugs and the neurobiological mechanisms that underlie an individual's innate susceptibility to SUD remain surprisingly poorly understood. Nonetheless, it is clear from research within the clinical domain that some behavioural traits are recurrently co-expressed in individuals with SUD, thereby inviting the hypothesis that certain behavioural endophenotypes may be predictive, or at least act in some way, to modify an individual's probability for developing this disorder. The analysis of such endophenotypes and their catalytic relationship to the expression of addiction-related behaviours has been greatly augmented by experimental approaches in rodents that attempt to capture diagnostically relevant aspects of this progressive brain disorder. This work has evolved from an early focus on aberrant drug reinforcement mechanisms to a now much richer account of the putatively impaired cognitive control processes that ultimately determine individual trajectories to compulsive drug-related behaviours. In this chapter we discuss the utility of experimental approaches in rodents designed to elucidate the neurobiological and genetic underpinnings of so-called risk traits and how these innate vulnerabilities collectively contribute to the pathogenesis of SUD.

Early life adversity potentiates expression of addiction-related traits

Many individuals sporadically and circumstantially sample addictive drugs, yet few become addicted. The individual vulnerabilities underlying the development of addiction are not well understood. Correlational findings show that early life adversity is associated with a greater propensity to develop drug addiction. However, the mechanisms by which early life adversity increases addiction vulnerability are unknown. Separate lines of research have found that several traits are associated with addiction. Here, we examined the effects of early life adversity on addiction-related traits in adulthood. We weaned male and female Sprague-Dawley rats (postnatal day - PND21) and randomly assigned them to either a non-adversity group (N-ADV) or an adversity group (ADV). ADV rats experienced adversity from PND 21-35, they were: a) singly housed, b) food restricted for 12h/day, c) subjected to forced-swim sessions, and d) restrained and exposed to predator odour (1h). As adults, rats were tested for impulsivity, anxiety-like behaviour, novelty preference, and attribution of incentive salience to a reward cue. ADV rats showed enhanced novelty preference and attributed greater incentive value to a reward cue. Compared to N-ADV rats, a greater proportion of ADV rats expressed multiple addiction risk traits. Furthermore, fewer ADV rats expressed no addiction risk traits. This effect was most evident in female ADV rats.

A glucocorticoid receptor antagonist reduces sign-tracking behavior in male Japanese quail

Addiction is characterized as a chronic debilitating disease. One devastating feature of addiction is the susceptibility of relapse (40-60%) after stretches of abstinence. One theory that may account for relapse suggests that drug cues (e.g., paraphernalia) may increase stress hormones, and this may prompt relapse. Repeatedly pairing a neutral cue with a reward is commonly utilized to measure what subjects learn about a cue that is predictive of reward. Research has shown that animals that attend to a cue more than to the reward (sign trackers) may be more vulnerable to drug addiction. Additionally, research has shown that sign tracking is associated with an increase in corticosterone, a primary stress hormone. PT150 is a novel glucocorticoid receptor antagonist that moderates the release of corticosterone. In the current experiment, it was hypothesized that subjects given repeated administration of PT150 would reduce sign tracking compared to subjects given placebo. Time spent (in seconds) near a cue that predicts reward (conditional stimulus) served as a measure of sign tracking, and PT150 or placebo was administered following sign tracking. An independent-samples t test revealed that subjects that received PT150 had reduced time spent near the conditioned stimulus compared to controls. Given the devastating effects of drug addiction, identification of a potential pharmacological intervention in the reduction of relapse would be of great value. Therefore, future research is needed to validate the use of PT150 in reducing behaviors associated with drug addiction. (PsycINFO Database Record

The role of glutamate signaling in incentive salience: second-by-second glutamate recordings in awake Sprague-Dawley rats

The attribution of incentive salience to reward-predictive stimuli has been shown to be associated with substance abuse-like behavior such as increased drug taking. Evidence suggests that glutamate neurotransmission and sequential N-methyl-D-aspartate (NMDA) activation are involved in the attribution of incentive salience. Here, we further explore the role of second-by-second glutamate neurotransmission in the attribution of incentive salience to reward-predictive stimuli by measuring sign-tracking behavior during a Pavlovian conditioned approach procedure using ceramic-based microelectrode arrays configured for sensitive measures of extracellular glutamate in awake behaving Sprague-Dawley rats. Specifically, we show that there is an increase in extracellular glutamate levels in the prelimbic cortex (PrL) and the nucleus accumbens core (NAcC) during sign-tracking behavior to a food-predictive conditioned stimulus (CS+) compared to the presentation of a non-predictive conditioned stimulus (CS-). Furthermore, the results indicate greater increases in extracellular glutamate levels in the PrL compared to NAcC in response to the CS+, including differences in glutamate release and signal decay. Taken together, the present research suggests that there is differential glutamate signaling in the NAcC and PrL during sign-tracking behavior to a food-predictive CS+.

Transient inactivation of the paraventricular nucleus of the thalamus enhances cue-induced reinstatement in goal-trackers, but not sign-trackers

RATIONALE

The paraventricular nucleus of the thalamus (PVT) has been shown to mediate cue-motivated behaviors, such as sign- and goal-tracking, as well as reinstatement of drug-seeking behavior. However, the role of the PVT in mediating individual variation in cue-induced drug-seeking behavior remains unknown.

OBJECTIVES

This study aimed to determine if inactivation of the PVT differentially mediates cue-induced drug-seeking behavior in sign-trackers and goal-trackers.

METHODS

Rats were characterized as sign-trackers (STs) or goal-trackers (GTs) based on their Pavlovian conditioned approach behavior. Rats were then exposed to 15 days of cocaine self-administration, followed by a 2-week forced abstinence period and then extinction training. Rats then underwent tests for cue-induced reinstatement and general locomotor activity, prior to which they received an infusion of either saline (control) or baclofen/muscimol (B/M) to inactivate the PVT.

RESULTS

Relative to control animals of the same phenotype, GTs show a robust increase in cue-induced drug-seeking behavior following PVT inactivation, whereas the behavior of STs was not affected. PVT inactivation did not affect locomotor activity in either phenotype.

CONCLUSION

In GTs, the PVT appears to inhibit the expression of drug-seeking, presumably by attenuating the incentive value of the drug cue. Thus, inactivation of the PVT releases this inhibition in GTs, resulting in an increase in cue-induced drug-seeking behavior. PVT inactivation did not affect cue-induced drug-seeking behavior in STs, suggesting that the role of the PVT in encoding the incentive motivational value of drug cues differs between STs and GTs.

How foraging works: Uncertainty magnifies food-seeking motivation

Food uncertainty has the effect of invigorating food-related responses. Psychologists have noted that mammals and birds respond more to a conditioned stimulus that unreliably predicts food delivery, and ecologists have shown that animals (especially small passerines) consume and/or hoard more food and can get fatter when access to that resource is unpredictable. Are these phenomena related? We think they are. Psychologists have proposed several mechanistic interpretations, while ecologists have suggested a functional interpretation: The effect of unpredictability on fat reserves and hoarding behavior is an evolutionary strategy acting against the risk of starvation when food is in short supply. Both perspectives are complementary, and we argue that the psychology of incentive motivational processes can shed some light on the causal mechanisms leading animals to seek and consume more food under uncertainty in the wild. Our theoretical approach is in agreement with neuroscientific data relating to the role of dopamine, a neurotransmitter strongly involved in incentive motivation, and its plausibility has received some explanatory and predictive value with respect to Pavlovian phenomena. Overall, we argue that the occasional and unavoidable absence of food rewards has motivational effects (called incentive hope) that facilitate foraging effort. We show that this hypothesis is computationally tenable, leading foragers in an unpredictable environment to consume more food items and to have higher long-term energy storage than foragers in a predictable environment.

Early-life adversity facilitates acquisition of cocaine self-administration and induces persistent anhedonia

Early-life adversity increases the risk for emotional disorders such as depression and schizophrenia. Anhedonia, thought to be a core feature of these disorders, is provoked by our naturalistic rodent model of childhood adversity (i.e., rearing pups for one week in cages with limited bedding and nesting, LBN). Drug use and addiction are highly comorbid with psychiatric disorders featuring anhedonia, yet effects of LBN on drug-seeking behavior and the reward and stress-related circuits that underlie it remain unknown. Here we examined the effects of LBN on cocaine intake and seeking, using a battery of behavioral tests measuring distinct aspects of cocaine reward, and for comparison, chocolate intake. We also examined activation of neurons within the pleasure/reward and stress circuits following cocaine in LBN and control rats. Early-life adversity reduced spontaneous intake of palatable chocolate, extending prior reports of sucrose and social-play anhedonia. In a within-session cocaine behavioral economic test, LBN rats self-administered lower dosages of cocaine under low-effort conditions, consistent with a reduced hedonic set-point for cocaine, and potentially anhedonia. In contrast, cocaine demand elasticity was not consistently affected, indicating no major changes in motivation to maintain preferred cocaine blood levels. These changes were selective, as LBN did not cause an overt anxiety-like phenotype, nor did it affect sensitivity to self-administered cocaine dose, responding for cocaine under extinction conditions, cocaine- or cue-induced reinstatement of cocaine seeking, or locomotor response to acute cocaine. However, high Fos expression was seen after cocaine in both reward- and stress-related brain regions of LBN rats, including nucleus accumbens core, central amygdala, and lateral habenula. In contrast, hypothalamic orexin neuron activation after cocaine was significantly attenuated in LBN rats. Together, these findings demonstrate enduring effects of early-life adversity on both reward- and fear/anxiety-related neural circuits, as well as anhedonia-like reductions in consumption of natural and drug rewards.

•

Adversity during a sensitive developmental period provokes persistent anhedonia.

•

This adversity reduces cocaine hedonic set point, but not motivation.

•

Cocaine-associated Fos is altered in reward- and anxiety/fear circuits.

•

Cocaine-dose sensitivity, reinstatement, and locomotion are unchanged.

•

Effects are selective, as anxiety-related behaviors were unaltered.

Sex-dependent impact of early-life stress and adult immobilization in the attribution of incentive salience in rats

Early life stress (ELS) induces long-term effects in later functioning and interacts with further exposure to other stressors in adulthood to shape our responsiveness to reward-related cues. The attribution of incentive salience to food-related cues may be modulated by previous and current exposures to stressors in a sex-dependent manner. We hypothesized from human data that exposure to a traumatic (severe) adult stressor will decrease the attribution of incentive salience to reward-associated cues, especially in females, because these effects are modulated by previous ELS. To study these factors in Long-Evans rats, we used as an ELS model of restriction of nesting material and concurrently evaluated maternal care. In adulthood, the offspring of both sexes were exposed to acute immobilization (IMO), and several days after, a Pavlovian conditioning procedure was used to assess the incentive salience of food-related cues. Some rats developed more attraction to the cue predictive of reward (sign-tracking) and others were attracted to the location of the reward itself, the food-magazine (goal-tracking). Several dopaminergic markers were evaluated by in situ hybridization. The results showed that ELS increased maternal care and decreased body weight gain (only in females). Regarding incentive salience, in absolute control animals, females presented slightly greater sign-tracking behavior than males. Non-ELS male rats exposed to IMO showed a bias towards goal-tracking, whereas in females, IMO produced a bias towards sign-tracking. Animals of both sexes not exposed to IMO displayed an intermediate phenotype. ELS in IMO-treated females was able to reduce sign-tracking and decrease tyrosine hydroxylase expression in the ventral tegmental area and dopamine D1 receptor expression in the accumbens shell. Although the predicted greater decrease in females in sign-tracking after IMO exposure was not corroborated by the data, the results highlight the idea that sex is an important factor in the study of the long-term impact of early and adult stressors.

Foraging motivation favors the occurrence of Lévy walks

Lévy walks are a property of random movements often observed among foraging animals (and humans), and they might confer some advantages for survival in an unpredictable environment, in comparison with Brownian walks. In animals with a nervous system, specific neurotransmitters associated with some psychological states could play a crucial role in controlling the occurrence of Lévy walks. We argue that incentive motivation, a dopamine-dependent process that in vertebrates makes rewards and their predictive conditioned stimuli attractive, has behavioral effects that may favor their occurrence: incentive motivation is higher when food is unpredictable and it strongly underpins foraging activity. An individual-based computer model is used to determine whether changes in incentive motivation can influence the probability that Lévy walks occur among foraging agents. Our results suggest that they are produced more often under an unpredictable than a predictable food access, and more often in strongly rather than weakly motivated foragers exposed to an unpredictable food access. Also, our motivational framework indicates that the occurrence of Lévy walks are correlated with, but not causally linked to, the number of food items consumed and the ability to store fat reserves. We conclude that Lévy walks can confer some advantages for survival in an unpredictable environment, provided that they appear in foragers with a high motivation to seek food.

The Nucleus Accumbens: Mechanisms of Addiction across Drug Classes Reflect the Importance of Glutamate Homeostasis

The nucleus accumbens is a major input structure of the basal ganglia and integrates information from cortical and limbic structures to mediate goal-directed behaviors. Chronic exposure to several classes of drugs of abuse disrupts plasticity in this region, allowing drug-associated cues to engender a pathologic motivation for drug seeking. A number of alterations in glutamatergic transmission occur within the nucleus accumbens after withdrawal from chronic drug exposure. These drug-induced neuroadaptations serve as the molecular basis for relapse vulnerability. In this review, we focus on the role that glutamate signal transduction in the nucleus accumbens plays in addiction-related behaviors. First, we explore the nucleus accumbens, including the cell types and neuronal populations present as well as afferent and efferent connections. Next we discuss rodent models of addiction and assess the viability of these models for testing candidate pharmacotherapies for the prevention of relapse. Then we provide a review of the literature describing how synaptic plasticity in the accumbens is altered after exposure to drugs of abuse and withdrawal and also how pharmacological manipulation of glutamate systems in the accumbens can inhibit drug seeking in the laboratory setting. Finally, we examine results from clinical trials in which pharmacotherapies designed to manipulate glutamate systems have been effective in treating relapse in human patients. Further elucidation of how drugs of abuse alter glutamatergic plasticity within the accumbens will be necessary for the development of new therapeutics for the treatment of addiction across all classes of addictive substances.

Individual differences in food cue responsivity are associated with acute and repeated cocaine-induced vocalizations, but not cue-induced vocalizations

RATIONALE

Individuals prone to attribute incentive salience to food-associated stimuli ("cues") are also more sensitive to cues during drug seeking and drug taking. This may be due in part to a difference in sensitivity to the affective or other stimulus properties of the drug. In rats, these properties are associated with 50-kHz ultrasonic vocalizations (USVs), in that they are elicited during putative positive affective and motivational states, including in response to drugs of abuse.

OBJECTIVES

We sought to determine whether individual differences in the tendency to attribute incentive salience to a food cue (as measured by approach) were associated with differences in cocaine-induced USVs. We also tested whether the food cue would elicit USVs and if this response was related to approach to the food cue.

METHODS

In experiment 1, rats underwent Pavlovian conditioned approach (PavCA) training where they learned to associate a cue (an illuminated lever) with the delivery of a food pellet into a food cup. Subjects were categorized based on their approach to the cue ("sign-trackers") or to the food cup ("goal-trackers"). Rats subsequently underwent nine testing days in which they were given saline or cocaine (10 mg/kg i.p) and placed into a locomotor chamber. In experiment 2, rats were first tested in the locomotor chambers for one saline-treated day followed by one cocaine-treated day and then trained in PavCA. USVs were recorded from a subset of individuals during the last day of PavCA to determine if the food cue would elicit USVs.

RESULTS

Sign-trackers produced 5-24 times more cocaine-induced 50 kHz USVs compared to goal-trackers for all days of experiment 1, and this response sensitized with repeated cocaine, only in sign-trackers. Similarly in experiment 2, individuals that produced the most cocaine-induced USVs on a single exposure also showed the greatest tendency to sign-track during PavCA. Lastly, while sign-trackers produced more USVs during PavCA generally, the cue itself did not elicit additional USVs in sign- or goal-trackers.

CONCLUSIONS

These results indicate a robust and consistent relationship between approach to a food cue and cocaine-induced USV production. Thus, these USVs may index the neurobiological differences underlying the behavioral distinctions of sign- and goal-trackers.

Influence of the Novelty-Seeking Endophenotype on the Rewarding Effects of Psychostimulant Drugs in Animal Models

Novelty seeking (NS), defined as a tendency to pursue novel and intense emotional sensations and experiences, is one of the most relevant individual factors predicting drug use among humans. High novelty seeking (HNS) individuals present an increased risk of drug use compared to low novelty seekers. The NS endophenotype may explain some of the differences observed among individuals exposed to drugs of abuse in adolescence. However, there is little research about the particular response of adolescents to drugs of abuse in function of this endophenotype, and the data that do exist are inconclusive. The present work reviews the literature regarding the influence of NS on psychostimulant reward, with particular focus on adolescent subjects. First, the different animal models of NS and the importance of this endophenotype in adolescence are discussed. Later, studies that have used the most common animal models of reward (self-administration, conditioned place preference paradigms) to evaluate how the NS trait influences the rewarding effects of psychostimulants are reviewed. Finally, possible explanations for the enhanced risk of developing substance dependence among HNS individuals are discussed. In conclusion, the studies referred to in this review show that the HNS trait is associated with: (1) increased initial sensitivity to the rewarding effects of psychostimulants, (2) a higher level of drug craving when the subject is exposed to the environmental cues associated with the drug, and (3) enhanced long-term vulnerability to relapse to drug consumption after prolonged abstinence.

Structural and functional plasticity of dendritic spines - root or result of behavior?

Dendritic spines are multifunctional integrative units of the nervous system and are highly diverse and dynamic in nature. Both internal and external stimuli influence dendritic spine density and morphology on the order of minutes. It is clear that the structural plasticity of dendritic spines is related to changes in synaptic efficacy, learning and memory and other cognitive processes. However, it is currently unclear whether structural changes in dendritic spines are primary instigators of changes in specific behaviors, a consequence of behavioral changes, or both. In this review, we first examine the basic structure and function of dendritic spines in the brain, as well as laboratory methods to characterize and quantify morphological changes in dendritic spines. We then discuss the existing literature on the temporal and functional relationship between changes in dendritic spines in specific brain regions and changes in specific behaviors mediated by those regions. Although technological advancements have allowed us to better understand the functional relevance of structural changes in dendritic spines that are influenced by environmental stimuli, the role of spine dynamics as an underlying driver or consequence of behavior still remains elusive. We conclude that while it is likely that structural changes in dendritic spines are both instigators and results of behavioral changes, improved research tools and methods are needed to experimentally and directly manipulate spine dynamics in order to more empirically delineate the relationship between spine structure and behavior.

Less is more: prolonged intermittent access cocaine self-administration produces incentive-sensitization and addiction-like behavior

RATIONALE

Contemporary animal models of cocaine addiction focus on increasing the amount of drug consumption to produce addiction-like behavior. However, another critical factor is the temporal pattern of consumption, which in humans is characterized by intermittency, both within and between bouts of use.

OBJECTIVE

To model this, we combined prolonged access to cocaine (∼70 days in total) with an intermittent access (IntA) self-administration procedure and used behavioral economic indicators to quantify changes in motivation for cocaine.

RESULTS

IntA produced escalation of intake, a progressive increase in cocaine demand (incentive-sensitization), and robust drug- and cue-induced reinstatement of drug-seeking behavior. We also asked whether rats that vary in their propensity to attribute incentive salience to reward cues (sign-trackers [STs] vs. goal-trackers [GTs]) vary in the development of addiction-like behavior. Although STs were more motivated to take cocaine after limited drug experience, after IntA, STs and GTs no longer differed on any measure of addiction-like behavior.

CONCLUSIONS

Exposure to large quantities of cocaine is not necessary for escalation of intake, incentive-sensitization, or other addiction-like behaviors (IntA results in far less total cocaine consumption than 'long access' procedures). Also, the ST phenotype may increase susceptibility to addiction, not because STs are inherently susceptible to incentive-sensitization (perhaps all individuals are at risk), but because this phenotype promotes continued drug use, subjecting them to incentive-sensitization. Thus, the pharmacokinetics associated with the IntA procedure are especially effective in producing a number of addiction-like behaviors and may be valuable for studying associated neuroadaptations and for assessing individual variation in vulnerability.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Exploration of a novel object in late adolescence predicts novelty-seeking behavior in adulthood: Associations among behavioral responses in four novelty-seeking tests

The sensation/novelty seeking behavioral trait refers to the exploration/preference for a novel environment. Novelty seeking increases during late adolescence and it has been associated with several neurobehavioral disorders. In this experiment, we asked whether inbred Roman high- and low-avoidance (RHA-I, RLA-I) rats (1) differ in novelty seeking in late adolescence and (2) whether late adolescent novelty seeking predicts this trait in adulthood. Thirty six male RHA-I and 36 RLA-I rats were exposed to a novel object exploration (NOE) test during late adolescence (pnd: 52-59;

DEPENDENT VARIABLES

contact latency, contact time, contact frequency). Head-dipping (hole-board, HB), time and visits to a novel-arm (Y-maze), and latency-in and emergence latency (emergence test) were registered in adulthood (pnd: 83-105). The results showed strain differences in all these tests (RHA-I>RLA-I). Factor analysis (RHA-I+RLA-I) revealed two clusters. The first one grouped HB and emergence test measures. The second one grouped NOE and Y-maze variables. Time exploring a novel object (NOE) was a significant predictor of novel arm time (RHA-I+RLA, RHA-I); contact latency was a significant predictor of novel arm frequency (RLA-I). Present results show consistent behavioral associations across four novelty-seeking tests and suggest that late adolescent novelty seeking predicts this genetically-influenced temperamental trait in adult Roman rats.

Novelty response and 50 kHz ultrasonic vocalizations: Differential prediction of locomotor and affective response to amphetamine in Sprague-Dawley rats

RATIONALE

Novelty and sensation seeking (NSS) predisposes humans and rats to experiment with psychostimulants. In animal models, different tests of NSS predict different phases of drug dependence. Ultrasonic vocalizations (USVs) are evoked by psychomotor stimulants and measure the affective/motivation response to stimuli, yet the role NSS has on USVs in response to amphetamine is not determined.

OBJECTIVES

The aim of the present study was to determine if individual differences in NSS and USVs can predict locomotor and USV response to amphetamine (0.0, 0.3, and 1.0 mg/kg) after acute and chronic exposure.

METHODS

Thirty male rats were tested for their response to novelty (IEN), choice to engage in novelty (NPP), and heterospecific play (H-USV). Rats were administered non-contingent amphetamine or saline for seven exposures, and USVs and locomotor activity were measured. After a 14-day rest, rats were administered a challenge dose of amphetamine.

RESULTS

Regression analyses indicated that amphetamine dose-dependently increased locomotor activity and the NPP test negatively predicted treatment-induced locomotor activity. The H-USV test predicted treatment-induced frequency-modulated (FM) USVs, but the strength of prediction depended on IEN response.

CONCLUSIONS

Results provide evidence that locomotor activity and FM USVs induced by amphetamine represent different behavioral responses. The prediction of amphetamine-induced FM USVs by the H-USV screen was changed by the novelty response, indicating that the affective value of amphetamine-measured by FM USVs-depends on novelty response. This provides evidence that higher novelty responders may develop a tolerance faster and may escalate intake faster.

Novelty, conditioning and attentional bias to sexual rewards

The Internet provides a large source of novel and rewarding stimuli, particularly with respect to sexually explicit materials. Novelty-seeking and cue-conditioning are fundamental processes underlying preference and approach behaviors implicated in disorders of addiction. Here we examine these processes in individuals with compulsive sexual behaviors (CSB), hypothesizing a greater preference for sexual novelty and stimuli conditioned to sexual rewards relative to healthy volunteers. Twenty-two CSB males and forty age-matched male volunteers were tested in two separate behavioral tasks focusing on preferences for novelty and conditioned stimuli. Twenty subjects from each group were also assessed in a third conditioning and extinction task using functional magnetic resonance imaging. CSB was associated with enhanced novelty preference for sexual, as compared to control images, and a generalized preference for cues conditioned to sexual and monetary versus neutral outcomes compared to healthy volunteers. CSB individuals also had greater dorsal cingulate habituation to repeated sexual versus monetary images with the degree of habituation correlating with enhanced preference for sexual novelty. Approach behaviors to sexually conditioned cues dissociable from novelty preference were associated with an early attentional bias to sexual images. This study shows that CSB individuals have a dysfunctional enhanced preference for sexual novelty possibly mediated by greater cingulate habituation along with a generalized enhancement of conditioning to rewards. We further emphasize a dissociable role for cue-conditioning and novelty preference on the early attentional bias for sexual cues. These findings have wider relevance as the Internet provides a broad range of novel and potentially rewarding stimuli.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

PYY3-36: Beyond food intake

The gastrointestinal hormone peptide tyrosine tyrosine 3-36 (PYY(3-36)) has attained broad recognition with respect to its involvement in energy homeostasis and the control of food intake. It is mainly secreted by distal intestinal enteroendocrine L-cells in response to eating and exerts neurally mediated, paracrine and endocrine effects on various target organs. In addition to its gastrointestinal effects, PYY(3-36) has long been known to inhibit food intake. Recent closer examination of the effects of PYY(3-36) revealed that this gut-derived peptide also influences a wide spectrum of behavioral and cognitive functions that are pivotal for basic processes of perception and judgment, including central information processing, salience learning, working memory, and behavioral responding to novelty. Here, we review the effects of PYY(3-36) that go beyond food intake and provide a conceptual framework suggesting that several apparently unrelated behavioral actions of PYY(3-36) may actually reflect different manifestations of modulating the central dopamine system.

Sex and strain influence attribution of incentive salience to reward cues in mice

The propensity to attribute incentive salience to reward cues, measured by Pavlovian sign-tracking, is strongly associated with addiction-related traits including cocaine self-administration, impulsivity, novelty reactivity, and novelty preference. Despite its critical role in addiction, the genetic underpinnings of incentive salience attribution and its relationship to drug addiction are unknown. Mouse genetics can be a powerful means to discover genetic mechanisms underlying this relationship. However, feasibility of genetic dissection of sign-tracking in mice is unknown as only a single study limited to male C57BL/6J mice has rigorously examined this behavior, and limited sign-tracking was observed. Highly diverse mouse populations such as the Collaborative Cross (CC) and Diversity Outbred population (DO) possess a greater range of behavioral and genetic variation than conventional laboratory strains. In the present study, we evaluated sign-tracking and the related phenotype goal-tracking in mice of both sexes from five inbred CC and DO founder strains. Male CAST/EiJ mice exhibited robust sign-tracking; male NOD, male C57BL/6J, and female A/J mice also exhibited significant sign-tracking. Male and female mice from all strains exhibited significant goal-tracking, and significant strain and sex differences were observed. Sign-tracking in males was genetically correlated with exploration of a novel environment, and heritability of sign-tracking and goal-tracking ranged from .32 to .41. These data highlight the importance of considering genetic diversity when evaluating the occurrence of specific behavioral traits in the laboratory mouse and demonstrate that the CC and DO mouse populations can be used to discover mechanisms underlying genetic relationships among sign-tracking and addiction-related behaviors.

Harmonic and frequency modulated ultrasonic vocalizations reveal differences in conditioned and unconditioned reward processing

Novelty and sensation seeking (NSS) and ultrasonic vocalizations (USVs) are both used as measures of individual differences in reward sensitivity in rodent models. High responders in the inescapable novelty screen have a greater response to low doses of amphetamine and acquire self-administration more rapidly, while the novelty place preference screen is positively correlated with compulsive drug seeking. These screens are uncorrelated and implicated in separate drug abuse models. 50 kHz USVs measure affective state in rats and are evoked by positive stimuli. NSS and USVs are each implicated in drug response, self-administration, and reveal differences in individual behavior, yet their relationship with each other is not understood. The present study screened rats for their response to novelty and measured USVs of all call types in response to heterospecific play to determine the relationships between these individual difference traits. Generally, we hypothesized that 50k Hz USVs would be positively correlated with the NPP screen, and that 22 kHz would be positively correlated with the IEN screen. Results indicate none of the screens were correlated indicating they are measuring different individual difference traits. However, examination of the subtypes of USVs indicated harmonic USVs and the novelty place preference were positively correlated. Harmonic 50 kHz USVs increased in response to reward associated context, suggesting animals conditioned to the heterospecific tickle arena and anticipated rewarding stimuli, while FM only increased in response to tickling. USV subtypes can be used to elucidate differences in attribution of incentive value across conditioned stimuli and receipt of rewarding stimuli. These data provide strong support that harmonic and FM USVs can be used to understand reward processing in addition to NSS.

Association of novelty-related behaviors and intravenous cocaine self-administration in Diversity Outbred mice

RATIONALE

The preference for and reaction to novelty are strongly associated with addiction to cocaine and other drugs. However, the genetic variants and molecular mechanisms underlying these phenomena remain largely unknown. Although the relationship between novelty- and addiction-related traits has been observed in rats, studies in mice have failed to demonstrate this association. New, genetically diverse, high-precision mouse populations including Diversity Outbred (DO) mice provide an opportunity to assess an expanded range of behavioral variation enabling detection of associations of novelty- and addiction-related traits in mice.

METHODS

To examine the relationship between novelty- and addiction-related traits, male (n = 51) and female (n = 47) DO mice were tested on open field exploration, hole board exploration, and novelty preference followed by intravenous cocaine self-administration (IVSA; ten 2-h sessions of fixed ratio 1 and one 6-h session of progressive ratio).

RESULTS

We observed high variation of cocaine IVSA in DO mice with 43 % reaching and 57 % not reaching conventional acquisition criteria. As a group, mice that did not reach these criteria still demonstrated significant lever discrimination. Mice experiencing catheter occlusion or other technical issues (n = 17) were excluded from the analysis. Novelty-related behaviors were positively associated with cocaine IVSA. Multivariate analysis of associations among novelty- and addiction-related traits revealed a large degree of shared variance (45 %).

CONCLUSIONS

Covariation among cocaine IVSA and novelty-related phenotypes in DO mice indicates that this relationship is amenable to genetic dissection. The high genetic precision and phenotypic diversity in the DO may facilitate discovery of previously undetectable mechanisms underlying predisposition to develop addiction disorders.

Isolating the incentive salience of reward-associated stimuli: value, choice, and persistence

Sign- and goal-tracking are differentially associated with drug abuse-related behavior. Recently, it has been hypothesized that sign- and goal-tracking behavior are mediated by different neurobehavioral valuation systems, including differential incentive salience attribution. Herein, we used different conditioned stimuli to preferentially elicit different response types to study the different incentive valuation characteristics of stimuli associated with sign- and goal-tracking within individuals. The results demonstrate that all stimuli used were equally effective conditioned stimuli; however, only a lever stimulus associated with sign-tracking behavior served as a robust conditioned reinforcer and was preferred over a tone associated with goal-tracking. Moreover, the incentive value attributed to the lever stimulus was capable of promoting suboptimal choice, leading to a significant reduction in reinforcers (food) earned. Furthermore, sign-tracking to a lever was more persistent than goal-tracking to a tone under omission and extinction contingencies. Finally, a conditional discrimination procedure demonstrated that sign-tracking to a lever and goal-tracking to a tone were dependent on learned stimulus–reinforcer relations. Collectively, these results suggest that the different neurobehavioral valuation processes proposed to govern sign- and goal-tracking behavior are independent but parallel processes within individuals. Examining these systems within individuals will provide a better understanding of how one system comes to dominate stimulus–reward learning, thus leading to the differential role these systems play in abuse-related behavior.