Individual differences in pavlovian autoshaping of lever pressing in rats predict stress-induced corticosterone release and mesolimbic levels of monoamines

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues

The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Male Goal-Tracker and Sign-Tracker Rats Do Not Differ in Neuroendocrine or Behavioral Measures of Stress Reactivity

Environmental cues attain the ability to guide behavior via learned associations. As predictors, cues can elicit adaptive behavior and lead to valuable resources (e.g., food). For some individuals, however, cues are transformed into incentive stimuli and elicit motivational states that can be maladaptive. The goal-tracker (GT)/sign-tracker (ST) animal model captures individual differences in cue-motivated behaviors, with reward-associated cues serving as predictors of reward for both phenotypes but becoming incentive stimuli to a greater degree for STs. While these distinct phenotypes are characterized based on Pavlovian conditioned approach (PavCA) behavior, they exhibit differences on a number of behaviors relevant to psychopathology. To further characterize the neurobehavioral endophenotype associated with individual differences in cue-reward learning, neuroendocrine and behavioral profiles associated with stress and anxiety were investigated in male GT, ST, and intermediate responder (IR) rats. It was revealed that baseline corticosterone (CORT) increases with Pavlovian learning, but to the same degree, regardless of phenotype. No significant differences in behavior were observed between GTs and STs during an elevated plus maze (EPM) or open field test (OFT), nor were there differences in CORT response to the OFT or physiological restraint. Upon examination of central markers associated with stress reactivity, we found that STs have greater glucocorticoid receptor (GR) mRNA expression in the ventral hippocampus, with no phenotypic differences in the dorsal hippocampus or prelimbic cortex (PrL). These findings demonstrate that GTs and STs do not differ on stress-related and anxiety-related behaviors, and suggest that differences in neuroendocrine measures between these phenotypes can be attributed to distinct cue-reward learning styles.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Dopamine modulates individual differences in avoidance behavior: A pharmacological, immunohistochemical, neurochemical and volumetric investigation

Avoidance behavior is a hallmark in pathological anxiety disorders and results in impairment of daily activities. Individual differences in avoidance responses are critical in determining vulnerability or resistance to anxiety disorders. Dopaminergic activation is implicated in the processing of avoidance responses; however, the mechanisms underlying these responses are unknown. In this sense, we used a preclinical model of avoidance behavior to investigate the possibility of an intrinsic differential dopaminergic pattern between good and poor performers. The specific goal was to assess the participation of dopamine (DA) through pharmacological manipulation, and we further evaluated the effects of systemic injections of the dopaminergic receptor type 1 (D1 antagonist - SCH23390) and dopaminergic receptor type 2 (D2 antagonist - sulpiride) antagonists in the good performers. Additionally, we evaluated the effects of intra-amygdala microinjection of a D1 antagonist (SCH23390) and a D2 antagonist (sulpiride) in good performers as well as intra-amygdala microinjection of a D1 agonist (SKF38393) and D2 agonist (quinpirole) in poor performers. Furthermore, we quantified the contents of dopamine and metabolites (3,4-dihydroxyphenylacetic acid (DOPAC) and homovanillic acid (HVA)) in the amygdala, evaluated the basal levels of tyrosine hydroxylase expression (catecholamine synthesis enzyme) and measured the volume of the substantia nigra, ventral tegmental area and locus coeruleus. Our results showed that it could be possible to convert animals from good to poor performers, and vice versa, by intra-amygdala (basolateral and central nucleus) injections of D1 receptor antagonists in good performers or D2 receptor agonists in poor performers. Additionally, the good performers had lower levels of DOPAC and HVA in the amygdala, an increase in the total volume of the amygdala (AMG), substantia nigra (SN), ventral tegmental area (VTA) and locus coeruleus (LC), and an increase in the number of tyrosine hydroxylase-positive cells in SN, VTA and LC, which positively correlates with the avoidance behavior. Taken together, our data show evidence for a dopaminergic signature of avoidance performers, emphasizing the role of distinct dopaminergic receptors in individual differences in avoidance behavior based on pharmacological, immunohistochemical, neurochemical and volumetric analyses. Our findings provide a better understanding of the role of the dopaminergic system in the execution of avoidance behavior.

•

The role of dopamine in individual differences in avoidance behavior.

•

Dopamine modulates avoidance behavior.

•

Dopaminergic evidence of individual difference in avoidance behavior.

•

Good and poor avoiders distinction based on dopaminergic signature.

•

Dopaminergic signature of avoidance performers: poor versus good avoiders.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

Sensitivity to Morphine Reward Associates With Gut Dysbiosis in Rats With Morphine-Induced Conditioned Place Preference

Gut microbiota has been found to establish a bidirectional relationship with the central nervous system. Variations of the gut microbiota has been implicated in various mental disorders, including opioid use disorders. Morphine exposure has been repeatedly found to disrupt the gut microbiota, but association between the gut microbiota and the sensitivity to morphine reward remains unknown. In this study the conditioned place preference (CPP) paradigm was used for morphine-treated rats and saline-treated rats. After the CPP procedure, the morphine-treated rats were divided equally into the low and high CPP (L- and H-CPP) groups according to the CPP scores. We adopted 16S rRNA sequencing for the fecal bacterial communities at baseline and post-conditioning. By comparing the morphine-treated group with saline-treated group, we found alterations of microbial composition in the morphine-treated group, but no significant differences in alpha diversity. The L-CPP group and H-CPP group differed in microbial composition both before and after morphine treatment. The relative abundance of certain taxa was correlated to the CPP scores, such as Alloprevotella and Romboutsia. This study provides direct evidence that morphine exposure alters the composition of the gut microbiota in rats and that microbial alterations are correlated to the sensitivity to morphine reward. These findings may help develop novel therapeutic and preventive strategies for opioid use disorder.

Drug-Induced Glucocorticoids and Memory for Substance Use

The biological stress response of the body forms one of the foundations of adaptive behavior, including promoting (and impairing) different forms of memory. This response transcends stressful experiences and underlies reactions to challenges and even reinforcers such as addictive substances. Nevertheless, drug-induced stress responses are rarely incorporated into models of addiction. We propose here that drug-induced stress responses (particularly glucocorticoids) play a crucial role in addictive behavior by modulating the formation of memories for substance-use experiences. We review the contributions of amygdala-, striatum-, and hippocampus-based memory systems to addiction, and reveal common effects of addictive drugs and acute stress on these different memories. We suggest that the contributions of drug-induced stress responses to memory may provide insights into the mechanisms driving addictive behavior.

A glucocorticoid receptor antagonist reduces sign-tracking behavior in male Japanese quail

Addiction is characterized as a chronic debilitating disease. One devastating feature of addiction is the susceptibility of relapse (40-60%) after stretches of abstinence. One theory that may account for relapse suggests that drug cues (e.g., paraphernalia) may increase stress hormones, and this may prompt relapse. Repeatedly pairing a neutral cue with a reward is commonly utilized to measure what subjects learn about a cue that is predictive of reward. Research has shown that animals that attend to a cue more than to the reward (sign trackers) may be more vulnerable to drug addiction. Additionally, research has shown that sign tracking is associated with an increase in corticosterone, a primary stress hormone. PT150 is a novel glucocorticoid receptor antagonist that moderates the release of corticosterone. In the current experiment, it was hypothesized that subjects given repeated administration of PT150 would reduce sign tracking compared to subjects given placebo. Time spent (in seconds) near a cue that predicts reward (conditional stimulus) served as a measure of sign tracking, and PT150 or placebo was administered following sign tracking. An independent-samples t test revealed that subjects that received PT150 had reduced time spent near the conditioned stimulus compared to controls. Given the devastating effects of drug addiction, identification of a potential pharmacological intervention in the reduction of relapse would be of great value. Therefore, future research is needed to validate the use of PT150 in reducing behaviors associated with drug addiction. (PsycINFO Database Record

Beyond Cue Reactivity: Non-Drug-Related Motivationally Relevant Stimuli Are Necessary to Understand Reactivity to Drug-Related Cues

Neurobiological models of addiction posit that drug use can alter reward processes in two ways: (1) by increasing the motivational relevance of drugs and drug-related cues and (2) by reducing the motivational relevance of non-drug-related rewards. Here, we discuss the results from a series of neuroimaging studies in which we assessed the extent to which these hypotheses apply to nicotine dependence. In these studies, we recorded smokers’ and nonsmokers’ brain responses to a wide array of motivationally relevant visual stimuli that included pleasant, unpleasant, cigarette-related, and neutral images. Based on these findings, we highlight the flaws of the traditional cue reactivity paradigm and we conclude that responses to non-drug-related motivationally relevant stimuli should be used to appropriately gauge the motivational relevance of cigarette-related cues and to identify smokers attributing higher motivational relevance to drug-related cues than to non-drug-related rewards. Identifying these individuals is clinically relevant as they achieve lower rates of long-term smoking abstinence when attempting to quit. Finally, we show how this approach may be extended beyond nicotine dependence to inform theoretical and clinical research in the study of obesity.

Implications

The cue reactivity paradigm (ie, comparing responses evoked by drug-related cues to those evoked by neutral cues) cannot provide conclusive information about the motivational relevance of drug-related cues. Responses to non-drug-related motivationally relevant stimuli should be used to appropriately gauge the level of motivational relevance that substance-dependent individuals attribute to drug-related cues.

Individual differences in food cue responsivity are associated with acute and repeated cocaine-induced vocalizations, but not cue-induced vocalizations

RATIONALE

Individuals prone to attribute incentive salience to food-associated stimuli ("cues") are also more sensitive to cues during drug seeking and drug taking. This may be due in part to a difference in sensitivity to the affective or other stimulus properties of the drug. In rats, these properties are associated with 50-kHz ultrasonic vocalizations (USVs), in that they are elicited during putative positive affective and motivational states, including in response to drugs of abuse.

OBJECTIVES

We sought to determine whether individual differences in the tendency to attribute incentive salience to a food cue (as measured by approach) were associated with differences in cocaine-induced USVs. We also tested whether the food cue would elicit USVs and if this response was related to approach to the food cue.

METHODS

In experiment 1, rats underwent Pavlovian conditioned approach (PavCA) training where they learned to associate a cue (an illuminated lever) with the delivery of a food pellet into a food cup. Subjects were categorized based on their approach to the cue ("sign-trackers") or to the food cup ("goal-trackers"). Rats subsequently underwent nine testing days in which they were given saline or cocaine (10 mg/kg i.p) and placed into a locomotor chamber. In experiment 2, rats were first tested in the locomotor chambers for one saline-treated day followed by one cocaine-treated day and then trained in PavCA. USVs were recorded from a subset of individuals during the last day of PavCA to determine if the food cue would elicit USVs.

RESULTS

Sign-trackers produced 5-24 times more cocaine-induced 50 kHz USVs compared to goal-trackers for all days of experiment 1, and this response sensitized with repeated cocaine, only in sign-trackers. Similarly in experiment 2, individuals that produced the most cocaine-induced USVs on a single exposure also showed the greatest tendency to sign-track during PavCA. Lastly, while sign-trackers produced more USVs during PavCA generally, the cue itself did not elicit additional USVs in sign- or goal-trackers.

CONCLUSIONS

These results indicate a robust and consistent relationship between approach to a food cue and cocaine-induced USV production. Thus, these USVs may index the neurobiological differences underlying the behavioral distinctions of sign- and goal-trackers.

Individual differences in voluntary alcohol intake in rats: relationship with impulsivity, decision making and Pavlovian conditioned approach

RATIONALE

Alcohol use disorder (AUD) has been associated with suboptimal decision making, exaggerated impulsivity, and aberrant responses to reward-paired cues, but the relationship between AUD and these behaviors is incompletely understood.

OBJECTIVES

This study aims to assess decision making, impulsivity, and Pavlovian-conditioned approach in rats that voluntarily consume low (LD) or high (HD) amounts of alcohol.

METHODS

LD and HD were tested in the rat gambling task (rGT) or the delayed reward task (DRT). Next, the effect of alcohol (0-1.0 g/kg) was tested in these tasks. Pavlovian-conditioned approach (PCA) was assessed both prior to and after intermittent alcohol access (IAA). Principal component analyses were performed to identify relationships between the most important behavioral parameters.

RESULTS

HD showed more optimal decision making in the rGT. In the DRT, HD transiently showed reduced impulsive choice. In both LD and HD, alcohol treatment increased optimal decision making in the rGT and increased impulsive choice in the DRT. PCA prior to and after IAA was comparable for LD and HD. When PCA was tested after IAA only, HD showed a more sign-tracking behavior. The principal component analyses indicated dimensional relationships between alcohol intake, impulsivity, and sign-tracking behavior in the PCA task after IAA.

CONCLUSIONS

HD showed a more efficient performance in the rGT and DRT. Moreover, alcohol consumption enhanced approach behavior to reward-predictive cues, but sign-tracking did not predict the level of alcohol consumption. Taken together, these findings suggest that high levels of voluntary alcohol intake are associated with enhanced cue- and reward-driven behavior.

Individual Differences in the Attribution of Incentive Salience to a Pavlovian Alcohol Cue

Individual differences exist in the attribution of incentive salience to conditioned stimuli associated with food. Here, we investigated whether individual differences also manifested with a Pavlovian alcohol conditioned stimulus (CS). We compiled data from five experiments that used a Pavlovian autoshaping paradigm and tests of conditioned reinforcement. In all experiments, male, Long-Evans rats with unrestricted access to food and water were acclimated to 15% ethanol. Next, rats received Pavlovian autoshaping training, in which a 10 s presentation of a retractable lever served as the CS and 0.2 mL of 15% ethanol served as the unconditioned stimulus (US). Finally, rats underwent conditioned reinforcement tests in which nose-pokes to an active aperture led to brief presentations of the lever-CS, but nose-pokes to an inactive aperture had no consequence. Rats were categorized as sign-trackers, goal-trackers and intermediates based on a response bias score that reflected their tendencies to sign-track or goal-track at different times during training. We found that distinct groups of rats either consistently interacted with the lever-CS (“sign-trackers”) or routinely approached the port during the lever-CS (“goal-trackers”) across a majority of the training sessions. However, some individuals (“shifted sign-trackers”) with an early tendency to goal-track later shifted to comparable asymptotic levels of sign-tracking as the group identified as sign-trackers. The lever-CS functioned as a conditioned reinforcer for sign-trackers and shifted sign-trackers, but not for goal-trackers. These results provide evidence of robust individual differences in the extent to which a Pavlovian alcohol cue gains incentive salience and functions as a conditioned reinforcer.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Sign Tracking, but Not Goal Tracking, is Resistant to Outcome Devaluation

During Pavlovian conditioning, a conditioned stimulus (CS) may act as a predictor of a reward to be delivered in another location. Individuals vary widely in their propensity to engage with the CS (sign tracking) or with the site of eventual reward (goal tracking). It is often assumed that sign tracking involves the association of the CS with the motivational value of the reward, resulting in the CS acquiring incentive value independent of the outcome. However, experimental evidence for this assumption is lacking. In order to test the hypothesis that sign tracking behavior does not rely on a neural representation of the outcome, we employed a reward devaluation procedure. We trained rats on a classic Pavlovian paradigm in which a lever CS was paired with a sucrose reward, then devalued the reward by pairing sucrose with illness in the absence of the CS. We found that sign tracking behavior was enhanced, rather than diminished, following reward devaluation; thus, sign tracking is clearly independent of a representation of the outcome. In contrast, goal tracking behavior was decreased by reward devaluation. Furthermore, when we divided rats into those with high propensity to engage with the lever (sign trackers) and low propensity to engage with the lever (goal trackers), we found that nearly all of the effects of devaluation could be attributed to the goal trackers. These results show that sign tracking and goal tracking behavior may be the output of different associative structures in the brain, providing insight into the mechanisms by which reward-associated stimuli—such as drug cues—come to exert control over behavior in some individuals.

Rats that sign-track are resistant to Pavlovian but not instrumental extinction

Individuals vary in the extent to which they attribute incentive salience to a discrete cue (conditioned stimulus; CS) that predicts reward delivery (unconditioned stimulus; US), which results in some individuals approaching and interacting with the CS (sign-trackers; STs) more than others (goal-trackers; GTs). Here we asked how periods of non-reinforcement influence conditioned responding in STs vs. GTs, in both Pavlovian and instrumental tasks. After classifying rats as STs or GTs by pairing a retractable lever (the CS) with the delivery of a food pellet (US), we introduced periods of non-reinforcement, first by simply withholding the US (i.e., extinction training; experiment 1), then by signaling alternating periods of reward (R) and non-reward (NR) within the same session (experiments 2 and 3). We also examined how alternating R and NR periods influenced instrumental responding for food (experiment 4). STs and GTs did not differ in their ability to discriminate between R and NR periods in the instrumental task. However, in Pavlovian settings STs and GTs responded to periods of non-reward very differently. Relative to STs, GTs very rapidly modified their behavior in response to periods of non-reward, showing much faster extinction and better and faster discrimination between R and NR conditions. These results highlight differences between Pavlovian and instrumental extinction learning, and suggest that if a Pavlovian CS is strongly attributed with incentive salience, as in STs, it may continue to bias attention toward it, and to facilitate persistent and relatively inflexible responding, even when it is no longer followed by reward.

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction.

Skewed by Cues? The Motivational Role of Audiovisual Stimuli in Modelling Substance Use and Gambling Disorders

The similarity between gambling disorder (GD) and drug addiction has recently been recognized at the diagnostic level. Understanding the core cognitive processes involved in these addiction disorders, and in turn their neurobiological mechanisms, remains a research priority due to the enormous benefits such knowledge would have in enabling effective treatment design. Animal models can be highly informative in this regard. Although numerous rodent behavioural paradigms that capture different facets of gambling-like behaviour have recently been developed, the motivational power of cues in biasing individuals towards risky choice has so far received little attention despite the central role played by drug-paired cues in successful laboratory models of chemical dependency. Here, we review some of the comparatively simple paradigms in which reward-paired cues are known to modulate behaviour in rodents, such as sign-tracking, Pavlovian-to-instrumental transfer and conditioned reinforcement. Such processes are thought to play an important role in mediating responding for drug reward, and the need for future studies to address whether similar processes contribute to cue-driven risky choice is highlighted.

Sign-tracking predicts increased choice of cocaine over food in rats

The purpose of this study was to determine whether the tendency to sign-track to a food cue was predictive of rats' choice of cocaine over food. First, rats were trained on a procedure where insertion of a retractable lever was paired with food. A sub-group of rats - sign-trackers - primarily approached and contacted the lever, while another sub-group - goal-trackers - approached the site of food delivery. Rats were then trained on a choice task where they could choose between an infusion of cocaine (1.0 mg/kg) and a food pellet (45 mg). Sign-trackers chose cocaine over food significantly more often than did goal-trackers. These results support the incentive-salience theory of addiction and add to a growing number of studies which suggest that sign-trackers may model an addiction-prone phenotype.

Dual reward prediction components yield Pavlovian sign- and goal-tracking

Reinforcement learning (RL) has become a dominant paradigm for understanding animal behaviors and neural correlates of decision-making, in part because of its ability to explain Pavlovian conditioned behaviors and the role of midbrain dopamine activity as reward prediction error (RPE). However, recent experimental findings indicate that dopamine activity, contrary to the RL hypothesis, may not signal RPE and differs based on the type of Pavlovian response (e.g. sign- and goal-tracking responses). In this study, we address this discrepancy by introducing a new neural correlate for learning reward predictions; the correlate is called "cue-evoked reward". It refers to a recall of reward evoked by the cue that is learned through simple cue-reward associations. We introduce a temporal difference learning model, in which neural correlates of the cue itself and cue-evoked reward underlie learning of reward predictions. The animal's reward prediction supported by these two correlates is divided into sign and goal components respectively. We relate the sign and goal components to approach responses towards the cue (i.e. sign-tracking) and the food-tray (i.e. goal-tracking) respectively. We found a number of correspondences between simulated models and the experimental findings (i.e. behavior and neural responses). First, the development of modeled responses is consistent with those observed in the experimental task. Second, the model's RPEs were similar to dopamine activity in respective response groups. Finally, goal-tracking, but not sign-tracking, responses rapidly emerged when RPE was restored in the simulated models, similar to experiments with recovery from dopamine-antagonist. These results suggest two complementary neural correlates, corresponding to the cue and its evoked reward, form the basis for learning reward predictions in the sign- and goal-tracking rats.

Inhibitory effect of NMDA receptors in the ventral tegmental area on hormonal and eating behavior responses to stress in rats

BACKGROUND

Stress and its consequences are among the causes of accidents.

OBJECTIVE

The effects of intraventral tegmental area (I-VTA) memantine on the plasma corticosterone and eating parameters disturbance induced by acute stress were investigated.

METHODS

Male Wistar rats (W: 250-300 g) were divided into control and experiential groups, each of which received memantine either intra-VTA or peripherally. One week after bilateral cannulation, the rats received memantine (1 and 5 μg/Rat) five min before electroshock stress. The other experimental groups received memantine (1 and 5 mg/kg) intraperitoneally 30 min before stress. The control groups received saline or memantine but did not experience stress. Food and water intake and plasma corticosterone level were recorded.

RESULTS

Results showed that stress decreases food intake but does not change water intake and increase in plasma corticosterone level. Intraperitoneal memantine administration slightly inhibits the stress effects on food intake. However, water intake and plasma corticosterone level were increased. Intra-VTA memantine reduces the effects of stress on corticosterone and water intake.

CONCLUSION

It could be concluded that inhibition of glutamate NMDA receptors in the VTA by memantine leads to the inhibition of the eating behavior parameters and plasma corticosterone level disturbance induced by stress in rats.

Prequit fMRI responses to pleasant cues and cigarette-related cues predict smoking cessation outcome

INTRODUCTION

The reasons that some smokers find it harder to quit than others are unclear. Understanding how individual differences predict smoking cessation outcomes may allow the development of more successful personalized treatments for nicotine dependence. Theoretical models suggest that drug users might be characterized by increased sensitivity to drug cues and by reduced sensitivity to nondrug-related natural rewards. We hypothesized that baseline differences in brain sensitivity to natural rewards and cigarette-related cues would predict the outcome of a smoking cessation attempt.

METHODS

Using functional magnetic resonance imaging, we recorded prequit brain responses to neutral, emotional (pleasant and unpleasant), and cigarette-related cues from 55 smokers interested in quitting. We then assessed smoking abstinence, mood, and nicotine withdrawal symptoms during the course of a smoking cessation attempt.

RESULTS

Using cluster analysis, we identified 2 groups of smokers who differed in their baseline responses to pleasant cues and cigarette-related cues in the posterior visual association areas, the dorsal striatum, and the medial and dorsolateral prefrontal cortex. Smokers who showed lower prequit levels of brain reactivity to pleasant stimuli than to cigarette-related cues were less likely to be abstinent 6 months after their quit attempt, and they had higher levels of negative affect during the course of the quit attempt.

CONCLUSIONS

Smokers with blunted brain responses to pleasant stimuli, relative to cigarette-related stimuli, had more difficulty quitting smoking. For these individuals, the lack of alternative forms of reinforcement when nicotine deprived might be an important factor underlying relapse. Normalizing these pathological neuroadaptations may help them achieve abstinence.

Updating appetitive memory during reconsolidation window: critical role of cue-directed behavior and amygdala central nucleus

When presented with a light cue followed by food, some rats simply approach the foodcup (Nonorienters), while others first orient to the light in addition to displaying the food-cup approach behavior (Orienters). Cue-directed orienting may reflect enhanced attentional and/or emotional processing of the cue, suggesting divergent natures of cue-information processing in Orienters and Nonorienters. The current studies investigate how differences in cue processing might manifest in appetitive memory retrieval and updating using a paradigm developed to persistently attenuate fear responses (Retrieval-extinction paradigm; Monfils et al., 2009). First, we examined whether the retrieval-extinction paradigm could attenuate appetitive responses in Orienters and Nonorienters. Next, we investigated if the appetitive memory could be updated using reversal learning (fear conditioning) during the reconsolidation window (as opposed to repeated unreinforced trials, i.e., extinction). Both extinction and new fear learning given within the reconsolidation window were effective at persistently updating the initial appetitive memory in the Orienters, but not the Nonorienters. Since conditioned orienting is mediated by the amygdala central nucleus (CeA), our final experiment examined the CeA's role in the retrieval-extinction process. Bilateral CeA lesions interfered with the retrieval-extinction paradigm-did not prevent spontaneous recovery of food-cup approach. Together, our studies demonstrate the critical role of conditioned orienting behavior and the CeA in updating appetitive memory during the reconsolidation window.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Environmental manipulations alter age differences in attribution of incentive salience to reward-paired cues

Cues repeatedly paired with rewards often themselves become imbued with enhanced motivational value, or incentive salience. During Pavlovian conditioned approach procedures, a cue repeatedly preceding reward delivery often elicits conditioned responses at either the reward delivery location ("goal-tracking") or the cue itself ("sign-tracking"). Sign-tracking behavior is thought to reflect the individual differences in attribution of incentive salience to reward-paired cues that may contribute to addiction vulnerability. Adolescent rats typically demonstrate less sign-tracking behavior than adult rats, a surprising finding given that adolescence is hypothesized to be a time of heightened addiction vulnerability. Given evidence that adult sign-tracking behavior can be influenced by environmental conditions, the present study compared the effects of isolate housing and food deprivation on expression of sign-tacking and goal-tracking behavior in adolescent and adult male rats across eight days of a Pavlovian conditioned approach procedure. Pair-housed adults exhibited more sign-tracking behavior than pair-housed adolescents; however, this age difference was not apparent in isolate-housed subjects. Adolescents often appeared more sensitive than adults to both food restriction- and isolate housing-induced changes in behavior, with food restriction promoting an increase in sign-tracking among isolate-housed adolescents and an increase in goal-tracking among pair-housed adolescents. For adults, food restriction resulted in a modest increase in overall expression of both sign- and goal-tracking behavior. To the extent that sign-tracking behavior reflects attribution of incentive salience to reward-paired cues, results from the present study provide evidence that reactivity to rewards during adolescence is strongly related to the nature of the surrounding environment.

On the motivational properties of reward cues: Individual differences

Cues associated with rewards, such as food or drugs of abuse, can themselves acquire motivational properties. Acting as incentive stimuli, such cues can exert powerful control over motivated behavior, and in the case of cues associated with drugs, they can goad continued drug-seeking behavior and relapse. However, recent studies reviewed here suggest that there are large individual differences in the extent to which food and drug cues are attributed with incentive salience. Rats prone to approach reward cues (sign-trackers) attribute greater motivational value to discrete localizable cues and interoceptive cues than do rats less prone to approach reward cues (goal-trackers). In contrast, contextual cues appear to exert greater control over motivated behavior in goal-trackers than sign-trackers. It is possible to predict, therefore, before any experience with drugs, in which animals specific classes of drug cues will most likely reinstate drug-seeking behavior. The finding that different individuals may be sensitive to different triggers capable of motivating behavior and producing relapse suggests there may be different pathways to addiction, and has implications for thinking about individualized treatment. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue

RATIONALE

Cues associated with rewards bias attention towards them and can motivate drug-seeking and drug-taking behavior. There is, however, considerable individual variation in the extent to which cues associated with rewards acquire motivational properties. For example, only in some rats does a localizable food cue become attractive, eliciting approach towards it, and "wanted", in the sense that it serves as an effective conditioned reinforcer.

OBJECTIVES

We asked whether the propensity of animals to attribute incentive salience to a food cue predicts the extent to which a classically conditioned cocaine cue acquires incentive motivational properties.

METHODS

First, a Pavlovian conditioned approach procedure was used to identify rats prone to attribute incentive salience to a food cue. We then measured the extent to which a classically conditioned cocaine cue acquired two properties of an incentive stimulus: (1) the ability to elicit approach towards it, and (2) the ability to reinstate drug-seeking behavior, using an extinction-reinstatement procedure (i.e., to act as a conditioned reinforcer).

RESULTS

We found that a classically conditioned cocaine cue became more attractive, in that it elicited greater approach toward it, and more desired, in that it supported more drug-seeking behavior under extinction conditions, in individuals prone to attribute incentive salience to a food cue.

CONCLUSIONS

We conclude that rats vary in their propensity to attribute incentive salience to both food and cocaine cues, and it is possible to predict, prior to any drug experience, in which rats a cocaine cue will acquire the strongest motivational control over behavior.

Ventral striatal dopamine synthesis capacity predicts financial extravagance in Parkinson's disease

Impulse control disorders (ICDs), including disordered gambling, can occur in a significant number of patients with Parkinson’s disease (PD) receiving dopaminergic therapy. The neurobiology underlying susceptibility to such problems is unclear, but risk likely results from an interaction between dopaminergic medication and a pre-existing trait vulnerability. Impulse control and addictive disorders form part of a broader psychopathological spectrum of disorders, which share a common underlying genetic vulnerability, referred to as externalizing. The broad externalizing risk factor is a continuously varying trait reflecting vulnerability to various impulse control problems, manifested at the overt level by disinhibitory symptoms and at the personality level by antecedent traits such as impulsivity and novelty/sensation seeking. Trait “disinhibition” is thus a core endophenotype of ICDs, and a key target for neurobiological investigation. The ventral striatal dopamine system has been hypothesized to underlie individual variation in behavioral disinhibition. Here, we examined whether individual differences in ventral striatal dopamine synthesis capacity predicted individual variation in disinhibitory temperament traits in individuals with PD. Eighteen early-stage male PD patients underwent 6-[¹⁸F]Fluoro-l-DOPA (FDOPA) positron emission tomography scanning to measure striatal dopamine synthesis capacity, and completed a measure of disinhibited personality. Consistent with our predictions, we found that levels of ventral, but not dorsal, striatal dopamine synthesis capacity predicted disinhibited personality, particularly a propensity for financial extravagance. Our results are consistent with recent preclinical models of vulnerability to behavioral disinhibition and addiction proneness, and provide novel insights into the neurobiology of potential vulnerability to impulse control problems in PD and other disorders.

Reward uncertainty enhances incentive salience attribution as sign-tracking

Conditioned stimuli (CSs) come to act as motivational magnets following repeated association with unconditioned stimuli (UCSs) such as sucrose rewards. By traditional views, the more reliably predictive a Pavlovian CS-UCS association, the more the CS becomes attractive. However, in some cases, less predictability might equal more motivation. Here we examined the effect of introducing uncertainty in CS-UCS association on CS strength as an attractive motivation magnet. In the present study, Experiment 1 assessed the effects of Pavlovian predictability versus uncertainty about reward probability and/or reward magnitude on the acquisition and expression of sign-tracking (ST) and goal-tracking (GT) responses in an autoshaping procedure. Results suggested that uncertainty produced strongest incentive salience expressed as sign-tracking. Experiment 2 examined whether a within-individual temporal shift from certainty to uncertainty conditions could produce a stronger CS motivational magnet when uncertainty began, and found that sign-tracking still increased after the shift. Overall, our results support earlier reports that ST responses become more pronounced in the presence of uncertainty regarding CS-UCS associations, especially when uncertainty combines both probability and magnitude. These results suggest that Pavlovian uncertainty, although diluting predictability, is still able to enhance the incentive motivational power of particular CSs.

Quantifying individual variation in the propensity to attribute incentive salience to reward cues

If reward-associated cues acquire the properties of incentive stimuli they can come to powerfully control behavior, and potentially promote maladaptive behavior. Pavlovian incentive stimuli are defined as stimuli that have three fundamental properties: they are attractive, they are themselves desired, and they can spur instrumental actions. We have found, however, that there is considerable individual variation in the extent to which animals attribute Pavlovian incentive motivational properties ("incentive salience") to reward cues. The purpose of this paper was to develop criteria for identifying and classifying individuals based on their propensity to attribute incentive salience to reward cues. To do this, we conducted a meta-analysis of a large sample of rats (N = 1,878) subjected to a classic Pavlovian conditioning procedure. We then used the propensity of animals to approach a cue predictive of reward (one index of the extent to which the cue was attributed with incentive salience), to characterize two behavioral phenotypes in this population: animals that approached the cue ("sign-trackers") vs. others that approached the location of reward delivery ("goal-trackers"). This variation in Pavlovian approach behavior predicted other behavioral indices of the propensity to attribute incentive salience to reward cues. Thus, the procedures reported here should be useful for making comparisons across studies and for assessing individual variation in incentive salience attribution in small samples of the population, or even for classifying single animals.

Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing

Initially-neutral cues paired with rewards are thought to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues may serve as secondary reinforcers to establish new learning, modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the ventral striatal nucleus accumbens (ACb) and the basolateral amygdala (BLA) on the acquisition of discriminative autoshaped lever-pressing in rats. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose was delivered independently of the rats' behavior, sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Bilateral ACb lesions impaired the initial acquisition of sign-tracking but not its terminal levels. In contrast, BLA lesions produced substantial deficits in terminal levels of sign-tracking. Furthermore, whereas ACb lesions primarily affected the probability of lever press responses, BLA lesions mostly affected the rate of responding once it occurred. Finally, disconnection lesions that disrupted communication between ACb and BLA produced both sets of deficits. We suggest that ACb is important for initial acquisition of consummatory-like responses that incorporate hedonic aspects of the reward, while BLA serves to enhance such incentive salience once it is acquired.

Fish welfare and genomics

There is a considerable public and scientific debate concerning welfare of fish in aquaculture. In this review, we will consider fish welfare as an integration of physiological, behavioral, and cognitive/emotional responses, all of which are essentially adaptative responses to stressful situations. An overview of fish welfare in this context suggests that understanding will rely on knowledge of all components of allostatic responses to stress and environmental perturbations. The development of genomic technologies provides new approaches to this task, exemplified by how genome-wide analysis of genetic structures and corresponding expression patterns can lead to the discovery of new aspects of adaptative responses. We will illustrate how the genomic approach may give rise to new biomarkers for fish welfare and also increase our understanding of the interaction between physiological, behavioral, and emotional responses. In a first part, we present data on expression of candidate genes selected a priori. This is a common avenue to develop molecular biomarkers capable of diagnosing a stress condition at its earliest onset, in order to allow quick corrective intervention in an aquaculture setting. However, most of these studies address isolated physiological functions and stress responses that may not be truly indicative of animal welfare, and there is only rudimentary understanding of genes related to possible cognitive and emotional responses in fish. We also present an overview on transcriptomic analysis related to the effect of aquaculture stressors, environmental changes (temperature, salinity, hypoxia), or concerning specific behavioral patterns. These studies illustrate the potential of genomic approaches to characterize the complexity of the molecular mechanisms which underlies not only physiological but also behavioral responses in relation to fish welfare. Thirdly, we address proteomic studies on biological responses to stressors such as salinity change and hypoxia. We will also consider proteomic studies developed in mammals in relation to anxiety and depressive status which may lead to new potential candidates in fish. Finally, in the conclusion, we will suggest new developments to facilitate an integrated view of fish welfare. This includes use of laser microdissection in the transcriptomic/proteomic studies, development of meta-analysis methods for extracting information from genomic data sets, and implementation of technological advances for high-throughput proteomic studies. Development of these new approaches should be as productive for our understanding of the biological processes underlying fish welfare as it has been for the progress of pathophysiological research.

Chronic administration of tibolone modulates anxiety-like behavior and enhances cognitive performance in ovariectomized rats

Hormone replacement therapy (HRT) may be prescribed to prevent the symptoms of menopause. This therapy may include estrogenic and/or progestin components and may increase the incidence of endometrial and breast cancers. Tibolone (TIB), which is also made up of estrogen and progestin components, is often used to reduce the impact of HRT. However, the effect of TIB on the processes of learning, memory and anxiety has yet to be fully elucidated. The aim of this study was to evaluate the long-term effect on learning, memory processes and anxiety in ovariectomized rats caused by different doses of TIB (0 mg/kg, 0.01 mg/kg, 0.1 mg/kg 1.0 mg/kg and 10 mg/kg, administered daily via the oral route for 18 weeks). Two behavioral animal models, the autoshaping and T maze models were employed. The concentrations of acetyl choline transferase (ChAT) and tryptophan hydroxylase (TPH) in the hippocampus were directly measured by Western blot. No significant changes were observed in the autoshaping model and spontaneous activity test. In the T maze, increased latency was observed with TIB doses of 1 and 10 mg/kg compared to the vehicle. We observed that the ChAT content decreased with increasing doses of TIB, whereas TPH content increased with doses of 1 and 10 mg/kg of TIB. These data indicate that high doses of TIB improved emotional learning, which may be related to the modulation of the cholinergic and serotonergic systems by TIB.

Pairings of lever and food induce Pavlovian conditioned approach of sign-tracking and goal-tracking in C57BL/6 mice

In rats, Pavlovian sign-tracking has been extensively evaluated as a model of compulsiveness in drug addiction and other addictive behaviors, but it remains unexplored in mice, a species with a wealth of genetically modified models, which makes it possible to examine gene-behavior relationships. In C57BL/6 mice, the most commonly used mouse strain for genetic studies, repeated pairings of lever conditioned stimulus (CS) with food unconditioned stimulus (US) induced Pavlovian conditioning of sign-tracking conditioned response (ST CR) performance of lever CS-directed approach, and Pavlovian conditioning of goal-tracking conditioned response (GT CR) performance of approach responses directed at the location of the food trough where the food US was delivered. The CS-US Paired group performed more ST CRs and more GT CRs during sessions 15-16 than did pseudoconditioning controls which received the lever CS and food US randomly with respect to one another. During sessions 15-16, all mice in the Paired group performed more GT CRs than ST CRs, and regression analysis revealed a positive relationship between an individual subject's tendency to perform ST CRs and GT CRs. The mice that performed more ST CRs during sessions 15-16 yielded higher plasma corticosterone levels. These data reveal stable and reliable acquisition and maintenance of ST CR performance and GT CR performance in mice; however, unlike in rats, ST CRs and GT CRs did not vary inversely within subjects. Corticosterone release, a pathophysiological marker of vulnerability to drug abuse, was positively related to ST CR performance.

Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue

It has been proposed that animals that attribute high levels of incentive salience to reward-related cues may be especially vulnerable to addiction. Individual variation has also been observed in the motivational value attributed to aversive cues, which may confer vulnerability to anxiety disorders such as post-traumatic stress disorder (PTSD). There may be a core behavioral trait that contributes to individual variation in the motivational value assigned to predictive cues regardless of emotional valence. To test this hypothesis, we used a Pavlovian conditioned approach procedure to classify rats based on whether they learned to approach and interact with a cue predicting food reward (sign-trackers) or learned upon cue presentation to go to the location of impending food delivery (goal-trackers), and then examined Pavlovian fear conditioning in the same animals. It has recently been proposed that sign-trackers are more vulnerable to substance abuse because they attribute greater incentive motivational value to drug cues. Here we show that sign-trackers also have a tendency to be more fearful of discrete cues that predict footshock. In addition, we found that goal-trackers exhibited greater contextual fear when placed back into the original fear-conditioning context in the absence of temporally discrete cues. These results suggest that there may be a subset of individuals who tend to attribute high levels of motivational salience to predictive cues regardless of emotional valence, which may predispose them to a number of psychiatric comorbidities including PTSD and substance abuse. Other individuals use contexts to appropriately modify their reactions to such salient stimuli.

Inadequate early social experience increases the incentive salience of reward-related cues in adulthood

The mechanisms by which childhood abuse and/or neglect become risk factors for the development of drug addiction, problem gambling, and other disorders of behavioral inhibition are unknown. The loss of behavioral inhibition is often triggered by reward-related cues that acquire incentive salience. This study examined whether inadequate early-life social experience in rats affects the incentive salience of reward-related cues. Rats were deprived of early-life social experience with the mother and litter through artificial-rearing (AR). A group of AR rats (AR+STM) received additional tactile stimulation that mimicked maternal licking, a critical component of rat maternal care. Control rats were maternally reared (MR). The incentive salience attributed to a food cue was measured in adult rats using a conditioned approach task, where a conditional stimulus (CS; lever) was paired with food delivery, and in a conditional reinforcement task. The dependent measures were approach towards the CS (sign-tracking) versus approach towards the place of food delivery (goal-tracking) and instrumental responding for the CS. AR rats made significantly more sign-tracking responses than MR rats. AR rats also made more instrumental responses when reinforced with the CS. AR+STM rats' responses were intermediate to MR and AR rats. Thus, inadequate early-life social experience enhanced the incentive salience of a reward-related cue in adulthood. Replacement of maternal licking partially reversed this effect. These results highlight a potential link between early-life social adversity and susceptibility to disorders of behavioral inhibition.

Autoshaping in adolescence enhances sign-tracking behavior in adulthood: impact on ethanol consumption

Autoshaping refers to a procedure during which a cue repeatedly paired with a reward elicits a conditioned response directed at either the reward delivery location ("goal-tracking") or the cue itself ("sign- tracking"). Individual differences in expression of sign-tracking behavior may be predictive of voluntary ethanol intake. The present study was designed to explore the development of differences in sign-tracking behavior in adolescent and adult male and female rats in an 8-day autoshaping procedure. Consistency of sign-tracking and goal-tracking across age was examined by retesting adolescents again in adulthood and comparing their adult data with animals tested only as adults to explore pre-exposure effects on adult responding. In order to assess the relationship between sign-tracking and ethanol intake, voluntary ethanol consumption was measured in an 8-day, 2-hr limited access drinking paradigm following the 8-day autoshaping procedure in adulthood. Animals tested as adolescents showed notably less sign-tracking behavior than animals tested as adults, and sign-tracking behavior was not correlated across age. Animals exposed to the autoshaping procedure as adolescents demonstrated greater sign-tracking behavior as adults when compared to control animals tested only in adulthood. When examining the relationship in adulthood between sign-tracking and ethanol intake, an increase in ethanol intake among sign-trackers was found only in animals pre-exposed to autoshaping as adolescents. Whether or not these results reflect an adolescent-specific experience effect is unclear without further work to determine whether comparable pre-exposure effects are seen if the initial autoshaping sessions are delayed into adulthood.

Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat

It has been suggested that incentive salience plays a major role in drug abuse and the development of addiction. Additionally, novelty seeking has been identified as a significant risk factor for drug abuse. However, how differences in the readiness to attribute incentive salience relate to novelty seeking and drug abuse vulnerability has not been explored. The present experiments examined how individual differences in incentive salience attribution relate to novelty seeking and acquisition of cocaine self-administration in a preclinical model. Rats were first assessed in an inescapable novelty task and a novelty place preference task (measures of novelty seeking), followed by a Pavlovian conditioned approach task for food (a measure of incentive salience attribution). Rats then were trained to self-administer cocaine (0.3 or 1.0 mg/kg/infusion) using an autoshaping procedure. The results demonstrate that animals that attributed incentive salience to a food-associated cue were higher novelty seekers and acquired cocaine self-administration more quickly at the lower dose. The results suggest that novelty-seeking behavior may be a mediator of incentive salience attribution and that incentive salience magnitude may be an indicator of drug reward.

Individual differences in prefrontal cortex function and the transition from drug use to drug dependence

Several neuropsychological hypotheses have been formulated to explain the transition to addiction, including hedonic allostasis, incentive salience, and the development of habits. A key feature of addiction that remains to be explored is the important individual variability observed in the propensity to self-administer drugs, the sensitivity to drug-associated cues, the severity of the withdrawal state, and the ability to quit. In this review, we suggest that the concept of self-regulation, combined with the concept of modularity of cognitive function, may aid in the understanding of the neural basis of individual differences in the vulnerability to drugs and the transition to addiction. The thesis of this review is that drug addiction involves a failure of the different subcomponents of the executive systems controlling key cognitive modules that process reward, pain, stress, emotion, habits, and decision-making. A subhypothesis is that the different patterns of drug addiction and individual differences in the transition to addiction may emerge from differential vulnerability in one or more of the subcomponents.

Disruption of conditioned reward association by typical and atypical antipsychotics

Antipsychotic drugs are broadly classified into typical and atypical compounds; they vary in their pharmacological profile however a common component is their antagonist effects at the D2 dopamine receptors (DRD2). Unfortunately, diminished DRD2 activation is generally thought to be associated with the severity of neuroleptic-induced anhedonia. The purpose of this study was to determine the effect of the atypical antipsychotic olanzapine and typical antipsychotic haloperidol in a paradigm that reflects the learned transfer of incentive motivational properties to previously neutral stimuli, namely autoshaping. In order to provide a dosing comparison to a therapeutically relevant endpoint, both drugs were tested against amphetamine-induced disruption of prepulse inhibition as well. In the autoshaping task, rats were exposed to repeated pairings of stimuli that were differentially predictive of reward delivery. Conditioned approach to the reward-predictive cue (sign-tracking) and to the reward (goal-tracking) increased during repeated pairings in the vehicle treated rats. Haloperidol and olanzapine completely abolished this behavior at relatively low doses (100microg/kg). This same dose was the threshold dose for each drug to antagonize the sensorimotor gating deficits produced by amphetamine. At lower doses (3-30microg/kg) both drugs produced a dose-dependent decrease in conditioned approach to the reward-predictive cue. There was no difference between drugs at this dose range which indicates that olanzapine disrupts autoshaping at a significantly lower proposed DRD2 receptor occupancy. Interestingly, neither drug disrupted conditioned approach to the reward at the same dose range that disrupted conditioned approach to the reward-predictive cue. Thus, haloperidol and olanzapine, at doses well below what is considered therapeutically relevant, disrupts the attribution of incentive motivational value to previously neutral cues. Drug effects on this dimension of reward processing are an important consideration in the development of future pharmacological treatments for schizophrenia.

A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction

BACKGROUND

In addicts drug cues attract attention, elicit approach, and motivate drug-seeking and drug-taking behavior, and addicts find it difficult to resist such cues. In preclinical studies we have found, however, that food cues acquire incentive motivational properties only in a subset of individuals. For example, a food cue becomes attractive, eliciting approach and engagement with it, and acts as an effective conditional reinforcer in some rats but not others. We asked, therefore, whether rats that have a propensity to attribute incentive salience to a food cue are the same ones that attribute incentive value to a drug (cocaine) cue.

METHODS

We first used a Pavlovian conditioned approach procedure to determine which individual rats attributed incentive salience to a food cue. A second cue was then associated with the IV self-administration of cocaine. Later, the ability of the cocaine cue to maintain self-administration behavior and to reinstate self-administration after extinction was assessed.

RESULTS

We report that in individuals that had a propensity to attribute incentive salience to a food cue, a cocaine cue spurred motivation to take drugs (its removal greatly diminished self-administration) and reinstated robust drug-seeking after extinction. However, in those individuals that failed to attribute incentive salience to a food cue, the cocaine cue was relatively devoid of incentive motivational properties.

CONCLUSIONS

We conclude that it is possible to determine, before any drug experience, which individuals will most likely have difficulty resisting drug cues, a trait that might confer susceptibility to addiction.

Effects of acute amphetamine exposure on two kinds of Pavlovian approach behavior

Two kinds of Pavlovian conditioned approach behavior are possible: approach of the CS (sign-tracking) and approach of the US (goal-tracking). We hypothesized that administration of AMP would increase sign-tracking and decrease goal-tracking. However, increasing doses of AMP (up to 2.0mg/kg) decreased measures of sign-tracking while simultaneously increasing measures of goal-tracking. Administration of AMP may shift responding from cues distant from the CS to cues closer to the CS.

Learning strategies during fear conditioning

This paper describes a model of fear learning, in which subjects have an option of behavioral responses to impending social defeat. The model generates two types of learning: social avoidance and classical conditioning, dependent upon (1) escape from or (2) social subordination to an aggressor. We hypothesized that social stress provides the impetus as well as the necessary information to stimulate dichotomous goal-oriented learning. Specialized tanks were constructed to subject rainbow trout to a conditioning paradigm where the conditioned stimulus (CS) is cessation of tank water flow (water off) and the unconditioned stimulus (US) is social aggression from a larger conspecific. Following seven daily CS/US pairings, approximately half of the test fish learned to consistently escape the aggression to a neutral chamber through a small escape hole available only during the interaction. The learning curve for escaping fish was dramatic, with an 1100% improvement in escape time over 7 days. Fish that did not escape exhibited a 400% increase in plasma cortisol and altered brain monoamine response to presentation of the CS alone. Elevated plasma cortisol levels represent classical fear conditioning in non-escaping fish, while a lack of fear conditioning and a decreased latency to escape over the training period in escapers indicates learned escape.

Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences

BACKGROUND

If presentation of a stimulus (conditional stimulus, CS) reliably predicts delivery of a reward, the CS will come to evoke a conditional response (CR) through Pavlovian learning, and the CS may also acquire incentive motivational properties. Thus, CSs can have both predictive and incentive properties. We ask here whether it is possible to dissociate the predictive versus incentive properties of a CS in rats by considering individual differences in the nature of the CR.

METHODS

We used Pavlovian procedures to study the ability of a localizable CS (an illuminated lever) to acquire two properties of an incentive stimulus-the ability to attract and the ability to act as a conditional reinforcer.

RESULTS

For some rats, the CS evoked a "sign-tracking" CR, consisting of approach toward and engagement with the CS itself. For other rats, the CS instead produced a "goal-tracking" CR: approach was directed away from the CS toward the site of food delivery. For sign-trackers (but not goal-trackers) the CS also acted as an effective conditional reinforcer.

CONCLUSIONS

The predictive and incentive properties of a CS can be dissociated by considering individual differences in the CR. In a given animal, a cue that is predictive of reward, supporting Pavlovian learning, may or may not be attributed with incentive salience. This procedure may provide a powerful means to test hypotheses regarding the role of neural systems in learning versus incentive motivational functions and to study individual variation in the extent to which reward-associated stimuli act as incentive stimuli.

Effects of prior amphetamine exposure on approach strategy in appetitive Pavlovian conditioning in rats

RATIONALE

Pavlovian conditioning with a discrete reward-predictive visual cue can elicit two classes of behaviors: "sign-tracking" (approach toward and contact with the cue) and "goal-tracking" (approach toward the site of reward delivery). Sign-tracking has been proposed to be linked to behavioral disorders involving compulsive reward-seeking, such as addiction. Prior exposure to psychostimulant drugs of abuse can facilitate reward-seeking behaviors through enhancements in incentive salience attribution. Thus, it was predicted that a sensitizing regimen of amphetamine exposure would increase sign-tracking behavior.

OBJECTIVE

The purpose of these experiments was to determine how a regimen of exposure to amphetamine affects subsequent sign-tracking behavior.

MATERIALS AND METHODS

Male Long-Evans rats were given daily injections of d-amphetamine (2.0 mg/kg) or saline for 5 days, then given a 7-day drug-free period followed by testing in a Pavlovian conditioning task. In experiment 1, rats were presented with a visual cue (simultaneous illumination of a light and extension of a lever) located either to the left or right of a centrally located food trough. One cue (CS+) was always followed by food delivery, whereas the other (CS-) was not. In experiment 2, rats were tested in a nondiscriminative (CS+ only) version of the task.

RESULTS

In both experiments, amphetamine-exposed rats showed less sign-tracking and more goal-tracking compared to saline controls.

CONCLUSIONS

Contrary to predictions, prior amphetamine exposure decreased sign-tracking and increased goal-tracking behavior. However, these results do support the hypothesis that psychostimulant exposure and incentive sensitization enhance behavior directed toward reward-proximal cues at the expense of reward-distal cues.