Rapid induction of Pavlovian approach to an ethanol-paired visual cue in mice

The Continuing Challenges of Studying Parallel Behaviours in Humans and Animal Models

The use of animal models continues to be essential for carrying out research into clinical phenomena, including addiction. However, the complexity of the clinical condition inevitably means that even the best animal models are inadequate, and this may go some way to account for the apparent failures of discoveries from animal models, including the identification of potential novel therapies, to translate to the clinic. We argue here that it is overambitious and misguided in the first place to attempt to model complex, multifacetted human disorders such as addiction in animals, and especially in rodents, and that all too frequently "validity" of such models is limited to superficial similarities, referred to as "face validity", that reflect quite different underlying phenomena and biological processes from the clinical situation. Instead, a more profitable approach is to identify (a) well-defined intermediate human behavioural phenotypes that reflect defined, limited aspects of, or contributors to, the human clinical disorder, and (b) to develop animal models that are homologous with those discrete human behavioural phenotypes in terms of psychological processes, and underlying neurobiological mechanisms. Examples of past and continuing weaknesses and suggestions for more limited approaches that may allow better homology between the test animal and human condition are made.

Effects of an ethanol-paired conditioned stimulus on responding for ethanol suppressed by a conditioned-taste-aversion

Ethanol-Paired Conditioned Stimuli (CS) can increase ethanol-responding either in extinction or occurring at low rates late in a session. To examine the generality of CS-induced increases in ethanol-responding, we examined whether a CS could increase responding suppressed by Conditioned-Taste-Aversion (CTA), which presumably suppresses responding by changing ethanol's valence from positive to negative. Rats were trained to respond for ethanol under a Random Interval (RI) schedule. We then removed the lever and paired Random-Time ethanol deliveries with illumination of a stimulus light (i.e., CS) for 10 sessions. Results were compared with a Truly Random Control group, in which the light and ethanol deliveries occurred independently. In a subsequent experiment, rats were treated similarly, except the light served as a discriminative stimulus, as the lever was extended and ethanol deliveries were available under a RI during light presentations. After this training, the lever was returned and rats again responded for ethanol. Subsequently, sessions were followed by LiCl administration. When responding reached low levels, LiCl administration stopped and the light was occasionally illuminated during the session. Responding during the light presentation was compared to responding during the period preceding light presentation. Responding partially recovered across 10 sessions and was greater during light presentations than in the period before it in all three groups. Increases were not reliably different between the groups, indicating that explanations for these increases such as CS-induced increases in motivation or approach toward the light are unlikely to be correct. The most likely explanation for these light-induced increases is that during sessions in which the light had been presented previously, LiCl had never been presented and thus, the light had come to signal that ethanol was safe to drink.

β2* nicotinic acetylcholine receptor subtypes mediate nicotine-induced enhancement of Pavlovian conditioned responding to an alcohol cue

Nicotine enhances Pavlovian conditioned responses to reward-associated cues. We investigated through which nicotinic acetylcholine receptor (nAChR) subtypes nicotine acts to produce this behavioral effect to an alcohol-associated cue. Male Long-Evans rats with freely available food and water were first accustomed to drinking 15% ethanol in their home cages using an intermittent access, two-bottle choice procedure. Then the rats were given 15 Pavlovian conditioning sessions in which a 15-s audiovisual conditioned stimulus (CS) predicted the delivery of 0.2 ml of ethanol, the unconditioned stimulus (US). Each session contained 12 CS-US trials. A control group received explicitly unpaired presentations of the CS and US. We measured Pavlovian conditioned approach to the site of US delivery during presentations of the CS, accounting for pre-CS baseline activity. Before each conditioning session, rats were injected subcutaneously with nicotine (0.4 mg/kg) or saline (1 ml/kg). During nAChR antagonist test sessions, rats were first injected systemically with the β2*-selective nAChR antagonist dihydro-beta-erythroidine (DHβE; 3 mg/kg) or the α7-selective nAChR antagonist methyllycaconitine (MLA; 6 mg/kg), followed by their assigned nicotine or saline injection before assessing their conditioned response to the alcohol-associated cue. Consistent with previous reports, nicotine enhanced the Pavlovian conditioned response to the alcohol-paired cue. DHβE attenuated this enhancement, whereas MLA did not. These results suggest that nicotine acts via β2*, but not α7, nAChRs to amplify Pavlovian conditioned responding to an alcohol cue. These findings contribute to a growing literature that identifies nAChRs as potential targets for pharmacological treatment of co-morbid alcohol and tobacco use disorders.

Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder

Purpose of Review

Current theories of alcohol use disorders (AUD) highlight the importance of Pavlovian and instrumental learning processes mainly based on preclinical animal studies. Here, we summarize available evidence for alterations of those processes in human participants with AUD with a focus on habitual versus goal-directed instrumental learning, Pavlovian conditioning, and Pavlovian-to-instrumental transfer (PIT) paradigms.

Recent Findings

The balance between habitual and goal-directed control in AUD participants has been studied using outcome devaluation or sequential decision-making procedures, which have found some evidence of reduced goal-directed/model-based control, but little evidence for stronger habitual responding. The employed Pavlovian learning and PIT paradigms have shown considerable differences regarding experimental procedures, e.g., alcohol-related or conventional reinforcers or stimuli.

Summary

While studies of basic learning processes in human participants with AUD support a role of Pavlovian and instrumental learning mechanisms in the development and maintenance of drug addiction, current studies are characterized by large variability regarding methodology, sample characteristics, and results, and translation from animal paradigms to human research remains challenging. Longitudinal approaches with reliable and ecologically valid paradigms of Pavlovian and instrumental processes, including alcohol-related cues and outcomes, are warranted and should be combined with state-of-the-art imaging techniques, computational approaches, and ecological momentary assessment methods.

Ethanol-paired stimuli can increase reinforced ethanol responding

While ethanol-paired stimuli are frequently postulated to increase drinking motivation and thus increase ethanol responding and precipitate relapse, no study has demonstrated increases in ethanol-reinforced responding following presentation of an ethanol-paired stimulus that had not previously been part of a contingent relationship. Previous studies have shown that food-paired stimuli can increase food responding that is at low rates and increase food consumption in food-sated rats. In Experiment 1, we show that an ethanol-paired stimulus can increase ethanol responding that is at low levels late in the experimental session, presumably due to satiation. However, these increases may have resulted from either associative or non-associative mechanisms. In Experiment 2, we compared the effects of an ethanol-paired stimulus to those of the same stimulus in a Truly-Random-Control group. In a Truly-Random-Control, the stimulus and ethanol each are presented on independent random schedules, and thus any differences between the effects of the stimulus in the experimental and control groups is likely attributable to the association between the stimulus and ethanol. The stimulus increased ethanol-reinforced responding in both the experimental and control groups, but these increases were greater in the experimental than the control group. Thus, both stimulus-change and the pairing of the stimulus with ethanol may result in increases in ethanol-reinforced responding.

Individual variation in the attribution of incentive salience to social cues

Research on the attribution of incentive salience to drug cues has furthered our understanding of drug self-administration in animals and addiction in humans. The influence of social cues on drug-seeking behavior has garnered attention recently, but few studies have investigated how social cues gain incentive-motivational value. In the present study, a Pavlovian conditioned approach (PCA) procedure was used to identify rats that are more (sign-trackers; STs) or less (goal-trackers; GTs) prone to attribute incentive salience to food reward cues. In Experiment 1, a novel procedure employed social ‘peers’ to compare the tendency of STs and GTs to attribute incentive salience to social reward cues as well as form a social-conditioned place preference. In Experiment 2, social behavior of STs and GTs was compared using social interaction and choice tests. Finally, in Experiment 3, levels of plasma oxytocin were measured in STs and GTs seven days after the last PCA training session, because oxytocin is known to modulate the mesolimbic reward system and social behavior. Compared to GTs, STs attributed more incentive salience to social-related cues and exhibited prosocial behaviors (e.g., social-conditioned place preference, increased social interaction, and social novelty-seeking). No group differences were observed in plasma oxytocin levels. Taken together, these experiments demonstrate individual variation in the attribution of incentive salience to both food- and social-related cues, which has important implications for the pathophysiology of addiction.

Effects of rat strain and method of inducing ethanol drinking on Pavlovian-Instrumental-Transfer with ethanol-paired conditioned stimuli

Ethanol-paired conditioned stimuli (CSs) are widely thought to invigorate ethanol responding, and thus, precipitate relapse to drinking. However, preclinical studies investigating this issue using Pavlovian-Instrumental-Transfer (PIT) procedures have had mixed results, with some studies finding PIT while others did not. The studies failing to show PIT used Lewis rats and induced ethanol drinking using a post-prandial drinking procedure. The present experiments examined whether either of these two variables influenced the magnitude of PIT observed. In the first experiment, ethanol drinking in Lewis rats was induced using either sucrose fading or post-prandial drinking. In the second experiment, ethanol drinking was induced using post-prandial drinking in either Long-Evans Hooded or Lewis rats. In both experiments, rats were trained to respond for ethanol under a random interval schedule. Subsequently with the lever removed, 2-min light presentations were paired with ethanol deliveries. Finally, with the lever returned, the effect of light presentations on responding was tested while responding was in extinction. Light presentations similarly affected responding in Lewis rats regardless of the method of drinking induction. Likewise, light presentations similarly affected responding in both Lewis and Long-Evans Hooded rats. Neither ethanol induction method nor rat strain affected the magnitude of PIT observed, and thus, neither likely explains previous failures to observe PIT with ethanol-maintained behavior.

Effects of an ethanol-paired CS on responding for ethanol and food: Comparisons with a stimulus in a Truly-Random-Control group and to a food-paired CS on responding for food

Motivational increases due to exposure to alcohol-paired Conditioned Stimuli (CS) are central to some accounts of alcoholism. However, few studies isolate a stimulus's function as a CS from its other potential functions. Pavlovian-Instrumental-Transfer (PIT) procedures isolate a stimulus's function as a CS from its other functions. Though there are several relevant studies using PIT, knowledge gaps exist. Particularly, it is not clear that an alcohol-paired CS will increase alcohol seeking compared to the same stimulus in a Truly-Random-Control group, nor whether such increases are specific to alcohol seeking. To address these knowledge gaps in Experiment 1, rats responded for ethanol (0.1 ml 8% w/v) under an RI 30-sec schedule, then the lever was removed and half the rats had ethanol delivered during occasional 120-sec light presentations, while the remainder had ethanol and the light presented under independent RT schedules. Later the lever was returned and the light was presented during responding in extinction (PIT test). Following this test, levers were again removed and the light was presented without ethanol (light extinction), following again by a PIT test. Responding in the two groups during light presentations did not differ in either PIT test. Experiment 2 repeated Experiment 1 using food instead of ethanol. In Experiment 2, responding during light presentations increased in the paired group. In Experiment 3, rats were trained on a concurrent FR schedule of food and ethanol delivery. Ethanol was delivered following 5 responses and the response requirement for food adjusted so that similar numbers of food and ethanol deliveries were obtained. Subsequently, rats underwent conditioning, control and testing procedures identical to those in Experiment 1. In Experiment 3, the ethanol-paired CS increased ethanol-responding, but not food-responding. These results are most easily interpreted as changes in responding resulting from CS-elicited behavior rather than motivational changes. This interpretation is more compatible with some descriptions of the role of an alcohol-paired CS in alcoholism than others.

Conditioned stimuli's role in relapse: preclinical research on Pavlovian-Instrumental-Transfer

RATIONALE AND OBJECTIVE

Pavlovian learning is central to many theories of addiction. In these theories, stimuli paired with drug ingestion become conditioned stimuli (CS) and subsequently elicit drug-seeking and drug-taking. However, in most relevant studies, Pavlovian and instrumental learning are confounded. This confound may be avoided in Pavlovian-Instrumental-Transfer (PIT) procedures. In PIT, Pavlovian and instrumental learning are established separately and then combined. In order to better understand the role of CSs in addiction, we review the relevant studies using PIT.

FINDINGS

We identified seven articles examining PIT effects of ethanol- or cocaine-paired CSs. Under at least one condition, six of these articles reported CS-elicited increases in responding previously maintained by drug. However, the only study using the optimal control condition failed to find a CS-elicited increase. Two studies examining CS specificity found the CS also increased responding maintained by a different reinforcer. Two studies examined if CSs elicit increases in actual drug-taking. Both failed to find CS-elicited increases, i.e., no study shows CS-elicited increases in actual drug-taking. Further, CS-elicited increases in extinguished responding are short-lived.

CONCLUSIONS

These findings are not entirely consistent with Pavlovian learning playing a central role in addiction. However, design issues can explain most of these inconsistencies. Studies without these design issues are needed. Additionally, existing theories hypothesize drug-paired CSs increase drug-taking by increasing motivation, by eliciting conditioned responses that make drug-seeking more probable, or by a combination of these. Work distinguishing between these mechanisms would also be useful.

Individual differences in the influence of task-irrelevant Pavlovian cues on human behavior

Pavlovian-to-instrumental transfer (PIT) refers to the process of a Pavlovian reward-paired cue acquiring incentive motivational proprieties that drive choices. It represents a crucial phenomenon for understanding cue-controlled behavior, and it has both adaptive and maladaptive implications (i.e., drug-taking). In animals, individual differences in the degree to which such cues bias performance have been identified in two types of individuals that exhibit distinct Conditioned Responses (CR) during Pavlovian conditioning: Sign-Trackers (ST) and Goal-Trackers (GT). Using an appetitive PIT procedure with a monetary reward, the present study investigated, for the first time, the extent to which such individual differences might affect the influence of reward-paired cues in humans. In a first task, participants learned an instrumental response leading to reward; then, in a second task, a visual Pavlovian cue was associated with the same reward; finally, in a third task, PIT was tested by measuring the preference for the reward-paired instrumental response when the task-irrelevant reward-paired cue was presented, in the absence of the reward itself. In ST individuals, but not in GT individuals, reward-related cues biased behavior, resulting in an increased likelihood to perform the instrumental response independently paired with the same reward when presented with the task-irrelevant reward-paired cue, even if the reward itself was no longer available (i.e., stronger PIT effect). This finding has important implications for developing individualized treatment for maladaptive behaviors, such as addiction.

Pavlovian conditioned approach, extinction, and spontaneous recovery to an audiovisual cue paired with an intravenous heroin infusion

RATIONALE

Novel stimuli paired with exposure to addictive drugs can elicit approach through Pavlovian learning. While such approach behavior, or sign tracking, has been documented for cocaine and alcohol, it has not been shown to occur with opiate drugs like heroin. Most Pavlovian conditioned approach paradigms use an operandum as the sign, so that sign tracking can be easily automated.

OBJECTIVES

We were interested in assessing whether approach behavior occurs to an audiovisual cue paired with an intravenous heroin infusion. If so, would this behavior exhibit characteristics of other Pavlovian conditioned behaviors, such as extinction and spontaneous recovery?

METHODS

Rats were repeatedly exposed to an audiovisual cue, similar to that used in standard self-administration models, along with an intravenous heroin infusion. Sign tracking was measured in an automated fashion by analyzing motion pixels within the cue zone during each cue presentation.

RESULTS

We were able to observe significant sign tracking after only five pairings of the conditioned stimulus (CS) with the unconditioned stimulus (US). This behavior rapidly extinguished over 2 days, but exhibited pronounced spontaneous recovery 3 weeks later.

CONCLUSIONS

We conclude that sign tracking measured by these methods exhibits all the characteristics of a classically conditioned behavior. This model can be used to examine the Pavlovian component of drug memories, alone, or in combination with self-administration methods.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Interactive effects of methylphenidate and alcohol on discrimination, conditioned place preference and motor coordination in C57BL/6J mice

INTRODUCTION

Prior research indicates methylphenidate (MPH) and alcohol (ethanol, EtOH) interact to significantly affect responses humans and mice. The present studies tested the hypothesis that MPH and EtOH interact to potentiate ethanol-related behaviors in mice.

METHODS

We used several behavioral tasks including: drug discrimination in MPH-trained and EtOH-trained mice, conditioned place preference (CPP), rota-rod and the parallel rod apparatus. We also used gas chromatographic methods to measure brain tissue levels of EtOH and the D- and L-isomers of MPH and the metabolite, ethylphenidate (EPH).

RESULTS

In discrimination, EtOH (1 g/kg) produced a significant leftward shift in the MPH generalization curve (1-2 mg/kg) for MPH-trained mice, but no effects of MPH (0.625-1.25 mg/kg) on EtOH discrimination in EtOH-trained mice (0-2.5 g/kg) were observed. In CPP, the MPH (1.25 mg/kg) and EtOH (1.75 g/kg) combination significantly increased time on the drug paired side compared to vehicle (30.7 %), but this was similar to MPH (28.8 %) and EtOH (33.6 %). Footslip errors measured in a parallel rod apparatus indicated that the drug combination was very ataxic, with footslips increasing 29.5 % compared to EtOH. Finally, brain EtOH concentrations were not altered by 1.75 g/kg EtOH combined with 1.25 mg/kg MPH. However, EtOH significantly increased D-MPH and L-EPH without changing L-MPH brain concentrations.

CONCLUSIONS

The enhanced behavioral effects when EtOH is combined with MPH are likely due to the selective increase in brain D-MPH concentrations. These studies are consistent with observations in humans of increased interoceptive awareness of the drug combination and provide new clinical perspectives regarding enhanced ataxic effects of this drug combination.

A cocaine cue is more preferred and evokes more frequency-modulated 50-kHz ultrasonic vocalizations in rats prone to attribute incentive salience to a food cue

RATIONALE

Individuals vary considerably in the extent to which they attribute incentive salience to food-associated cues.

OBJECTIVES

We asked whether individuals prone to attribute incentive salience to a food cue are also prone to attribute incentive properties to a stimulus associated with a drug of abuse-cocaine.

METHODS

We first identified those rats that attributed incentive salience to a food cue by quantifying the extent to which they came to approach and engage a food cue. We then used a conditioned place preference procedure to pair an injection of 10 mg/kg cocaine (i.p.) with one distinct floor texture (grid or holes) and saline with another. Following 8 days of conditioning, each rat was given a saline injection and placed into a chamber that had both floors present. We measured the time spent on each floor, and also 50-kHz ultrasonic vocalizations, which have been associated with positive affective states.

RESULTS

Rats that vigorously engaged the food cue ("sign trackers") expressed a preference for the cocaine-paired floor compared to those that did not ("goal trackers"). In addition, sign trackers made substantially more frequency-modulated 50-kHz vocalizations when injected with cocaine and when later exposed to the cocaine cue.

CONCLUSIONS

Rats prone to attribute incentive salience to a food cue are also prone to attribute incentive motivational properties to a tactile cue associated with cocaine. We suggest that individuals prone to attribute incentive salience to reward cues will have difficulty resisting them and, therefore, may be especially vulnerable to develop impulse control disorders, including addiction.

Critical thoughts on current rodent models for evaluating potential treatments of alcohol addiction and withdrawal

Despite years of neurobiological research that have helped to identify potential therapeutic targets, we do not have a reliable pharmacological treatment for alcoholism. There are a range of possible explanations for this failure, including arguments that alcoholism is a spectrum disorder and that different population subtypes may respond to different treatments. This view is supported by categorisations such as early- and late-onset alcoholism, whilst multifactorial genetic factors may also alter responsivity to pharmacological agents. Furthermore, experience of alcohol withdrawal may play a role in future drinking in a way that may distinguish alcoholism from other forms of addiction. Additionally, our neurobiological models, based largely upon results from rodent studies, may not mimic specific aspects of the human condition and may reflect different underlying phenomena and biological processes from the clinical pattern. As a result, potential treatments may be targeting inappropriate aspects of alcohol-related behaviours. Instead, we suggest a more profitable approach is (a) to identify well-defined intermediate behavioural phenotypes in human experimental models that reflect defined aspects of the human clinical disorder and (b) to develop animal models that are homologous with those phenotypes in terms of psychological processes and underlying neurobiological mechanisms. This review describes an array of animal models currently used in the addiction field and what they tell us about alcoholism. We will then examine how established pharmacological agents have been developed using only a limited number of these models, before describing some alternative novel approaches to achieving homology between animal and human experimental measures.

Social bonding decreases the rewarding properties of amphetamine through a dopamine D1 receptor-mediated mechanism

Although the protective effects of social bonds on drug use/abuse have been well documented, we know little about the underlying neural mechanisms. Using the prairie vole (Microtus ochrogaster)--a socially monogamous rodent that forms long-term pair bonds after mating--we demonstrate that amphetamine (AMPH) conditioning induced a conditioned place preference (CPP) in sexually naive (SN), but not pair-bonded (PB), males. Although AMPH treatment induced a similar magnitude of dopamine release in the nucleus accumbens (NAcc) of SN and PB males, it had differential effects on NAcc D1 receptor (D1R) binding. Specifically, AMPH treatment increased D1R binding in SN, but decreased D1R binding in PB males. NAcc D1R, but not D2 receptor, antagonism blocked AMPH-induced CPP in SN males and NAcc D1R activation before AMPH conditioning enabled AMPH-induced CPP in PB males. Together, our data demonstrate that pair-bonding experience decreases the rewarding properties of AMPH through a D1R-mediated mechanism.

Age- and sex-related differences in the acquisition and reinstatement of ethanol CPP in mice

Many people begin to experiment with alcohol during adolescence, an important developmental period during which sex differences in the effects of ethanol appear. In the present study we evaluated the effect of ethanol (0, 0.625, 1.25 or 2.5 g/kg) on the acquisition of a conditioned place preference (CPP) in early and late adolescent male and female mice. In addition, we assessed the capacity of ethanol to induce reinstatement of the CPP after its extinction. CPP was induced in early and late adolescent females with 2.5 g/kg, and in early adolescent males with 1.25 or 2.5 g/kg of ethanol. No CPP was observed in late adolescent males. Priming with ethanol reinstated the CPP induced by the highest dose in early adolescent male and early and late adolescent female mice. Our data suggest that early adolescents of both sex and late adolescent females are particularly vulnerable to the effects of ethanol.

Blockade of opioid receptors in anterior cingulate cortex disrupts ethanol-seeking behavior in mice

The anterior cingulate cortex (ACC) and opioid receptors have been suggested to play a role in attributing incentive motivational properties to drug-related cues. We examined whether blockade of ACC opioid receptors would reduce cue-induced ethanol-seeking behavior in mice. We show that intra-ACC opioid receptor blockade disrupted expression of an ethanol-induced conditioned place preference, suggesting that endogenous opioid modulation in the ACC may be critical for maintaining the cue's conditioned rewarding effects.

The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction

Memory reconsolidation is the process by which memories, destabilised at retrieval, require restabilisation to persist in the brain. It has been demonstrated that even old, well-established memories require reconsolidation following retrieval; therefore, memory reconsolidation could potentially be exploited to disrupt, or even erase, aberrant memories that underlie psychiatric disorders, thereby providing a novel therapeutic target. Drug addiction is one such disorder; it is both chronic and relapsing, and one prominent risk factor for a relapse episode is the presentation of environmental cues that have previously been associated with drugs of abuse. This 'cue-induced relapse' can be accounted for in psychological terms by reinforcing memories of the pavlovian association between the cue and the drug, which can thus influence behaviour through at least three psychologically and neurobiologically dissociable mechanisms: conditioned reinforcement, conditioned approach and conditioned motivation. As each of these psychological processes could contribute to the resumption of drug-seeking following abstinence, it is important to develop treatments that can reduce drug-seeking re-established via influences on each or all of these pavlovian processes, in order to minimise the risk of a subsequent relapse. Investigation of the memory reconsolidation mechanisms of the memories underlying conditioned reinforcement, conditioned approach and conditioned motivation indicate that they depend upon different neurochemical systems, including the glutamatergic and adrenergic systems within limbic corticostriatal circuitry. We also discuss here the subsequent translation to the clinic of this preclinical work.

Reward sensitivity: issues of measurement, and achieving consilience between human and animal phenotypes

Reward is a concept fundamental to discussions of drug abuse and addiction. The idea that altered sensitivity to either drug-reward, or to rewards in general, contributes to, or results from, drug-taking is a common theme in several theories of addiction. However, the concept of reward is problematic in that it is used to refer to apparently different behavioural phenomena, and even to diverse neurobiological processes (reward pathways). Whether these different phenomena are different behavioural expressions of a common underlying process is not established, and much research suggests that there may be only loose relationships among different aspects of reward. Measures of rewarding effects of drugs in humans often depend upon subjective reports. In animal studies, such insights are not available, and behavioural measures must be relied upon to infer rewarding effects of drugs or other events. In such animal studies, but also in many human methods established to objectify measures of reward, many other factors contribute to the behaviour being studied. For that reason, studying the biological (including genetic) bases of performance of tasks that ostensibly measure reward cannot provide unequivocal answers. The current overview outlines the strengths and weaknesses of current approaches that hinder the conciliation of cross-species studies of the genetics of reward sensitivity and the dysregulation of reward processes by drugs of abuse. Some suggestions are made as to how human and animal studies may be made to address more closely homologous behaviours, even if those processes are only partly able to isolate 'reward' from other factors contributing to behavioural output.

Effects of disconnection of amygdala dopamine and nucleus accumbens N-methyl-d-aspartate receptors on ethanol-seeking behavior in mice

There is a strong interest in harnessing the genetic manipulations that are possible in mice to investigate the functional neural mechanisms modulating the associative processes that control drug-seeking behavior. However, it is unknown whether intracranial techniques, such as the disconnection procedure commonly used in rats to examine serial connectivity between implicated areas, can be successfully applied to mice. We have previously demonstrated that the expression of ethanol-seeking behavior in mice is dependent upon amygdala (Amy) dopamine and nucleus accumbens (Acb) N-methyl-d-aspartate (NMDA) receptor activation (Gremel & Cunningham, 2009). Here, we used a neuropharmacological disconnection procedure to investigate whether dopamine activation of the Amy directly leading to increases in Acb glutamate release and binding of NMDA receptors modulates the expression of ethanol-seeking behavior. Immediately before testing the expression of an ethanol-induced conditioned place preference, mice were given an Amy infusion of flupenthixol and either an ipsilateral or contralateral Acb infusion of AP-5. Although both ipsilateral and contralateral manipulations reduced the expression of ethanol conditioned place preference, in a separate experiment we demonstrated that a unilateral Acb infusion of AP-5, but not Amy flupenthixol, is sufficient to disrupt preference. The finding of a significant blockade by unilateral AP-5 into the Acb precludes any conclusions about a unique role for the Amy/Acb neuroanatomical connection in this model of ethanol-seeking behavior. Further, the current results suggest potential limitations in transferring techniques from rats to mice in order to study serial interactions between neural areas underlying motivated behaviors. Nevertheless, these findings provide evidence showing that Acb NMDA receptors play an important role in the expression of ethanol-conditioned behavior.

Involvement of amygdala dopamine and nucleus accumbens NMDA receptors in ethanol-seeking behavior in mice

Although progress has been made identifying neural mechanisms underlying ethanol's primary reinforcing effects, few studies have examined the mechanisms mediating ethanol-induced conditioned effects. A recent lesion study suggests that expression of ethanol-conditioned behaviors depends upon an intact amygdala and nucleus accumbens core. However, specific mechanisms within these nuclei are unknown. In the present experiments, we used site-specific microinfusions of dopamine and NMDA receptor antagonists to examine the roles of accumbens and amygdala in the expression of ethanol conditioned place preference (CPP) in mice. In experiments 1 and 2, a D1/D2/D3 receptor antagonist (flupenthixol) was infused into accumbens or amygdala before testing, whereas experiment 3 used pretest infusions of an NMDA antagonist (AP-5) to examine the role of intra-accumbens NMDA receptors. Dopamine antagonism of accumbens was without effect, but intra-amygdala infusions of flupenthixol blocked CPP expression. Moreover, this effect was dependent upon dopamine antagonism within the basolateral nucleus but not the central nucleus of the amygdala. Antagonism of NMDA receptors in accumbens also blocked CPP expression. The present findings suggest that expression of the ethanol-conditioned response depends upon amygdala dopamine and accumbens NMDA receptors. These are the first studies in any species to show a role for amygdala dopamine receptors and the first studies in mice to implicate accumbens NMDA receptors in ethanol-induced conditioned effects.

Effects of prior amphetamine exposure on approach strategy in appetitive Pavlovian conditioning in rats

RATIONALE

Pavlovian conditioning with a discrete reward-predictive visual cue can elicit two classes of behaviors: "sign-tracking" (approach toward and contact with the cue) and "goal-tracking" (approach toward the site of reward delivery). Sign-tracking has been proposed to be linked to behavioral disorders involving compulsive reward-seeking, such as addiction. Prior exposure to psychostimulant drugs of abuse can facilitate reward-seeking behaviors through enhancements in incentive salience attribution. Thus, it was predicted that a sensitizing regimen of amphetamine exposure would increase sign-tracking behavior.

OBJECTIVE

The purpose of these experiments was to determine how a regimen of exposure to amphetamine affects subsequent sign-tracking behavior.

MATERIALS AND METHODS

Male Long-Evans rats were given daily injections of d-amphetamine (2.0 mg/kg) or saline for 5 days, then given a 7-day drug-free period followed by testing in a Pavlovian conditioning task. In experiment 1, rats were presented with a visual cue (simultaneous illumination of a light and extension of a lever) located either to the left or right of a centrally located food trough. One cue (CS+) was always followed by food delivery, whereas the other (CS-) was not. In experiment 2, rats were tested in a nondiscriminative (CS+ only) version of the task.

RESULTS

In both experiments, amphetamine-exposed rats showed less sign-tracking and more goal-tracking compared to saline controls.

CONCLUSIONS

Contrary to predictions, prior amphetamine exposure decreased sign-tracking and increased goal-tracking behavior. However, these results do support the hypothesis that psychostimulant exposure and incentive sensitization enhance behavior directed toward reward-proximal cues at the expense of reward-distal cues.

Ethanol intake patterns in female mice: influence of allopregnanolone and the inhibition of its synthesis

The neurosteroid allopregnanolone (ALLO) is a positive modulator of GABA(A) receptors that exhibits a psychopharmacological profile similar to ethanol (i.e., anxiolytic, sedative-hypnotic). Based on research suggesting that manipulation of ALLO levels altered ethanol self-administration in male rodents, the current studies determined whether exogenous ALLO administration or the inhibition of its synthesis in vivo modulated ethanol intake patterns in female C57BL/6J mice. Lickometer circuits collected temporal lick records of ethanol (10%, v/v) and water consumption during daily 2h limited access sessions. Following the establishment of stable ethanol intake, studies examined the effect of an acute ALLO challenge (3.2-24.0 mg/kg) or a 7-day blockade of ALLO production with finasteride (FIN; 50 or 100 mg/kg) on ethanol intake in a within-subjects design. In contrast to results in male mice, ethanol dose (g/kg), ethanol preference and most of the bout parameters were unaltered by ALLO pretreatment in female mice. Ethanol intake in females also was recalcitrant to 7-day treatment with 50 mg/kg FIN, whereas 100 mg/kg FIN significantly reduced the ethanol dose consumed by 35%. The FIN-attenuated ethanol intake was attributable to a significant decrease in bout frequency (up to 45%), with lick patterns indicating reduced maintenance of consumption throughout the 2-h session. FIN also produced a dose-dependent decrease in brain ALLO levels. In conjunction with data in male mice, the present findings indicate that there are sex differences in the physiological regulation of ethanol intake patterns by GABAergic neurosteroids.

Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction

Drugs of abuse acquire different degrees of control over thoughts and actions based not only on the effects of drugs themselves, but also on predispositions of the individual. Those individuals who become addicted are unable to shift their thoughts and actions away from drugs and drug-associated stimuli. Thus in addicts, exposure to places or things (cues) that has been previously associated with drug-taking often instigates renewed drug-taking. We and others have postulated that drug-associated cues acquire the ability to maintain and instigate drug-taking behavior in part because they acquire incentive motivational properties through Pavlovian (stimulus-stimulus) learning. In the case of compulsive behavioral disorders, including addiction, such cues may be attributed with pathological incentive value ("incentive salience"). For this reason, we have recently begun to explore individual differences in the tendency to attribute incentive salience to cues that predict rewards. When discrete cues are associated with the non-contingent delivery of food or drug rewards some animals come to quickly approach and engage the cue even if it is located at a distance from where the reward will be delivered. In these animals the reward-predictive cue itself becomes attractive, eliciting approach towards it, presumably because it is attributed with incentive salience. Animals that develop this type of conditional response are called "sign-trackers". Other animals, "goal-trackers", do not approach the reward-predictive cue, but upon cue presentation they immediately go to the location where food will be delivered (the "goal"). For goal-trackers the reward-predictive cue is not attractive, presumably because it is not attributed with incentive salience. We review here preliminary data suggesting that these individual differences in the tendency to attribute incentive salience to cues predictive of reward may confer vulnerability or resistance to compulsive behavioral disorders, including addiction. It will be important, therefore, to study how environmental, neurobiological and genetic interactions determine the extent to which individuals attribute incentive value to reward-predictive stimuli.

Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse

Drug abuse researchers have noted striking similarities between behaviors elicited by Pavlovian sign-tracking procedures and prominent symptoms of drug abuse. In Pavlovian sign-tracking procedures, repeated paired presentations of a small object (conditioned stimulus, CS) with a reward (unconditioned stimulus, US) elicits a conditioned response (CR) that typically consists of approaching the CS, contacting the CS, and expressing consummatory responses at the CS. Sign-tracking CR performance is poorly controlled and exhibits spontaneous recovery and long-term retention, effects that resemble relapse. Sign-tracking resembles psychomotor activation, a syndrome of behavioral responses evoked by addictive drugs, and the effects of sign-tracking on corticosterone levels and activation of dopamine pathways resemble the neurobiological effects of abused drugs. Finally, the neurobiological profile of individuals susceptible to sign-tracking resembles the pathophysiological profile of vulnerability to drug abuse, and vulnerability to sign-tracking predicts vulnerability to impulsive responding and alcohol self-administration. Implications of sign-tracking for models of drug addiction are considered.

Goal- and signal-directed incentive: conditioned approach, seeking, and consumption established with unsweetened alcohol in rats

RATIONALE

Many theories of addictive behavior propose that cues signaling drug administration influence the likelihood of drug-taking and drug-seeking behavior.

OBJECTIVES

We investigated the behavioral impact of cues associated with unsweetened ethanol and their interaction with responding maintained by ethanol self-administration. Our goal was to establish the influence of such cues on ethanol seeking.

MATERIALS AND METHODS

The experiment used a matching contingency and saccharin-fading procedure to establish equal levels of responding to two spatially distinct levers using unsweetened 10% ethanol solution. After ethanol self-administration was established, a brief cue light located alternately over each lever location was either paired or unpaired (control) with the opportunity to consume the same ethanol solution. Finally, self-administration was re-established, and the effect of the cue was measured in a transfer design.

RESULTS

The reaction to lights paired with the opportunity to ingest unsweetened ethanol had three main effects: (1) induction of operant behavior reinforced by ethanol, (2) stimulation of ethanol-seeking behavior (drinker entries), and (3) cue-directed approach and contact behavior (i.e. autoshaping or sign-tracking). Cue-directed behavior to the light interacted with choice behavior in a manner predicted by the location of the cue light, enhancing responding only when the approach response did not interfere with the operant response.

CONCLUSIONS

These findings replicate and extend the effects of Pavlovian conditioning on ethanol-seeking and support-conditioned incentive theories of addictive behavior. Signals for ethanol influence spatial choice behavior and may be relevant to attentional bias shown to alcohol-associated stimuli in humans.

Individual differences in the attribution of incentive salience to a reward-related cue: influence on cocaine sensitization

When a discrete cue (a "sign") is presented repeatedly in anticipation of a food reward the cue can become imbued with incentive salience, leading some animals to approach and engage it, a phenomenon known as "sign-tracking" (the animals are sign-trackers; STs). In contrast, other animals do not approach the cue, but upon cue presentation go to the location where food will be delivered (the goal). These animals are known as goal-trackers (GTs). It has been hypothesized that individuals who attribute excessive incentive salience to reward-related cues may be especially vulnerable to develop compulsive behavioral disorders, including addiction. We were interested, therefore, in whether individual differences in the propensity to sign-track are associated with differences in responsivity to cocaine. Using an autoshaping procedure in which lever (conditioned stimulus) presentation was immediately followed by the response-independent delivery of a food pellet (unconditioned stimulus), rats were first characterized as STs or GTs and subsequently studied for the acute psychomotor response to cocaine and the propensity for cocaine-induced psychomotor sensitization. We found that GTs were more sensitive than STs to the acute locomotor activating effects of cocaine, but STs showed a greater propensity for psychomotor sensitization upon repeated treatment. These data suggest that individual differences in the tendency to attribute incentive salience to a discrete reward-related cue, and to approach and engage it, are associated with susceptibility to a form of cocaine-induced plasticity that may contribute to the development of addiction.