Pavlovian Conditioning With Ethanol: Sign-Tracking (Autoshaping), Conditioned Incentive, and Ethanol Self-Administration

Effects of an ethanol-paired conditioned stimulus on responding for ethanol suppressed by a conditioned-taste-aversion

Ethanol-Paired Conditioned Stimuli (CS) can increase ethanol-responding either in extinction or occurring at low rates late in a session. To examine the generality of CS-induced increases in ethanol-responding, we examined whether a CS could increase responding suppressed by Conditioned-Taste-Aversion (CTA), which presumably suppresses responding by changing ethanol's valence from positive to negative. Rats were trained to respond for ethanol under a Random Interval (RI) schedule. We then removed the lever and paired Random-Time ethanol deliveries with illumination of a stimulus light (i.e., CS) for 10 sessions. Results were compared with a Truly Random Control group, in which the light and ethanol deliveries occurred independently. In a subsequent experiment, rats were treated similarly, except the light served as a discriminative stimulus, as the lever was extended and ethanol deliveries were available under a RI during light presentations. After this training, the lever was returned and rats again responded for ethanol. Subsequently, sessions were followed by LiCl administration. When responding reached low levels, LiCl administration stopped and the light was occasionally illuminated during the session. Responding during the light presentation was compared to responding during the period preceding light presentation. Responding partially recovered across 10 sessions and was greater during light presentations than in the period before it in all three groups. Increases were not reliably different between the groups, indicating that explanations for these increases such as CS-induced increases in motivation or approach toward the light are unlikely to be correct. The most likely explanation for these light-induced increases is that during sessions in which the light had been presented previously, LiCl had never been presented and thus, the light had come to signal that ethanol was safe to drink.

Ethanol-paired conditioned stimulus effects on concurrent reinforced responding for ethanol and food

The influence of Pavlovian Conditioned Stimuli (CS) on ethanol self-administration and choice between ethanol and an alternative are potentially important. Ethanol-paired CS might increase ethanol self-administration, especially when it has been reduced during recovery, though the selectivity of these increases has been questioned. To date, one study examined the effects of an ethanol-paired CS on ethanol choice and found that the CS increased ethanol-responding more than food-responding when both were in extinction. However, it remains unclear whether ethanol-paired CS increase ethanol-choice that is not in extinction. Here, we examine the effects of an ethanol-paired CS on ethanol-choice when both food- and ethanol-responding are reinforced. Sixteen adult male Lewis rats were trained on a concurrent schedule to respond for ethanol on one lever and for food on the other lever. Ethanol was available under an FR 5 schedule, and food was available under an FR schedule that was adjusted for each rat to earn an equal number of food and ethanol deliveries. Then, 2-min light presentations were paired with an RT 25-sec schedule of ethanol delivery for 10 sessions in the absence of both levers. After this, subjects were placed back on the concurrent schedule for one session, then five sessions with the CS being present or absent on each trial of the concurrent schedule occurred. Rats learned to respond on one lever for ethanol and on the other for food and earned similar numbers of ethanol and food deliveries. During Pavlovian Conditioning, the number of head entries into the head-entry detector was higher in the presence of the CS than in its absence. In the test sessions, rats made more ethanol responses in the presence of the CS than in its absence. However, this effect was small and did not increase the amount of ethanol earned. Thus, ethanol-paired CS could increase ethanol-responding under a choice procedure but did not increase ethanol consumption meaningfully under the studied conditions.

Conditioned stimulus effects on paired or alternative reinforcement depend on presentation duration: Implications for conceptualizations of craving

Conditioned stimuli (CS) associated with alcohol ingestion are thought to play a role in relapse by producing a craving that in turn increases motivation to drink which increases ethanol-seeking and disrupts other ongoing behavior. Alternatively, such CS may provide information indicating a likely increase in the density of the paired unconditioned stimulus and simultaneously elicit behavior that may be incompatible with other ongoing behavior, i.e., approach toward the CS. To explore these possibilities, rats were trained to respond for ethanol or food in two different components of the same session after which a light above the ethanol-lever was lighted twice during each component and each light presentation was followed by ethanol delivery. The duration of this CS was 10 s initially and then increased to 30 s, then to 100 s, and finally returned to 30 s. The change in responding for ethanol or food was compared to a matched period immediately preceding CS presentation. The CS presentation increased responding to ethanol, and this effect increases with longer CS presentations. In contrast, the CS presentation decreased responding to food, and this effect decreases with longer CS presentations. These results appear to support the informational account of CS action rather than simply a change in the motivation to seek and consume ethanol. This suggests that craving as it is commonly understood likely represents multiple behavioral processes, not simply increased desire for alcohol and that reports of craving likely reflect labeling based upon past experiences rather than a cause of future drug-taking.

Melatonin attenuates morphine-induced conditioned place preference in Wistar rats

PURPOSE

Morphine is the predominantly used drug for postoperative and cancer pain management. However, the abuse potential of morphine is the primary disadvantage of using opioids in pain management. Melatonin is a neurohormone synthesized in the pineal gland and is involved in circadian rhythms in mammals, as well as other physiological functions. Melatonin provenly attenuates alcohol-seeking and relapse behaviors in rats. Therefore, we aimed to investigate the involvement of the melatonergic system in attenuating morphine dependence.

MATERIALS AND METHODS

Male Wistar rats were divided into three groups: control, morphine, and morphine + melatonin. Animals were habituated for 3 days, and the initial preference was evaluated. Following the initial preference, the control group received the vehicle and was placed for a 45-min session in the assigned chamber every day, alternating between the two chambers, for 8 days. The morphine group received a morphine injection (5 mg/kg, IP) and was placed for a 45-min session in the white chamber, for a total of four sessions. The morphine + melatonin group received the morphine injection (5 mg/kg, IP) for a total of four sessions over an 8-day period. In the posttest session, the control and morphine groups received a vehicle injection 30 min before placement in the conditioned place preference (CPP). The morphine + melatonin group received a single injection of melatonin (50 mg/kg, IP) 30 min before the preference test.

RESULTS

Statistical analysis revealed that repeated administration of morphine for four sessions produced a significant increase in the CPP score in the morphine group compared to the control group. However, a single melatonin injection administered 30 min before the posttest attenuated morphine-seeking behavior and reduced morphine-induced place preference.

CONCLUSION

These findings provide novel evidence for the role of the melatonergic system as a potential target in modulating morphine-seeking behavior.

Prior chronic alcohol exposure enhances Pavlovian-to-instrumental transfer

Alcohol dependence is associated with aberrant decision-making processes, particularly in the presence of alcohol-related environmental cues. For instance, alcohol cues can trigger alcohol seeking, consumption, and even relapse behavior. Recently, works have suggested that alcohol dependence may induce more general alterations in cued processes that support adaptive behavior, including enhanced cue control of volitional behavior unrelated to alcohol use. Here we examine this hypothesis by combining prior exposure to chronic intermittent ethanol and repeated withdrawal (CIE) procedures with a Pavlovian-to-instrumental transfer (PIT) task in mice. The PIT task entails training a Pavlovian association, separately training an instrumental contingency, and a final test during which the Pavlovian cue and instrumental action are combined for the first time. We first tested two variants of the PIT procedure in ethanol-naïve mice, differing in part in the duration of Pavlovian conditioned cues (short or long). We found in the PIT test that the short cue procedure produced negative transfer, whereas the long cue procedure produced positive transfer. We then used the long cue variant to examine PIT behavior in mice previously exposed to either CIE or air vapor. We found that prior CIE exposure strengthened PIT behavior, with enhanced instrumental responding during presentation of the food-associated cue. We further found that this enhancement in CIE mice persisted even after devaluation of the food outcome. Our findings suggest that ethanol dependence can enhance the influence of reward-predictive cues on ongoing behavior. Greater non-alcohol cue control of behavior may reflect the effect of chronic ethanol exposure on neural circuitry critical for cue-guided behavior in general.

Instrumental and Pavlovian Mechanisms in Alcohol Use Disorder

Purpose of Review

Current theories of alcohol use disorders (AUD) highlight the importance of Pavlovian and instrumental learning processes mainly based on preclinical animal studies. Here, we summarize available evidence for alterations of those processes in human participants with AUD with a focus on habitual versus goal-directed instrumental learning, Pavlovian conditioning, and Pavlovian-to-instrumental transfer (PIT) paradigms.

Recent Findings

The balance between habitual and goal-directed control in AUD participants has been studied using outcome devaluation or sequential decision-making procedures, which have found some evidence of reduced goal-directed/model-based control, but little evidence for stronger habitual responding. The employed Pavlovian learning and PIT paradigms have shown considerable differences regarding experimental procedures, e.g., alcohol-related or conventional reinforcers or stimuli.

Summary

While studies of basic learning processes in human participants with AUD support a role of Pavlovian and instrumental learning mechanisms in the development and maintenance of drug addiction, current studies are characterized by large variability regarding methodology, sample characteristics, and results, and translation from animal paradigms to human research remains challenging. Longitudinal approaches with reliable and ecologically valid paradigms of Pavlovian and instrumental processes, including alcohol-related cues and outcomes, are warranted and should be combined with state-of-the-art imaging techniques, computational approaches, and ecological momentary assessment methods.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Behavioral, neurobiological, and neurochemical mechanisms of ethanol self-administration: A translational review

Alcohol use disorder has multiple characteristics including excessive ethanol consumption, impaired control over drinking behaviors, craving and withdrawal symptoms, compulsive seeking behaviors, and is considered a chronic condition. Relapse is common. Determining the neurobiological targets of ethanol and the adaptations induced by chronic ethanol exposure is critical to understanding the clinical manifestation of alcohol use disorders, the mechanisms underlying the various features of the disorder, and for informing medication development. In the present review, we discuss ethanol's interactions with a variety of neurotransmitter systems, summarizing findings from preclinical and translational studies to highlight recent progress in the field. We then describe animal models of ethanol self-administration, emphasizing the value, limitations, and validity of commonly used models. Lastly, we summarize the behavioral changes induced by chronic ethanol self-administration, with an emphasis on cue-elicited behavior, the role of ethanol-related memories, and the emergence of habitual ethanol seeking behavior.

Ethanol-paired stimuli can increase reinforced ethanol responding

While ethanol-paired stimuli are frequently postulated to increase drinking motivation and thus increase ethanol responding and precipitate relapse, no study has demonstrated increases in ethanol-reinforced responding following presentation of an ethanol-paired stimulus that had not previously been part of a contingent relationship. Previous studies have shown that food-paired stimuli can increase food responding that is at low rates and increase food consumption in food-sated rats. In Experiment 1, we show that an ethanol-paired stimulus can increase ethanol responding that is at low levels late in the experimental session, presumably due to satiation. However, these increases may have resulted from either associative or non-associative mechanisms. In Experiment 2, we compared the effects of an ethanol-paired stimulus to those of the same stimulus in a Truly-Random-Control group. In a Truly-Random-Control, the stimulus and ethanol each are presented on independent random schedules, and thus any differences between the effects of the stimulus in the experimental and control groups is likely attributable to the association between the stimulus and ethanol. The stimulus increased ethanol-reinforced responding in both the experimental and control groups, but these increases were greater in the experimental than the control group. Thus, both stimulus-change and the pairing of the stimulus with ethanol may result in increases in ethanol-reinforced responding.

Evidence for incentive salience sensitization as a pathway to alcohol use disorder

The incentive salience sensitization (ISS) theory of addiction holds that addictive behavior stems from the ability of drugs to progressively sensitize the brain circuitry that mediates attribution of incentive salience (IS) to reward-predictive cues and its behavioral manifestations. In this article, we establish the plausibility of ISS as an etiological pathway to alcohol use disorder (AUD). We provide a comprehensive and critical review of evidence for: (1) the ability of alcohol to sensitize the brain circuitry of IS attribution and expression; and (2) attribution of IS to alcohol-predictive cues and its sensitization in humans and non-human animals. We point out gaps in the literature and how these might be addressed. We also highlight how individuals with different alcohol subjective response phenotypes may differ in susceptibility to ISS as a pathway to AUD. Finally, we discuss important implications of this neuropsychological mechanism in AUD for psychological and pharmacological interventions attempting to attenuate alcohol craving and cue reactivity.

Cue-alcohol associative learning in female rats

The ability of environmental cues to trigger alcohol-seeking behaviors is believed to facilitate problematic alcohol use. We previously showed that the development of this cue-evoked alcohol approach reflects cue-alcohol learning and memory in the adult male rat; however, we do not know whether the same is true for similarly aged female rats. Consequently, adult Long-Evans female rats were allowed to drink unsweetened alcohol in the home cage (Monday, Wednesday, Friday; 24-h two-bottle choice; 5 weeks) and were subsequently split into two experimental groups: Paired and Unpaired. Groups were matched for ingested doses and alcohol bottle preference across the pre-conditioning home cage period. Both groups were trained in conditioning chambers using a Pavlovian procedure. For the Paired group, the chamber houselight was illuminated to signal access to an alcohol sipper. Houselight onset was yoked for the Unpaired group, but access to the alcohol sipper was scheduled to occur only during the intervening periods (in the absence of light). We found that in the Paired, but not Unpaired group, an alcohol approach reaction was conditioned to houselight illumination, and the level of cue-conditioned reactivity predicted drinking behavior within trials. Groups experienced equivalently low but non-negligible blood alcohol concentrations over the course of conditioning sessions. We conclude that cue-triggered alcohol-seeking behavior in adult female rats reflects associative learning about the relationship between alcohol availability and houselight illumination.

Effects of rat strain and method of inducing ethanol drinking on Pavlovian-Instrumental-Transfer with ethanol-paired conditioned stimuli

Ethanol-paired conditioned stimuli (CSs) are widely thought to invigorate ethanol responding, and thus, precipitate relapse to drinking. However, preclinical studies investigating this issue using Pavlovian-Instrumental-Transfer (PIT) procedures have had mixed results, with some studies finding PIT while others did not. The studies failing to show PIT used Lewis rats and induced ethanol drinking using a post-prandial drinking procedure. The present experiments examined whether either of these two variables influenced the magnitude of PIT observed. In the first experiment, ethanol drinking in Lewis rats was induced using either sucrose fading or post-prandial drinking. In the second experiment, ethanol drinking was induced using post-prandial drinking in either Long-Evans Hooded or Lewis rats. In both experiments, rats were trained to respond for ethanol under a random interval schedule. Subsequently with the lever removed, 2-min light presentations were paired with ethanol deliveries. Finally, with the lever returned, the effect of light presentations on responding was tested while responding was in extinction. Light presentations similarly affected responding in Lewis rats regardless of the method of drinking induction. Likewise, light presentations similarly affected responding in both Lewis and Long-Evans Hooded rats. Neither ethanol induction method nor rat strain affected the magnitude of PIT observed, and thus, neither likely explains previous failures to observe PIT with ethanol-maintained behavior.

Cued for risk: Evidence for an incentive sensitization framework to explain the interplay between stress and anxiety, substance abuse, and reward uncertainty in disordered gambling behavior

Gambling disorder is an impairing condition confounded by psychiatric co-morbidity, particularly with substance use and anxiety disorders. Yet, our knowledge of the mechanisms that cause these disorders to coalesce remains limited. The Incentive Sensitization Theory suggests that sensitization of neural "wanting" pathways, which attribute incentive salience to rewards and their cues, is responsible for the excessive desire for drugs and cue-triggered craving. The resulting hyper-reactivity of the "wanting' system is believed to heavily influence compulsive drug use and relapse. Notably, evidence for sensitization of the mesolimbic dopamine pathway has been seen across gambling and substance use, as well as anxiety and stress-related pathology, with stress playing a major role in relapse. Together, this evidence highlights a phenomenon known as cross-sensitization, whereby sensitization to stress, drugs, or gambling behaviors enhance the sensitivity and dopaminergic response to any of those stimuli. Here, we review the literature on how cue attraction and reward uncertainty may underlie gambling pathology, and examine how this framework may advance our understanding of co-mordidity with substance-use disorders (e.g., alcohol, nicotine) and anxiety disorders. We argue that reward uncertainty, as seen in slot machines and games of chance, increases dopaminergic activity in the mesolimbic pathway and enhances the incentive value of reward cues. We propose that incentive sensitization by reward uncertainty may interact with and predispose individuals to drug abuse and stress, creating a mechanism through which co-mordidity of these disorders may emerge.

Alcohol-associated antecedent stimuli elicit alcohol seeking in non-dependent rats and may activate the insula

Alcohol self-administration produces brain and behavior adaptations that facilitate a progressive loss of control over drinking and contribute to relapse. One possible adaptation is the ability of antecedent environmental stimuli that are consistently paired with alcohol to trigger alcohol-seeking behaviors. We previously modeled this adaptation in rats using a Pavlovian conditioning procedure in which illumination of a houselight preceded the presentation of a sipper tube that produced unsweetened alcohol when licked. However, in our previous work we did not demonstrate whether this adaptation represented a consequence of repeated exposure to alcohol or the houselight, or whether it was the consequence of associative learning and memory. Thus, in the present study, we tested the associative basis of alcohol seeking in response to houselight illumination in our task using adult male rats that were not food- or water-deprived and were not dependent on alcohol. Separate groups of rats received houselight illumination that was explicitly paired or unpaired with presentation of the retractable sipper that provided access to unsweetened alcohol. Our primary dependent variable was appetitive alcohol-directed behavior: the frequency of movement toward and interaction with the hole in the wall of the chamber through which the sipper was presented during the period of houselight illumination trial before each sipper presentation. However, we also analyzed consummatory sipper licking behavior and blood ethanol concentration in the same rats. Finally, we explored the brain basis of cue-elicited alcohol seeking using c-Fos immunohistochemistry. Our findings confirmed the associative basis of cue-elicited alcohol seeking in our paradigm and mapped these onto the insular cortex, suggesting a role for this brain region in early stages of brain and behavior adaptation to regular alcohol use.

Cue-Induced Ethanol Seeking in Drosophila melanogaster Is Dose-Dependent

Alcohol use disorder generates devastating social, medical and economic burdens, making it a major global health issue. The persistent nature of memories associated with intoxication experiences often induces cravings and triggers relapse in recovering individuals. Despite recent advances, the neural and molecular mechanisms underlying these memories are complex and not well understood. This makes finding effective pharmacological targets challenging. The investigation of persistent alcohol-associated memories in the fruit fly, Drosophila melanogaster, presents a unique opportunity to gain a comprehensive understanding of the memories for ethanol reward at the level of genes, molecules, neurons and circuits. Here we characterize the dose-dependent nature of ethanol on the expression of memory for an intoxication experience. We report that the concentration of ethanol, number of ethanol exposures, length of ethanol exposures, and timing between ethanol exposures are critical in determining whether ethanol is perceived as aversive or appetitive, and in how long the memory for the intoxicating properties of ethanol last. Our study highlights that fruit flies display both acute and persistent memories for ethanol-conditioned odor cues, and that a combination of parameters that determine the intoxication state of the fly influence the seemingly complex retention and expression of memories associated with intoxication. Our thorough behavioral characterization provides the opportunity to interrogate the biological underpinnings of these observed preference differences in future studies.

Optogenetic activation of amygdala projections to nucleus accumbens can arrest conditioned and unconditioned alcohol consummatory behavior

Following a Pavlovian pairing procedure, alcohol-paired cues come to elicit behavioral responses that lead to alcohol consumption. Here we used an optogenetic approach to activate basolateral amygdala (BLA) axonal terminals targeting the shell of nucleus accumbens (AcbSh) and investigated a possible influence over cue-conditioned alcohol seeking and alcohol drinking, based on the demonstrated roles of these areas in behavioral responding to Pavlovian cues and in feeding behavior. Rats were trained to anticipate alcohol or sucrose following the onset of a discrete conditioned stimulus (CS). Channelrhodopsin-mediated activation of the BLA-to-AcbSh pathway concurrent with each CS disrupted cued alcohol seeking. Activation of the same pathway caused rapid cessation of alcohol drinking from a sipper tube. Neither effect was accompanied by an overall change in locomotion. Finally, the suppressive effect of photoactivation on cued-triggered seeking was also evidenced in animals trained with sucrose. Together these findings suggest that photoactivation of BLA terminals in the AcbSh can override the conditioned motivational properties of reward-predictive cues as well as unconditioned consummatory responses necessary for alcohol drinking. The findings provide evidence for a limbic-striatal influence over motivated behavior for orally consumed rewards, including alcohol.

Conditioned Stimulus Form Does Not Explain Failures to See Pavlovian-Instrumental-Transfer With Ethanol-Paired Conditioned Stimuli

BACKGROUND

Pavlovian-Instrumental-Transfer (PIT) examines the effects of associative learning upon instrumental responding. Previous studies examining PIT with ethanol (EtOH)-maintained responding showed increases in responding following presentation of an EtOH-paired conditioned stimulus (CS). Recently, we conducted 2 studies examining PIT with an EtOH-paired CS. One of these found increases in responding, while the other did not. This less robust demonstration of PIT may have resulted from the form of the CS used, as we used a 120-second light stimulus as a CS, while the previous studies used either a 120-second auditory stimulus or a 10-second light stimulus. This study examined whether using conditions similar to our earlier study, but with either a 120-second auditory or a 10-second light stimulus as a CS, resulted in more robust PIT. We also examined the reliability of our previous failure to observe PIT.

METHODS

Three experiments were conducted examining whether PIT was obtained using (i) a 120-second light stimulus, (ii) a 10-second light stimulus, or (iii) a 120-second auditory stimulus as CSs.

RESULTS

We found PIT was not obtained using (i) a 120-second light stimulus as a CS, (ii) a 10-second light stimulus as a CS, or (iii) a 120-second auditory stimulus as a CS.

CONCLUSIONS

These results suggest that CS form does not account for our earlier failure to see PIT. Rather, factors like rat strain or how EtOH drinking is induced may account for when PIT is or is not observed.

Individual Differences in the Attribution of Incentive Salience to a Pavlovian Alcohol Cue

Individual differences exist in the attribution of incentive salience to conditioned stimuli associated with food. Here, we investigated whether individual differences also manifested with a Pavlovian alcohol conditioned stimulus (CS). We compiled data from five experiments that used a Pavlovian autoshaping paradigm and tests of conditioned reinforcement. In all experiments, male, Long-Evans rats with unrestricted access to food and water were acclimated to 15% ethanol. Next, rats received Pavlovian autoshaping training, in which a 10 s presentation of a retractable lever served as the CS and 0.2 mL of 15% ethanol served as the unconditioned stimulus (US). Finally, rats underwent conditioned reinforcement tests in which nose-pokes to an active aperture led to brief presentations of the lever-CS, but nose-pokes to an inactive aperture had no consequence. Rats were categorized as sign-trackers, goal-trackers and intermediates based on a response bias score that reflected their tendencies to sign-track or goal-track at different times during training. We found that distinct groups of rats either consistently interacted with the lever-CS (“sign-trackers”) or routinely approached the port during the lever-CS (“goal-trackers”) across a majority of the training sessions. However, some individuals (“shifted sign-trackers”) with an early tendency to goal-track later shifted to comparable asymptotic levels of sign-tracking as the group identified as sign-trackers. The lever-CS functioned as a conditioned reinforcer for sign-trackers and shifted sign-trackers, but not for goal-trackers. These results provide evidence of robust individual differences in the extent to which a Pavlovian alcohol cue gains incentive salience and functions as a conditioned reinforcer.

Childhood Maltreatment and Development of Substance Use Disorders: A Review and a Model of Cognitive Pathways

Exposure to childhood maltreatment (CM) is associated with increased risk for developing substance use disorders (SUDs). CM exerts negative effects on cognitive abilities including intellectual performance, memory, attention, and executive function. Parallel cognitive impairments have been observed in SUDs. Hence, limited studies have examined the mediating effect of cognitive impairments in the relationship between CM and SUDs. In addition, most studies used concurrent self-report assessments in adult populations. Longitudinal studies that investigated the long-term consequences of CM on psychopathology, including SUDs, throughout childhood, adolescence, and adulthood are rare. Thus, the underlying developmental pathways between CM and SUDs are not clearly understood. In this article, we review the evidence that cognitive impairments mediate, at least in part, the relationship between CM and development of SUDs and propose a model that explains how CM increases the risk for SUDs through the development of a cognitive framework of vulnerability.

Effects of an ethanol-paired CS on responding for ethanol and food: Comparisons with a stimulus in a Truly-Random-Control group and to a food-paired CS on responding for food

Motivational increases due to exposure to alcohol-paired Conditioned Stimuli (CS) are central to some accounts of alcoholism. However, few studies isolate a stimulus's function as a CS from its other potential functions. Pavlovian-Instrumental-Transfer (PIT) procedures isolate a stimulus's function as a CS from its other functions. Though there are several relevant studies using PIT, knowledge gaps exist. Particularly, it is not clear that an alcohol-paired CS will increase alcohol seeking compared to the same stimulus in a Truly-Random-Control group, nor whether such increases are specific to alcohol seeking. To address these knowledge gaps in Experiment 1, rats responded for ethanol (0.1 ml 8% w/v) under an RI 30-sec schedule, then the lever was removed and half the rats had ethanol delivered during occasional 120-sec light presentations, while the remainder had ethanol and the light presented under independent RT schedules. Later the lever was returned and the light was presented during responding in extinction (PIT test). Following this test, levers were again removed and the light was presented without ethanol (light extinction), following again by a PIT test. Responding in the two groups during light presentations did not differ in either PIT test. Experiment 2 repeated Experiment 1 using food instead of ethanol. In Experiment 2, responding during light presentations increased in the paired group. In Experiment 3, rats were trained on a concurrent FR schedule of food and ethanol delivery. Ethanol was delivered following 5 responses and the response requirement for food adjusted so that similar numbers of food and ethanol deliveries were obtained. Subsequently, rats underwent conditioning, control and testing procedures identical to those in Experiment 1. In Experiment 3, the ethanol-paired CS increased ethanol-responding, but not food-responding. These results are most easily interpreted as changes in responding resulting from CS-elicited behavior rather than motivational changes. This interpretation is more compatible with some descriptions of the role of an alcohol-paired CS in alcoholism than others.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Conditioned stimuli's role in relapse: preclinical research on Pavlovian-Instrumental-Transfer

RATIONALE AND OBJECTIVE

Pavlovian learning is central to many theories of addiction. In these theories, stimuli paired with drug ingestion become conditioned stimuli (CS) and subsequently elicit drug-seeking and drug-taking. However, in most relevant studies, Pavlovian and instrumental learning are confounded. This confound may be avoided in Pavlovian-Instrumental-Transfer (PIT) procedures. In PIT, Pavlovian and instrumental learning are established separately and then combined. In order to better understand the role of CSs in addiction, we review the relevant studies using PIT.

FINDINGS

We identified seven articles examining PIT effects of ethanol- or cocaine-paired CSs. Under at least one condition, six of these articles reported CS-elicited increases in responding previously maintained by drug. However, the only study using the optimal control condition failed to find a CS-elicited increase. Two studies examining CS specificity found the CS also increased responding maintained by a different reinforcer. Two studies examined if CSs elicit increases in actual drug-taking. Both failed to find CS-elicited increases, i.e., no study shows CS-elicited increases in actual drug-taking. Further, CS-elicited increases in extinguished responding are short-lived.

CONCLUSIONS

These findings are not entirely consistent with Pavlovian learning playing a central role in addiction. However, design issues can explain most of these inconsistencies. Studies without these design issues are needed. Additionally, existing theories hypothesize drug-paired CSs increase drug-taking by increasing motivation, by eliciting conditioned responses that make drug-seeking more probable, or by a combination of these. Work distinguishing between these mechanisms would also be useful.

Preventing the recovery of extinguished ethanol tolerance

There is substantial evidence that drug-paired cues become associated with drug effects. From a Pavlovian perspective, these cues act as conditioned stimuli and elicit conditioned compensatory responses that contribute to drug tolerance. Here we report two experiments with rats in which we studied the extinction of the associative tolerance to the ataxic effect of ethanol. Experiment 1 evaluated whether changes in the temporal and physical contexts after extinction training provoke recovery of the extinguished tolerance. The results showed successful extinction, spontaneous recovery and renewal of the extinguished tolerance, but no summation of renewal and spontaneous recovery. Experiment 2 evaluated whether using massive extinction trials and delivering extinction in multiple contexts attenuates the renewal effect. The results showed that both manipulations reduced renewal of the extinguished tolerance to the ataxic effect of ethanol; however, these manipulations used in combination did not appear to be more effective in reducing recovery than each by itself. The present results may help guide further research that evaluates behavioral ploys to prevent the recovery of extinguished responses.

Ethanol self-administration in mice under a second-order schedule

Long Fixed-Interval (FI) schedules, particularly second-order schedules, can engender substantial responding before drug or ethanol delivery that is uninfluenced by the direct effects of the drug or ethanol. Thus, these schedules can be used to study the effects of medications upon drug- or ethanol-seeking, uninfluenced by the direct effects of the self-administered drug or ethanol. Long FI second-order schedules are frequently used in primates and occasionally in rats. Under second-order schedules, completion of one response requirement, e.g., a Fixed Ratio 10 (FR10:S), produces a brief stimulus presentation, e.g., a 1-s 80-dB 4-kHZ tone, and this FR10:S serves as the response unit under another schedule, e.g., an FI 1800-s. Thus, the first FR10 completed after 1800 s would result in delivery both of the tone and of reinforcement, e.g., 10 × 0.01 mL 16% (w/v) ethanol. To examine if such schedules could be effectively used in mice, which have advantages in neurobiological and genetic studies, we trained eight C57BL/6J mice to respond under the schedule just described. This schedule maintained substantial responding. The temporal pattern of behavior was typical of an FI schedule with responding accelerating across the interval. We also examined the effects of acute and chronic administration of fluvoxamine on this responding, and these were modest. Finally, we examined responding when alcohol and/or tone deliveries were withheld, and found that extinction occurred most rapidly when both were withheld. This work demonstrates that long FI schedules of ethanol delivery may be useful in studying ethanol seeking in mice.

The attribution of incentive salience to Pavlovian alcohol cues: a shift from goal-tracking to sign-tracking

Environmental stimuli that are reliably paired with alcohol may acquire incentive salience, a property that can operate in the use and abuse of alcohol. Here we investigated the incentive salience of Pavlovian alcohol cues using a preclinical animal model. Male, Long-Evans rats (Harlan) with unrestricted access to food and water were acclimated to drinking 15% ethanol (v/v) in their home-cages. Rats then received Pavlovian autoshaping training in which the 10 s presentation of a retractable lever served as the conditioned stimulus (CS) and 15% ethanol served as the unconditioned stimulus (US) (0.2 ml/CS; 12 CS presentations/session; 27 sessions). Next, in an operant test of conditioned reinforcement, nose pokes into an active aperture delivered presentations of the lever-CS, whereas nose pokes into an inactive aperture had no consequences. Across initial autoshaping sessions, goal-tracking behavior, as measured by entries into the fluid port where ethanol was delivered, developed rapidly. However, with extended training goal-tracking diminished, and sign-tracking responses, as measured by lever-CS activations, emerged. Control rats that received explicitly unpaired CS and US presentations did not show goal-tracking or sign-tracking responses. In the test for conditioned reinforcement, rats with CS-US pairings during autoshaping training made more active relative to inactive nose pokes, whereas rats in the unpaired control group did not. Moreover, active nose pokes were positively correlated with sign-tracking behavior during autoshaping. Extended training may produce a shift in the learned properties of Pavlovian alcohol cues, such that after initially predicting alcohol availability they acquire robust incentive salience.

Pavlovian conditioned approach, extinction, and spontaneous recovery to an audiovisual cue paired with an intravenous heroin infusion

RATIONALE

Novel stimuli paired with exposure to addictive drugs can elicit approach through Pavlovian learning. While such approach behavior, or sign tracking, has been documented for cocaine and alcohol, it has not been shown to occur with opiate drugs like heroin. Most Pavlovian conditioned approach paradigms use an operandum as the sign, so that sign tracking can be easily automated.

OBJECTIVES

We were interested in assessing whether approach behavior occurs to an audiovisual cue paired with an intravenous heroin infusion. If so, would this behavior exhibit characteristics of other Pavlovian conditioned behaviors, such as extinction and spontaneous recovery?

METHODS

Rats were repeatedly exposed to an audiovisual cue, similar to that used in standard self-administration models, along with an intravenous heroin infusion. Sign tracking was measured in an automated fashion by analyzing motion pixels within the cue zone during each cue presentation.

RESULTS

We were able to observe significant sign tracking after only five pairings of the conditioned stimulus (CS) with the unconditioned stimulus (US). This behavior rapidly extinguished over 2 days, but exhibited pronounced spontaneous recovery 3 weeks later.

CONCLUSIONS

We conclude that sign tracking measured by these methods exhibits all the characteristics of a classically conditioned behavior. This model can be used to examine the Pavlovian component of drug memories, alone, or in combination with self-administration methods.

Predicting extinction and reinstatement of alcohol and sucrose self-administration in outbred rats

Preventing relapse to drinking or escalation to excessive drinking could be aided by identifying factors that predict these behaviors. Animal models, particularly those that utilize operant self-administration techniques, can be useful. In a prior operant study, we noted a good deal of variability in behaviors during training and test sessions. We utilized data obtained from that study of two groups of rats, trained and tested identically except one responded for alcohol and the other for sucrose, to explore for associations related to relapse (reinstatement) or to excessive drinking (maintenance). Data were obtained from sessions conducted under fixed- and progressive-ratio schedules as well as from extinction and reinstatement sessions. Variables assessed included active and inactive presses, head entries into the dipper trough, and automated recordings of body movements during these sessions as well as alcohol preference before training. First, using multiple regression, we examined whether alcohol preference before training associated with any response variable among alcohol-responding rats. Second, using factor analysis, we identified a training variable, body movements, that associated with responses during tests. Using this measure, rats were divided into low- and high-response groups and compared on active lever presses and head entries across test sessions. Results show that among alcohol-responding rats, alcohol preference predicted head entries during extinction. High-body-movement rats emitted significantly fewer active lever presses and had fewer head entries across test sessions, particularly during reinstatement, compared with low-body-movement rats. Results from this exploratory study provide clues for future experimental studies.

Associative learning mechanisms underpinning the transition from recreational drug use to addiction

Learning theory proposes that drug seeking is a synthesis of multiple controllers. Whereas goal-directed drug seeking is determined by the anticipated incentive value of the drug, habitual drug seeking is elicited by stimuli that have formed a direct association with the response. Moreover, drug-paired stimuli can transfer control over separately trained drug seeking responses by retrieving an expectation of the drug's identity (specific transfer) or incentive value (general transfer). This review covers outcome devaluation and transfer of stimulus-control procedures in humans and animals, which isolate the differential governance of drug seeking by these four controllers following various degrees of contingent and noncontingent drug exposure. The neural mechanisms underpinning these four controllers are also reviewed. These studies suggest that although initial drug seeking is goal-directed, chronic drug exposure confers a progressive loss of control over action selection by specific outcome representations (impaired outcome devaluation and specific transfer), and a concomitant increase in control over action selection by antecedent stimuli (enhanced habit and general transfer). The prefrontal cortex and mediodorsal thalamus may play a role in this drug-induced transition to behavioral autonomy.

Effects of naltrexone on alcohol drinking patterns and extinction of alcohol seeking in baboons

RATIONALE

Understanding naltrexone's effect on motivation to drink and pattern of drinking is important for better treatment outcomes and for comparison with novel medications.

OBJECTIVES

Naltrexone's effects on number and pattern of seeking, self-administration, and extinction responses were evaluated in two groups of baboons trained under a three-component chained schedule of reinforcement (CSR).

METHODS

Alcohol (4 % w/v; n = 4; alcohol group) or a preferred nonalcoholic beverage (n = 4; control group) was available for self-administration only in component 3 of the CSR. Responses in component 2 provided indices of motivation to drink (seeking). Naltrexone (0.32-3.2 mg/kg) and saline were administered before drinking and component 2 extinction sessions.

RESULTS

Acute doses of naltrexone significantly decreased total self-administration responses (p < 0.01), intake volume (p < 0.001), and grams per kilogram of alcohol (p < 0.01) in the alcohol group only. Pattern of drinking did not change, but the number of drinks during the initial drinking bout was decreased significantly by naltrexone for both groups (p < 0.05). During within-session extinction tests, acute naltrexone significantly decreased time to reach extinction (p < 0.01) and number of seeking responses (p < 0.05), particularly early in the extinction period in the alcohol group only. When administered chronically, naltrexone did not decrease progressive ratio breaking points to gain access to alcohol, but dose dependently reduced alcohol self-administration (p < 0.05) by decreasing the magnitude of the initial drinking bout.

CONCLUSIONS

The results support clinical observations that naltrexone may be most effective at reducing self-administration in the context of ongoing alcohol availability and may reduce motivation to drink in the presence of alcohol-related cues.

Sign- vs. goal-tracking in a feature positive discrimination task with nicotine: importance of spatial location of the conditional stimulus

We assessed whether sign-tracking developed along with goal-tracking in a Pavlovian drug discrimination task. Rats had nicotine sessions intermixed with saline sessions. For nicotine sessions, 15-s illumination of a light near (Experiment 1) or far (Experiment 2) from the dipper receptacle was followed by sucrose. Saline sessions were similar to nicotine sessions except sucrose was withheld. Regardless of location, the light evoked goal-tracking only on nicotine sessions. Only rats with the light near the dipper developed sign-tracking.

The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction

Memory reconsolidation is the process by which memories, destabilised at retrieval, require restabilisation to persist in the brain. It has been demonstrated that even old, well-established memories require reconsolidation following retrieval; therefore, memory reconsolidation could potentially be exploited to disrupt, or even erase, aberrant memories that underlie psychiatric disorders, thereby providing a novel therapeutic target. Drug addiction is one such disorder; it is both chronic and relapsing, and one prominent risk factor for a relapse episode is the presentation of environmental cues that have previously been associated with drugs of abuse. This 'cue-induced relapse' can be accounted for in psychological terms by reinforcing memories of the pavlovian association between the cue and the drug, which can thus influence behaviour through at least three psychologically and neurobiologically dissociable mechanisms: conditioned reinforcement, conditioned approach and conditioned motivation. As each of these psychological processes could contribute to the resumption of drug-seeking following abstinence, it is important to develop treatments that can reduce drug-seeking re-established via influences on each or all of these pavlovian processes, in order to minimise the risk of a subsequent relapse. Investigation of the memory reconsolidation mechanisms of the memories underlying conditioned reinforcement, conditioned approach and conditioned motivation indicate that they depend upon different neurochemical systems, including the glutamatergic and adrenergic systems within limbic corticostriatal circuitry. We also discuss here the subsequent translation to the clinic of this preclinical work.

Involvement of amygdala dopamine and nucleus accumbens NMDA receptors in ethanol-seeking behavior in mice

Although progress has been made identifying neural mechanisms underlying ethanol's primary reinforcing effects, few studies have examined the mechanisms mediating ethanol-induced conditioned effects. A recent lesion study suggests that expression of ethanol-conditioned behaviors depends upon an intact amygdala and nucleus accumbens core. However, specific mechanisms within these nuclei are unknown. In the present experiments, we used site-specific microinfusions of dopamine and NMDA receptor antagonists to examine the roles of accumbens and amygdala in the expression of ethanol conditioned place preference (CPP) in mice. In experiments 1 and 2, a D1/D2/D3 receptor antagonist (flupenthixol) was infused into accumbens or amygdala before testing, whereas experiment 3 used pretest infusions of an NMDA antagonist (AP-5) to examine the role of intra-accumbens NMDA receptors. Dopamine antagonism of accumbens was without effect, but intra-amygdala infusions of flupenthixol blocked CPP expression. Moreover, this effect was dependent upon dopamine antagonism within the basolateral nucleus but not the central nucleus of the amygdala. Antagonism of NMDA receptors in accumbens also blocked CPP expression. The present findings suggest that expression of the ethanol-conditioned response depends upon amygdala dopamine and accumbens NMDA receptors. These are the first studies in any species to show a role for amygdala dopamine receptors and the first studies in mice to implicate accumbens NMDA receptors in ethanol-induced conditioned effects.

Context-induced relapse of conditioned behavioral responding to ethanol cues in rats

BACKGROUND

The environmental context in which drug-conditioned cues are encountered could modulate the capacity of such cues to trigger relapse in abstinent addicts. We explored this hypothesis using a behavioral animal model.

METHODS

Rats were trained to discriminate between two auditory stimuli; the first (CS+) was paired with 10% ethanol and the second (CS-) was presented without ethanol. Training occurred in operant conditioning chambers equipped with distinct contextual stimuli, and entries into the ethanol delivery port during the stimuli were measured. Behavior was then extinguished by presenting both stimuli without ethanol in a second, different context. Context-dependent renewal of port entries was tested by presenting the CS+ and CS- without ethanol in the original training context.

RESULTS

At test, port entries during the CS+ increased compared with extinction levels, while responding during the CS- remained unchanged (n = 11). This effect was attenuated after multiple extinction sessions in three distinct contexts (n = 18), compared with an equivalent number of extinction sessions in a single unique context (n = 16). Context-dependent renewal of port entries was also observed to a CS+ paired with 14% sucrose (n = 7) but not to a CS+ paired with 2% sucrose (n = 8).

CONCLUSIONS

Environmental contexts can trigger the relapse of behavioral responding to ethanol- and sucrose-predictive cues in rats. For ethanol, this effect can be reduced by extinguishing responses to the ethanol cue in multiple distinct contexts, a manipulation that could increase the efficacy of cue-reactivity treatments for addiction.

Individual differences in the attribution of incentive salience to reward-related cues: Implications for addiction

Drugs of abuse acquire different degrees of control over thoughts and actions based not only on the effects of drugs themselves, but also on predispositions of the individual. Those individuals who become addicted are unable to shift their thoughts and actions away from drugs and drug-associated stimuli. Thus in addicts, exposure to places or things (cues) that has been previously associated with drug-taking often instigates renewed drug-taking. We and others have postulated that drug-associated cues acquire the ability to maintain and instigate drug-taking behavior in part because they acquire incentive motivational properties through Pavlovian (stimulus-stimulus) learning. In the case of compulsive behavioral disorders, including addiction, such cues may be attributed with pathological incentive value ("incentive salience"). For this reason, we have recently begun to explore individual differences in the tendency to attribute incentive salience to cues that predict rewards. When discrete cues are associated with the non-contingent delivery of food or drug rewards some animals come to quickly approach and engage the cue even if it is located at a distance from where the reward will be delivered. In these animals the reward-predictive cue itself becomes attractive, eliciting approach towards it, presumably because it is attributed with incentive salience. Animals that develop this type of conditional response are called "sign-trackers". Other animals, "goal-trackers", do not approach the reward-predictive cue, but upon cue presentation they immediately go to the location where food will be delivered (the "goal"). For goal-trackers the reward-predictive cue is not attractive, presumably because it is not attributed with incentive salience. We review here preliminary data suggesting that these individual differences in the tendency to attribute incentive salience to cues predictive of reward may confer vulnerability or resistance to compulsive behavioral disorders, including addiction. It will be important, therefore, to study how environmental, neurobiological and genetic interactions determine the extent to which individuals attribute incentive value to reward-predictive stimuli.

Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse

Drug abuse researchers have noted striking similarities between behaviors elicited by Pavlovian sign-tracking procedures and prominent symptoms of drug abuse. In Pavlovian sign-tracking procedures, repeated paired presentations of a small object (conditioned stimulus, CS) with a reward (unconditioned stimulus, US) elicits a conditioned response (CR) that typically consists of approaching the CS, contacting the CS, and expressing consummatory responses at the CS. Sign-tracking CR performance is poorly controlled and exhibits spontaneous recovery and long-term retention, effects that resemble relapse. Sign-tracking resembles psychomotor activation, a syndrome of behavioral responses evoked by addictive drugs, and the effects of sign-tracking on corticosterone levels and activation of dopamine pathways resemble the neurobiological effects of abused drugs. Finally, the neurobiological profile of individuals susceptible to sign-tracking resembles the pathophysiological profile of vulnerability to drug abuse, and vulnerability to sign-tracking predicts vulnerability to impulsive responding and alcohol self-administration. Implications of sign-tracking for models of drug addiction are considered.

Roles of the nucleus accumbens and amygdala in the acquisition and expression of ethanol-conditioned behavior in mice

Although progress has been made identifying the neural areas underlying the primary reinforcing effects of ethanol, few studies have examined the neural areas mediating ethanol-induced conditioned effects. Previous work using the conditioned place preference (CPP) procedure implicates the ventral tegmental area (VTA) (Bechtholt and Cunningham, 2005), but the downstream neural areas modulating the conditioned rewarding effects of ethanol have not been identified. Although the nucleus accumbens (Acb) and the amygdala (Amy), which both receive dopamine innervation from the VTA, have been implicated in the primary reinforcing effects of ethanol, the roles these areas play in ethanol-conditioned behaviors are unknown. In the present set of experiments, we use the CPP procedure along with selective electrolytic lesions to examine the neural areas underlying the acquisition and expression of ethanol conditioned behavior. In the acquisition experiment, male DBA/2J mice received bilateral lesions of the Acb or Amy before CPP training. In the expression experiments, mice received bilateral lesions of the Acb, Acb shell, Acb core, and Amy, or unilateral lesions of the Amy after training but before testing. Lesions of the Acb and Amy before training disrupted acquisition and expression of ethanol CPP. However, when given after training, only lesions of the Amy disrupted expression, whereas lesions of the Acb core facilitated loss of responding, of ethanol CPP. For the first time, these results demonstrate the role of the Acb and Amy in the acquisition and expression of ethanol-induced conditioned reward.

Goal- and signal-directed incentive: conditioned approach, seeking, and consumption established with unsweetened alcohol in rats

RATIONALE

Many theories of addictive behavior propose that cues signaling drug administration influence the likelihood of drug-taking and drug-seeking behavior.

OBJECTIVES

We investigated the behavioral impact of cues associated with unsweetened ethanol and their interaction with responding maintained by ethanol self-administration. Our goal was to establish the influence of such cues on ethanol seeking.

MATERIALS AND METHODS

The experiment used a matching contingency and saccharin-fading procedure to establish equal levels of responding to two spatially distinct levers using unsweetened 10% ethanol solution. After ethanol self-administration was established, a brief cue light located alternately over each lever location was either paired or unpaired (control) with the opportunity to consume the same ethanol solution. Finally, self-administration was re-established, and the effect of the cue was measured in a transfer design.

RESULTS

The reaction to lights paired with the opportunity to ingest unsweetened ethanol had three main effects: (1) induction of operant behavior reinforced by ethanol, (2) stimulation of ethanol-seeking behavior (drinker entries), and (3) cue-directed approach and contact behavior (i.e. autoshaping or sign-tracking). Cue-directed behavior to the light interacted with choice behavior in a manner predicted by the location of the cue light, enhancing responding only when the approach response did not interfere with the operant response.

CONCLUSIONS

These findings replicate and extend the effects of Pavlovian conditioning on ethanol-seeking and support-conditioned incentive theories of addictive behavior. Signals for ethanol influence spatial choice behavior and may be relevant to attentional bias shown to alcohol-associated stimuli in humans.

Rapid induction of Pavlovian approach to an ethanol-paired visual cue in mice

RATIONALE

Although many studies have shown Pavlovian conditioned approach to cues paired with natural reinforcers, it has been quite difficult to induce such behavior with drug reinforcers.

OBJECTIVES

This experiment tested a novel Pavlovian procedure for inducing approach to a conditioned stimulus (CS) paired with ethanol.

METHODS

Mice (NZB/B1NJ, DBA/2J) received intraperitoneal injections of ethanol (2 g/kg) immediately before 10-min exposure to a rectangular chamber that contained a distinctive visual cue (star) at one end (Paired group, CS+ trials). On alternate days, saline injection preceded apparatus exposure with no distinctive cues (CS- trials). Unpaired control mice received ethanol in the home cage 60-75 min after each CS+ trial.

RESULTS

NZB/B1NJ Paired group mice spent increasing amounts of time (>85% of the session) in proximity to the star, whereas Unpaired group mice did not. DBA/2J Paired group mice spent slightly more time on the star side than Unpaired group mice but did not show an acquisition curve. Postconditioning tests showed a strong preference for the star side in Paired groups from both strains after saline injection. However, only NZB/B1NJ mice showed a preference after ethanol.

CONCLUSIONS

This study provides the first unambiguous demonstration of Pavlovian conditioned approach to an ethanol-paired visual stimulus in the absence of any contingency between the animal's behavior and drug exposure. This effect, which is remarkable both in terms of its magnitude and the rapidity with which it was produced (within 2-3 trials), may be related to the cue-associated craving that accompanies alcohol and drug addiction.

Ethanol-associated cues produce general pavlovian-instrumental transfer

BACKGROUND

Conditioned stimuli are thought to play an important role in maintaining ethanol use and inducing relapse. Therefore, understanding the mechanisms through which such stimuli trigger ethanol seeking is of interest in the study and treatment of alcoholism.

METHODS

This series of experiments examined the impact of ethanol-associated cues on ethanol-seeking behavior using a Pavlovian-instrumental transfer design. Rats received Pavlovian training in which an auditory stimulus predicted ethanol (10%) delivery. In a separate instrumental training phase, animals were trained to press a lever for ethanol. In the test phase, the impact of the stimulus on instrumental performance was assessed in extinction by presenting the stimulus while animals were free to perform the lever-press response. Experiment 2 assessed the selectivity of the transfer effect; rats received training with 2 auditory stimuli which predicted either ethanol or sucrose (2%) delivery and were trained to perform 2 instrumental responses, one earning ethanol and the other earning sucrose. Finally, Experiment 3 examined the selectivity of PIT using 2 natural rewards (sucrose and polycose).

RESULTS

The results from Experiment 1 show that ethanol supports excitatory conditioning and that ethanol-associated cues facilitate instrumental performance for ethanol. When the selectivity of the transfer effect was examined in Experiment 2, the ethanol-paired stimulus was found to have a general excitatory effect on reward-seeking behavior, affecting both ethanol-directed and sucrose-directed responding equally. In contrast, the sucrose-paired stimulus had a selective effect, elevating sucrose-directed responding only. Experiment 3 confirms that selective transfer is observed when 2 natural rewards are used to reinforce responding.

CONCLUSIONS

These data provide further evidence that ethanol-associated cues can drive ethanol-seeking behaviors. Because ethanol-associated cues also enhanced seeking behavior for a nonalcohol reward, these results additionally suggest that the modulation of reward-directed behaviors by cues associated with ethanol versus natural rewards may rely on different behavioral and neural mechanisms.

The habitual brain: an "adapted habit" theory of substance use disorders

Behavioral habits are essential to human and animal life. We consider the many ways that habits - which are normally adaptive - can be expressed as drug use behavior and addiction. Although habit theories of substance use disorders have been proposed (e.g., Tiffany, 1990), the behavioral science and underlying neurobiology of habit development, maintenance, and change is only now being studied. We first define "adapted habit." We then propose that the etiology of an adapted habit represents the combination of: (a) initial "capture" of a habit, (b) development of behavioral action schemata, and (c) an overlay of cognitive expectancies concerning aspects of the habit. This combination conspires to make an intractable adapted habit such as substance abuse and addiction. Many intractable habits change, including substance use disorders such as cigarette smoking. As part of a science of habits, we need a real understanding of how to change habits to avoid or minimize harm.

From Malthus to motive: how the HPA axis engineers the phenotype, yoking needs to wants

The hypothalamo-pituitary-adrenal (HPA) axis is the critical mediator of the vertebrate stress response system, responding to environmental stressors by maintaining internal homeostasis and coupling the needs of the body to the wants of the mind. The HPA axis has numerous complex drivers and highly flexible operating characterisitics. Major drivers include two circadian drivers, two extra-hypothalamic networks controlling top-down (psychogenic) and bottom-up (systemic) threats, and two intra-hypothalamic networks coordinating behavioral, autonomic, and neuroendocrine outflows. These various networks jointly and flexibly control HPA axis output of periodic (oscillatory) functions and a range of adventitious systemic or psychological threats, including predictable daily cycles of energy flow, actual metabolic deficits over many time scales, predicted metabolic deficits, and the state-dependent management of post-prandial responses to feeding. Evidence is provided that reparation of metabolic derangement by either food or glucocorticoids results in a metabolic signal that inhibits HPA activity. In short, the HPA axis is intimately involved in managing and remodeling peripheral energy fluxes, which appear to provide an unidentified metabolic inhibitory feedback signal to the HPA axis via glucocorticoids. In a complementary and perhaps a less appreciated role, adrenocortical hormones also act on brain to provide not only feedback, but feedforward control over the HPA axis itself and its various drivers, as well as coordinating behavioral and autonomic outflows, and mounting central incentive and memorial networks that are adaptive in both appetitive and aversive motivational modes. By centrally remodeling the phenotype, the HPA axis provides ballistic and predictive control over motor outflows relevant to the type of stressor. Evidence is examined concerning the global hypothesis that the HPA axis comprehensively induces integrative phenotypic plasticity, thus remodeling the body and its governor, the brain, to yoke the needs of the body to the wants of the mind. Adverse side effects of this yoking under conditions of glucocorticoid excess are discussed.

Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm

Environmental stimuli predictive of appetitive events can elicit Pavlovian approach responses that enhance an organism's ability to track and secure natural rewards, but may also contribute to the compulsive nature of drug addiction. Here, we examined the activity of individual nucleus accumbens (NAc) neurons during an autoshaping paradigm. One conditioned stimulus (CS+, a retractable lever presented for 10 s) was immediately followed by the delivery of a 45-mg sucrose pellet to a food receptacle, while another stimulus (CS-, a separate retractable lever presented for 10 s) was never followed by sucrose. Approach responses directed at the CS+ and CS- were recorded as lever presses and had no experimental consequence. Rats (n = 9) selectively approached the CS+ on more than 80% of trials and were surgically prepared for electrophysiological recording. Of 76 NAc neurons, 57 cells (75%) exhibited increases and/or decreases in firing rate (i.e. termed 'phasically active') during the CS+ presentation and corresponding approach response. Forty-seven percent of phasically active cells (27 out of 57) were characterized by time-locked but transient increases in cell firing, while 53% (30 out of 57) showed a significant reduction in firing for the duration of the CS+. In contrast, the same excitatory subpopulation exhibited smaller increases in activity relative to CS- onset, while the inhibitory subpopulation showed no change in firing during the CS- period. The magnitude and prevalence of cue-related neural responses reported here indicates that the NAc encodes biologically significant, repetitive approach responses that may model the compulsive nature of drug addiction in humans.

The attribution of incentive salience to a stimulus that signals an intravenous injection of cocaine

A central premise of a number of theories of addiction is that discrete environmental stimuli repeatedly paired with drugs of abuse acquire incentive salience as a result of Pavlovian learning. There is, however, no unequivocal evidence supporting this assumption. Thus, we employed a Pavlovian conditioning procedure known to imbue non-drug reinforcers with incentive salience and extended it to study the effects of intravenous cocaine. Specifically, we examined whether a cue paired with intravenous cocaine administration would come to elicit approach towards it (sign-tracking), even if no behavioral response were required to receive the cue or drug. We found that when a cue was paired with intravenous cocaine delivery (but not when it was unpaired) rats came to approach and investigate the cue, and did so with increasing rapidity. We conclude that Pavlovian learning can imbue drug-paired cues with incentive salience, making them attractive and "wanted" stimuli. Delineating the neurobiological mechanisms responsible for this process will be important for understanding and treating drug addiction.

Behavioural assessment of drug reinforcement and addictive features in rodents: an overview

Some psychoactive drugs are abused because of their ability to act as reinforcers. As a consequence behavioural patterns (such as drug-seeking/drug-taking behaviours) are promoted that ensure further drug consumption. After prolonged drug self-administration, some individuals lose control over their behaviour so that these drug-seeking/taking behaviours become compulsive, pervading almost all life activities and precipitating the loss of social compatibility. Thus, the syndrome of addictive behaviour is qualitatively different from controlled drug consumption. Drug-induced reinforcement can be assessed directly in laboratory animals by either operant or non-operant self-administration methods, by classical conditioning-based paradigms such as conditioned place preference or sign tracking, by facilitation of intracranial electric self-stimulation, or, alternatively by drug-induced memory enhancement. In contrast, addiction cannot be modelled in animals, at least as a whole, within the constraints of the laboratory. However, various procedures have been proposed as possible rodent analogues of addiction's major elements including compulsive drug seeking, relapse, loss of control/impulsivity, and continued drug consumption despite negative consequences. This review provides an extensive overview and a critical evaluation of the methods currently used for studying drug-induced reinforcement as well as specific features of addictive behaviour. In addition, comic strips that illustrate behavioural methods used in the drug abuse field are provided given for free download under http://www.zi-mannheim/psychopharmacology.de.

Sign-tracking (autoshaping) in rats: a comparison of cocaine and food as unconditioned stimuli

A series of experiments was performed to determine whether sign-tracking would occur in rats with intravenous (i.v.) cocaine as the unconditioned stimulus. In Experiment 1, a retractable lever paired with food produced strong sign-tracking, but a lever paired with one of three doses of i.v. cocaine did not elicit any approach or contact behavior. Experiment 2 demonstrated that doses of cocaine that did not elicit sign-tracking would function as a positive reinforcer for a lever contact operant. In Experiment 3, an artificial consummatory response was added to make the cocaine reinforcement episode more behaviorally comparable to that occasioned by food. Although the rats readily performed this response when it was required to receive cocaine infusions, they still did not contact a lever that signaled the availability of these infusions. It appears that cocaine is different from other positive reinforcers (e.g., food, water, warmth, or intracranial stimulation) in that it will not produce sign-tracking in rats.

Context Effects on Alcohol Cognitions

This article summarizes a symposium on context and alcohol-related cognitions presented at the 2004 Annual Meeting of the Research Society on Alcoholism in Vancouver, British Columbia, Canada. The studies reported here examine how the manipulation of contextual variables influences the availability of alcohol outcome expectancies and implicit memories for alcohol associations. The symposium illustrates the range of context variables and shows some of the potential impact of retrieval on cognitions that predict alcohol use. Two of the studies explore naturalistic drinking contexts: one examines the impact of stress induction, and one assesses within survey question placement effects. A variety of measures of alcohol cognitions were used. The results demonstrate that alcohol cognitions are more accessible in alcohol-related contexts. Moreover, availability of alcohol associations and expectancies depended on individual differences. These results underscore the potential value of memory processes in the retrieval and measurement of alcohol cognitions. The findings have direct implications for improving methods of predicting alcohol use and in understanding the role of alcohol cognitions in various contexts associated with alcohol use.