Cam: An animal learning model of excessive and compulsive implementassisted drug-taking in humans

Effects of an ethanol-paired conditioned stimulus on responding for ethanol suppressed by a conditioned-taste-aversion

Ethanol-Paired Conditioned Stimuli (CS) can increase ethanol-responding either in extinction or occurring at low rates late in a session. To examine the generality of CS-induced increases in ethanol-responding, we examined whether a CS could increase responding suppressed by Conditioned-Taste-Aversion (CTA), which presumably suppresses responding by changing ethanol's valence from positive to negative. Rats were trained to respond for ethanol under a Random Interval (RI) schedule. We then removed the lever and paired Random-Time ethanol deliveries with illumination of a stimulus light (i.e., CS) for 10 sessions. Results were compared with a Truly Random Control group, in which the light and ethanol deliveries occurred independently. In a subsequent experiment, rats were treated similarly, except the light served as a discriminative stimulus, as the lever was extended and ethanol deliveries were available under a RI during light presentations. After this training, the lever was returned and rats again responded for ethanol. Subsequently, sessions were followed by LiCl administration. When responding reached low levels, LiCl administration stopped and the light was occasionally illuminated during the session. Responding during the light presentation was compared to responding during the period preceding light presentation. Responding partially recovered across 10 sessions and was greater during light presentations than in the period before it in all three groups. Increases were not reliably different between the groups, indicating that explanations for these increases such as CS-induced increases in motivation or approach toward the light are unlikely to be correct. The most likely explanation for these light-induced increases is that during sessions in which the light had been presented previously, LiCl had never been presented and thus, the light had come to signal that ethanol was safe to drink.

A test of the role of stimulus-response and stimulus-outcome associations in the effects of intermittent-access training

Increased reinforcer motivation in rats has been repeatedly demonstrated following intermittent-access (IntA) training, where the reinforcer is only available for brief periods during a session, compared to continuous-access (ContA) training where the reinforcer is available throughout the session. The present study investigated whether different associations learned during training on the two procedures contributes to the effect. Two experiments tested the importance of the stimulus-response (S-R) and stimulus-outcome (S-O) associations between the IntA availability cues and the training response and reinforcer, respectively. In Exp. 1, separate groups of rats were trained to lever press for saccharin on the IntA or ContA procedures. Increased motivation for saccharin was observed in the IntA group on a later progressive ratio test where nosepoking was the operant (but not when lever pressing was the operant). The outcome of the nosepoke test suggests that a potential S-R association formed during IntA training was not critical for the effect. In Exp. 2, increased saccharin motivation (on nosepoke tests) after IntA training (with lever pressing) was observed regardless of the presence or absence of IntA availability cues, indicating that the S-O association formed during training is not critical for the effect either. Overall, these results suggest that the elemental associations learned on IntA procedures may not be what drives increased motivation observed after IntA training.

Ethanol-paired stimuli can increase reinforced ethanol responding

While ethanol-paired stimuli are frequently postulated to increase drinking motivation and thus increase ethanol responding and precipitate relapse, no study has demonstrated increases in ethanol-reinforced responding following presentation of an ethanol-paired stimulus that had not previously been part of a contingent relationship. Previous studies have shown that food-paired stimuli can increase food responding that is at low rates and increase food consumption in food-sated rats. In Experiment 1, we show that an ethanol-paired stimulus can increase ethanol responding that is at low levels late in the experimental session, presumably due to satiation. However, these increases may have resulted from either associative or non-associative mechanisms. In Experiment 2, we compared the effects of an ethanol-paired stimulus to those of the same stimulus in a Truly-Random-Control group. In a Truly-Random-Control, the stimulus and ethanol each are presented on independent random schedules, and thus any differences between the effects of the stimulus in the experimental and control groups is likely attributable to the association between the stimulus and ethanol. The stimulus increased ethanol-reinforced responding in both the experimental and control groups, but these increases were greater in the experimental than the control group. Thus, both stimulus-change and the pairing of the stimulus with ethanol may result in increases in ethanol-reinforced responding.

Toward a Unifying Account of Impulsivity and the Development of Self-Control

Impulsivity has traditionally been thought to involve various behavioral traits that can be measured using different laboratory protocols. Whereas some authors regard different measures of impulsivity as reflecting fundamentally distinct and unrelated behavioral tendencies (fragmentation approach), others regard those different indexes as analogue forms of the same behavioral tendency, only superficially different (unification approach). Unifying accounts range from mere intuitions to more sophisticated theoretical systems. Some of the more complete attempts at unifying are intriguing but have validity weaknesses. We propose a new unifying attempt based on theoretical points posed by other authors and supplemented by theory and research on associative learning. We then apply these assumptions to characterize the paradigms used to study impulsivity in laboratory settings and evaluate their scope as an attempt at unification. We argue that our approach possesses a good balance of parsimony and empirical and theoretical grounding, as well as a more encompassing scope, and is more suitable for experimental testing than previous theoretical frameworks. In addition, the proposed approach is capable of generating a new definition of impulsivity and outlines a hypothesis of how self-control can be developed. Finally, we examine the fragmentation approach from a different perspective, emphasizing the importance of finding similarities among seemingly different phenomena.

Conditioned Stimulus Form Does Not Explain Failures to See Pavlovian-Instrumental-Transfer With Ethanol-Paired Conditioned Stimuli

BACKGROUND

Pavlovian-Instrumental-Transfer (PIT) examines the effects of associative learning upon instrumental responding. Previous studies examining PIT with ethanol (EtOH)-maintained responding showed increases in responding following presentation of an EtOH-paired conditioned stimulus (CS). Recently, we conducted 2 studies examining PIT with an EtOH-paired CS. One of these found increases in responding, while the other did not. This less robust demonstration of PIT may have resulted from the form of the CS used, as we used a 120-second light stimulus as a CS, while the previous studies used either a 120-second auditory stimulus or a 10-second light stimulus. This study examined whether using conditions similar to our earlier study, but with either a 120-second auditory or a 10-second light stimulus as a CS, resulted in more robust PIT. We also examined the reliability of our previous failure to observe PIT.

METHODS

Three experiments were conducted examining whether PIT was obtained using (i) a 120-second light stimulus, (ii) a 10-second light stimulus, or (iii) a 120-second auditory stimulus as CSs.

RESULTS

We found PIT was not obtained using (i) a 120-second light stimulus as a CS, (ii) a 10-second light stimulus as a CS, or (iii) a 120-second auditory stimulus as a CS.

CONCLUSIONS

These results suggest that CS form does not account for our earlier failure to see PIT. Rather, factors like rat strain or how EtOH drinking is induced may account for when PIT is or is not observed.

Effects of an ethanol-paired CS on responding for ethanol and food: Comparisons with a stimulus in a Truly-Random-Control group and to a food-paired CS on responding for food

Motivational increases due to exposure to alcohol-paired Conditioned Stimuli (CS) are central to some accounts of alcoholism. However, few studies isolate a stimulus's function as a CS from its other potential functions. Pavlovian-Instrumental-Transfer (PIT) procedures isolate a stimulus's function as a CS from its other functions. Though there are several relevant studies using PIT, knowledge gaps exist. Particularly, it is not clear that an alcohol-paired CS will increase alcohol seeking compared to the same stimulus in a Truly-Random-Control group, nor whether such increases are specific to alcohol seeking. To address these knowledge gaps in Experiment 1, rats responded for ethanol (0.1 ml 8% w/v) under an RI 30-sec schedule, then the lever was removed and half the rats had ethanol delivered during occasional 120-sec light presentations, while the remainder had ethanol and the light presented under independent RT schedules. Later the lever was returned and the light was presented during responding in extinction (PIT test). Following this test, levers were again removed and the light was presented without ethanol (light extinction), following again by a PIT test. Responding in the two groups during light presentations did not differ in either PIT test. Experiment 2 repeated Experiment 1 using food instead of ethanol. In Experiment 2, responding during light presentations increased in the paired group. In Experiment 3, rats were trained on a concurrent FR schedule of food and ethanol delivery. Ethanol was delivered following 5 responses and the response requirement for food adjusted so that similar numbers of food and ethanol deliveries were obtained. Subsequently, rats underwent conditioning, control and testing procedures identical to those in Experiment 1. In Experiment 3, the ethanol-paired CS increased ethanol-responding, but not food-responding. These results are most easily interpreted as changes in responding resulting from CS-elicited behavior rather than motivational changes. This interpretation is more compatible with some descriptions of the role of an alcohol-paired CS in alcoholism than others.

Conditioned stimuli's role in relapse: preclinical research on Pavlovian-Instrumental-Transfer

RATIONALE AND OBJECTIVE

Pavlovian learning is central to many theories of addiction. In these theories, stimuli paired with drug ingestion become conditioned stimuli (CS) and subsequently elicit drug-seeking and drug-taking. However, in most relevant studies, Pavlovian and instrumental learning are confounded. This confound may be avoided in Pavlovian-Instrumental-Transfer (PIT) procedures. In PIT, Pavlovian and instrumental learning are established separately and then combined. In order to better understand the role of CSs in addiction, we review the relevant studies using PIT.

FINDINGS

We identified seven articles examining PIT effects of ethanol- or cocaine-paired CSs. Under at least one condition, six of these articles reported CS-elicited increases in responding previously maintained by drug. However, the only study using the optimal control condition failed to find a CS-elicited increase. Two studies examining CS specificity found the CS also increased responding maintained by a different reinforcer. Two studies examined if CSs elicit increases in actual drug-taking. Both failed to find CS-elicited increases, i.e., no study shows CS-elicited increases in actual drug-taking. Further, CS-elicited increases in extinguished responding are short-lived.

CONCLUSIONS

These findings are not entirely consistent with Pavlovian learning playing a central role in addiction. However, design issues can explain most of these inconsistencies. Studies without these design issues are needed. Additionally, existing theories hypothesize drug-paired CSs increase drug-taking by increasing motivation, by eliciting conditioned responses that make drug-seeking more probable, or by a combination of these. Work distinguishing between these mechanisms would also be useful.

Sign-tracking predicts increased choice of cocaine over food in rats

The purpose of this study was to determine whether the tendency to sign-track to a food cue was predictive of rats' choice of cocaine over food. First, rats were trained on a procedure where insertion of a retractable lever was paired with food. A sub-group of rats - sign-trackers - primarily approached and contacted the lever, while another sub-group - goal-trackers - approached the site of food delivery. Rats were then trained on a choice task where they could choose between an infusion of cocaine (1.0 mg/kg) and a food pellet (45 mg). Sign-trackers chose cocaine over food significantly more often than did goal-trackers. These results support the incentive-salience theory of addiction and add to a growing number of studies which suggest that sign-trackers may model an addiction-prone phenotype.

Drink, drugs and disruption: memory manipulation for the treatment of addiction

Addiction is a complex disorder, and one characterised by the acquisition of maladaptive instrumental (drug-seeking and drug-taking) and pavlovian (cue-drug associations) memories. These memories markedly contribute to the long-term risk of relapse, so reduction of the impact of these memories on behaviour could potentially be an important addition to current therapies for addiction. Memory reconsolidation may provide such a target for disrupting well-consolidated pavlovian cue-drug memories following an extensive drug history. Reconsolidation can be disrupted either by administering amnestic drugs in conjunction with a memory reactivation session, or by updating the memory adaptively through the induction of 'superextinction'. More work is needed before these therapies are ready for translation to the clinic, but if found clinically effective memory manipulation promises a radical new way of treating addiction.

Effects of lesions of the amygdala central nucleus on autoshaped lever pressing

Neutral cues paired with rewards often appear to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues have been reported to modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), serve as conditioned reinforcers in the establishment of new learning, and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the amygdala central nucleus (CeA) on the acquisition of discriminative autoshaped lever-pressing. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose delivery was not contingent on lever pressing, both CeA- and sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Despite their showing little evidence of impairments in autoshaped lever pressing, these same CeA-lesioned rats showed significant deficits in the expression of PIT in a subsequent phase of the experiment. The lack of impaired autoshaping in CeA-lesioned rats contrasts with effects previously reported for conditioned orienting responses (ORs) and for other putative measures of incentive learning including PIT and conditioned approach to visual cues.

Pairings of lever and food induce Pavlovian conditioned approach of sign-tracking and goal-tracking in C57BL/6 mice

In rats, Pavlovian sign-tracking has been extensively evaluated as a model of compulsiveness in drug addiction and other addictive behaviors, but it remains unexplored in mice, a species with a wealth of genetically modified models, which makes it possible to examine gene-behavior relationships. In C57BL/6 mice, the most commonly used mouse strain for genetic studies, repeated pairings of lever conditioned stimulus (CS) with food unconditioned stimulus (US) induced Pavlovian conditioning of sign-tracking conditioned response (ST CR) performance of lever CS-directed approach, and Pavlovian conditioning of goal-tracking conditioned response (GT CR) performance of approach responses directed at the location of the food trough where the food US was delivered. The CS-US Paired group performed more ST CRs and more GT CRs during sessions 15-16 than did pseudoconditioning controls which received the lever CS and food US randomly with respect to one another. During sessions 15-16, all mice in the Paired group performed more GT CRs than ST CRs, and regression analysis revealed a positive relationship between an individual subject's tendency to perform ST CRs and GT CRs. The mice that performed more ST CRs during sessions 15-16 yielded higher plasma corticosterone levels. These data reveal stable and reliable acquisition and maintenance of ST CR performance and GT CR performance in mice; however, unlike in rats, ST CRs and GT CRs did not vary inversely within subjects. Corticosterone release, a pathophysiological marker of vulnerability to drug abuse, was positively related to ST CR performance.

Effects of removing food on maintenance of drinking initiated by pairings of sipper and food

Two experiments evaluated the effects of removing food presentations on the maintenance of drinking induced by experience with sipper - food pairings. In Exp 1, ethanol drinking was induced in non-deprived Long-Evans rats by Pavlovian conditioning procedures employing an ethanol sipper as conditioned stimulus (CS) and food pellet as unconditioned stimulus (US). The Paired/Ethanol group received presentations of the ethanol sipper CS followed immediately by the response-independent presentation of the food pellet US. The Random/Ethanol group received the ethanol sipper CS and food US randomly with respect to one another. For both groups, the concentration of ethanol in the sipper CS [(3%, 4%, 6%, 8% (vol./vol.)] was increased across sessions, and, as in previous studies employing low concentrations of ethanol in non-deprived rats (i.e., maintained with free access to food in their home cages), the two procedures induced comparable levels of sipper CS-directed ethanol drinking. Removing food US presentations had no effect on sipper CS-directed ethanol drinking in either group. In Exp 2, groups of non-deprived Long-Evans rats were trained either with water or ethanol in the sipper CS paired with food US. Removing food US presentations had no effect on ethanol drinking in the Paired/Ethanol group, but water drinking in the Paired/Water group declined systematically across sessions. Results indicate that food US presentations contribute to the maintenance of water drinking but not to the maintenance of ethanol drinking. Implications for accounts of ethanol drinking based on Pavlovian sign-tracking, behavioral economics and intermittent sipper procedures are considered.

Autoshaping in adolescence enhances sign-tracking behavior in adulthood: impact on ethanol consumption

Autoshaping refers to a procedure during which a cue repeatedly paired with a reward elicits a conditioned response directed at either the reward delivery location ("goal-tracking") or the cue itself ("sign- tracking"). Individual differences in expression of sign-tracking behavior may be predictive of voluntary ethanol intake. The present study was designed to explore the development of differences in sign-tracking behavior in adolescent and adult male and female rats in an 8-day autoshaping procedure. Consistency of sign-tracking and goal-tracking across age was examined by retesting adolescents again in adulthood and comparing their adult data with animals tested only as adults to explore pre-exposure effects on adult responding. In order to assess the relationship between sign-tracking and ethanol intake, voluntary ethanol consumption was measured in an 8-day, 2-hr limited access drinking paradigm following the 8-day autoshaping procedure in adulthood. Animals tested as adolescents showed notably less sign-tracking behavior than animals tested as adults, and sign-tracking behavior was not correlated across age. Animals exposed to the autoshaping procedure as adolescents demonstrated greater sign-tracking behavior as adults when compared to control animals tested only in adulthood. When examining the relationship in adulthood between sign-tracking and ethanol intake, an increase in ethanol intake among sign-trackers was found only in animals pre-exposed to autoshaping as adolescents. Whether or not these results reflect an adolescent-specific experience effect is unclear without further work to determine whether comparable pre-exposure effects are seen if the initial autoshaping sessions are delayed into adulthood.

Sign- vs. goal-tracking in a feature positive discrimination task with nicotine: importance of spatial location of the conditional stimulus

We assessed whether sign-tracking developed along with goal-tracking in a Pavlovian drug discrimination task. Rats had nicotine sessions intermixed with saline sessions. For nicotine sessions, 15-s illumination of a light near (Experiment 1) or far (Experiment 2) from the dipper receptacle was followed by sucrose. Saline sessions were similar to nicotine sessions except sucrose was withheld. Regardless of location, the light evoked goal-tracking only on nicotine sessions. Only rats with the light near the dipper developed sign-tracking.

The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction

Memory reconsolidation is the process by which memories, destabilised at retrieval, require restabilisation to persist in the brain. It has been demonstrated that even old, well-established memories require reconsolidation following retrieval; therefore, memory reconsolidation could potentially be exploited to disrupt, or even erase, aberrant memories that underlie psychiatric disorders, thereby providing a novel therapeutic target. Drug addiction is one such disorder; it is both chronic and relapsing, and one prominent risk factor for a relapse episode is the presentation of environmental cues that have previously been associated with drugs of abuse. This 'cue-induced relapse' can be accounted for in psychological terms by reinforcing memories of the pavlovian association between the cue and the drug, which can thus influence behaviour through at least three psychologically and neurobiologically dissociable mechanisms: conditioned reinforcement, conditioned approach and conditioned motivation. As each of these psychological processes could contribute to the resumption of drug-seeking following abstinence, it is important to develop treatments that can reduce drug-seeking re-established via influences on each or all of these pavlovian processes, in order to minimise the risk of a subsequent relapse. Investigation of the memory reconsolidation mechanisms of the memories underlying conditioned reinforcement, conditioned approach and conditioned motivation indicate that they depend upon different neurochemical systems, including the glutamatergic and adrenergic systems within limbic corticostriatal circuitry. We also discuss here the subsequent translation to the clinic of this preclinical work.

Motivational systems in adolescence: possible implications for age differences in substance abuse and other risk-taking behaviors

Adolescence is an evolutionarily conserved developmental phase characterized by hormonal, physiological, neural and behavioral alterations evident widely across mammalian species. For instance, adolescent rats, like their human counterparts, exhibit elevations in peer-directed social interactions, risk-taking/novelty seeking and drug and alcohol use relative to adults, along with notable changes in motivational and reward-related brain regions. After reviewing these topics, the present paper discusses conditioned preference and aversion data showing adolescents to be more sensitive than adults to positive rewarding properties of various drugs and natural stimuli, while less sensitive to the aversive properties of these stimuli. Additional experiments designed to parse specific components of reward-related processing using natural rewards have yielded more mixed findings, with reports of accentuated positive hedonic sensitivity during adolescence contrasting with studies showing less positive hedonic affect and reduced incentive salience at this age. Implications of these findings for adolescent substance abuse will be discussed.

Behavioral characteristics and neurobiological substrates shared by Pavlovian sign-tracking and drug abuse

Drug abuse researchers have noted striking similarities between behaviors elicited by Pavlovian sign-tracking procedures and prominent symptoms of drug abuse. In Pavlovian sign-tracking procedures, repeated paired presentations of a small object (conditioned stimulus, CS) with a reward (unconditioned stimulus, US) elicits a conditioned response (CR) that typically consists of approaching the CS, contacting the CS, and expressing consummatory responses at the CS. Sign-tracking CR performance is poorly controlled and exhibits spontaneous recovery and long-term retention, effects that resemble relapse. Sign-tracking resembles psychomotor activation, a syndrome of behavioral responses evoked by addictive drugs, and the effects of sign-tracking on corticosterone levels and activation of dopamine pathways resemble the neurobiological effects of abused drugs. Finally, the neurobiological profile of individuals susceptible to sign-tracking resembles the pathophysiological profile of vulnerability to drug abuse, and vulnerability to sign-tracking predicts vulnerability to impulsive responding and alcohol self-administration. Implications of sign-tracking for models of drug addiction are considered.

Negative automaintenance omission training is effective

Twelve pigeons were exposed to negative automaintenance contingencies for 17-27 sessions immediately after brief (14-16 sessions) or extended (168-237 sessions) exposure to positive automaintenance contingencies, or after 4-10 sessions of instrumental training. In all conditions, negative automaintenance contingencies virtually eliminated responding, reducing response rates to an average 1.3 responses per min. This reduction in response rate was validated by a model of transition between early and late response rates that assumed exponential transition of rates from one set of contingencies to the next. The model faithfully reproduced cumulative records, and yielded estimates of terminal rates under negative automaintenance that were close to operant level.

A comparison of Lewis and Fischer rat strains on autoshaping (sign-tracking), discrimination reversal learning and negative automaintenance

Lewis (LEW) and Fischer (F344) rat strains differ on a number of physiological characteristics, such as hypothalamic-pituitary-adrenal (HPA) axis activity, as well as on behavioral tasks, including those that measure impulsivity and drug reward. Since autoshaping, the phenomenon where animals approach and contact reward-paired conditioned stimuli, has been linked to HPA axis functioning, impulsivity and drug taking, the present study compared LEW and F344 rats on the rate of acquisition and performance of the autoshaping response. Rats were trained on an autoshaping procedure where insertions of one retractable lever (CS(+)) were paired response-independently with food, while insertions of another lever (CS(-)) were not paired with food. LEW rats acquired the autoshaping response more rapidly and also performed the autoshaping response at a higher rate than F344 rats. No differences between the strains were observed when rats were trained on a discrimination reversal where the CS(+) and CS(-) levers were reversed or during a negative auto-maintenance phase where CS(+) lever contacts cancelled food delivery. Potential physiological mechanisms that might mediate the present results, including strain differences in HPA axis and monoamine neurotransmitter activity, are discussed. The finding that LEW (as compared to F344 rats) more readily acquire autoshaping and perform more responses is consistent with research indicating that LEW rats behave more impulsively and more readily self-administer drugs of abuse.

Intermittent presentations of ethanol sipper tube induce ethanol drinking in rats

AIMS

Intermittent presentations of the ethanol sipper have been reported to induce more ethanol drinking in rats than when the ethanol sipper was continuously available during the session. This intermittent sipper effect was observed in a social drinking situation, in which subjects experienced intermittent opportunities to interact briefly with a conspecific rat. The objective of this study was to evaluate the effects of the intermittent sipper procedure in situations providing for intermittent presentations of food, and, in addition, in situations that do not provide for intermittent presentations of another rewarding event.

METHODS

Four groups of male Long-Evans hooded rats, arranged in a 2 x 2 factorial design with two levels of Sipper Procedure (Intermittent vs Continuous) and two levels of Food procedure (Food vs No Food), were trained in drinking chambers. During each daily session, Intermittent Sipper groups received access to the ethanol sipper during each of 25 trials of 10 s each, while Continuous Sipper groups had access to the ethanol sipper during the entire session (approximately 30 min). During each session, Food groups received 25 presentations of food pellets while No Food groups received no food pellets. Ethanol concentrations in the sipper [3, 4, 6, 8, and 10% (vol./vol.)] increased across sessions.

RESULTS

More rapid escalation of ethanol intake was observed in the Intermittent Sipper groups than in the Continuous Sipper groups, and this effect was observed in both the Food and No Food conditions (P's < 0.05), which did not differ from one another.

CONCLUSIONS

Intermittent Sipper procedures provide less access to the ethanol sipper, yet induced more ethanol drinking than Continuous Sipper procedures. The intermittent sipper effect is not dependent on presentations of food. Implications for schedule-induced polydipsia and Pavlovian autoshaping are discussed.

Social interaction opportunity and intermittent presentations of ethanol sipper tube induce ethanol drinking in rats

We evaluated the effects of social interaction opportunity (SIO) and intermittent presentations of the ethanol sipper tube (IS) on autoshaping of ethanol drinking in nondeprived rats. Rats were assigned to one of seven groups. Two groups experienced brief IS, either paired with or randomly related to the response-independent raising of a guillotine door (D) revealing the presence of a conspecific male rat in a holding cage (SIO). Two control groups received similar training, respectively, except that the D revealed an empty cage, whereas a third control group received IS but neither D nor SIO. For two additional control groups, the ethanol sipper tube was continuously available during the session, with and without SIO, with both groups receiving intermittent D. In IS conditions, procedures with SIO induced more ethanol intake than did non-SIO procedures, indicating that SIO contributed to ethanol intake, but D procedures did not differ from non-D procedures, indicating that ethanol drinking was not related to the operation of the door. Groups that received training procedures providing for both SIO and IS showed more rapid initiation of ethanol intake and more rapid escalation of ethanol intake as the concentration of ethanol in the sipper tube conditioned stimulus was increased across sessions. Theoretical accounts, which are based on cue at response manipulandum/autoshaping, schedule-induced polydipsia, incentive sensitization, and intermittency-induced arousal, are considered.

Autoshaping induces ethanol drinking in nondeprived rats: evidence of long-term retention but no induction of ethanol preference

The effects of autoshaping procedures (paired vs. random) and sipper fluid (ethanol vs. water) on sipper-directed drinking were evaluated in male Long-Evans rats maintained with free access to food and water. For the paired/ethanol group (n=16), autoshaping procedures consisted of presenting the ethanol sipper (containing 0% to 28% unsweetened ethanol) conditioned stimulus (CS) followed by the response-independent presentation of food unconditioned stimulus (US). The random/ethanol group (n=8) received the sipper CS and food US randomly with respect to one another. The paired/water group (n=8) received only water in the sipper CS. The paired/ethanol group showed higher grams per kilogram ethanol intake than the random/ethanol group did at ethanol concentrations of 8% to 28%. The paired/ethanol group showed higher sipper CS-directed milliliter fluid consumption than the paired/water group did at ethanol concentrations of 1% to 6%, and 15%, 16%, 18%, and 20%. Following a 42-day retention interval, the paired/ethanol group showed superior retention of CS-directed drinking of 18% ethanol, relative to the random/ethanol group, and superior retention of CS-directed milliliter fluid drinking relative to the paired/water group. When tested for home cage ethanol preference using limited access two-bottle (28% ethanol vs. water) procedures, the paired/ethanol and random/ethanol groups did not differ on any drinking measures.

Social opportunity and ethanol drinking in rats

Two experiments were designed to evaluate the effects of pairings of ethanol sipper conditioned stimulus (CS) with social opportunity unconditioned stimulus (US) on ethanol sipper CS-directed drinking in rats. In both experiments, rats were deprived of neither food nor water, and initiation of drinking of unsweetened 3% ethanol was evaluated, as were the effects of increasing the concentration of unsweetened ethanol (3-10%) across sessions. In Experiment 1, Group Paired (n=8) received 35 trials per session wherein the ethanol sipper CS was presented for 10 s immediately prior to 15 s of social opportunity US. All rats initiated sipper CS-directed drinking of 3% ethanol. Increasing the concentration of ethanol in the sipper CS [(3%, 4%, 6%, 8%, 10% (vol./vol.)] across sessions induced escalation of daily g/kg ethanol intake. To evaluate the hypothesis that the drinking in Group Paired was due to autoshaping, Experiment 2 included a pseudoconditioning control that received sipper CS and social opportunity US randomly with respect to one another. All rats in Group Paired (n=6) and in Group Random (n=6) initiated sipper CS-directed drinking of 3% ethanol and daily mean g/kg ethanol intake in the two groups was comparable. Also comparable was daily g/kg ethanol intake, which increased for both groups with the availability of higher concentrations of ethanol in the sipper CS, up to a maximum of approximately 0.8 g/kg ethanol intake of 10% ethanol. Results indicate that random presentations of ethanol sipper CS and social opportunity US induced reliable initiation and escalation of ethanol intake, and close temporally contiguous presentations of CS and US did not induce still additional ethanol intake. This may indicate that autoshaping CR performance is not induced by these procedures, or that high levels of ethanol intake induced by factors related to pseudoconditioning produces a ceiling effect. Implications for ethanol drinking in humans are discussed.

Sign-tracking (autoshaping) in rats: a comparison of cocaine and food as unconditioned stimuli

A series of experiments was performed to determine whether sign-tracking would occur in rats with intravenous (i.v.) cocaine as the unconditioned stimulus. In Experiment 1, a retractable lever paired with food produced strong sign-tracking, but a lever paired with one of three doses of i.v. cocaine did not elicit any approach or contact behavior. Experiment 2 demonstrated that doses of cocaine that did not elicit sign-tracking would function as a positive reinforcer for a lever contact operant. In Experiment 3, an artificial consummatory response was added to make the cocaine reinforcement episode more behaviorally comparable to that occasioned by food. Although the rats readily performed this response when it was required to receive cocaine infusions, they still did not contact a lever that signaled the availability of these infusions. It appears that cocaine is different from other positive reinforcers (e.g., food, water, warmth, or intracranial stimulation) in that it will not produce sign-tracking in rats.

Pavlovian autoshaping procedures increase plasma corticosterone and levels of norepinephrine and serotonin in prefrontal cortex in rats

Pavlovian autoshaping procedures provide for pairings of a small object conditioned stimulus (CS) with a rewarding substance unconditioned stimulus (US), resulting in the acquisition of complex sequences of CS-directed skeletal-motor responses or autoshaping conditioned responses (CRs). Autoshaping procedures induce higher post-session levels of corticosterone than in controls receiving CS and US randomly, and the enhanced post-session corticosterone levels have been attributed to the appetitive or arousal-inducing effects of autoshaping procedures. Enhanced corticosterone release can be induced by aversive stimulation or stressful situations, where it is often accompanied by higher levels of norepinephrine (NE) and serotonin (5-HT) in prefrontal cortex (PFC) but not in striatum (ST). Effects of autoshaping procedures on post-session corticosterone levels, NE contents in PFC, and 5-HT contents in PFC and ST were investigated in male Long-Evans rats. Post-session blood samples revealed higher corticosterone levels in the CS-US Paired group (n = 46) than in the CS-US Random control group (n = 21), and brain samples revealed higher levels of PFC NE and 5-HT in CS-US Paired group. Striatal 5-HT levels were unaltered by the autoshaping procedures. Autoshaping procedures provide for appetitive stimulation and induce an arousal-like state, as well as simultaneous stress-like changes in plasma corticosterone and monoamine levels in PFC. Autoshaping, therefore, may be useful for the study of endocrine and central processes associated with appetitive conditions.

Autoshaping of ethanol drinking in rats: effects of ethanol concentration and trial spacing

In two studies, we evaluated the effects of ethanol concentration and trial spacing on Pavlovian autoshaping of ethanol drinking in rats. In these studies, the brief insertion of an ethanol sipper conditioned stimulus (CS) was followed by the response-independent presentation of food unconditioned stimulus (US), inducing sipper CS-directed drinking conditioned responses (CRs) in all rats. In Experiment 1, the ethanol concentration in the sipper CS [0%-16% volume/volume (vol./vol.), in increments of 1%] was systematically increased within subjects across autoshaping sessions. Groups of rats received sipper CS-food US pairings (Paired/Ethanol), a CS-US random procedure (Random/Ethanol), or water sipper CS paired with food US (Paired/Water). In Experiment 2, saccharin-fading procedures were used to initiate, in the Ethanol group, drinking of 6% (vol./vol.) ethanol in 0.1% saccharin or, in the Water group, drinking of tap water in 0.1% saccharin. After elimination of saccharin, and across days, the duration of access to the sipper CS during each autoshaping trial was increased (5, 10, 12.5, 15, 17.5, and 20 s), and subsequently, across days, the duration of the mean intertrial interval (ITI) was increased (60, 90, 120, and 150 s). In Experiment 1, Paired/Ethanol and Random/Ethanol groups showed higher intake of ethanol, in terms of grams per kilogram of body weight, at higher ethanol concentrations, with more ethanol intake recorded in the Paired/Ethanol group. In Experiment 2, the Ethanol group drank more than was consumed by the Water group, and, for both groups, fluid intake increased with longer ITIs. Results support the suggestion that autoshaping contributes to sipper CS-directed ethanol drinking.

Lever conditioned stimulus-directed autoshaping induced by saccharin-ethanol unconditioned stimulus solution: effects of ethanol concentration and trial spacing

Two experiments were designed to evaluate whether brief access to a saccharin-ethanol solution would function as an effective unconditioned stimulus (US) in Pavlovian-autoshaping procedures. In these experiments, the insertion of a lever conditioned stimulus (CS) was followed by the brief presentation of a sipper tube containing saccharin-ethanol US solution. Experience with this Pavlovian-autoshaping procedure engendered lever CS-directed autoshaping conditioned responses (CRs) in all rats. In Experiment 1, the concentration of ethanol [0%, 2%, 4%, 6%, or 8% (vol./vol.)] in 0.1% saccharin was systematically increased within subjects across autoshaping sessions to evaluate the relation between a rat's drinking and lever pressing. In Experiment 2, the mean intertrial interval (ITI) duration (60, 90, 120 s) was systematically increased within subjects across autoshaping sessions to evaluate the effect of ITI duration on drinking and lever pressing. A pseudoconditioning control group received lever CS randomly with respect to the saccharin-ethanol US solution. In Experiment 1, lever-press autoshaping CRs developed in all rats, and the tendency of a rat to drink an ethanol concentration was predictive of the performance of lever-press autoshaping CRs. In Experiment 2, longer ITIs induced more lever CS-directed responding, and CS-US paired procedures yielded more lever CS-directed responding than that observed in CS-US random procedures. Saccharin-ethanol is an effective US in Pavlovian-autoshaping procedures, inducing more CS-directed responding than in pseudoconditioning controls receiving CS-US random procedures. More lever CS-directed responding was observed when there was more drinking of the saccharin-ethanol US solution (Experiment 1); when the CS and US were paired, rather than random (Experiment 2); and with longer mean ITI durations (Experiment 2). This pattern of results is consistent with the hypothesis that lever CS-directed responding reflects performance of Pavlovian-autoshaping CRs.

Pavlovian autoshaping procedures increase plasma corticosterone levels in rats

Pavlovian autoshaping conditioned responses (CRs) are complex sequences of conditioned stimulus (CS)-directed skeletal-motor responses that are elicited by CS objects predictive of food unconditioned stimulus (US). Autoshaping CRs are observed under conditions known to be conducive to elevations in plasma corticosterone levels, as, for example, in response to the eating of food as well as in response to signals predictive of food. Two experiments investigated the relationships between Pavlovian autoshaping procedures, the performance of Pavlovian autoshaping CRs, and plasma corticosterone levels in male Long-Evans rats. In Experiment 1, rats in the CS-US paired group (n=30) were given 20 daily sessions of Pavlovian autoshaping training wherein the insertion of a retractable lever CS was followed by the response-independent presentation of the food US. Tail blood samples obtained after the 20th autoshaping session revealed higher plasma corticosterone levels in the CS-US paired group than in the CS-US random control group (n=10). In Experiment 2, rats (n=35) were assessed for basal plasma corticosterone levels 2 weeks prior to autoshaping training. Plasma samples obtained immediately following the first autoshaping session, and prior to the acquisition of lever-press autoshaping CR performance, revealed higher plasma corticosterone levels in the CS-US paired group (n=24) relative to basal levels. This effect was not observed in the CS-US random control group (n=11). Data suggest that corticosterone release is a physiological endocrine Pavlovian CR induced by lever CS-food US pairings during Pavlovian autoshaping procedures, rather than a by-product of autoshaping CR performance. Implications of the link between autoshaping procedures and corticosterone release are discussed.

Individual differences in pavlovian autoshaping of lever pressing in rats predict stress-induced corticosterone release and mesolimbic levels of monoamines

Pavlovian autoshaping CRs are directed and reflexive consummatory responses targeted at objects repeatedly paired with rewarding substances. To evaluate the hypothesis that autoshaping may provide an animal learning model of vulnerability to drug abuse, this study relates individual differences in lever-press autoshaping CR performance in rats to stress-induced corticosterone release and tissue monoamine levels in the mesolimbic dopamine tract. Long-Evans rats (n = 14) were given 20 sessions of Pavlovian autoshaping training wherein the insertion of a retractable lever CS was followed by the response-independent presentation of food US. Large between-subjects differences in lever-press autoshaping CR performance were observed, with group high CR frequency (n = 5) performing many more lever press CRs than group low CR frequency (n = 9). Tail-blood samples were obtained before and after the 20th autoshaping session, then 24 h later the rats were sacrificed and dissection yielded tissue samples of nucleus accumbens (NAC), prefrontal cortex (PFC), caudate putamen (CP), and ventral tegmental area (VTA). Serum levels of postsession corticosterone were elevated in group high CR frequency. HPLC revealed that group high CR frequency had higher tissue levels of dopamine and DOPAC in NAC, lower levels of DOPAC/DA turnover in CP, and lower levels of 5-HIAA and lower 5-HIAA/5-HT turnover in VTA. The neurochemical profile of rats that perform more autoshaping CRs share some features of vulnerability to drug abuse.

Locating reward cue at response manipulandum (CAM) induces symptoms of drug abuse

Appetitive instrumental discrimination learning procedures provide for CAM (cue and manipulandum) when the reward cue (discriminative stimulus positively correlated with positive reinforcement) is located at the response manipulandum (object that when contacted or manipulated defines the performance of the instrumental response). Evidence reviewed shows that CAM induces excessive and compulsive instrumental responding relative to otherwise comparable non-CAM control procedures. In humans, symptoms of drug abuse are particularly likely when the drug-taking implement (response manipulandum at which instrumental drug-taking is directed) is also predictive of the drug's rewarding effects (reward cue). Evidence that the predictive relationship between a drug-taking implement and drug reward relates to drug abuse is reviewed, and implications for treatment and prevention are considered. CAM is related to neurobiological models of drug abuse that emphasize the role of the neurotransmitter dopamine (DA). CAM produces convergence of DA-mediated responding for conditioned reinforcement with DA mediation of psychomotor activation and incentive-motivational processes to yield reflexive cue-directed responding not observed in non-CAM controls.