Delaying reinforcement in an autoshaping task generates adjunctive and superstitious behaviors

The neuropharmacological profile of interval responding during operant tasks

Responses occurring during intervals of operant tasks have been subdivided as interim, facultative, and terminal, depending on the time between response onset and reward. Although interval responses, also known as adjunctive responses, have been described in pigeons, rats, mice, monkeys, and humans, most experiments have been conducted in rats. We review the neurochemical basis of interval responses and examine the hypothesis that these responses modulate operant performance. Preliminary experiments indicate the involvement of biogenic amines, acetylcholine, and GABA during interval responding associated with operant tasks. In particular, catecholaminergic deafferentation of the basal ganglia modulated interval responses as did the peripheral injection of catecholamine reuptake blockers. Under the influence of amphetamine, interval responding may either increase or decrease, so that a wide range of responses must be selected to gauge drug effects. In non-drugged pigeons and rats, the expression of interval responses facilitates operant training.

Predicting extinction and reinstatement of alcohol and sucrose self-administration in outbred rats

Preventing relapse to drinking or escalation to excessive drinking could be aided by identifying factors that predict these behaviors. Animal models, particularly those that utilize operant self-administration techniques, can be useful. In a prior operant study, we noted a good deal of variability in behaviors during training and test sessions. We utilized data obtained from that study of two groups of rats, trained and tested identically except one responded for alcohol and the other for sucrose, to explore for associations related to relapse (reinstatement) or to excessive drinking (maintenance). Data were obtained from sessions conducted under fixed- and progressive-ratio schedules as well as from extinction and reinstatement sessions. Variables assessed included active and inactive presses, head entries into the dipper trough, and automated recordings of body movements during these sessions as well as alcohol preference before training. First, using multiple regression, we examined whether alcohol preference before training associated with any response variable among alcohol-responding rats. Second, using factor analysis, we identified a training variable, body movements, that associated with responses during tests. Using this measure, rats were divided into low- and high-response groups and compared on active lever presses and head entries across test sessions. Results show that among alcohol-responding rats, alcohol preference predicted head entries during extinction. High-body-movement rats emitted significantly fewer active lever presses and had fewer head entries across test sessions, particularly during reinstatement, compared with low-body-movement rats. Results from this exploratory study provide clues for future experimental studies.

Maintenance of responding when reinforcement becomes delayed

In four experiments with rats, we examined the persistence of behavior when reinforcement was switched from immediate to delayed. In Experiment 1, lever pressing elicited by instrumental training with immediate reinforcement continued when a 20-sec delay of reinforcement was introduced (easy-to-hard condition), whereas when the delay condition was introduced from the start (hard-to-hard condition), responding remained low throughout. A similar result was obtained in Experiment 2, in which lever pressing was elicited by a classical conditioning (autoshaping) procedure. In Experiment 3, rats initially trained with delayed reinforcement continued to respond at a low rate when switched to immediate reinforcement (hard-to-easy condition). By measuring magazine entry (goal tracking) as well as lever pressing (sign tracking) in Experiment 4, we confirmed that such transfer effects at least partly involve the persistence of whatever type of behavior was initially dominant.

Sign-tracking (autoshaping) in rats: a comparison of cocaine and food as unconditioned stimuli

A series of experiments was performed to determine whether sign-tracking would occur in rats with intravenous (i.v.) cocaine as the unconditioned stimulus. In Experiment 1, a retractable lever paired with food produced strong sign-tracking, but a lever paired with one of three doses of i.v. cocaine did not elicit any approach or contact behavior. Experiment 2 demonstrated that doses of cocaine that did not elicit sign-tracking would function as a positive reinforcer for a lever contact operant. In Experiment 3, an artificial consummatory response was added to make the cocaine reinforcement episode more behaviorally comparable to that occasioned by food. Although the rats readily performed this response when it was required to receive cocaine infusions, they still did not contact a lever that signaled the availability of these infusions. It appears that cocaine is different from other positive reinforcers (e.g., food, water, warmth, or intracranial stimulation) in that it will not produce sign-tracking in rats.

Sex differences in the effects of baclofen on the acquisition of intravenous cocaine self-administration in rats

Baclofen, a GABA(B) agonist, decreases both the maintenance and reinstatement of i.v. cocaine-reinforced responding in rats. In the present experiment the effects of baclofen were extended to a comparison of male and female rats during the acquisition of i.v. cocaine self-administration. Four groups of rats were trained to self-administer i.v. cocaine (0.2 mg/kg) under a fixed-ratio 1 (FR 1) schedule using an autoshaping procedure. The criterion for acquisition was a 5-day period during which a mean of 100 cocaine infusions were administered. Rats were given 30 days to reach this criterion. Male and female groups (n=10-13) were pretreated with i.p. injections of baclofen (2.5 mg/kg) or vehicle 30-min prior to the sessions. A subset of rats (N=5) that did not acquire cocaine self-administration continued to be exposed to the acquisition procedure after baclofen treatment ended. Pretreatment with baclofen decreased both the rate of acquisition of cocaine self-administration and the percentage of rats meeting the acquisition criterion to a greater extent in females than in males. Female rats that did not meet the acquisition criterion with baclofen treatment, acquired within a few days after treatment ended. The findings confirm previous reports of enhanced acquisition of cocaine self-administration in females versus males, and they indicate that baclofen suppressed the acquisition of cocaine self-administration significantly more in females than in males.

Acquisition of i.v. amphetamine and cocaine self-administration in rats as a function of dose

The effect of dose on the acquisition of i.v. amphetamine and cocaine self-administration was examined. Three unit doses of amphetamine (0.03, 0.06 and 0.12 mg/kg) and three unit doses of cocaine (0.05, 0.2 and 0.8 mg/kg) were tested in separate groups of ten (amphetamine) or 13 (cocaine) rats. Autoshaping methods were used to train rats to press a lever that resulted in drug infusion under a fixed-ratio (FR) 1 schedule. A daily 6-h autoshaping component non-contingently delivered 60 infusions according to a 60-s random time schedule with ten infusions delivered during the first half of each h. Each day autoshaping sessions were followed by a 6-h self-administration session. The criterion for acquisition was a 5-day period during which a daily mean of 100, 50 or 25 infusions for the three amphetamine doses and 400, 100 or 25 infusions were earned during the 6-h self-administration period for the three cocaine doses, respectively. As dose increased, more rats per group acquired drug self-administration and the mean number of days to meet the acquisition criterion decreased. The percentage of rats acquiring amphetamine self-administration increased with dose and ranged from 80 to 100%. Only one rat at the lowest cocaine dose met the acquisition criterion, but 100 percent of the rats at the two higher doses acquired. During the last 2 days of acquisition, mean infusions decreased and mean drug intake (mg/kg) increased as dose increased. On the last day of acquisition, the time course of infusions during the 6-h self-administration component was characterized by a steady rate of infusions per hour, and number of infusions was inversely related to dose. These findings indicate that the initial available dose of a drug is an important determinant of the rate and probability that successful acquisition will occur.

The economic context of drug and non-drug reinforcers affects acquisition and maintenance of drug-reinforced behavior and withdrawal effects

The focus of this review is to examine the effect of non-drug alternative reinforcers on drug-reinforced behavior. An increasing number of animal laboratory as well as human clinical studies have demonstrated the effectiveness of non-drug reinforcers in reducing steady-state levels of drug self-administration. One goal of this review was to determine what behavioral economic conditions are optimal for reducing drug-reinforced behavior. Variables such as price of the drug and non-drug reinforcer have been manipulated by changing fixed-ratio (FR) value of these commodities. Income has been changed by limiting the amount of access to the commodities or by changing session length. Substitution was evaluated by determining whether decreased demand for a drug (due to increased price) was related to increased demand for a non-drug reinforcer. A second goal of this review was to investigate transition states in the drug addiction process with respect to the role of alternative non-drug reinforcers. Animal models of acquisition and withdrawal were examined to identify behavioral economic conditions under which acquisition may be prevented or withdrawal effects (and potential for relapse) may be alleviated.

Autoshaping i.v. cocaine self-administration in rats: effects of nondrug alternative reinforcers on acquisition

The purpose of this experiment was to examine the effects of a nondrug alternative reinforcer and feeding conditions on the acquisition of cocaine self-administration. Rats were autoshaped to press a lever that resulted in a 0.2 mg/kg i.v. cocaine infusion. Responses on the lever were monitored during six consecutive autoshaping sessions that occurred each day. A retractable lever was inserted into the operant chamber on a random time 60 s schedule 10 times per session for six sessions that began each hour. Each day the six autoshaping sessions were followed by a 6-h cocaine self-administration session. During self-administration the lever remained extended, and each response on the lever resulted in a cocaine infusion (0.2 mg/kg). The criterion for acquisition of cocaine-reinforced behavior was met when there were 5 consecutive days during which the mean number of infusions during the 6-h self-administration session was at least 100. This procedure was repeated daily until the criterion was met or 30 days elapsed. The rats were also trained to respond on lick-operated automatic drinking devices that delivered 0.05 ml water or a glucose and saccharin solution (G + S) contingent upon each lick response. Five groups of 12-14 rats were compared. The first four groups constituted a 2 x 2 factorial design whereby either G + S or water was available in the home cage for 3 weeks before autoshaping began and G + S or water was available in the operant chamber during autoshaping. These groups were limited to 20 g food per day and all had free access to water.(ABSTRACT TRUNCATED AT 250 WORDS)

Long-term effects of neonatal exposure to isobutylmethylxanthine. I. Retardation of learning with antagonism by mianserin

Pregnant women regularly ingest the methylxanthines, caffeine and theophylline, during pregnancy and lactation. Also, theophylline is used to treat apnea in premature infants. In this study, rat pups were treated with 3-isobutyl-1-methylxanthine (IBMX), on days 7-10 of life. Transient IBMX treatment during infancy caused a retardation of acquisition of a delayed reinforced autoshaped lever touch response in adulthood. Treated rats required more trials to learn the task, but did not show altered exploratory activity in the operant chambers. Coadministration of the serotonin (5-HT) antagonist mianserin with IBMX was able to attenuate significantly the effects of IBMX in both males and females, even though mianserin treatment alone caused an apparent learning deficit in the males. The results indicate that 5-HT and 5-HT receptors are important during development for normal expression of a specific cognitive function later in life. Furthermore, a 5-HT system appears to play a role in the mechanism whereby perinatal methylxanthine exposure could lead to learning impairments or other undesirable behavioral consequences. The use of IBMX in developing rats may also offer a model for studying the long-term consequences of the expression of opioid withdrawal during the neonatal period, since this agent induces a quasi-morphine withdrawal syndrome (QMWS) in mature rats. It is of interest that mianserin can block or attenuate effects of both quasi- and true morphine withdrawal.

Colchicine-induced alterations of reference memory in rats: role of spatial versus non-spatial task components

Male, Fischer-344 rats received bilateral injections of 2.5 micrograms of colchicine per site in the dorsal and ventral hippocampus. Intradentate colchicine preferentially destroyed dentate granule cells. Subsequent behavioral studies showed that 3 weeks after dosing, colchicine impaired the acquisition of a spatial, reference memory task in the Morris water maze. In a second group of rats, which were trained in the water maze prior to dosing, intradentate colchicine impaired retention of this task when rats were tested 3 weeks later. The acquisition of non-spatial reference memory task, an autoshape of a lever touch response in an operant chamber, was facilitated by prior administration of colchicine. Facilitative effects of colchicine were seen if delays of 0, 4, or 6 s were interposed between response and presentation of food reinforcement. If rats were trained to lever-touch with either a 0- or 4-s delay between response and reinforcement, intradentate colchicine had no effect on retention of the response 3 weeks later. These data are in accord with the conclusion that the dentate gyrus plays an important role in the acquisition of new information and retrieval of previously learned material and is an integral neural substrate for reference memory involving a spatial component.

Naloxone administration impairs autoshaped learning

Effects of naloxone on acquisition of autoshaped behavior were investigated. Rats deprived to 85% of free-feeding weights were trained to touch a retractable lever; delivery of a food pellet occurred on every trial following lever retraction. The lever was retracted immediately if a touch occurred within 15 s, or automatically after 15 s. Analyses were conducted on number and latencies of touches of the extended lever, nose-pokes (touches) directed at the retracted lever during intertrial intervals (a measure less constrained by ceiling effects than extended lever touches), and unconditioned exploratory rearing activity, measured as touches of a metal strip mounted above the grid floor of the apparatus. In an initial experiment, male Sprague-Dawley rats were given saline or naloxone (2.0 mg/kg, ip) 5 min before a training session of 12 trials. Two days later they were tested, in the absence of drug, in a session of 36 (three blocks of 12) trials. Naloxone depressed training levels of lever responding, in addition to slowing acquisition rate. No effect of naloxone was observed on rearing activity. Previous work showed that injection of saline 5 min before behavioral testing increases the rate of autoshaping compared to injections 30 min before (Messing & Sparber, 1984). Thus, effects of naloxone on acquisition of lever-directed behaviors may have been confounded by behavioral depressant effects and/or by an injection effect such a short time before testing. In a second experiment naloxone (0.5 or 2.0 mg/kg) was injected after five of seven training sessions (12 trials each) to male and female rats. A 6-s delay of reinforcement was inserted between lever retraction and food delivery, slowing acquisition rates and providing the opportunity to test the effects of naloxone throughout a multiple-session task. The low dose retarded acquisition of extended lever touching in both sexes; both doses retarded acquisition of interim lever touching in males. Thus, in some circumstances, post-training naloxone administration may impair learning. The results support the notion that low doses of naloxone may have agonist activity.

Actions of nicotine on the acquisition of an autoshaped lever-touch response in rats

Experimentally naive male, Sprague-Dawley rats maintained at 85% of their original body weight were trained to touch a retractable lever that was presented on a random interval 48-s schedule. The lever retracted when touched or after 15 s had elapsed, and one 45 mg food pellet was delivered simultaneously with lever retraction or after an 8-s delay. Rats received ten daily sessions each consisting of ten lever presentations. Nicotine (0.25-0.8 mg/kg SC) administration, either 15 min prior to (pre-session) or immediately after (post-session) the daily autoshaping sessions, caused a significant dose-related impairment of acquisition with the post-session injections having the greater effect. Low doses of nicotine (0.025-0.1 mg/kg SC) had little effect on acquisition when injected pre-session or post-session. Injections of 0.45 mg/kg nicotine either immediately (t = 0) or at +5 min after the daily sessions impaired acquisition of the lever-touch response. Nicotine injected at +15, +30, +60, or +120 min had no effect on acquisition. A single intraventricular injection of the ganglionic blocker chlorisondamine (5 micrograms) 2 weeks prior to autoshaping blocked the impairment produced by 0.45 mg/kg nicotine. Post-session injections of nicotine did not alter the lever-touch behavior of well-trained animals, but suppressed responding in animals that were partially trained. Thus, nicotine-induced impairment of the autoshaped lever-touch response is dose dependent, centrally mediated, occurs within 5 min of a SC injection, and may interfere with post-training consolidation processes.