Compounding discriminative stimuli controlling free-operant avoidance

Cocaine cues retain silent traces of an excitatory history after conversion into conditioned inhibitors: 'the ghost in the addict'

The present experiment investigated the extent to which the A+/AB- conditioned inhibition procedure could counteract an excitatory drug-related conditioning history. In two groups of rats, a light stimulus was established as a signal for the absence of cocaine. For the History group, the light had previously been a discriminative stimulus (S) that occasioned cocaine self-administration and could thus be classified as a cocaine excitor. In comparison, the No-History group first encountered the light during conditioned inhibition training. During conditioned inhibition training, both groups self-administered cocaine during tone as well as during click Ss, whereas drug seeking was eliminated in click-plus-light, wherein cocaine was not available (A+/AB-). Drug seeking was essentially eliminated in both groups. Nevertheless, on a summation test the light reduced cocaine seeking occasioned by the tone S by 95% in the No-History group, but by less than 50% in the History group. This summation test result showed that the effects of a drug-related history persisted even after the light was converted into an effective conditioned inhibitor on the training baseline through the powerful A+/AB- procedure. Future research should seek procedures that produce even stronger conditioned inhibition that eliminates such residual 'silent' drug excitation, the 'ghost in the addict'.

Discriminated response and incentive processes in operant conditioning: a two-factor model of stimulus control

Understanding stimulus control generated in instrumental learning requires the direct investigation of discriminated response and reinforcer (incentive) processes acquired exclusively through the response-reinforcer contingencies operating on complex (multicomponent) baselines. Two series of stimulus-compounding studies accomplished this direct investigation. In one series, the independent variable was the relative reinforcement between schedule components; in the second series, it was relative response rate between components. Stimulus-compounding tests revealed that response and incentive processes enhanced each other when in agreement, counteracted each other when in opposition, and produced intermediate results when only one factor was operating. This pattern of results led to the conclusion that these factors were algebraically combining and to the development of a response/incentive matrix reflecting these dynamics. This two-factor analysis was extended to the peak-shift effect in stimulus generalization experiments and to the generation of inhibitory control. Two decades of stimulus compounding and peak-shift research were organized within this two-factor framework, extending this traditional approach to learning to active research areas heretofore not systematically considered in these terms.

The effect of reinforcement differences on choice and response distribution during stimulus compounding

In Experiments I and II, rats were trained to respond on one lever during light and another during tone. The absence of tone and light controlled response cessation. In the multiple schedule of Experiment I, all reinforcements were received for responding in tone or light; in the chain schedule of Experiment II, all reinforcements were received in no tone + no light for not responding. Experiment I subjects, for which tone and light were associated with response and reinforcement increase, responded significantly more to tone-plus-light than to tone or light alone (additive summation). Experiment II subjects, for which tone and light were associated with response increase and reinforcement decrease, responded comparably to tone, light, and tone + light. Thus, additive summation was observed when stimulus-response and stimulus-reinforcer associations in tone and light were both positive, but not when they were conflicting. All subjects in both experiments responded predominantly on the light-correlated lever during tone + light, even when light intensity was reduced in testing. Furthermore, when a light was presented to a subject engaged in tone-associated responding, all subjects immediately switched the locus of responding to the light-correlated lever. No change in locus occurred when a tone was presented to a subject engaged in light-associated responding, irrespective of the stimulus-reinforcer association conditioned to tone. The light-lever preference in tone + light indicates that the heightened responding observed in Experiment I was not the summation of tone-associated behavior with light-associated behavior. Rather, it appears to be the result of a facilitation of one operant (light-associated responding) by the reinforcement-associated cue for the other.

Combined-stimulus control as a function of the response rate controlled by the absence of the single stimuli

Rat's bar-press responses were maintained at moderate rates during separate presentations of light and tone by separate but concurrent variable-interval schedules of food and shock presentation. The relative response rate maintained during light-out-no-tone was alternated in four successive phases: in Phases 1 and 3 responding was maintained at a higher rate than that during light and tone alone by a variable-interval food schedule, while in Phases 2 and 4 responding was reduced to a lower rate by a differential-reinforcement-of-other-behavior food schedule. In test presentations of light, tone and a light-plus-tone combination, administered at the end of each phase, the proportion of responses emitted during light-plus-tone was an inverse function of the relative response rate controlled by light-out-no-tone, indicating that the relative training response rate controlled by the absence of the single stimuli determined the control exerted by the combined stimuli. Different relative response rates maintained in training may also be partly responsible for previously observed differences in the form of generalization gradients following the establishment of multi-stimulus control.

Warmup in avoidance as a function of time since prior training

On avoidance procedures, rats and pigeons typically show warmup effects, characterized by improving performance within sessions and loss of the improvement ("warmup decrement") between sessions. Between-session losses were examined by varying the time between periods of avoidance training. In one experiment, rats lived fulltime in conditioning chambers while intermission intervals were varied. In a second experiment, the animals lived in home cages between sessions; timeout intervals were introduced at midession, producing recurrence of warmup in the second half-session. In both experiments, the warmup decrements increased substantially as the timeout or intersession intervals were increased from zero to 30 minutes. With intervals of 60 or 120 minutes, the decrements approached or exceeded those obtained with intervals of a day or more. When avoidance was interposed between appetitive sessions, the appetitive responding was disrupted, but this seemed unrelated to the warmup or to the proficiency of avoidance. The warmup in avoidance shares characteristics with transient punishment effects, with the Kamin effect, and with habituation phenomena, but it is premature to assume that they reflect common processes.

Within-subject reversibility of discriminative function in the composite-stimulus control of behavior

According to the composite-stimulus control model (Weiss, 1969, 1972b), an individual discriminative stimulus (S(D)) is composed of that S(D)'s on-state plus the off-states of all other relevant S(D)s. The present experiment investigated the reversibility of composite-stimulus control. Separate groups of rats were trained to lever-press for food whenever a tone or a light S(D) was present. For one group, the nonreinforced S(Delta) condition was tone-and-light absence (T+L). Tone-plus-light (T+L) was S(Delta) in the other group. On a "stimulus compounding" test that recombined composite elements, maximum responding occurred to that composite consisting only of elements occasioning response increase. That was T+L for the group trained with T+L as S(Delta) and T+L for the group trained with T+L as S(Delta). The S(Delta) composite was next reversed over groups in Phase 2. In Phase 2 tests, maximum responding that was comparable in magnitude to that of Phase 1 was again controlled by the composite consisting only of elements most recently occasioning response increase-whether T+L or T+L. The inhibitory conditioning history of both composite-elements currently occasioning responding did not weaken the summative effect. These results confirm and extend Weiss's composite-stimulus control model, and demonstrate that such control is fully reversible. We discuss how translating conditions of the stimulus-compounding paradigm to a composite continuum creates a functional and logical connection to intradimensional control measured through stimulus generalization, reducing the number of different behavioral phenomena requiring unique explanations.

Averaging of temporal memories by rats

Rats were trained on a mixed fixed-interval schedule in which stimulus A (tone or light) indicated food availability after 10 s and stimulus B (the other stimulus) indicated food availability after 20 s. Testing consisted of nonreinforced probe trials in which the stimulus was A, B, or the compound AB. On single-stimulus trials, rats responded with a peak of activity around the programmed reinforced time. On compound-stimulus trials, rats showed a single scalar peak of responding at a time midway between those for stimulus A and B. These results suggest that when provided with discrepant information regarding the temporal predictability of reinforcement, rats compute an average of the scheduled reinforcement times for the A and B stimuli and use this average to generate an expectation of reward for the compound stimuli.

A comparison of the effects of discriminative and Pavlovian inhibitors and excitors on instrumental responding

In two experiments, the effects of Pavlovian or discriminative conditioned inhibitors on operant responding were investigated in rats. Experiment 1 found that a Pavlovian conditioned inhibitor for food suppressed food-reinforced lever pressing more than a non-differentially trained control stimulus did. Experiment 2 demonstrated that an operant discriminative inhibitor produced greater suppression of lever pressing than a Pavlovian conditioned inhibitor. Experiment 2 also found that compounding an operant discriminative stimulus (SD) for food-reinforced responding with another SD for food-reinforced responding resulted in more additive summation than when an SD was compounded with a Pavlovian conditioned excitor for food. The results of these experiments support two-factor theories that postulate that incentive and response discriminative processes summate algebraically when the processes are inhibitory or excitatory.

Stimulus control and compounding with ambient odor as a discriminative stimulus on a free-operant baseline

Previous experiments have demonstrated that the simultaneous presentation of independently established discriminative stimuli can control rates of operant responding substantially higher than the rates occasioned by the individual stimuli. This "additive summation" phenomenon has been shown with a variety of different reinforcers (e.g., food, water, shock avoidance, cocaine, and heroin). Discriminative stimuli previously used in such studies have been limited to the visual and auditory sensory modalities. The present experiment sought to (1) establish stimulus control on a free-operant baseline with an ambient olfactory discriminative stimulus, (2) compare olfactory control to that produced with an auditory discriminative stimulus, and (3) determine whether compounding independently established olfactory and auditory discriminative stimuli produces additive summation. Rats lever pressed for food on a variable-interval schedule in the presence of either a tone or an odor, with comparable control developed to each stimulus. In the absence of these stimuli responding was not reinforced. During stimulus compounding tests, the tone-plus-odor compound occasioned more than double the responses occasioned by either the tone or odor presented individually. Thus, the current study (1) established stimulus control with an ambient olfactory discriminative stimulus in a traditional free-operant setting and (2) extended the generality of stimulus-compounding effects by demonstrating additive summation when olfactory and auditory discriminative stimuli were presented simultaneously.

Reinstatement of a food-maintained operant produced by compounding discriminative stimuli

After a tone and a light were established as discriminative stimuli for food-reinforced responding in rats, presenting these stimuli simultaneously produced over three times as many responses as either the tone or light alone. Following this stimulus compounding test, responses during the tone and during the light were not reinforced (extinction) for 20 sessions, essentially eliminating responding. On stimulus compounding tests administered after the 10th and 20th extinction sessions, tone-plus-light continued to produce significantly more responding than the tone or light alone. The compound even produced responses when the individual stimuli no longer did. These results suggest that the simultaneous presentation of multiple extinguished discriminative stimuli may also contribute to the reinstatement of other positively-reinforced behaviors, such as drug taking.

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.

Cocaine self-administration increased by compounding discriminative stimuli

Presenting independently established discriminative stimuli in compound can substantially increase response rates under food and shock-avoidance schedules. To determine whether this effect extends to drug self-administration, rats were trained to press a lever to receive cocaine intravenously. A tone and a light were independently established as discriminative stimuli for cocaine self-administration, then presented in combination in a stimulus-compounding test. Compared to tone and light alone, the tone-plus-light compound stimulus increased responding approximately three-fold when cocaine was withheld during testing, and it increased drug intake approximately two-fold when cocaine was made available during testing. Compounding did not increase responding after training in a truly random control condition where tone and light were presented uncorrelated with the availability of cocaine. The results obtained with this animal model of drug abuse define conditions under which combinations of environmental stimuli might substantially increase human drug use.

A rapidly acquired one-way conditioned avoidance procedure in rats as a primary screening test for antipsychotics: influence of shock intensity on avoidance performance

Antipsychotics selectively disrupt relatively weak responses maintained by conditioned stimuli compared with stronger responses maintained by unconditioned stimuli. The present study describes an easily taught and rapidly acquired (within one 15-trial session) one-way conditioned avoidance procedure for rats suitable for screening of drugs for potential antipsychotic activity. This was achieved by using an easily acquired response (running, part of the species-specific defense reaction repertoire), a clearly discriminated conditioned stimulus and determination of the appropriate strength of the unconditioned stimulus (i.e. shock level) for this procedure. Behavior acquired under these described conditions resulted in stable performance over long retest periods. By using either a low or high intensity of shock level under which the animals were trained and tested, the difference between the dose of haloperidol and chlorpromazine able to disrupt avoidance and that which disrupted escape response rates was increased. This effect was also observed for morphine, which inhibited both avoidance and escape responses at similar dose levels only under low shock conditions. At a high shock condition morphine more selectively inhibited avoidance responding. Diazepam did not affect avoidance behavior under the conditions described here.

The integration of habits maintained by food and water reinforcement through stimulus compounding

In Experiment 1, a light and a tone were correlated independently with water reinforcement of bar pressing by rats. With different naive subjects in Experiment 2, one of these stimuli was correlated with food and the other with water reinforcement (counterbalanced). In both experiments the absence of tone and light signaled extinction. Tests of stimulus-reinforcer independence in Experiment 2 indicated that tone and light controlled behavior whose rate was specifically affected by deprivation state. In the stimulus-compounding tests of both experiments, response rates were higher to tone-plus-light than to tone or light presented alone (additive summation). This is the first report of additive summation produced through compounding stimuli paired with different reinforcers. The results are discussed in the context of the effects of incentive motivation on operant performance.

Incentive processes and the peak shift

Intradimensional operant discrimination schedules were employed, which eliminated the covariation of response and reinforcement rates that are found on most operant baselines. In Phase 1, one keylight (S(1)) controlled an increase in pigeons' treadle pressing, relative to another keylight (S(2)), while being correlated with a decrease in frequency of reinforcement. In Phase 2 both treadle pressing and reinforcement increased in the presence of one keylight, relative to the second. In Phase 1 the relatively flat treadle-press generalization gradients peaked at S(1), whereas the peaks of those in Phase 2 were shifted from S(1) in a direction away from S(2). It was postulated that these positive and negative stimulus-reinforcement contingencies influence the likelihood of obtaining peak shift through the operation of a classically conditioned "central motive state." How response-reinforcement and stimulus-reinforcement contingencies might contribute to the development of inhibitory effects of S(2) is discussed. Autoshaped key pecking also was produced by these procedures. During manipulations of stimuli, the gradients obtained for autoshaped key pecking were narrow and sharply peaked at the food-correlated stimulus (S(2)) in Phase 1. This failure to obtain peak shift for an elicited response suggests a difference in discriminative processes operating in classical and instrumental learning.