Discrimination training and stimulus compounding: consideration of non-reinforcement and response differentiation consequences of S

Cocaine cues retain silent traces of an excitatory history after conversion into conditioned inhibitors: 'the ghost in the addict'

The present experiment investigated the extent to which the A+/AB- conditioned inhibition procedure could counteract an excitatory drug-related conditioning history. In two groups of rats, a light stimulus was established as a signal for the absence of cocaine. For the History group, the light had previously been a discriminative stimulus (S) that occasioned cocaine self-administration and could thus be classified as a cocaine excitor. In comparison, the No-History group first encountered the light during conditioned inhibition training. During conditioned inhibition training, both groups self-administered cocaine during tone as well as during click Ss, whereas drug seeking was eliminated in click-plus-light, wherein cocaine was not available (A+/AB-). Drug seeking was essentially eliminated in both groups. Nevertheless, on a summation test the light reduced cocaine seeking occasioned by the tone S by 95% in the No-History group, but by less than 50% in the History group. This summation test result showed that the effects of a drug-related history persisted even after the light was converted into an effective conditioned inhibitor on the training baseline through the powerful A+/AB- procedure. Future research should seek procedures that produce even stronger conditioned inhibition that eliminates such residual 'silent' drug excitation, the 'ghost in the addict'.

Additive and suppressive response summation with a chain schedule

Rats responded in a two-segment (variable-interval variable-interval) chain schedule. In one experiment, three subjects had either clicker, light, or clicker plus light as terminal-segment stimuli. All three responded at the highest rate when clicker plus light were present, thus showing additive summation. For three other subjects, initial-segment stimuli were either clicker, light, or clicker plus light. Two subjects responded at the lowest rate when clicker plus light were present, thus showing suppressive summation. In a second experiment, three subjects had either clicker, light, or neither clicker nor light as terminal-segment stimuli. None of these subjects showed reliable additive summation. Three other subjects had clicker, light, or neither as the initial-segment stimulus, and all three showed suppressive summation. Additive and suppressive summation both can be demonstrated with chain schedules, but stimulus parameters may be major variables in producing the effect.

Discriminated response and incentive processes in operant conditioning: a two-factor model of stimulus control

Understanding stimulus control generated in instrumental learning requires the direct investigation of discriminated response and reinforcer (incentive) processes acquired exclusively through the response-reinforcer contingencies operating on complex (multicomponent) baselines. Two series of stimulus-compounding studies accomplished this direct investigation. In one series, the independent variable was the relative reinforcement between schedule components; in the second series, it was relative response rate between components. Stimulus-compounding tests revealed that response and incentive processes enhanced each other when in agreement, counteracted each other when in opposition, and produced intermediate results when only one factor was operating. This pattern of results led to the conclusion that these factors were algebraically combining and to the development of a response/incentive matrix reflecting these dynamics. This two-factor analysis was extended to the peak-shift effect in stimulus generalization experiments and to the generation of inhibitory control. Two decades of stimulus compounding and peak-shift research were organized within this two-factor framework, extending this traditional approach to learning to active research areas heretofore not systematically considered in these terms.

The effect of reinforcement differences on choice and response distribution during stimulus compounding

In Experiments I and II, rats were trained to respond on one lever during light and another during tone. The absence of tone and light controlled response cessation. In the multiple schedule of Experiment I, all reinforcements were received for responding in tone or light; in the chain schedule of Experiment II, all reinforcements were received in no tone + no light for not responding. Experiment I subjects, for which tone and light were associated with response and reinforcement increase, responded significantly more to tone-plus-light than to tone or light alone (additive summation). Experiment II subjects, for which tone and light were associated with response increase and reinforcement decrease, responded comparably to tone, light, and tone + light. Thus, additive summation was observed when stimulus-response and stimulus-reinforcer associations in tone and light were both positive, but not when they were conflicting. All subjects in both experiments responded predominantly on the light-correlated lever during tone + light, even when light intensity was reduced in testing. Furthermore, when a light was presented to a subject engaged in tone-associated responding, all subjects immediately switched the locus of responding to the light-correlated lever. No change in locus occurred when a tone was presented to a subject engaged in light-associated responding, irrespective of the stimulus-reinforcer association conditioned to tone. The light-lever preference in tone + light indicates that the heightened responding observed in Experiment I was not the summation of tone-associated behavior with light-associated behavior. Rather, it appears to be the result of a facilitation of one operant (light-associated responding) by the reinforcement-associated cue for the other.

Response summation to a compound stimulus in a context of choice

Key pecks by two groups of pigeons were reinforced on concurrent schedules. For group E, pecks were reinforced during either a visual or an auditory stimulus; for group E, an additional, extinction component was available, during which both visual and auditory stimuli were absent. After training, both groups were given a compound test to measure preference among four stimuli, the three used in training plus a compound of the visual and auditory stimulus. Group E showed preference for the compound, emitting more pecks and spending more time in this stimulus than in other stimuli. Group E showed no preference between the compound and visual stimulus, nor between the auditory stimulus and the absence of both stimuli, but preferred the former pair over the latter pair of stimuli.

Compounding discriminative stimuli controlling free-operant avoidance

The performances of three rats were stabilized on a multiple schedule that maintained responding by a free-operant avoidance schedule during independent presentations of tone and light. The simultaneous absence of these stimuli signalled shock-free periods and controlled response cessation. Subsequently, test sessions were administered consisting of independent presentations of each stimulus and these stimuli compounded (tone-plus-light). During an extinction test, additive summation was observed to the compounded stimuli, i.e., more responses were emitted to the compound than to either tone or light. During a series of 28 maintenance-test sessions in which the shock schedule remained operative, the compounded stimuli produced a generally enhanced response rate and fewer pauses terminating with shock than either single stimulus condition. These results extend the generality of free-operant additive summation to responding maintained by aversive control. In addition, a comparison of the present study with previous experiments reporting additive summation of positively reinforced responding indicates that similar variables-rate and aversive differences between training stimulus conditions-should be considered in accounting for response distributions during stimulus compounding when responding is controlled by either positive or negative contingencies.

Within-subject reversibility of discriminative function in the composite-stimulus control of behavior

According to the composite-stimulus control model (Weiss, 1969, 1972b), an individual discriminative stimulus (S(D)) is composed of that S(D)'s on-state plus the off-states of all other relevant S(D)s. The present experiment investigated the reversibility of composite-stimulus control. Separate groups of rats were trained to lever-press for food whenever a tone or a light S(D) was present. For one group, the nonreinforced S(Delta) condition was tone-and-light absence (T+L). Tone-plus-light (T+L) was S(Delta) in the other group. On a "stimulus compounding" test that recombined composite elements, maximum responding occurred to that composite consisting only of elements occasioning response increase. That was T+L for the group trained with T+L as S(Delta) and T+L for the group trained with T+L as S(Delta). The S(Delta) composite was next reversed over groups in Phase 2. In Phase 2 tests, maximum responding that was comparable in magnitude to that of Phase 1 was again controlled by the composite consisting only of elements most recently occasioning response increase-whether T+L or T+L. The inhibitory conditioning history of both composite-elements currently occasioning responding did not weaken the summative effect. These results confirm and extend Weiss's composite-stimulus control model, and demonstrate that such control is fully reversible. We discuss how translating conditions of the stimulus-compounding paradigm to a composite continuum creates a functional and logical connection to intradimensional control measured through stimulus generalization, reducing the number of different behavioral phenomena requiring unique explanations.

A comparison of the effects of discriminative and Pavlovian inhibitors and excitors on instrumental responding

In two experiments, the effects of Pavlovian or discriminative conditioned inhibitors on operant responding were investigated in rats. Experiment 1 found that a Pavlovian conditioned inhibitor for food suppressed food-reinforced lever pressing more than a non-differentially trained control stimulus did. Experiment 2 demonstrated that an operant discriminative inhibitor produced greater suppression of lever pressing than a Pavlovian conditioned inhibitor. Experiment 2 also found that compounding an operant discriminative stimulus (SD) for food-reinforced responding with another SD for food-reinforced responding resulted in more additive summation than when an SD was compounded with a Pavlovian conditioned excitor for food. The results of these experiments support two-factor theories that postulate that incentive and response discriminative processes summate algebraically when the processes are inhibitory or excitatory.

Stimulus control and compounding with ambient odor as a discriminative stimulus on a free-operant baseline

Previous experiments have demonstrated that the simultaneous presentation of independently established discriminative stimuli can control rates of operant responding substantially higher than the rates occasioned by the individual stimuli. This "additive summation" phenomenon has been shown with a variety of different reinforcers (e.g., food, water, shock avoidance, cocaine, and heroin). Discriminative stimuli previously used in such studies have been limited to the visual and auditory sensory modalities. The present experiment sought to (1) establish stimulus control on a free-operant baseline with an ambient olfactory discriminative stimulus, (2) compare olfactory control to that produced with an auditory discriminative stimulus, and (3) determine whether compounding independently established olfactory and auditory discriminative stimuli produces additive summation. Rats lever pressed for food on a variable-interval schedule in the presence of either a tone or an odor, with comparable control developed to each stimulus. In the absence of these stimuli responding was not reinforced. During stimulus compounding tests, the tone-plus-odor compound occasioned more than double the responses occasioned by either the tone or odor presented individually. Thus, the current study (1) established stimulus control with an ambient olfactory discriminative stimulus in a traditional free-operant setting and (2) extended the generality of stimulus-compounding effects by demonstrating additive summation when olfactory and auditory discriminative stimuli were presented simultaneously.

Reinstatement of a food-maintained operant produced by compounding discriminative stimuli

After a tone and a light were established as discriminative stimuli for food-reinforced responding in rats, presenting these stimuli simultaneously produced over three times as many responses as either the tone or light alone. Following this stimulus compounding test, responses during the tone and during the light were not reinforced (extinction) for 20 sessions, essentially eliminating responding. On stimulus compounding tests administered after the 10th and 20th extinction sessions, tone-plus-light continued to produce significantly more responding than the tone or light alone. The compound even produced responses when the individual stimuli no longer did. These results suggest that the simultaneous presentation of multiple extinguished discriminative stimuli may also contribute to the reinstatement of other positively-reinforced behaviors, such as drug taking.

Conditioned inhibition of cocaine seeking in rats

Despite its potential relevance to the treatment of drug abuse, conditioned inhibition of drug seeking has not been systematically investigated before. In this study, rats could self-administer cocaine by lever pressing whenever a click or tone was present. Responding was not reinforced when a light was present. The light was presented simultaneously with the click (i.e., in an excitatory context) in 1 group, but the light was always presented alone in another group. When it was later presented in compound with the tone, the light was a highly effective conditioned inhibitor, suppressing cocaine seeking by 92% in the former group and by 74% in the latter. These results suggest ways to improve cue-oriented behavioral treatments for drug abuse.

Stimulus control of cocaine self-administration

Environmental stimuli that set the occasion wherein drugs are acquired can "trigger" drug-related behavior. Investigating the stimulus control of drug self-administration in laboratory animals should help us better understand this aspect of human drug abuse. Stimulus control of cocaine self-administration was generated here for the first time using multiple and chained schedules with short, frequently-alternating components--like those typically used to study food-maintained responding. The procedures and results are presented along with case histories to illustrate the strategies used to produce this stimulus control. All these multicomponent schedules contained variable-interval (VI) components as well as differential-reinforcement-of-other-behavior (DRO) or extinction components. Schedule parameters and unit dose were adjusted for each rat to produce stable, moderate rates in VI components, with minimal postreinforcement (infusion) pausing, and response cessation in extinction and DRO components. Whole-body drug levels on terminal baselines calculated retrospectively revealed that all rats maintained fairly stable drug levels (mean, 2.3 to 3.4 mg/kg) and molar rates of intake (approximately 6.0 mg/kg/hr). Within this range, no relation between local VI response rates and drug level was found. The stimulus control revealed in cumulative records was indistinguishable from that achieved with food under these schedules, suggesting that common mechanisms may underlie the control of cocaine- and food-maintained behavior.

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.

Humans' responses to novel stimulus compounds and the effects of training

Twenty-four college students participated in an experiment with stimulus compounds. Subjects learned to discriminate color stimuli that correlated with varying probabilities of reinforcement. Reinforcement consisted of points. For all subjects, two colors signaled a .80 reinforcement probability, and two others signaled a .20 probability. For compound-trained subjects, a fifth compound stimulus (composed of a high-probability color and a low-probability color) was correlated with a .10 reinforcement probability. During testing, interspersed probe trials required subjects to choose between two alternatives: a compound stimulus and either one of its constituent stimuli. Compound-untrained subjects preferred the compound over either individual stimulus, thus showing response summation. However, compound-trained subjects, having had experience with an exemplar compound, showed significantly lower choice proportions for a test compound, indicating that subjects' responding to novel stimulus compounds is modifiable by experience with a single similar compound.

Cocaine self-administration increased by compounding discriminative stimuli

Presenting independently established discriminative stimuli in compound can substantially increase response rates under food and shock-avoidance schedules. To determine whether this effect extends to drug self-administration, rats were trained to press a lever to receive cocaine intravenously. A tone and a light were independently established as discriminative stimuli for cocaine self-administration, then presented in combination in a stimulus-compounding test. Compared to tone and light alone, the tone-plus-light compound stimulus increased responding approximately three-fold when cocaine was withheld during testing, and it increased drug intake approximately two-fold when cocaine was made available during testing. Compounding did not increase responding after training in a truly random control condition where tone and light were presented uncorrelated with the availability of cocaine. The results obtained with this animal model of drug abuse define conditions under which combinations of environmental stimuli might substantially increase human drug use.

Locating reward cue at response manipulandum (CAM) induces symptoms of drug abuse

Appetitive instrumental discrimination learning procedures provide for CAM (cue and manipulandum) when the reward cue (discriminative stimulus positively correlated with positive reinforcement) is located at the response manipulandum (object that when contacted or manipulated defines the performance of the instrumental response). Evidence reviewed shows that CAM induces excessive and compulsive instrumental responding relative to otherwise comparable non-CAM control procedures. In humans, symptoms of drug abuse are particularly likely when the drug-taking implement (response manipulandum at which instrumental drug-taking is directed) is also predictive of the drug's rewarding effects (reward cue). Evidence that the predictive relationship between a drug-taking implement and drug reward relates to drug abuse is reviewed, and implications for treatment and prevention are considered. CAM is related to neurobiological models of drug abuse that emphasize the role of the neurotransmitter dopamine (DA). CAM produces convergence of DA-mediated responding for conditioned reinforcement with DA mediation of psychomotor activation and incentive-motivational processes to yield reflexive cue-directed responding not observed in non-CAM controls.

Generalization peak shift for autoshaped and operant key pecks

Pigeons acquired discriminated key pecking between 528- and 540-nm stimuli by either a response-reinforcer (operant group) or a stimulus-reinforcer (autoshaped group) contingency, with other training-schedule parameters comparable over groups. For the birds in the operant group, key pecks intermittently produced grain in the presence of one hue on the key (positive stimulus) but not in the other (negative stimulus). For the birds in the autoshaped group, pecking emerged when grain was intermittently presented independently of key pecking during one key color but was not presented during the other key color. Two independent contingency assays, peck-location comparisons and elimination of differences in reinforcement rate, confirmed the effectiveness of the two training procedures in establishing operant or respondent control of key pecking. After reaching a 10:1, or better, discrimination ratio between key pecks during the two key colors, the birds received a wavelength generalization test. Criterion baseline key-peck rates were comparable for operant and autoshaped groups prior to testing. On the generalization test, performed in extinction, all birds pecked most at a stimulus removed from the positive training stimulus in the direction away from the negative stimulus. In testing, autoshaped "peak" rates (24.5 to 64.9 pecks per minute) were from 33% to 80% higher than rates in the presence of the training stimuli. Respondent peak shift rarely has been reported heretofore, and never this consistently and robustly. These results further confirm the similarity of perceptual processing in classical and operant learning. They are discussed in terms of Spence's gradient-interaction theory and Weiss' (1978) two-process model of stimulus control.

Absence of anticipatory contrast in rats trained on multiple schedules

Rats were trained on three- and four-component multiple schedules in which two of the components were correlated with identical reinforcement schedules that remained unchanged throughout training. These target components differed in terms of whether their respective following schedules were either higher or lower in value. Unlike corresponding experiments previously reported with pigeons, higher response rates occurred in the target component followed by a higher valued schedule than in the target component followed by the lower valued schedule. Overall contrast effects occurred independently of these sequential effects, but were inconsistent across subjects. The results suggest that the effects of a following schedule of reinforcement are opposite for pigeons and rats, and that one reason previous studies have often failed to show contrast effects with rats is that the effects of the following schedule in rats are in competition with contrast dynamics.

The integration of habits maintained by food and water reinforcement through stimulus compounding

In Experiment 1, a light and a tone were correlated independently with water reinforcement of bar pressing by rats. With different naive subjects in Experiment 2, one of these stimuli was correlated with food and the other with water reinforcement (counterbalanced). In both experiments the absence of tone and light signaled extinction. Tests of stimulus-reinforcer independence in Experiment 2 indicated that tone and light controlled behavior whose rate was specifically affected by deprivation state. In the stimulus-compounding tests of both experiments, response rates were higher to tone-plus-light than to tone or light presented alone (additive summation). This is the first report of additive summation produced through compounding stimuli paired with different reinforcers. The results are discussed in the context of the effects of incentive motivation on operant performance.

Incentive processes and the peak shift

Intradimensional operant discrimination schedules were employed, which eliminated the covariation of response and reinforcement rates that are found on most operant baselines. In Phase 1, one keylight (S(1)) controlled an increase in pigeons' treadle pressing, relative to another keylight (S(2)), while being correlated with a decrease in frequency of reinforcement. In Phase 2 both treadle pressing and reinforcement increased in the presence of one keylight, relative to the second. In Phase 1 the relatively flat treadle-press generalization gradients peaked at S(1), whereas the peaks of those in Phase 2 were shifted from S(1) in a direction away from S(2). It was postulated that these positive and negative stimulus-reinforcement contingencies influence the likelihood of obtaining peak shift through the operation of a classically conditioned "central motive state." How response-reinforcement and stimulus-reinforcement contingencies might contribute to the development of inhibitory effects of S(2) is discussed. Autoshaped key pecking also was produced by these procedures. During manipulations of stimuli, the gradients obtained for autoshaped key pecking were narrow and sharply peaked at the food-correlated stimulus (S(2)) in Phase 1. This failure to obtain peak shift for an elicited response suggests a difference in discriminative processes operating in classical and instrumental learning.

Brightness contrast: a reinterpretation of compound cue and combined cue experiments with pigeons

A group of three pigeons was trained on a 4-ply multiple schedule: a green color and a vertical line superimposed upon an achromatic background as positive stimuli, and a red color and a horizontal line on an achromatic background as negative stimuli. The pigeons were tested with the vertical line superimposed upon different achromatic background intensities, then with the vertical line superimposed upon different green background intensities, and finally with the vertical line and its training achromatic backgfound attenuated (and unattenuated) by a neutral density filter. The gradients peaked at the luminance of the achromatic background used during training and at the equivalent luminance for the green background when it was substituted for the achromatic background. The brightness contrast, not the background luminance, was the critical variable as the neutral density filter attenuated both the line and the background equally, leaving brightness contrast unchanged; there was no response decrement to this attenuated stimulus. Two other groups of three pigeons showed that they attended to line orientation as well as to brightness contrast. The brightness contrast hypothesis was extended to explain results of attention experiments and combined cue experiments which have used line stimuli in combinations with different backgrounds.