Stimulus compounding in free-operant and classical conditioning. A review and analysis

Learning processes in relapse to alcohol use: lessons from animal models

RATIONALE

Alcohol use is reliably preceded by discrete and contextual stimuli which, through diverse learning processes, acquire the capacity to promote alcohol use and relapse to alcohol use.

OBJECTIVE

We review contemporary extinction, renewal, reinstatement, occasion setting, and sex differences research within a conditioning framework of relapse to alcohol use to inform the development of behavioural and pharmacological therapies.

KEY FINDINGS

Diverse learning processes and corresponding neurobiological substrates contribute to relapse to alcohol use. Results from animal models indicate that cortical, thalamic, accumbal, hypothalamic, mesolimbic, glutamatergic, opioidergic, and dopaminergic circuitries contribute to alcohol relapse through separable learning processes. Behavioural therapies could be improved by increasing the endurance and generalizability of extinction learning and should incorporate whether discrete cues and contexts influence behaviour through direct excitatory conditioning or occasion setting mechanisms. The types of learning processes that most effectively influence responding for alcohol differ in female and male rats.

CONCLUSION

Sophisticated conditioning experiments suggest that diverse learning processes are mediated by distinct neural circuits and contribute to relapse to alcohol use. These experiments also suggest that gender-specific behavioural and pharmacological interventions are a way towards efficacious therapies to prevent relapse to alcohol use.

Probabilistic reinforcement precludes transitive inference: A preliminary study

In the basic verbal task from Piaget, when a relation of the form if A > B and B > C is given, a logical inference A > C is expected. This process is called transitive inference (TI). The adapted version for animals involves the presentation of a simultaneous discrimination between stimuli pairs. In this way, when A+B-, B+C-, C+D-, D+E- is trained, a B>D preference is expected, assuming that if A>B>C>D>E, then B>D. This effect has been widely reported using several procedures and different species. In the current experiment TI was evaluated employing probabilistic reinforcement. Thus, for the positive stimuli a .7 probability was administered and for the negative stimuli a .3 probability was administered. Under this arrangement the relation A>B>C>D>E is still allowed, but TI becomes more difficult. Five pigeons (Columba Livia) were exposed to the mentioned arrangement. Only one pigeon reached the criterion in C+D- discrimination, whereas the remaining did not. Only the one who successfully solved C+D- was capable of learning TI, whereas the others were not. Additionally, it was found that correct response ratios did not predict BD performance. Consequently, probabilistic reinforcement disrupted TI, but some positional ordering was retained in the test. The results suggest that TI might be affected by associative strength but also by the positional ordering of the stimuli. The discussion addresses the two main accounts of TI: the associative account and the ordinal representation account.

Contextual effects in sensorimotor adaptation adhere to associative learning rules

Traditional associative learning tasks focus on the formation of associations between salient events and arbitrary stimuli that predict those events. This is exemplified in cerebellar-dependent delay eyeblink conditioning, where arbitrary cues such as a tone or light act as conditioned stimuli (CSs) that predict aversive sensations at the cornea (unconditioned stimulus [US]). Here, we ask if a similar framework could be applied to another type of cerebellar-dependent sensorimotor learning - sensorimotor adaptation. Models of sensorimotor adaptation posit that the introduction of an environmental perturbation results in an error signal that is used to update an internal model of a sensorimotor map for motor planning. Here, we take a step toward an integrative account of these two forms of cerebellar-dependent learning, examining the relevance of core concepts from associative learning for sensorimotor adaptation. Using a visuomotor adaptation reaching task, we paired movement-related feedback (US) with neutral auditory or visual contextual cues that served as CSs. Trial-by-trial changes in feedforward movement kinematics exhibited three key signatures of associative learning: differential conditioning, sensitivity to the CS-US interval, and compound conditioning. Moreover, after compound conditioning, a robust negative correlation was observed between responses to the two elemental CSs of the compound (i.e. overshadowing), consistent with the additivity principle posited by theories of associative learning. The existence of associative learning effects in sensorimotor adaptation provides a proof-of-concept for linking cerebellar-dependent learning paradigms within a common theoretical framework.

Discrimination of Polymorphous Stimulus Sets by Pigeons

Pigeons were trained to perform a visual discrimination between stimulus sets in which the presence of any two of three positive features made a stimulus positive, while any two of three negative features made it negative (there were thus three different positive and three different negative stimuli). After training, the birds were exposed to test stimuli that contained either all three positive or all three negative features. In Experiment I three pigeons were successfully trained by a successive method, and subsequently responded to the test stimuli as though they were positive or negative respectively. In Experiment II four pigeons were trained by a simultaneous method. Three learned the discrimination and generalized appropriately to the test stimuli, but they showed no preference between positive test and positive training stimuli, nor any consistent difference in speed of response to them; and similar results were found for negative stimuli. It is argued from this that the pigeons learned to respond to the stimuli as patterns (configurations of features) rather than to the constituent features, but that they generalized to the test stimuli by using the common features. The experiments show that pigeons could in principle learn to discriminate natural polymorphous classes (such as “pigeon” or “person”) without using any single feature, but neither the present experiments nor earlier ones demonstrating discriminations of such natural classes establish that pigeons make use of polymorphous concepts in the same way as people.

Spatial integration during performance in pigeons

We've shown that pigeons can integrate separately acquired spatial maps into a cognitive map. Integration requires an element shared between maps. In two experiments using a spatial-search task in pigeons, we test spatial combination rules when no shared element was present during training. In all three experiments, pigeons first learned individual landmark-target maps. In subsequent tests involving combinations of landmarks, we found evidence that landmarks collaborate in guiding spatial choice at test (Experiment 1). In Experiment 2, pigeons were trained on two landmarks with different proximities to the target. On tests on a compound of both landmarks, pigeons showed stronger spatial control by the more proximal landmark, a performance overshadowing effect. Extinction of the proximal landmark shifted spatial control to the non-extinguished distal landmark. This reveals that the performance overshadowing effect was associative in nature, and not due to perceptual or spatial biases. This emphasis on spatial control during performance reflects the emphasis on performance processes that were a major focus in Ralph Miller's lab.

Negative mood reverses devaluation of goal-directed drug-seeking favouring an incentive learning account of drug dependence

BACKGROUND

Two theories explain how negative mood primes smoking behaviour. The stimulus-response (S-R) account argues that in the negative mood state, smoking is experienced as more reinforcing, establishing a direct (automatic) association between the negative mood state and smoking behaviour. By contrast, the incentive learning account argues that in the negative mood state smoking is expected to be more reinforcing, which integrates with instrumental knowledge of the response required to produce that outcome.

OBJECTIVES

One differential prediction is that whereas the incentive learning account anticipates that negative mood induction could augment a novel tobacco-seeking response in an extinction test, the S-R account could not explain this effect because the extinction test prevents S-R learning by omitting experience of the reinforcer.

METHODS

To test this, overnight-deprived daily smokers (n = 44) acquired two instrumental responses for tobacco and chocolate points, respectively, before smoking to satiety. Half then received negative mood induction to raise the expected value of tobacco, opposing satiety, whilst the remainder received positive mood induction. Finally, a choice between tobacco and chocolate was measured in extinction to test whether negative mood could augment tobacco choice, opposing satiety, in the absence of direct experience of tobacco reinforcement.

RESULTS

Negative mood induction not only abolished the devaluation of tobacco choice, but participants with a significant increase in negative mood increased their tobacco choice in extinction, despite satiety.

CONCLUSIONS

These findings suggest that negative mood augments drug-seeking by raising the expected value of the drug through incentive learning, rather than through automatic S-R control.

Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization

How do we apply learning from one situation to a similar, but not identical, situation? The principles governing the extent to which animals and humans generalize what they have learned about certain stimuli to novel compounds containing those stimuli vary depending on a number of factors. Perhaps the best studied among these factors is the type of stimuli used to generate compounds. One prominent hypothesis is that different generalization principles apply depending on whether the stimuli in a compound are similar or dissimilar to each other. However, the results of many experiments cannot be explained by this hypothesis. Here, we propose a rational Bayesian theory of compound generalization that uses the notion of consequential regions, first developed in the context of rational theories of multidimensional generalization, to explain the effects of stimulus factors on compound generalization. The model explains a large number of results from the compound generalization literature, including the influence of stimulus modality and spatial contiguity on the summation effect, the lack of influence of stimulus factors on summation with a recovered inhibitor, the effect of spatial position of stimuli on the blocking effect, the asymmetrical generalization decrement in overshadowing and external inhibition, and the conditions leading to a reliable external inhibition effect. By integrating rational theories of compound and dimensional generalization, our model provides the first comprehensive computational account of the effects of stimulus factors on compound generalization, including spatial and temporal contiguity between components, which have posed long-standing problems for rational theories of associative and causal learning.

Learned together, extinguished apart: reducing fear to complex stimuli

Pairing a previously neutral conditioned stimulus (CS; e.g., a tone) to an aversive unconditioned stimulus (US; e.g., a footshock) leads to associative learning such that the tone alone comes to elicit a conditioned response (e.g., freezing). We have previously shown that an extinction session that occurs within the reconsolidation window attenuates fear responding and prevents the return of fear in pure tone Pavlovian fear conditioning. Here we sought to examine whether this effect also applies to a more complex fear memory. First, we show that after fear conditioning to the simultaneous presentation of a tone and a light (T+L) coterminating with a shock, the compound memory that ensues is more resistant to fear extinction than simple tone-shock pairings. Next, we demonstrate that the compound memory can be disrupted by interrupting the reconsolidation of the two individual components using a sequential retrieval+extinction paradigm, provided the stronger compound component is retrieved first. These findings provide insight into how compound memories are encoded, and could have important implications for PTSD treatment.

Temporal memory averaging and post-encoding alterations in temporal expectation

Recent work in our lab has demonstrated that rats trained to associate two different reinforcement delays with two different cues will generate a scalar temporal expectation at a time between these delays when presented with the cue compound. This work demonstrates that rats will integrate distinct temporal memories at retrieval, revealing that temporal expectation need not be a veridical representation of experience. Following from this recognition that processes occurring at or after memory retrieval may transform or bias temporal expectations, we suggest that previous pharmacological work that had been interpreted as resulting from sensorial, or clock-speed, changes, may be alternatively interpreted as resulting from mnemonic alterations. We end with a brief review of the impact of post-encoding alterations of memory on behavior other than timing.

Combining versus analyzing multiple causes: how domain assumptions and task context affect integration rules

In everyday life, people typically observe fragments of causal networks. From this knowledge, people infer how novel combinations of causes they may never have observed together might behave. I report on 4 experiments that address the question of how people intuitively integrate multiple causes to predict a continuously varying effect. Most theories of causal induction in psychology and statistics assume a bias toward linearity and additivity. In contrast, these experiments show that people are sensitive to cues biasing various integration rules. Causes that refer to intensive quantities (e.g., taste) or to preferences (e.g., liking) bias people toward averaging the causal influences, whereas extensive quantities (e.g., strength of a drug) lead to a tendency to add. However, the knowledge underlying these processes is fallible and unstable. Therefore, people are easily influenced by additional task-related context factors. These additional factors include the way data are presented, the difficulty of the inference task, and transfer from previous tasks. The results of the experiments provide evidence for causal model and related theories, which postulate that domain-general representations of causal knowledge are influenced by abstract domain knowledge, data-driven task factors, and processing difficulty.

Adolescent nicotine exposure sensitizes cue-induced reinstatement of cocaine seeking in rats bred for high and low saccharin intake

BACKGROUND

Environmental factors such as early drug exposure influence drug abuse vulnerability, and evidence also suggests that drug abuse is highly heritable. The purpose of the present study was to determine whether environmental and genetic factors interact to produce additive drug abuse vulnerability.

METHODS

An animal model of relapse was used to examine the effects of adolescent nicotine exposure on adult cocaine seeking in rats bred for high (HiS) and low (LoS) saccharin intake. Rats from HiS and LoS progenitor lines received s.c. injections of nicotine for 10 days (postnatal days 22-31). Rats were then allowed to reach adulthood and were trained to lever press for cocaine infusions. During each self-administration session, the house light (HL) was illuminated and each lever press activated a set of lights adjacent to the lever (LL). Following cocaine self-administration, the HL and LL were deactivated, cocaine solutions were replaced with saline, and rats extinguished lever pressing. Subsequently, rats were tested under a multi-component reinstatement procedure consisting of: (1) cue-induced reinstatement with LL alone and the HL presented alone, (2) cocaine-induced reinstatement without LL and HL present, (3) and cocaine-induced reinstatement with LL present.

RESULTS

The results indicated that adolescent nicotine exposure sensitized the reinstatement of cocaine seeking during adulthood in HiS (but not LoS) rats when lever pressing resulted in LL cue presentations. In addition, following administration of the cocaine priming injection, rats exposed to nicotine (vs. saline) during adolescence (LoS and HiS) engaged in more cocaine seeking under the cocaine-primed reinstatement condition when lever pressing illuminated the LL.

CONCLUSION

These results suggest that drug abuse vulnerability may be a function of early life exposure to drugs of abuse in addition to genetic influences.

Additive and suppressive response summation with a chain schedule

Rats responded in a two-segment (variable-interval variable-interval) chain schedule. In one experiment, three subjects had either clicker, light, or clicker plus light as terminal-segment stimuli. All three responded at the highest rate when clicker plus light were present, thus showing additive summation. For three other subjects, initial-segment stimuli were either clicker, light, or clicker plus light. Two subjects responded at the lowest rate when clicker plus light were present, thus showing suppressive summation. In a second experiment, three subjects had either clicker, light, or neither clicker nor light as terminal-segment stimuli. None of these subjects showed reliable additive summation. Three other subjects had clicker, light, or neither as the initial-segment stimulus, and all three showed suppressive summation. Additive and suppressive summation both can be demonstrated with chain schedules, but stimulus parameters may be major variables in producing the effect.

Discriminated response and incentive processes in operant conditioning: a two-factor model of stimulus control

Understanding stimulus control generated in instrumental learning requires the direct investigation of discriminated response and reinforcer (incentive) processes acquired exclusively through the response-reinforcer contingencies operating on complex (multicomponent) baselines. Two series of stimulus-compounding studies accomplished this direct investigation. In one series, the independent variable was the relative reinforcement between schedule components; in the second series, it was relative response rate between components. Stimulus-compounding tests revealed that response and incentive processes enhanced each other when in agreement, counteracted each other when in opposition, and produced intermediate results when only one factor was operating. This pattern of results led to the conclusion that these factors were algebraically combining and to the development of a response/incentive matrix reflecting these dynamics. This two-factor analysis was extended to the peak-shift effect in stimulus generalization experiments and to the generation of inhibitory control. Two decades of stimulus compounding and peak-shift research were organized within this two-factor framework, extending this traditional approach to learning to active research areas heretofore not systematically considered in these terms.

The effect of reinforcement differences on choice and response distribution during stimulus compounding

In Experiments I and II, rats were trained to respond on one lever during light and another during tone. The absence of tone and light controlled response cessation. In the multiple schedule of Experiment I, all reinforcements were received for responding in tone or light; in the chain schedule of Experiment II, all reinforcements were received in no tone + no light for not responding. Experiment I subjects, for which tone and light were associated with response and reinforcement increase, responded significantly more to tone-plus-light than to tone or light alone (additive summation). Experiment II subjects, for which tone and light were associated with response increase and reinforcement decrease, responded comparably to tone, light, and tone + light. Thus, additive summation was observed when stimulus-response and stimulus-reinforcer associations in tone and light were both positive, but not when they were conflicting. All subjects in both experiments responded predominantly on the light-correlated lever during tone + light, even when light intensity was reduced in testing. Furthermore, when a light was presented to a subject engaged in tone-associated responding, all subjects immediately switched the locus of responding to the light-correlated lever. No change in locus occurred when a tone was presented to a subject engaged in light-associated responding, irrespective of the stimulus-reinforcer association conditioned to tone. The light-lever preference in tone + light indicates that the heightened responding observed in Experiment I was not the summation of tone-associated behavior with light-associated behavior. Rather, it appears to be the result of a facilitation of one operant (light-associated responding) by the reinforcement-associated cue for the other.

Stimulus generalization of schedule-induced polydipsia

Five rats were exposed to an intradimensional discrimination by associating two tones of different frequency with the components of a multiple random-time 30-sec, extinction schedule of food presentation. After schedule-induced polydipsia developed and the intermittent schedule of food presentation established stable differential licking rates during the stimuli associated with the multiple schedule, a stimulus generalization test was conducted. When generalization testing was conducted by presenting stimuli that varied on the frequency dimension during the random-time 30-sec component of the multiple schedule, all five rats demonstrated moderately sloping symmetrical gradients. Thus, schedule-induced polydipsia can be brought under the control of stimuli other than the food pellet.

Within-subject reversibility of discriminative function in the composite-stimulus control of behavior

According to the composite-stimulus control model (Weiss, 1969, 1972b), an individual discriminative stimulus (S(D)) is composed of that S(D)'s on-state plus the off-states of all other relevant S(D)s. The present experiment investigated the reversibility of composite-stimulus control. Separate groups of rats were trained to lever-press for food whenever a tone or a light S(D) was present. For one group, the nonreinforced S(Delta) condition was tone-and-light absence (T+L). Tone-plus-light (T+L) was S(Delta) in the other group. On a "stimulus compounding" test that recombined composite elements, maximum responding occurred to that composite consisting only of elements occasioning response increase. That was T+L for the group trained with T+L as S(Delta) and T+L for the group trained with T+L as S(Delta). The S(Delta) composite was next reversed over groups in Phase 2. In Phase 2 tests, maximum responding that was comparable in magnitude to that of Phase 1 was again controlled by the composite consisting only of elements most recently occasioning response increase-whether T+L or T+L. The inhibitory conditioning history of both composite-elements currently occasioning responding did not weaken the summative effect. These results confirm and extend Weiss's composite-stimulus control model, and demonstrate that such control is fully reversible. We discuss how translating conditions of the stimulus-compounding paradigm to a composite continuum creates a functional and logical connection to intradimensional control measured through stimulus generalization, reducing the number of different behavioral phenomena requiring unique explanations.

Averaging of temporal memories by rats

Rats were trained on a mixed fixed-interval schedule in which stimulus A (tone or light) indicated food availability after 10 s and stimulus B (the other stimulus) indicated food availability after 20 s. Testing consisted of nonreinforced probe trials in which the stimulus was A, B, or the compound AB. On single-stimulus trials, rats responded with a peak of activity around the programmed reinforced time. On compound-stimulus trials, rats showed a single scalar peak of responding at a time midway between those for stimulus A and B. These results suggest that when provided with discrepant information regarding the temporal predictability of reinforcement, rats compute an average of the scheduled reinforcement times for the A and B stimuli and use this average to generate an expectation of reward for the compound stimuli.

Summation and subtraction using a modified autoshaping procedure in pigeons

A modified autoshaping paradigm (significantly different from those previously reported in the summation literature) was employed to allow for the simultaneous assessment of stimulus summation and subtraction in pigeons. The response requirements and the probability of food delivery were adjusted such that towards the end of training 12 of 48 trials ended in food delivery, the same proportion as under testing. Stimuli (outlines of squares of three sizes and colors: A, B, and C) were used that could be presented separately or in any combination of two or three stimuli. Twelve of the pigeons (summation groups) were trained with either A, B, and C or with AB, BC, and CA, and tested with ABC. The remaining 12 pigeons (subtraction groups) received training with ABC but were tested with A, B, and C or with AB, BC, and CA. These groups were further subdivided according to whether stimulus elements were presented either in a concentric or dispersed manner. Summation did not occur; subtraction occurred in the two concentric groups. For interpretation of the results, configural theory, the Rescorla-Wagner model, and the composite-stimulus control model were considered. The results suggest different mechanisms responsible for summation and subtraction.

A role for CS-US contingency in Pavlovian conditioning

Two experiments evaluated the role of conditioned stimulus-unconditioned stimulus (CS-US) contingency in appetitive Pavlovian conditioning in rats. In both experiments, some groups received a positively contingent CS signaling an increased likelihood of the US relative to the absence of the CS. These groups were compared with control treatments in which the likelihood of the US was the same in the presence and absence of the CS. A trial marker served as a trial context. Experiment 1 found contingency sensitivity. There was a reciprocal relationship between responding to the CS and the trial marker. Experiment 2 showed that this result was not stimulus or response specific. These results are consistent with associative explanations and the idea that rats are sensitive to CS-US contingency.

Configural learning in two species of marsupial (Setonix brachyurus and Sminthopsis crassicaudata)

Four experiments examined the ability of quokkas (Setonix brachyurus) and fat-tailed dunnarts (Sminthopsis crassicaudata) to solve 2 configural tasks: transverse and negative patterning. Transverse patterning requires the simultaneous solution of 3 overlapping discrimination problems (A+ B-, B+ C-, C+ A-). Both species could solve the nonoverlapping (elemental) version of this task (U+ V-, W+ X-, Y+ Z-), but only dunnarts solved the transverse patterning task. Negative patterning requires conditioned responses to 2 stimuli when presented separately but not together (A+, B+, AB-). Both species formed a selective conditioned response to A+ and B+ stimuli and inhibited responding to a simple nonreinforced stimulus (C-), but only dunnarts successfully inhibited responding to the AB- compound to solve the negative patterning task. These experiments are the first to demonstrate configural learning in a marsupial.

Stimulus control of cocaine self-administration

Environmental stimuli that set the occasion wherein drugs are acquired can "trigger" drug-related behavior. Investigating the stimulus control of drug self-administration in laboratory animals should help us better understand this aspect of human drug abuse. Stimulus control of cocaine self-administration was generated here for the first time using multiple and chained schedules with short, frequently-alternating components--like those typically used to study food-maintained responding. The procedures and results are presented along with case histories to illustrate the strategies used to produce this stimulus control. All these multicomponent schedules contained variable-interval (VI) components as well as differential-reinforcement-of-other-behavior (DRO) or extinction components. Schedule parameters and unit dose were adjusted for each rat to produce stable, moderate rates in VI components, with minimal postreinforcement (infusion) pausing, and response cessation in extinction and DRO components. Whole-body drug levels on terminal baselines calculated retrospectively revealed that all rats maintained fairly stable drug levels (mean, 2.3 to 3.4 mg/kg) and molar rates of intake (approximately 6.0 mg/kg/hr). Within this range, no relation between local VI response rates and drug level was found. The stimulus control revealed in cumulative records was indistinguishable from that achieved with food under these schedules, suggesting that common mechanisms may underlie the control of cocaine- and food-maintained behavior.

Conditioned Fear-Related Ultrasonic Vocalizations are Emitted as an Emotional Response

Ultrasonic vocalizations (USVs) are observed along with freezing behavior when rats are placed under fearful situation. Coping style with stress is categorized into two forms, namely passive and emotional avoidance and active operant avoidance. In this study, fear-induced USV was compared between two conditioning protocols. Two groups of male Wistar rats were contextually conditioned for 10 days by exposing to the shock box. One group was shock-unavoidable and the other shock-avoidable by operant control of emitting the USVs. They were then proceeded to the extinction phase. As the results, the shock-unavoidable group emitted greater USV in both conditioning and extinction phases. The extinction burst, commonly seen in active learned responses, was not observed in either group. The duration of freezing was also longer in shock-unavoidable conditioned rats. These results suggest that under the shock-unavoidable condition, rats receive more stress and thus emit more USV. It is therefore concluded that fear-induced USV is an emotional and passive response to the stress, rather than being controlled in an operant-way.

The importance of a compound stimulus in conditioned drug-seeking behavior following one week of extinction from self-administered cocaine in rats

Previous studies have demonstrated that conditioned stimuli can increase responding on a drug-associated lever after extinction from drug self-administration. The present study investigated singular stimuli (tone or light) or a compound stimulus (tone + light) for their ability to increase extinguished responding following chronic cocaine self-administration. Rats self-administered cocaine for 2 weeks on a fixed ratio (FR1) schedule of reinforcement, in which lever responding resulted in varied presentation of a tone, light, or tone + light combination. The rats were then exposed to 1 week of daily extinction sessions. Presentation of the tone + light on day 8 of extinction in the absence of cocaine reinforcement resulted in a significant increase in responding, while either stimulus component alone was much weaker or failed to produce any changes from extinction rates of responding. In addition, changing the duration of the single elements of the compound did not affect the magnitude of increased responding to the compound. Following three final extinction sessions, robust lever responding for cocaine infusions on day 12 of extinction was seen across all groups. These findings suggest that compound stimuli may be critical to fully activate drug-seeking behavior in conditions of craving and relapse following prolonged extinction.

Humans' responses to novel stimulus compounds and the effects of training

Twenty-four college students participated in an experiment with stimulus compounds. Subjects learned to discriminate color stimuli that correlated with varying probabilities of reinforcement. Reinforcement consisted of points. For all subjects, two colors signaled a .80 reinforcement probability, and two others signaled a .20 probability. For compound-trained subjects, a fifth compound stimulus (composed of a high-probability color and a low-probability color) was correlated with a .10 reinforcement probability. During testing, interspersed probe trials required subjects to choose between two alternatives: a compound stimulus and either one of its constituent stimuli. Compound-untrained subjects preferred the compound over either individual stimulus, thus showing response summation. However, compound-trained subjects, having had experience with an exemplar compound, showed significantly lower choice proportions for a test compound, indicating that subjects' responding to novel stimulus compounds is modifiable by experience with a single similar compound.

Cocaine self-administration increased by compounding discriminative stimuli

Presenting independently established discriminative stimuli in compound can substantially increase response rates under food and shock-avoidance schedules. To determine whether this effect extends to drug self-administration, rats were trained to press a lever to receive cocaine intravenously. A tone and a light were independently established as discriminative stimuli for cocaine self-administration, then presented in combination in a stimulus-compounding test. Compared to tone and light alone, the tone-plus-light compound stimulus increased responding approximately three-fold when cocaine was withheld during testing, and it increased drug intake approximately two-fold when cocaine was made available during testing. Compounding did not increase responding after training in a truly random control condition where tone and light were presented uncorrelated with the availability of cocaine. The results obtained with this animal model of drug abuse define conditions under which combinations of environmental stimuli might substantially increase human drug use.