A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Translations in Stimulus-Stimulus Pairing: Autoshaping of Learner Vocalizations

Stimulus-stimulus pairing (SSP) is a procedure used by behavior analysis practitioners that capitalizes on respondent conditioning processes to elicit vocalizations. These procedures usually are implemented only after other, more customary methods (e.g., standard echoic training via modeling) have been exhausted. Unfortunately, SSP itself has mixed research support, probably because certain as-yet-unidentified procedural variations are more effective than others. Even when SSP produces (or increases) vocalizations, its effects can be short-lived. Although specific features of SSP differ across published accounts, fundamental characteristics include presentation of a vocal stimulus proximal with presentation of a preferred item. In the present article, we draw parallels between SSP procedures and autoshaping, review factors shown to affect autoshaping, and interpret autoshaping research for suggested SSP tests and applications. We then call for extended use and reporting of SSP in behavior-analytic treatments. Finally, three bridges created by this article are identified: basic-applied, respondent-operant, and behavior analysis with other sciences.

An Examination of Autoshaped Keypecking in a Dark Chamber

Three experiments investigated critical variables influencing the development of autoshaping in a dark chamber. The context in which magazine-training occurred, length of intertrial interval, and CS intensity were the independent variables. Performance was best following magazine-training in the light; 60-sec. intertrial interval was better than 25; and little responding developed with a bright CS. These results are discussed with reference to the cue-localization hypothesis and a context-blocking effect.

Timing Information Provided by Trial-Stimulus Onset and Offset in a Sign-Tracking Procedure

Four types of stimulus-food contingencies were compared for effectiveness in producing and maintaining trial-stimulus pecking in pigeons. The four trial-stimulus contingencies were: (a) fixed-length trials contiguous with food, (b) variable-length trials contiguous with food, (c) fixed-length trials with fixed-length trace intervals preceding food, and (d) variable-length trials with variable-length trace intervals preceding food. In all cases the inter-trial interval was variable with a 30-sec. mean and the trial stimulus was 5 sec. or 5 sec. on the average. Trial-stimulus pecking was rapidly acquired when the trial stimulus was contiguous with food, whereas the trace procedures produced pecking in only a few pigeons and then only after considerable training. Neither variability in the trial-stimulus length nor in the trace interval reliably affected acquisition or maintenance.

Trace autoshaping: Acquisition, maintenance, and path dependence at long trace intervals

The pigeon's tendency to acquire and maintain signal-directed key pecking under a trace conditioning procedure was parametrically examined. In Experiment 1, the percentage of CS trials with a key peck response was a decreasing function of the trace interval for separate groups of pigeons. The majority of subjects acquired signal-directed key pecking with trace intervals as long as 36 sec. In Experiment 2, differential maintenance of key pecking occurred across trace intervals in a within-subject procedure. Maintenance of key pecking at 36- and 60-sec trace intervals was path dependent in that responding depended on the subject's performance under the preceding trace interval.

Automaintenance without stimulus-change reinforcement: Temporal control of key pecks

Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals of roles in the yoked procedure. Although temporal control developed more slowly in follower birds, asymptotic temporal distributions of key pecking were similar for all birds in both leader and follower roles; maximum responding occurred soon after keylight onset and decreased to a minimum prior to reinforcement. Response distributions for both leader and follower birds were described by Killeen's (1975) mathematical model of temporal control. Follower birds received response-independent reinforcement, and the development by these birds of temporal distributions which are minimal immediately prior to reinforcement is without precedent in Pavlovian appetitive conditioning. However, maintenance of key pecking by the leader birds, whose responses postponed both stimulus-change and food reinforcement, supports an interpretation of autoshaped and automaintained key pecking as responding elicited by signaled grain presentation.

Sign-tracking with an interfood clock

Food was presented to pigeons, irrespective of their behavior. The fixed 60-s interfood interval was segmented into ten 6-s periods, each signaled by a distinctive stimulus color, ordered by wavelength. This "interfood clock" reliably generated and maintained successively higher rates of key pecking at stimuli successively closer to food. Under extinction, key pecking ceased. When the standard stimulus sequence was changed to a different sequence for each bird, accelerated responding again emerged and was sustained under each of the new color sequences. However, responding was neither maintained nor acquired when each successive interfood interval provided a different random sequence of the ten stimuli. Thus, the interfood clock generated and maintained sign-tracking under stimulus control, and the resulting behavior was attributable neither to stimulus generalization nor to a simple temporal gradient.

Contrast and autoshaping in multiple schedules varying reinforcer rate and duration

Thirteen master pigeons were exposed to multiple schedules in which reinforcement frequency (Experiment I) or duration (Experiment II) was varied. In Phases 1 and 3 of Experiment I, the values of the first and second components' random-interval schedules were 33 and 99 seconds, respectively. In Phase 2, these values were 99 seconds for both components. In Experiment II, a random-interval 33-second schedule was associated with each component. During Phases 1 and 3, the first and second components had hopper durations of 7.5 and 2.5 seconds respectively. During Phase 2, both components' hopper durations were 2.5 seconds. In each experiment, positive contrast obtained for about half the master subjects. The rest showed a rate increase in both components (positive induction). Each master subject's key colors and reinforcers were synchronously presented on a response-independent basis to a yoked control. Richer component key-pecking occurred during each experiment's Phases 1 and 3 among half these subjects. However, none responded during the contrast condition (unchanged component of each experiment's Phase 2). From this it is inferred that autoshaping did not contribute to the contrast and induction findings among master birds. Little evidence of local contrast (highest rate at beginning of richer component) was found in any subject. These data show that (a) contrast can occur independently from autoshaping, (b) contrast assays during equal-valued components may produce induction, (c) local contrast in multiple schedules often does not occur, and (d) differential hopper durations can produce autoshaping and contrast.

Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement

In Experiment 1, three pigeons' key pecking was maintained under a variable-interval 60-s schedule of food reinforcement. A 1-s unsignaled nonresetting delay to reinforcement was then added. Rates decreased and stabilized at values below those observed under immediate-reinforcement conditions. A brief stimulus change (key lit red for 0.5 s) was then arranged to follow immediately the peck that began the delay. Response rates quickly returned to baseline levels. Subsequently, rates near baseline levels were maintained with briefly signaled delays of 3 and 9 s. When a 27-s briefly signaled delay was instituted, response rates decreased to low levels. In Experiment 2, four pigeons' responding was first maintained under a multiple variable-interval 60-s (green key) variable-interval 60-s (red key) schedule. Response rates in both components fell to low levels when a 3-s unsignaled delay was added. In the first component delays were then briefly signaled in the same manner as Experiment 1, and in the second component they were signaled with a change in key color that remained until food was delivered. Response rates increased to near baseline levels in both components, and remained near baseline when the delays in both components were lengthened to 9 s. When delays were lengthened to 27 s, response rates fell to low levels in the briefly signaled delay component for three of four pigeons while remaining at or near baseline in the completely signaled delay component. In Experiment 3, low response rates under a 9-s unsignaled delay to reinforcement (tandem variable-interval 60 s fixed-time 9 s) increased when the delay was briefly signaled. The role of the brief stimulus as conditioned reinforcement may be a function of its temporal relation to food, and thus may be related to the eliciting function of the stimulus.

Stimulus-food pairings produce stimulus-directed touch-screen responding in cynomolgus monkeys (macaca fascicularis) with or without a positive response contingency

Acquisition and maintenance of touch-screen responding was examined in naïve cynomolgus monkeys (Macaca fascicularis) under automaintenance and classical conditioning arrangements. In the first condition of Experiment 1, we compared acquisition of screen touching to a randomly positioned stimulus (a gray square) that was either stationary or moving under automaintenance (i.e., banana pellet delivery followed an 8-s stimulus presentation or immediately upon a stimulus touch). For all subjects stimulus touching occurred within the first session and increased to at least 50% of trials by the end of four sessions (320 trials). In the subsequent condition, stimulus touching further increased under a similar procedure in which pellets were only delivered if a stimulus touch occurred (fixed ratio 1 with 8-s limited hold). In Experiment 2, 6 naive subjects were initially exposed to a classical conditioning procedure (8-s stimulus preceded pellet delivery). Despite the absence of a programmed response contingency, all subjects touched the stimulus within the first session and responded on about 50% or more of trials by the second session. Responding was also sensitive to negative, neutral, and positive response contingencies introduced in subsequent conditions. Similar to other species, monkeys engaged in stimulus-directed behavior when stimulus presentations were paired with food delivery. However, stimulus-directed behavior quickly conformed to response contingencies upon subsequent introduction. Video recordings of sessions showed topographies of stimulus-directed behavior that resembled food acquisition and consumption.

Feature-short and feature-long discrimination learning in the pigeon: conditional control of a two-event temporal map

Eight pigeons were trained to peck an illuminated target key on discrete-trial fixed-interval schedules of reinforcement by food. Four birds were exposed to a feature-short (FS) task where a feature light signaled shortening of the forthcoming target-outcome interval from 30 to 15s, while the other four birds were exposed to a feature-long (FL) task where a feature light signaled extension of the forthcoming target-outcome interval from 15 to 30s. The discrimination performance measured by differential temporal distributions of pecks between featured and non-featured target trials suggested that the target-food temporal map was under conditional control of the feature light in both groups. The FS discrimination was more difficult to learn than the FL discrimination. This FS inferiority implies that our birds did not resort on the simple temporal discrimination by timing from the trial onset. The simple temporal discrimination account was also negated by the finding that increasing the feature-target gap did not have a predicted effect on the response distribution.

Learning in cod (Gadus morhua): long trace interval retention

Basic knowledge about learning capacities and awareness in fish is lacking. In this study we investigated which temporal gaps Atlantic cod could tolerate between two associated events, using an appetitive trace-conditioning paradigm with blinking light as conditioned stimulus (CS) and dry fish food as unconditioned stimulus (US). CS-US presentations were either temporally overlapping (delay conditioning, CS duration 24 s, interstimulus interval 12 s) or separated by 20, 60, or 120 s (trace conditioning, CS duration 12 s) or 2 h (control, CS duration 12 s). The percentage of fish in the feeding area increased strongly during CS presentation in all delay, 20 s, and 60 s trace groups and in one out of two 120 s trace groups, but not in the control groups. In the 20 and 60 s trace procedures, the fish crowded together in the small feeding area during the trace interval, showing strong anticipatory behaviour. In all the conditioned groups, the fish responded to the CS within eight trials, demonstrating rapid learning. At 88 and 70 days after the end of the conditioning experiments, the delay and 20 s trace groups, respectively, were presented the CS six times at 2-h intervals without reward. All groups responded to the light signal, demonstrating memory retention after at least 3 months. This study demonstrates that Atlantic cod has an impressively good ability to associate two time-separated events and long time retention of learnt associations.

Stimulus Over-selectivity in Rats

The present study explored whether a similar phenomenon to stimulus over-selectivity occurred in rats, in the hope of establishing a non-human model for the autism. Rats were serially presented with two-15 seconds, two-element compound stimuli prior to the delivery of food, in an appetitive classical conditioning procedure. Each compound stimulus consisted of two lights. Once the rats had acquired a conditioned response (CR) to the stimuli, they were presented with each of the component elements separately in extinction. The rats demonstrated greater conditioning to components of the compound presented just prior to reinforcement than to the components of the temporally distant compound. However, there was a smaller difference between CRs to the components of the compound presented just prior to reinforcement (i.e. less overshadowing) than between the components of the temporally distant compound. It is suggested that rats demonstrated a form of stimulus over-selectivity, resulting in greater overshadowing of one cue by another. Such results may form the basis of a viable non-human model of this symptom of autistic spectrum disorder.

Key pecking of pigeons under variable-interval schedules of briefly signaled delayed reinforcement: effects of variable-interval value

Key pecking of 4 pigeons was maintained under a multiple variable-interval 20-s variable-interval 120-s schedule of food reinforcement. When rates of key pecking were stable, a 5-s unsignaled, nonresetting delay to reinforcement separated the first peck after an interval elapsed from reinforcement in both components. Rates of pecking decreased substantially in both components. When rates were stable, the situation was changed such that the peck that began the 5-s delay also changed the color of the keylight for 0.5 s (i.e., the delay was briefly signaled). Rates increased to near-immediate reinforcement levels. In subsequent conditions, delays of 10 and 20 s, still briefly signaled, were tested. Although rates of key pecking during the component with the variable-interval 120-s schedule did not change appreciably across conditions, rates during the variable-interval 20-s component decreased greatly in 1 pigeon at the 10-s delay and decreased in all pigeons at the 20-s delay. In a control condition, the variable-interval 20-s schedule with 20-s delays was changed to a variable-interval 35-s schedule with 5-s delays, thus equating nominal rates of reinforcement. Rates of pecking increased to baseline levels. Rates of pecking, then, depended on the value of the briefly signaled delay relative to the programmed interfood times, rather than on the absolute delay value. These results are discussed in terms of similar findings in the literature on conditioned reinforcement, delayed matching to sample, and classical conditioning.

Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration

Two experiments with pigeons examined the relation of the duration of a signal for delay ("delay signal") to rates of key pecking. The first employed a multiple schedule comprised of two components with equal variable-interval 60-s schedules of 27-s delayed food reinforcement. In one component, a short (0.5-s) delay signal, presented immediately following the key peck that began the delay, was increased in duration across phases; in the second component the delay signal initially was equal to the length of the programmed delay (27 s) and was decreased across phases. Response rates prior to delays were an increasing function of delay-signal duration. As the delay signal was decreased in duration, response rates were generally higher than those obtained under identical delay-signal durations as the signal was increased in duration. In Experiment 2 a single variable-interval 60-s schedule of 27-s delayed reinforcement was used. Delay-signal durations were again increased gradually across phases. As in Experiment 1, response rates increased as the delay-signal duration was increased. Following the phase during which the signal lasted the entire delay, shorter delay-signal-duration conditions were introduced abruptly, rather than gradually as in Experiment 1, to determine whether the gradual shortening of the delay signal accounted for the differences observed in response rates under identical delay-signal conditions in Experiment 1. Response rates obtained during the second exposures to the conditions with shorter signals were higher than those observed under identical conditions as the signal duration was increased, as in Experiment 1. In both experiments, rates and patterns of responding during delays varied greatly across subjects and were not systematically related to delay-signal durations. The effects of the delay signal may be related to the signal's role as a discriminative stimulus for adventitiously reinforced intradelay behavior, or the delay signal may have served as a conditioned reinforcer by virtue of the temporal relation between it and presentation of food.

The influence of partial reinforcement on serial autoshaping with pigeons

The effect of partial reinforcement on the rate of responding during the first element of a serial compound was investigated using autoshaping in pigeons. Experiment I employed the illumination of a response key by two different colours as the elements of the compound. Responding during the first element was faster when this stimulus was intermittently paired with the second element and the unconditioned stimulus than when a continuous reinforcement schedule was employed. Experiment II demonstrated that this effect of partial reinforcement is unaffected by maniuplating the associative strength of the second element at the outset of compound conditioning. A similar effect of partial reinforcement was also found in Experiment III which used a tone as the first element of the serial compound.