Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state

Behavioral resistance to haloperidol and clozapine

Using a procedure to assess behavioral resistance to change, the effects of two drugs (haloperidol and clozapine) were compared to each other and to the effect of response-independent food delivered between multiple-schedule components. Using rats as subjects, responding in one component was maintained on a variable-interval 30-s schedule, whereas responding in another component was maintained on a variable-interval 30-s schedule that operated concurrently with a variable-time 30-s schedule. Consistent with previous findings, responding in the component with the greater overall amount of reinforcement displayed the greater resistance to response-independent food delivery. Similarly, increasing the dose of haloperidol or clozapine increased the overall extent of disruption (relative to baseline levels), with the greatest disruption occurring to responding in the component associated with the smaller overall amount of food reinforcement. Thus, as with the disruption caused by alterations in reinforcement conditions, the extent of disruption to reinforced responding caused by haloperidol and clozapine is specifically dependent upon baseline reinforcement conditions rather than baseline response rates.

Differential reinforcement and resistance to change of divided-attention performance

Behavioral momentum theory provides a framework for understanding how conditions of reinforcement influence instrumental response strength under conditions of disruption (i.e., resistance to change). The present experiment examined resistance to change of divided-attention performance when different overall probabilities of reinforcement were arranged across two components of a multiple schedule. Pigeons responded in a delayed-matching-to-sample procedure with compound samples (color + line orientation) and element comparisons (two colors or two line orientations). Reinforcement ratios of 1:9, 1:1, and 9:1 for accurate matches on the two types of comparison trials were examined across conditions using reinforcement probabilities (color/lines) of .9/.1, .5/.5, and .1/.9 in the rich component and .18/.02, .1/.1, and .02/.18 in the lean component. Relative accuracy with color and line comparisons was an orderly function of relative reinforcement, but this relation did not depend on the overall rate of reinforcement between components. The resistance to change of divided-attention performance was greater for both trial types in the rich component with presession feeding and extinction, but not with decreases in sample duration. These findings suggest promise for the applicability of quantitative models of operant behavior to divided-attention performance, but they highlight the need to further explore conditions impacting the resistance to change of attending.

Resistance to change of alcohol self-administration: effects of alcohol-delivery rate on disruption by extinction and naltrexone

A common finding in resistance to change research with food-maintained operant behavior is that the persistence of behavior depends on the rate of reinforcement delivered in the context in which the behavior occurs. The present experiment evaluated the effects of rate of response-dependent alcohol delivery on the resistance to change of rats' alcohol self-administration in the face of disruption produced by extinction and a range of doses of naltrexone (1.0, 3.0, 10.0 mg/kg, subcutaneous). Rats responded for a 10% alcohol solution in a multiple schedule of reinforcement arranging a higher rate of alcohol delivery (variable interval 15 s) in the presence of one stimulus and a lower rate of alcohol delivery (variable interval 45 s) in the presence of another stimulus. Baseline response rates and resistance to extinction were higher in the presence of the stimulus associated with higher rates of alcohol delivery. This finding is consistent with studies of the resistance to change of food-maintained behavior. The rate of alcohol delivered in the components, however, did not systematically affect resistance to disruption by naltrexone. One interpretation of this finding from the perspective of behavioral momentum theory is that naltrexone may decrease the impact of alcohol-associated stimuli on the persistence of drinking by reducing sensitivity to the relative reinforcement conditions arranged in the presence of different stimuli.

Resistance to change in goldfish

Resistance to change has been studied in several species such as humans, rats, and pigeons. We conducted two experiments using goldfish as subjects to examine the generality of the findings on resistance to change in a phylogenetically more primitive species. In Experiment 1, five goldfish (Carassius auratus) were trained on two-component multiple schedules with different variable-interval schedules in effect. When responding was disrupted by presenting free food during intercomponent intervals or by extinction, resistance to change was greater in the component with the higher reinforcement rates. In Experiment 2, identical variable-interval schedules were presented in two multiple-schedule components, but in one of the components response-independent food was delivered concurrently according to variable-time schedules. Baseline response rates were the same for both components, which is inconsistent with previous findings with other species that the addition of response-independent food decreases response rates. However, response rates in the component with added response-independent food showed the greater resistance to change, which is similar to findings in other species. The convergence of these results across various species confirms the generality of the findings on resistance to change.

Unsignaled delay of reinforcement, relative time, and resistance to change

Two experiments with pigeons examined the effects of unsignaled, nonresetting delays of reinforcement on responding maintained by different reinforcement rates. In Experiment 1, 3-s unsignaled delays were introduced into each component of a multiple variable-interval (VI) 15-s VI 90-s VI 540-s schedule. When considered as a proportion of the preceding immediate reinforcement baseline, responding was decreased similarly for the three multiple-schedule components in both the first six and last six sessions of exposure to the delay. In addition, the relation between response rates and reinforcement rates was altered such that both parameters of the single-response version of the matching law (i.e., k and Re) were decreased. Experiment 2 examined the effects of unsignaled delays ranging from 0.5 s to 8.0 s on responding maintained by a multiple VI 20-s VI 120-s schedule of reinforcement. Response rates in both components increased with brief unsignaled delays and decreased with longer delays. As in Experiment 1, response rates as a proportion of baseline were affected similarly for the two components in both the first six and last six sessions of exposure to the delay. Unlike delays imposed between two stimulus events, the effects of delays between responses and reinforcers do not appear to be attenuated when the average time between reinforcers is longer. In addition, the disruptions produced by unsignaled delays appear to be inconsistent with the general finding that responding maintained by higher rates of reinforcement is less resistant to change.

Measuring behavioral momentum

The metaphor of behavioral momentum proposes that when ongoing operant behavior is disrupted, changes in response rate are directly related to a force-like aspect of the disruptor and inversely proportional to behavioral mass. Several data sets suggest that differential resistance to change between the components of a multiple schedule satisfies the requirements of a ratio scale and is additive when different disruptors and different dimensions of reinforcement are combined. Differential resistance also provides a basis for scaling force in relation to rate of food presentation between components as a disruptor, and for scaling mass in relation to food rate within a component as a reinforcer. Preference in concurrent chains with terminal links identical to multiple-schedule components also meets the requirements of ratio-scale measurement, is additive when different dimensions of reinforcement are combined, and provides convergent measurement of behavioral mass.

Superstitious responding and reinforcement rate under concurrent variable-interval extinction schedules

To examine superstitious responding, four pigeons key pecked under multiple concurrent variable-interval 45 s variable-interval 90 s concurrent variable-interval 90 s variable-interval 180 s schedules in the absence of a changeover delay. The two variable-interval 90 s schedules then were replaced by extinction, and key-peck responding during extinction was examined as a function of the prevailing reinforcement rate. During the first several sessions, extinction-key responding was maintained closer to baseline levels in the presence of the higher reinforcement rate, and this effect dissipated or even reversed with continued exposure to extinction. Although extinction-key responding generally decreased to near-zero levels after several sessions, in a few instances, it continued for 30 and 45 sessions. These results demonstrate how concurrent variable-interval extinction schedules can be used to investigate what often has been labeled superstitious responding.