Effects of food-pellet size on rate, latency, and topography of autoshaped key pecks and gapes in pigeons

Reinforcer quality matters: A test of the Mathematical Principles of Reinforcement with domestic hens (Gallus gallus domesticus)

This study evaluated the ability of Killeen's (1994) Mathematical Principles of Reinforcement to account for the effects of changes in reinforcer quality on hens' rates of responding on fixed-ratio schedules. Hens were trained to peck a key on a fixed-ratio schedule of reinforcement and then experienced an ascending series of ratio values in two separate conditions. In different conditions, the food reinforcer was either wheat or puffed wheat. Response rates initially increased with increases in ratio requirement before eventually decreasing at larger ratios. Quantitative fits of the model accounted for the data well. The fits revealed that different foods were systematically associated with changes in the specific activation parameter, a, and these were consistent with previous reports of preference for those food items.

Species-specific response-topography of chickens' and pigeons' water-induced autoshaped responding

Four pigeons and eight chickens received autoshaping training where a keylight (conditioned stimulus) signaled response-independent deliveries of water (unconditioned stimulus). Pigeons drink while keeping their beaks submerged in water and moving their beaks to create suction ("mumbling"), whereas chickens drink by trapping a small amount of water in their mouths and then lifting their heads so the water trickles down. This experiment tested whether these and other species-specific differences in drinking and related behaviors of pigeons and chickens would be reflected in the form of conditioned (autoshaped) responding. Touchscreens and videotapes were used for data recording. Results showed that chickens moved their heads more than pigeons when drinking (unconditioned response). The birds also differed in conditioned responding in the presence of the keylight: Pigeons produced more keyswitch closures and mumbled at the keylight more than chickens whereas chickens scratched more than pigeons. In conclusion, with this unique comparative method that employed identical contingencies and comparable deprivation levels, species-specific differences in unconditioned responses and, more importantly, differences in their corresponding conditioned responses were observed.

Herrnstein??s hyperbolic matching equation and behavioral pharmacology: review and critique

Behavioral pharmacologists have enlisted Herrnstein's (1970) hyperbolic matching equation to understand the behavioral effects of drugs. Herrnstein's hyperbola describes the relation between absolute response rate and reinforcement rate. The equation has two fitted parameters. The parameter k represents the asymptotic response rate, and the parameter r(e) represents the reinforcement rate necessary to obtain half the asymptotic response rate. According to one interpretation of the equation, changes in k should reflect changes in response or motoric variables, and changes in r(e) should reflect changes in reinforcer or motivational variables, or changes in reinforcement from sources extraneous to the instrumental response. We review research that has applied Herrnstein's equation to distinguish the motoric from the motivational effects of drugs, and to identify additional independent variables responsible for drug effects, such as extraneous reinforcement. The validity of inferences about drug effects depends on the consistency of how k and r(e) respond to environmental manipulations: k should change only with response or motoric variables, and r(e) should change with reinforcer or motivational variables and with the rate of extraneous reinforcement. Empirical tests of these predictions, however, have produced inconsistent results. The review suggests that Herrnstein's theory has not fulfilled its promise of identifying the behavioral mechanisms of drug action. Modifications to the equation, known as bias and sensitivity, may explain some of these inconsistent results, and the modified equation may have utility in behavioral pharmacology.

Ontogeny has a phylogeny: background to adjunctive behaviors in pigeons and budgerigars

Animals coping with operant conditioning tasks often show behaviors that are not recorded by keys, levers and similar response transducers. Nevertheless, these adjunctive behaviors should not be disposed of by classifying them as incidental. Often they are found to be at least partially influenced by the experimentally programmed contingencies, and under certain conditions they can in turn influence conditioned behaviors. Here we describe the occurrence and characteristics of two such behaviors, stimulus grasping in operantly key-pecking pigeons and intra-delay stereotypies in a delayed matching-to-sample task with budgerigars. It is argued that for a proper account of these behaviors it is necessary to refer to a behavioral systems approach that appeals to longer ranging ontogenetic and phylogenetic histories than is usually considered in the psychological literature. The gaping towards on-key stimuli by pigeons is attributed to the hypothesis that operantly conditioned key-pecks probably relate to a grasp-pecking response that is normally executed towards non-edible items covering food. The intra-delay behaviors shown by the budgerigars are assumed to have originated from stress-induced displacement responses that adventitiously came under the influence of differential reinforcement contingencies. Finally, we discuss what kinds of evidence are needed to put these hypothetical explanations on a more certain footing.

Complex dynamic processes in sign tracking with an omission contingency (negative automaintenance)

Hungry pigeons received food periodically, signaled by the onset of a keylight. Key pecks aborted the feeding. Subjects responded for thousands of trials, despite the contingent nonreinforcement, with varying probability as the intertrial interval was varied. Hazard functions showed the dominant tendency to be perseveration in responding and not responding. Once perseveration was accounted for, a linear operator model of associative conditioning further improved predictions. Response rates during trials were correlated with the prior probabilities of a response. Rescaled range analyses showed that the behavioral trajectories were a kind of fractional Brownian motion.

Molecular analyses of the principal components of response strength

Killeen and Hall (2001) showed that a common factor called strength underlies the key dependent variables of response probability, latency, and rate, and that overall response rate is a good predictor of strength. In a search for the mechanisms that underlie those correlations, this article shows that (a) the probability of responding on a trial is a two-state Markov process; (b) latency and rate of responding can be described in terms of the probability and period of stochastic machines called clocked Bernoulli modules, and (c) one such machine, the refractory Poisson process, provides a functional relation between the probability of observing a response during any epoch and the rate of responding. This relation is one of proportionality at low rates and curvilinearity at higher rates.

Acquisition and extinction in autoshaping

C. R. Gallistel and J. Gibbon (2000) presented quantitative data on the speed with which animals acquire behavioral responses during autoshaping, together with a statistical model of learning intended to account for them. Although this model captures the form of the dependencies among critical variables, its detailed predictions are substantially at variance with the data. In the present article, further key data on the speed of acquisition are used to motivate an alternative model of learning, in which animals can be interpreted as paying different amounts of attention to stimuli according to estimates of their differential reliabilities as predictors.

Conditioning the pecking motions of pigeons

The spatio-temporal courses of head and neck motions of pigeons while pecking at small grains are described. Single and serial pecks are distinguished but the inter- and intraindividual variability of the peck kinetics is stressed. Pigeons were then trained with instrumental conditioning procedures to speed-up their pecking. A partial reinforcement schedule where pigeons had to peck repeatedly before receiving reward led to a mild shortening of inter-peck intervals at lower reinforcement rates but surprisingly, a lengthening at higher rates. A schedule where short inter-peck intervals were differentially rewarded yielded a pronounced abbreviation of the inter-peck intervals, but this was achieved by a reduction of the movement path rather than an increase in motion velocity. A schedule whereby increased approach velocities were differentially rewarded yielded marked movement accelerations. When pigeons were rewarded for diminished approach speeds they also showed significant movement decelerations. Finally, it is shown that pigeons could learn to reliably abort their peck approach movement when a visual stimulus signalling a penalty was occasionally presented during the approach movement. The proportion of successful peck interruptions decreased as these interruption signals occurred later during the approach phase. It is concluded that the pecking of pigeons is neither an innately fixed nor a visually ballistic movement. It is instead a multiply controlled and flexibly adaptable response pattern.

Effects of primary reinforcement on pigeons' initial-link responding under a concurrent chains schedule with nondifferntial terminal links

The effect of primary reinforcement on initial-link responding under concurrent-chains schedules with nondifferential terminal links was assessed in 12 pigeons. The iniitial and terminal links were variable-interval schedules (always the same for both alternatives). The positions (left or right key) of the initial-link stimuli (red or green) were randomized while the correlation between color and food amount remained constant within each condition. The terminal-link stimuli were always presented on the center key. Except in two control groups and conditions, the terminal-link stimuli were the same color (nondifferential, blue or yellow). Over six conditions, the differences in food amont and the durations of the initial- and terminal-link schedules were manipulated. In 57 of 60 cases, birds generated choice proportions above .50 in favor of the initial-link stimlus that was correlated with the larger reinforcer. There was some indication that preference increased with shortened terminal-link durations. Because the terminal-link stimuli were nondifferential, differential responding in the initial links cannot be explained easily by conditioned reinforcement represented by the terminal-link stimuli. Thus, primiary reinforcement has a direct effect on initial-link responding in concurrent-chains schedules.

The principal components of response strength

As Skinner (1938) described it, response strength is the "state of the reflex with respect to all its static properties" (p. 15), which include response rate, latency, probability, and persistence. The relations of those measures to one another was analyzed by probabilistically reinforcing, satiating, and extinguishing pigeons' key pecking in a trials paradigm. Reinforcement was scheduled according to variable-interval, variable-ratio, and fixed-interval contingencies. Principal components analysis permitted description in terms of a single latent variable, strength, and this was validated with confirmatory factor analyses. Overall response rate was an excellent predictor of this state variable.

Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding

The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Information that is consistent with habituation, but that is difficult to reconcile with satiation, is not adequately addressed. Second, the limited evidence offered in support of satiation is ambiguous because the results are just as compatible with habituation as with other satiety variables. Finally, the term satiation is used in an intuitive way that is sometimes contradicted by research about the termination of ingestion. Use of the technical term satiation in a way that differs from its conventional usage will only isolate operant psychology from other areas of psychological research.

Falsification of matching theory's account of single-alternative responding: Herrnstein's k varies with sucrose concentration

Eight rats pressed levers for varying concentrations of sucrose in water under eight variable-interval schedules that specified a wide range of reinforcement rate. Herrnstein's (1970) hyperbolic equation described the relation between reinforcement and responding well. Although the y asymptote, k, of the hyperbola appeared roughly constant over conditions that approximated conditions used by Heyman and Monaghan (1994), k varied when lower concentration solutions were included. Advances in matching theory that reflect asymmetries between response alternatives and insensitive responding were incorporated into Herrnstein's equation. After fitting the modified equation to the data, Herrnstein's k also increased. The results suggest that variation in k can be detected under a sufficiently wide range of reinforcer magnitudes, and they also suggest that matching theory's account of response strength is false. The results support qualitative predictions made by linear system theory.

Models of ratio schedule performance

Predictions of P. R. Killeen's (1994) mathematical principles of reinforcement were tested for responding on ratio reinforcement schedules. The type of response key, the number of sessions per condition, and first vs. second half of a session had negligible effects on responding. Longer reinforcer durations and larger grain types engendered more responding, affecting primarily the parameter alpha (specific activation). Key pecking was faster than treadle pressing, affecting primarily the parameter delta (response time). Longer intertrial intervals led to higher overall response rates and shorter postreinforcement pauses and higher running rates, and ruled out some competing explanations. The treadle data required a distinction between the energetic requirements and rate-limiting properties of extended responses. The theory was extended to predict pause durations and run rates on ratio schedules.

Models of ratio schedule performance

Predictions of P. R. Killeen's (1994) mathematical principles of reinforcement were tested for responding on ratio reinforcement schedules. The type of response key, the number of sessions per condition, and first vs. second half of a session had negligible effects on responding. Longer reinforcer durations and larger grain types engendered more responding, affecting primarily the parameter alpha (specific activation). Key pecking was faster than treadle pressing, affecting primarily the parameter delta (response time). Longer intertrial intervals led to higher overall response rates and shorter postreinforcement pauses and higher running rates, and ruled out some competing explanations. The treadle data required a distinction between the energetic requirements and rate-limiting properties of extended responses. The theory was extended to predict pause durations and run rates on ratio schedules.

Key-peck probability and topography in a concurrent variable-interval variable-interval schedule with food and water reinforcers

The relation between variables that modulate the probability and the topography of key pecks was examined using a concurrent variable-interval variable-interval schedule with food and water reinforcers. Measures of response probability (response rates, time allocation) and topography (peck duration, gape amplitude) were obtained in 5 water- and food-deprived pigeons. Key color signaled reinforcer type. During baseline, response rates and time allocations were greater to the food key than to the water key, and food-key pecks had larger gapes and shorter durations. Relative probability measures (for the food key) were increased by prewatering and decreased by prefeeding. Deprivation effects upon topography measures were apparent only when food- and water-key pecks were analyzed separately. Food-key gape amplitudes increased with prewatering and decreased with prefeeding. The clearest effect occurred with prewatering. There were no consistent effects upon water-key gapes. The key color-reinforcer relation was reversed for 3 pigeons to determine how response topography was modulated during the transition from food- to water-key pecks. Reacquisition was faster for the probability than for the topography measures. Analysis of gape-amplitude distributions during reversal indicated that response-form modulation proceeded through the generation of intermediate gape sizes.