Momentary maximizing and optimal foraging theories of performance on concurrent VR schedules

An alternative to the stay/switch equation assessed when using a changeover-delay

An alternative to the generalized matching equation for understanding concurrent performances is the stay/switch model. For the stay/switch model, the important events are the contingencies and behaviors at each alternative. The current experiment compares the descriptions by two stay/switch equations, the original, empirically derived stay/switch equation and a more theoretically derived equation based on ratios of stay to switch responses matching ratios of stay to switch reinforcers. The present experiment compared descriptions by the original stay/switch equation when using and not using a changeover delay. It also compared descriptions by the more theoretical equation with and without a changeover delay. Finally, it compared descriptions of the concurrent performances by these two equations. Rats were trained in 15 conditions on identical concurrent random-interval schedules in each component of a multiple schedule. A COD operated in only one component. There were no consistent differences in the variance accounted for by each equation of concurrent performances whether or not a COD was used. The simpler equation found greater sensitivity to stay than to switch reinforcers. It also found a COD eliminated the influence of switch reinforcers. Because estimates of parameters were more meaningful when using the more theoretical stay/switch equation it is preferred.

Drug self-administration studies: a novel reinforcement schedule enhances choice

Relative reinforcing effects of different ethanol and different cocaine doses were studied under concurrent independent fixed-ratio (FR) schedules and concurrent nonindependent FR schedules with rhesus monkeys. Nonindependent FR schedules differed from independent FR schedules in that responses on either side counted towards the FR requirements of two concurrently presented choices. Thus, responses on the right operandum counted toward completion of both right and left FR schedules and, symmetrically, responses on the left did the same. Nonindependent schedules allow the number of responses per drug delivery to vary considerably, unlike independent schedules, thereby making the number of responses per delivery a sensitive dependent variable. In contrast, standard independent schedules do not allow responses per drug delivery to vary; the required number of responses is an independent variable. Three rhesus monkeys were subjects, and choices between different doses of ethanol or cocaine were studied. Larger doses maintained higher response rates than smaller doses - consistent with previous choice studies. By using nonindependent schedules, however, graded responses per drug delivery and increased switching between sides were obtained, providing additional data and useful measures of choice.

Structure of motivation using food demand in mice

Most animals have evolved to be foragers for food. We discriminate two types of foraging, the cost to locate or obtain access to the food, and the unit cost to consume the food once it is nearby. Using closed economy studies in normal weight and genetically obese mice, we have examined the effect of either access and/or unit cost on food demand and meal patterns. We also have included wheel running either as a voluntary activity or as an access cost. Our results showed that the demand functions differ between normal, exercising, and genetically obese mice, and that changes in intake normally occur via changes in the size of individual feeding bouts or meals. In contrast, changes in access cost have only a small effect on food demand but have large effects on the pattern of intake--on meal size and the number of meals taken. Thus, although food intake is sensitive to effort, the type of effort and the mode in which it is applied is critically important. These data are discussed in terms of potential economic strategies that could address the human obesity epidemic, for example by maximally targeting meal size and/or snacking behavior.

The stay/switch model of concurrent choice

This experiment compared descriptions of concurrent choice by the stay/switch model, which says choice is a function of the reinforcers obtained for staying at and for switching from each alternative, and the generalized matching law, which says choice is a function of the total reinforcers obtained at each alternative. For the stay/switch model two schedules operate when at each alternative. One arranges reinforcers for staying there and the other arranges reinforcers for switching from there. Rats were exposed to eight or nine conditions that differed in the arrangement of the values of the stay and switch schedules. The generalized matching law described preferences when arrangements were similar to those found when using two concurrently running interval schedules. It did not, however, describe all preferences when using different arrangements. The stay/switch model described all preferences in one analysis. In addition, comparisons of selected conditions indicated that changing the ratio of obtained reinforcers was neither necessary nor sufficient for changing preference as measured by response ratios. Taken together these results provide support for the stay/switch model as a viable alternative to the generalized matching law and that the critical independent variable is allocation of stay and switch reinforcers.

The stay/switch model describes choice among magnitudes of reinforcers

The stay/switch model is an alternative to the generalized matching law for describing choice in concurrent procedures. The purpose of the present experiment was to extend this model to choice among magnitudes of reinforcers. Rats were exposed to conditions in which the magnitude of reinforcers (number of food pellets) varied for staying at alternative 1, switching from alternative 1, staying at alternative 2 and switching from alternative 2. A changeover delay was not used. The results showed that the stay/switch model provided a good account of the data overall, and deviations from fits of the generalized matching law to response allocation data were in the direction predicted by the stay/switch model. In addition, comparisons among specific conditions suggested that varying the ratio of obtained reinforcers, as in the generalized matching law, was not necessary to change the response and time allocations. Other comparisons suggested that varying the ratio of obtained reinforcers was not sufficient to change response allocation. Taken together these results provide additional support for the stay/switch model of concurrent choice.

Matching by fixing and sampling: a local model based on internality

Undermatching and overmatching in concurrent schedules of reinforcement have been traditionally described as changes in the slope of the Generalized Matching Law function. More recently, it has been suggested that deviations from strict matching may be better described as following a policy of mostly fixing on the preferred schedule, and occasionally sampling the alternative schedule. So far, no model of local performance predicts the global outcome of this policy. We describe one such model; it assumes immediate and long-term effects of reinforcement on local performance. The model assumes long-term effects as changes in the internal state of the organism. Formally, the model is analogous to the Axiom of Repeated Choice [Lefebvre, V.A., 2004. Bipolarity, choice, and entro-field. In: Proceedings of the Eighth World Multi-Conference on Systemics, Cybernetics and Informatics, vol. IV, pp. 95-99].