Saving the best for last? A cross-species analysis of choices between reinforcer sequences

The several roles of stimuli in token reinforcement

Three experiments were conducted with pigeons to identify the stimulus functions of tokens in second-order token-reinforcement schedules. All experiments employed two-component multiple schedules with a token-reinforcement schedule in one component and a schedule with equivalent response requirements and/or reinforcer density in the other. In Experiment 1, response rates were lower under a token-reinforcement schedule than under a tandem schedule with the same response requirements, suggesting a discriminative role for the tokens. In Experiment 2, response rates varied systematically with signaling functions of the tokens in a series of conditions designed to explore other aspects of the temporal-correlative relations between tokens and food. In Experiment 3, response rates were reduced but not eliminated by presenting tokens independent of responding, yoked to their temporal occurrence in a preceding token component, suggesting both a reinforcing function and eliciting/evocative functions based on stimulus-food relations. Only when tokens were removed entirely was responding eliminated. On the whole, the results suggest that tokens, as stimuli temporally correlated with food, may serve multiple stimulus functions in token-reinforcement procedures--reinforcing, discriminative, or eliciting--depending on the precise arrangement of the contingencies in which they are embedded.

Optimal and nonoptimal choice in a laboratory-based sunk cost task with humans: a cross-species replication

The current four experiments examined the sunk cost effect-nonoptimal persistence following investment-in a laboratory-based decision-making task with adult humans. Subjects made repeated decisions about whether to persist in a course of action-a fixed-ratio schedule whose response requirements varied unpredictably from one trial to the next-or to abandon it and escape in favor of a new trial with a potentially smaller fixed ratio schedule. Satisfying the ratio requirement produced a brief video clip from a preferred television program. In Experiment 1, sunk-cost errors were less likely in subjects who had previously experienced markedly differential reinforcement for escape. In Experiment 2, stimulus changes correlated with changes in mean response requirement, and these changes reduced sunk-cost errors in a small number of subjects. In Experiment 3, sunk-cost errors occurred more frequently as the ratio of the mean response requirements for persistence and escape approached 1.0. The importance of this variable was further supported by the results of Experiment 4, in which features other than this ratio did not markedly alter performance. These four experiments identified some key determinants of whether humans commit the sunk-cost error and confirmed the utility of video clips as reinforcers in experimental research with humans.

Effects of reward bundling on male rats' preference for larger-later food rewards

In both humans and nonhumans, prior research demonstrates increased preference for larger-later over smaller-sooner rewards when rewards are bundled together in a series (i.e., when an operant choice produces multiple discrete reward deliveries, as opposed to only a single delivery). These findings can be predicted using a traditional hyperbolic delay-discounting model. The present study was designed to examine the parametric effects of the size of the reward bundle on larger-later reward preference in male rats. During a reward-bundling phase, rats were exposed to bundle-sizes of either 1 (i.e., no bundling), 3, or 9 rewards. Rats in the Bundle-size 9 group showed significantly greater larger-later reward preference across a range of delays (0-17.5 s) than rats in any other group, but no other significant differences in choice were observed between groups. In addition, when choice for unbundled rewards was assessed following the reward-bundling phase, rats in the Bundle-size 9 group showed a significant increase in larger-later reward preference (compared to a pre-test). Obtained data from the reward-bundling phase are compared to model-predicted data, and potential mechanisms of the observed increase in self-control for unbundled rewards are discussed.