Relative sensitivity to reinforcer amount and delay in a self-control choice situation

A comparison of the effects of brief rules, a timer, and preferred toys on self-control

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self-control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self-control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self-control. However, providing preferred toys during the delay effectively enhanced self-control.

Impulsive choice in inbred strains of mice

When humans or non-humans are given a choice between receiving a sooner-smaller (SS) reinforcer, or a later-larger (LL) reinforcer, the choice of a SS reinforcer represents impulsive choice whereas the choice of a LL reinforcer represents self-controlled choice. It has been suggested that both biological and genetic factors influence impulsive/self-control choice in this paradigm. In the present study, the inbred strains of BALB/c, C57BL/6, and DBA/2 mice were given a choice to press one of two levers in an operant chamber. Depending on their choice, mice received either a smaller reinforcer (one pellet delivered after 6s) sooner (SS) or a larger reinforcer (two pellets after 6, 9, 12, 18, or 30s) later (LL). Mice preference for the larger reinforcer decreased with longer delays. More importantly, the BALB/c mice chose the SS reinforcer more often than the C57BL/6 mice under the 9- and 12-s delays, and more often than the DBA/2 mice under the 9-s delay. This indicates that the choice pattern of the BALB/c strain is more "impulsive" than the other strains and suggests that specific gene configurations influence impulsive choice in mice.

Assessment of impulsivity and the development of self-control in students with attention deficit hyperactivity disorder

We examined a combined approach of manipulating reinforcer dimensions and delay fading to promote the development of self-control with 3 students diagnosed with attention deficit hyperactivity disorder. First, we administered a brief computer-based assessment to determine the relative influence of reinforcer rate (R), reinforcer quality (Q), reinforcer immediacy (I), and effort (E) on the students' choices between concurrently presented math problems. During each session, one of these dimensions was placed in direct competition with another dimension (e.g., RvI involving math problem alternatives associated with high-rate delayed reinforcement vs. low-rate immediate reinforcement), with all possible pairs of dimensions presented across the six assessment conditions (RvQ, RvI, RvE, QvI, QvE, IvE). The assessment revealed that the choices of all 3 students were most influenced by immediacy of reinforcement, reflecting impulsivity. We then implemented a self-control training procedure in which reinforcer immediacy competed with another influential dimension (RvI or Qvl), and the delay associated with the higher rate or quality reinforcer alternative was progressively increased. The students allocated the majority of their time to the math problem alternatives yielding more frequent (high-rate) or preferred (high-quality) reinforcement despite delays of up to 24 hr. Subsequent readministration of portions of the assessment showed that self-control transferred across untrained dimensions of reinforcement.

Three predictions of the economic concept of unit price in a choice context

Economic theory makes three predictions about consumption and response output in a choice situation: (a) When plotted on logarithmic coordinates, total consumption (i.e., summed across concurrent sources of reinforcement) should be a positively decelerating function, and total response output should be a bitonic function of unit price increases; (b) total consumption and response output should be determined by the value of the unit price ratio, independent of its cost and benefit components; and (c) when a reinforcer is available at the same unit price across all sources of reinforcement, consumption should be equal between these sources. These predictions were assessed in human cigarette smokers who earned cigarette puffs in a two-choice situation at a range of unit prices. In some sessions, smokers chose between different amounts of puffs, both available at identical unit prices. Individual subjects' data supported the first two predictions but failed to support the third. Instead, at low unit prices, the relatively larger reinforcer (and larger response requirement) was preferred, whereas at high unit prices, the smaller reinforcer (and smaller response requirement) was preferred. An expansion of unit price is proposed in which handling costs and the discounted value of reinforcers available according to ratio schedules are incorporated.

Humans' choice in a self-control choice situation: sensitivity to reinforcer amount, reinforcer delay, and overall reinforcement density

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.