Effect of varying the duration of grain presentation on automaintenance

Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors

When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the lever also display impulsivity and altered attention, as compared to rats showing behavior directed toward the reward delivery location. The current study used a light CS to categorize rats' propensity for cue-directed behavior, and assessed whether individual differences in impulsivity and related behaviors still emerged. During the light-food pairings, some rats displayed enhanced rearing or orienting to the light (Orienters) prior to showing food cup approach behavior, while other rats only showed food cup approach behavior (Nonorienters). Our results showed that Orienters made more impulsive and risky decisions in two different choice tasks, and were quicker to leave a familiar dark environment to enter a novel bright field. Orienters also showed less accurate target detection when a visual distractor was introduced during an attentional challenge. Our current study suggests that light CS-induced rearing/orienting behavior might not necessarily share an identical mechanism with lever CS-approach behavior in predicting impulsivity-related behaviors.

Contrast and undermatching as a function of reinforcer duration and quality during multiple schedules

Eight pigeons pecked keys under multiple variable-interval two-minute variable-interval two-minute schedules. In Experiment 1, the reinforcers were 2, 4, or 8 seconds access to a food magazine. In Experiments 2 and 3, the reinforcers were grains that had been determined to be most-, moderately-, or non-preferred. Both positive and negative behavioral contrast occurred when the reinforcers in one component were held constant and the duration or type of reinforcer obtained in the other component varied. Undermatching occurred when the relative rate of responding during a component was plotted as a function of the relative duration of the reinforcers in that component.

Graded differential reinforcement: Response-dependent reinforcer amount

After key pecking had been autoshaped, six pigeons were exposed to a condition in which the duration of grain availability at the end of an 8-second trial depended on the number of responses emitted during the trial (0.25-second access to grain per response). This procedure, called correlated reinforcement, alternated across conditions with the automaintenance baseline in which the 8-second trial terminated with a constant 2.5-second access to grain. Two control procedures were run; in both, the reinforcer durations were yoked to those obtained in the last correlated session. In the yoked control no responses were required, but in the single-response yoked control at least one response was required to receive the yoked duration. The correlated condition maintained response rates above those produced by the two control conditions. These results may be accounted for by differential reinforcement.

Effects of autoshaping procedures on 3H-8-OH-DPAT-labeled 5-HT1a binding and 125I-LSD-labeled 5-HT2a binding in rat brain

Effects of experience with Pavlovian autoshaping procedures on lever-press autoshaping conditioned response (CR) performance and 3H-8-OH-DPAT-labeled binding of 5-HT(1a) receptors as well as 125I-LSD-labeled binding of 5-HT(2a) receptors were evaluated in four groups of male Long-Evans hooded rats. Two groups of rats (Group Paired High CR and Group Paired Low CR) received Pavlovian autoshaping procedures wherein the presentation of a lever (conditioned stimulus, CS) was followed by the response-independent presentation of food (unconditioned stimulus, US). Rats in Group Paired High CR (n=12) showed more rapid CR acquisition and higher asymptotic levels of lever-press autoshaping CR performance relative to rats in Group Low CR (n=12). Group Omission (n=9) received autoshaping with an omission contingency, such that performing the lever-press autoshaping CR resulted in the cancellation the food US, while Group Random (n=9) received presentations of lever CS and food US randomly with respect to one another. Though Groups Omission and Random did not differ in lever-press autoshaping CR performance, Group Omission showed significantly lower levels of 3H-8-OH-DPAT-labeled 5-HT(1a) binding in post-synaptic areas (frontal cortex, septum, caudate putamen), as well as significantly higher plasma corticosterone levels than Group Random. In addition, Group Random showed higher levels of 3H-8-OH-DPAT-labeled 5-HT(1a) binding in pre-synaptic somatodendritic autoreceptors on dorsal raphe nucleus relative to each of the other three groups. Autoradiographic analysis of 125I-LSD-labeled 5-HT(2a) receptor binding revealed no significant differences between Groups Paired High CR and Paired Low CR or between Groups Omission and Random in any brain regions.

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.

Effects of food-pellet size on rate, latency, and topography of autoshaped key pecks and gapes in pigeons

Four pigeons responded under autoshaping contingencies in which different conditional stimuli (red or green keylights) were associated with unconditional stimuli of different magnitudes (large or small food pellets) over successive trials within a session. Both topography (beak opening or gape) and strength (rates and latencies of key pecks and gapes) of responding during the conditional stimuli depended on the magnitude of the correlated unconditional stimulus. Key-peck and gape rates were higher and latencies were shorter in large-pellet trials than in small-pellet trials. Gape amplitudes varied directly with pellet size, although conditional and unconditional gapes were larger than either pellet. These findings were replicated when the key colors were presented either on one or two keys and after reversals of the color-size correlations. Because the unconditional stimulus was varied through pellet size, magnitude was not confounded with food-access duration or quality. These results demonstrate the effects of the magnitude of the unconditional stimulus, in that rates and latencies of both key pecks (which are directed movements toward the key) and gapes (which are independent of the bird's position and key properties) varied with pellet size. Gape measures were unique in that two dimensions (response strength and topography) of a single response class varied simultaneously with magnitude.

Locating reward cue at response manipulandum (CAM) induces symptoms of drug abuse

Appetitive instrumental discrimination learning procedures provide for CAM (cue and manipulandum) when the reward cue (discriminative stimulus positively correlated with positive reinforcement) is located at the response manipulandum (object that when contacted or manipulated defines the performance of the instrumental response). Evidence reviewed shows that CAM induces excessive and compulsive instrumental responding relative to otherwise comparable non-CAM control procedures. In humans, symptoms of drug abuse are particularly likely when the drug-taking implement (response manipulandum at which instrumental drug-taking is directed) is also predictive of the drug's rewarding effects (reward cue). Evidence that the predictive relationship between a drug-taking implement and drug reward relates to drug abuse is reviewed, and implications for treatment and prevention are considered. CAM is related to neurobiological models of drug abuse that emphasize the role of the neurotransmitter dopamine (DA). CAM produces convergence of DA-mediated responding for conditioned reinforcement with DA mediation of psychomotor activation and incentive-motivational processes to yield reflexive cue-directed responding not observed in non-CAM controls.

Choice as a dependent measure in autoshaping: sensitivity to frequency and duration of food presentation

Previous investigations have shown that rate, latency, and percentage of trials with at least one response are somewhat insensitive measures of the strength of autoshaped responding. In the present studies, these measures were contrasted with the allocation of responding during simultaneous choice tests, a measure of response strength frequently used in operant paradigms. In two experiments, nine pigeons were exposed to a forward pairing autoshaping procedure. Training sessions consisted of the successive presentation of three stimuli, each followed by food on either 100%, 50%, or 0% of the trials. Choice testing involved the simultaneous presentation of the three stimuli. In Experiment I, all pigeons consistently directed their initial choice responses and the majority of subsequent responses to the stimulus always followed by food, despite the fact that during training sessions the response rates of most birds were highest in the presence of the stimulus followed by food on 50% of the trials. In Experiment II, rate, latency, and percentage of trials with at least one response did not change appreciably as a function of duration of feeder presentations. However, choice responding was lawfully affected by duration of feeder presentations. These data suggest that choice is perhaps a more sensitive measure of the strength of autoshaped responding than other, more commonly employed, indices.