Noradrenaline and conditioned reinforcement

Effects of d-amphetamine on responding under second-order schedules of reinforcement with paired and nonpaired brief stimuli

Three pigeons were studied under a multiple schedule in which pecks in each component were reinforced according to a variable-interval 120-s second-order schedule with fixed-interval 60-s units. In the first component of the multiple schedule, the completion of a fixed interval produced either food or a 4-s change in key color plus houselight illumination. In the second component an identical schedule was in effect, but the stimulus was a 0.3-s change in key color. Both long and short brief stimuli were not paired with food presentations in Conditions 1 and 3 and were paired with food in Condition 2. There were no consistent differences in response patterns under paired and nonpaired brief-stimulus conditions when the stimulus was a 4-s change in key color accompanied by houselight illumination. However, pairing the 0.3-s key-color change with food presentations resulted in higher indices of curvature and lower response rates in the early segments of the fixed interval than when the stimulus was not paired with food presentations. Low doses of d-amphetamine (0.3 and 1 mg/kg) produced small and inconsistent increases in overall response rates, and higher doses (3 and 10 mg/kg) decreased overall response rates. d-Amphetamine altered response patterns within fixed intervals by decreasing the indices of curvature and increasing response rates in the early segments of the fixed interval. Response rates and patterns under paired and nonpaired brief-stimulus conditions were not differentially affected by d-amphetamine. Thus, evidence for the enhancement of the conditioned reinforcement effects of psychomotor stimulant drugs was not found with the second-order schedules used in the present study.

Food-paired stimuli as conditioned reinforcers: effects of d-amphetamine

Seven pigeons were studied in two experiments in which key pecks were reinforced under a second-order schedule wherein satisfaction of variable-interval schedule requirements produced food or a brief stimulus. In the second part of each session, responses produced only the brief stimulus according to a variable-interval schedule (food extinction). For the 4 pigeons in Experiment 1, the response key was red throughout the session. In separate phases, the brief stimulus was either paired with food, not paired with food, or not presented during extinction. d-Amphetamine (0.3 to 10.0 mg/kg) dose-dependently reduced food-maintained responding during the first part of the session and, at intermediate dosages, increased responding during the extinction portion of the session. The magnitude of these increases, however, did not consistently depend on whether the brief stimulus was paired, not paired, or not presented. It was also true that under nondrug conditions, response rates during extinction did not differ reliably depending on pairing operations for the brief stimulus. In Experiment 2, 3 different pigeons responded under a procedure wherein the key was red in the component with food presentations and blue in the extinction component (i.e., multiple schedule). Again, d-amphetamine produced dose-related decreases in responding during the first part of a session and increases in responding in the second part of the session. These increases, however, were related to the pairing operations; larger increases were observed when the brief stimulus was paired with food than when it was not or when it was not presented at all. Under nondrug conditions, the paired brief stimulus controlled higher response rates during extinction than did a nonpaired stimulus or no stimulus. These findings suggest that d-amphetamine can enhance the efficacy of conditioned reinforcers, and that this effect may be more robust if conditioned reinforcers occur in the context of a signaled period of extinction.

The neurochemistry and pharmacology of extinction behavior

The role of various neurotransmitter systems in the brain in extinction behavior is examined. An attempt is made to suggest psychological mechanisms (such as attention, secondary reinforcement or internal inhibition) by which the neurotransmitter systems or drugs act to produce the observed alteration in extinction behavior. The putative neurotransmitters acetylcholine, noradrenaline, dopamine, serotonin, endorphins and the peptides are reviewed, as are pharmacological agents such as the benzodiazepines, the barbiturates, the psychodelics, the neuroleptics, the psychomotor stimulants and cannabinoids. Other treatments and factors are considered such as peripheral hormones and the adrenal-pituitary axis. It is suggested that the noradrenergic system may be involved in the expression of extinction behavior by a role in selective attention, the dopamine system via an involvement with secondary reinforcement, the cholinergic system by a mechanism of response inhibition and the barbiturates and benzodiazepines by a block of nonreward.

Theories of the dorsal bundle extinction effect

Selective destruction of the noradrenaline systems in the rat brain using the neurotoxin 6-hydroxydopamine has been found to cause resistance to extinction in a number of behavioural situations. Several theories concerning the behavioural mechanism altered by the lesion, and hence about the role of noradrenaline in normal brain functioning, are proposed and evaluated. Theories suggesting a role for noradrenaline in activity, perseveration, internal inhibition, frustrative non-reward, motivation, or secondary reinforcement, fail to explain all the available evidence and direct tests of each theory fails to support its predictions. A model which suggests that noreadrenaline is involved in attentional behaviour, specifically in filtering out or learning to ignore irrelevant environmental stimuli, is successful in explaining all available data and direct tests of the lesioned rats' attentional capacity serve to confirm many of the predictions of an attentional theory of the dorsal bundle extinction effect.