Signal duration and suppression of operant responding by free reinforcement

Extending in vitro conditioning in Aplysia to analyze operant and classical processes in the same preparation

Operant and classical conditioning are major processes shaping behavioral responses in all animals. Although the understanding of the mechanisms of classical conditioning has expanded significantly, the understanding of the mechanisms of operant conditioning is more limited. Recent developments in Aplysia are helping to narrow the gap in the level of understanding between operant and classical conditioning, and have raised the possibility of studying the neuronal processes underlying the interaction of operant and classical components in a relatively complex learning task. In the present study, we describe a first step toward realizing this goal, by developing a single in vitro preparation in which both operant and classical conditioning can be studied concurrently. The new paradigm reproduced previously published results, even under more conservative and homogenous selection criteria and tonic stimulation regime. Moreover, the observed learning was resistant to delay, shortening, and signaling of reinforcement.

Behavioral contrast redux

Behavioral contrast is defined as a change in response rate during a stimulus associated with a constant reinforcement schedule, in inverse relation to the rates of reinforcement in the surrounding stimulus conditions. Contrast has at least two functionally separable components: local contrast, which occurs after component transition, and molar contrast. Local contrast contributes to molar contrast under some conditions, but not generally. Molar contrast is due primarily to anticipatory contrast. However, anticipatory contrast with respect to response rate has been shown to be inversely related to stimulus preference, which challenges the widely held view that contrast effects reflect changes in stimulus value owing to the reinforcement context. More recent data demonstrate that the inverse relation between response rate and preference with respect to anticipatory contrast is due to Pavlovian contingencies embedded in anticipatory contrast procedures. When those contingencies are weakened, anticipatory contrast and stimulus preference are positively related, thus reaffirming the view that the reinforcing effectiveness of a constant schedule is inversely related to the value of the context of reinforcement in which it occurs. The underlying basis of how the context of reinforcement controls reinforcement value remains uncertain, although clear parallels exist between contrast and the effects of contingency in both Pavlovian and operant conditioning.

The critical dimensions of the response-reinforcer contingency

Two major dimensions of any contingency of reinforcement are the temporal relation between a response and its reinforcer, and the relative frequency of the reinforcer given the response versus when the response has not occurred. Previous data demonstrate that time, per se, is not sufficient to explain the effects of delay-of-reinforcement procedures; needed in addition is some account of the events occurring in the delay interval. Moreover, the effects of the same absolute time values vary greatly across situations, such that any notion of a standard delay-of-reinforcement gradient is simplistic. The effects of reinforcers occurring in the absence of a response depend critically upon the stimulus conditions paired with those reinforcers, in much the same manner as has been shown with Pavlovian contingency effects. However, it is unclear whether the underlying basis of such effects is response competition or changes in the calculus of causation.

Mechanics of the animate

Behavior is treated as basic physics. Dimensions are identified and their transformations from physical specification to axes in behavioral space are suggested. Responses are treated as action patterns arrayed along a continuum of activation energy. Behavior is seen as movement along a trajectory through this behavior space. Incentives or reinforcers are attractors in behavior space, at the centers of basins of lowered potential. Trajectories impinging on such basins may be captured; repeated capture will warp the trajectory toward a geodesic, a process called conditioning. Conditioning is enhanced by contiguity, the proximity between the measured behavior and the incentive at the end of the trajectory, and by contingency, the depth of the trajectory below the average level of the potential energy landscape. Motivation is seen as the potential of an organism for motion under the forces impinging on it. Degree of motivation is characterized by the depth of the potential field, with low motivation corresponding to a flat field and a flat gradient of activation energy. Drives are the forces of incentives propagated through behavior space. Different laws for the attenuation of drive with behavioral distance are discussed, as is the dynamics of action. The basic postulate of behavior mechanics is incentive-tracking in behavior space, the energy for which is provided by decreases in potential. The relation of temporal gradients to response differentiation and temporal discrimination is analyzed. Various two-body problems are sketched to illustrate the application of these ideas to association, choice, scalar timing, self-control, and freedom.