Effect of drugs on response-duration differentiation VII: response-force requirements

Mice are Near Optimal Timers

Many conventional interval timing tasks do not contain asymmetric cost (loss) functions and thereby favor high temporal accuracy. On the other hand, asymmetric cost functions that differentially penalize/reinforce the early or late responses result in adaptive biases (shift) in timed responses due to timing uncertainty. Consequently, optimal performance in these tasks entails the normative parametrization of adaptive timing biases by the level of timing uncertainty. Differential reinforcement of response duration (DRRD) is one of these tasks that require mice to actively respond (e.g., continuously depressing a lever) for a minimum amount of time to be reinforced. The active production of a time interval by mice in DRRD differentiates this task from the differential reinforcement of low rates of responding (DRL) task as a passive waiting task that was used in earlier studies to investigate the optimality of adaptive biases in timing behavior. We tested 21 Th-Cre male mice (9 weeks old) in a DRRD task with a minimum requirement of 2 s. Mean response durations were positively biased (longer than the minimum requirement), and the extent of bias was predicted by the level of endogenous timing uncertainty. Mice nearly maximized the reward rate in this task. These results contribute to the accumulating evidence supporting optimal temporal risk assessment in non-human animals.

Rats can learn a temporal task in a single session

Fixed interval, peak interval, and temporal bisection procedures have been used to assess cognitive functions and address questions such as how animals perceive, represent, and reproduce time intervals. They have also been extensively used to test the effects of drugs on behavior, and to describe the neural correlates of interval timing. However, those procedures usually require several weeks of training for behavior to stabilize. Here, we investigated a variation of the Differential Reinforcement of Response Duration (DRRD) task with a target time of 1.2 s. We compared three types of training protocols and reported a procedure in which performance by the end of the very first session nearly matches the performance of long-term training. We also showed that the initial distribution of the responses is uni-modal and, as training evolves (and rats improve their performance), a second peak emerges and progressively shifts toward longer times. This one-day training protocol can be used to investigate temporal learning and may be especially useful to electrophysiological and neuropharmacological studies.

Differential reinforcement of an approach response in zebrafish (Danio rerio)

Five zebrafish were trained to approach a target using a fully automated training procedure. During a training session, if the distance between the fish and the target was closer than an arbitrarily set distance, the approach response was reinforced by food. The fish continued to respond under this reinforcement contingency and the distance criterion could be shortened up to eighty times within a 1h session. The initial distance limit was then shortened for the next test training session. Once the initial distance criterion was reduced to a final minimum distance, the distance criterion was fixed at this value for the next nine successive sessions. In a second experiment using different fish, we manipulated approach distances in three conditions. The first condition was identical to the changing criterion training as in Experiment 1. In the second condition, only response distances under a distance criterion were reinforced. And in the last condition, only response distances over the distance criterion were reinforced. Results show that zebrafish can control the distance between themselves and a target. In other words, zebrafish are sensitive to the spatial consequences of their behavior. The present results show that a differential reinforcement paradigm can be successfully applied to zebrafish which therefore enhances their value as a vertebrate model for studies of complex behavior including visuomotor learning.