Stimulus probability effects on temporal bisection performance of mice (Mus musculus)

Error modulates categorization of subsecond durations in multitasking contexts

Monitoring errors consumes limited cognitive resources and can disrupt subsequent task performance in multitasking scenarios. However, there is a dearth of empirical evidence concerning this interference with prospective estimation of time. In this study, we sought to investigate this issue through a serial multitasking experiment, employing a temporal bisection task as the primary task. We introduced two task contexts by implementing two different concurrent tasks. In one context, participants were tasked with discriminating the size difference between two visual items, while in the other context, they were required to judge the temporal order of similar visual items. The primary task remained the same for the entire experiment. Psychophysical metrics, including subjective bias (determined by the bisection point) and temporal sensitivity (measured by the Weber ratio), in addition to reaction time, remained unaltered in the primary task regardless of the perceptual context exerted by the concurrent tasks. However, commission of error in the concurrent tasks (i.e., non-specific errors) led to a right-ward shift in the bisection point, indicating underestimation of time after errors. Applying a drift-diffusion framework for temporal decision making, we observed alterations in the starting point and drift rate parameters, supporting the error-induced underestimation of time. The error-induced effects were all diminished with increasing a delay between the primary and concurrent task, indicating an adaptive response to errors at a trial level. Furthermore, the error-induced shift in the bisection point was diminished in the second half of the experiment, probably because of a decline in error significance and subsequent monitoring response. These findings indicate that non-specific errors impact the prospective estimation of time in multitasking scenarios, yet their effects can be alleviated through both local and global reallocation of cognitive resources from error processing to time processing.

Neurocomputational Models of Interval Timing: Seeing the Forest for the Trees

Extracting temporal regularities and relations from experience/observation is critical for organisms' adaptiveness (communication, foraging, predation, prediction) in their ecological niches. Therefore, it is not surprising that the internal clock that enables the perception of seconds-to-minutes-long intervals (interval timing) is evolutionarily well-preserved across many species of animals. This comparative claim is primarily supported by the fact that the timing behavior of many vertebrates exhibits common statistical signatures (e.g., on-average accuracy, scalar variability, positive skew). These ubiquitous statistical features of timing behaviors serve as empirical benchmarks for modelers in their efforts to unravel the processing dynamics of the internal clock (namely answering how internal clock "ticks"). In this chapter, we introduce prominent (neuro)computational approaches to modeling interval timing at a level that can be understood by general audience. These models include Treisman's pacemaker accumulator model, the information processing variant of scalar expectancy theory, the striatal beat frequency model, behavioral expectancy theory, the learning to time model, the time-adaptive opponent Poisson drift-diffusion model, time cell models, and neural trajectory models. Crucially, we discuss these models within an overarching conceptual framework that categorizes different models as threshold vs. clock-adaptive models and as dedicated clock/ramping vs. emergent time/population code models.

Diverse Time Encoding Strategies Within the Medial Premotor Areas of the Primate

The measurement of time in the subsecond scale is critical for many sophisticated behaviors, yet its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the neural activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing. During single interval categorization, we found that preSMA encodes a subjective category limit by reaching a peak of activity at a time that divides the set of test intervals into short and long. We also observed neural signals associated with the category selected by the subjects and the reward outcomes of the perceptual decision. On the other hand, we have studied the behavioral and neurophysiological basis of rhythmic timing. First, we have shown in different tapping tasks that macaques are able to produce predictively and accurately intervals that are cued by auditory or visual metronomes or when intervals are produced internally without sensory guidance. In addition, we found that the rhythmic timing mechanism in MPC is governed by different layers of neural clocks. Next, the instantaneous activity of single cells shows ramping activity that encodes the elapsed or remaining time for a tapping movement. In addition, we found MPC neurons that build neural sequences, forming dynamic patterns of activation that flexibly cover all the produced interval depending on the tapping tempo. This rhythmic neural clock resets on every interval providing an internal representation of pulse. Furthermore, the MPC cells show mixed selectivity, encoding not only elapsed time, but also the tempo of the tapping and the serial order element in the rhythmic sequence. Hence, MPC can map different task parameters, including the passage of time, using different cell populations. Finally, the projection of the time varying activity of MPC hundreds of cells into a low dimensional state space showed circular neural trajectories whose geometry represented the internal pulse and the tapping tempo. Overall, these findings support the notion that MPC is part of the core timing mechanism for both single interval and rhythmic timing, using neural clocks with different encoding principles, probably to flexibly encode and mix the timing representation with other task parameters.

Animals in flow - towards the scientific study of intrinsic reward in animals

The concept of flow, a state of complete absorption in an intrinsically rewarding activity, has played a pivotal role in advancing notions of human well-being beyond minimising suffering towards promoting flourishing and thriving. While flow has played a fundamental role in human positive psychology, it has not yet been explored in non-human animals, leaving an enormous void in our understanding of intrinsic motivation in animals. As ethology and related fields keep progressing in uncovering complex cognitive and affective capacities of non-human animals, we propose the time is ripe to translate the concept of flow to animals. We start by embedding flow in the topic of intrinsic motivation and describe its impact on positive human psychology and potentially positive animal welfare. We then disambiguate flow from related concepts discussed in the animal literature. Next, we derive experimental approaches in animals from the canonical characteristics of flow in humans and provide guidelines for both inducing and assessing flow by focusing on two characteristics that do not necessarily depend on self-report, namely resistance to distraction and time distortion. Not all aspects of the human flow experience are (yet) translatable, but those that are may improve quality of life in captive non-human animals.

Effects of reinforcement during the intertrial interval on temporal discrimination: Location version with rats

Different studies on temporal control of behavior have focused on making modifications to experimental tasks by introducing disruptors to know how these manipulations modify temporal control. The aim of this study was to produce changes in temporal discrimination in a temporal bisection task by using a disruptor associated with motivation, which consisted in delivering reinforcement during the intertrial interval (RITI). Four Wistar rats and a pair of duration 2s−8s were used. There were two types of sessions: baseline generalization, where the disruptor was not applied, and RITI generalization, where the disruptive manipulation was applied. The analysis of results consisted of comparing psychophysical parameters, Signal Detection Theory indices, and latencies to start trials of baseline sessions and disruption sessions. The results showed a change in the point of subjective equality, a change in the psychophysical function, an increasing trend in the latencies to start trials on RITI disruption, and no change in the Signal Detection Theory indices. The results highlight the importance of incorporating motivational explanations to theories of temporal control in non-human organisms.

Beyond the classic sensory systems: Characteristics of the sense of time of harbor seals (Phoca vitulina) assessed in a visual temporal discrimination and a bisection task

Beyond the classic sensory systems, the sense of time is most likely involved from foraging to navigation. As a prerequisite for assessing the role time is playing in different behavioral contexts, we further characterized the sense of time of a harbor seal in this study. Supra-second time intervals were presented to the seal in a temporal discrimination and a temporal bisection task. During temporal discrimination, the seal needed to discriminate between a standard time interval (STI) and a longer comparison interval. In the bisection task, the seal learnt to discriminate two STIs. Subsequently, it indicated its subjective perception of test time intervals as resembling either the short or long STI more. The seal, although unexperienced regarding timing experiments, learnt both tasks fast. Depending on task, time interval or duration ratio, it achieved a high temporal sensitivity with Weber fractions ranging from 0.11 to 0.26. In the bisection task, the prerequisites for the Scalar Expectancy Theory including a constant Weber fraction, the bisection point lying close to the geometric mean of the STIs, and no significant influence of the STI pair condition on the probability of a long response were met for STIs with a ratio of 1:2, but not with a ratio of 1:4. In conclusion, the harbor seal's sense of time allows precise and complex judgments of time intervals. Cross-species comparisons suggest that principles commonly found to govern timing performance can also be discerned in harbor seals.

The ventral hippocampus CA3 is critical in regulating timing uncertainty in temporal decision-making

Timing uncertainty is a critical component of temporal decision-making, as it determines the decision strategies that maximize reward rate. However, little is known about the biological substrates of timing uncertainty. In this study, we report that the CA3 subregion of the ventral hippocampus (vCA3), a relatively unexplored area in timing, is critical in regulating timing uncertainty that informs temporal decision making. Using a variant of the differential reinforcement of low rates of responding (DRL) task that incorporates differential levels of approach-avoidance conflict, rats were trained to wait a minimum of 6 s to earn a reward that was paired with varying durations of foot shock. Post-training chemogenetic inhibition of the vCA3 reduced timing uncertainty without affecting mean wait times, irrespective of the level of conflict experienced. Simulations based on the information-processing variant of scalar expectancy theory (SET) revealed that the vCA3 may be important in modulating decision threshold or switch closure latency variability.

Numerical averaging in mice

Rodents can be trained to associate different durations with different stimuli (e.g., light/sound). When the associated stimuli are presented together, maximal responding is observed around the average of individual durations (akin to averaging). The current study investigated whether mice can also average independently trained numerosities. Mice were initially trained to make 10 or 20 lever presses on a single (run) lever to obtain a reward and each fixed-ratio schedule was signaled either with an auditory or visual stimulus. Then, mice were trained to press another lever to obtain the reward after they responded on the run lever for the minimum number of presses [Fixed Consecutive Number (FCN)-10 or -20 trials] signaled by the corresponding discriminative stimulus. Following this training, FCN trials with the compound stimulus were introduced to test the counting behavior of mice when they encountered conflicting information regarding the number of responses required to obtain the reward. Our results showed that the numbers of responses on these compound test trials were around the average of the number of responses in FCN-10 and FCN-20 trials particularly when the auditory stimulus was associated with a fewer number of required responses. The counting strategy explained the behavior of the majority of the mice in the FCN-Compound test trials (as opposed to the timing strategy). The number of responses in FCN-Compound trials was accounted for equally well by the arithmetic, geometric, and Bayesian averages of the number of responses observed in FCN-10 and FCN-20 trials.

Non-symmetrical effects in the temporal bisection after selective food devaluation in rats

The present study investigated the effects of selective food devaluation on performance in the temporal bisection procedure with rats. Differential outcomes (sucrose vs. grain pellets) were associated with correct responding for a short and a long duration in order to analyze the effects of a selective duration-specific food devaluation on the temporal bisection function. Selective prefeeding produced differential changes in proportion of responding, the p(long) function, and PSE. A more consistent impact was observed when the food associated with the long anchor duration was devalued than when the short anchor duration food was devalued. The results are discussed in relation to the bias as well as a choose-short effect.

A simple three layer excitatory-inhibitory neuronal network for temporal decision-making

Humans and animals do not only keep track of time intervals but they can also make decisions about durations. Temporal bisection is a psychophysical task that is widely used to assess the latter ability via categorization of durations as short or long. Many existing models of performance in temporal bisection primarily account for choice proportions and tend to overlook the associated response times. We propose a time-cell neural network that implements both interval timing and temporal categorization. The proposed model can keep track of time intervals based on lurching wave activity, it can learn the reference durations along with their association with different categorization responses, and finally, it can carry out the comparison of arbitrary intermediate durations to the reference durations. We compared the model's predictions about choice behavior and response times to the empirical data previously gathered from rats. We showed that this time-cell neural network can predict the canonical behavioral signatures of temporal bisection performance. Specifically, (a) the proposed model can account for the sigmoidal relationship between the probability of the long choices and the test durations, (b) the superposition of choice functions on a relative time scale, (c) the localization of the point of subjective equality at the geometric mean of the reference durations, and (d) the differential modulation of short and long categorization response times as a function of the test durations.

Duration-specific effects of outcome devaluation in temporal control are differentially sensitive to amount of training

This study demonstrates that overtraining in temporal discrimination modifies temporal stimulus control in a bisection task and produces habitual responding, as evidenced through insensitivity to food devaluation. Rats were trained or overtrained in a 2- versus 8-sec temporal discrimination task, with each duration associated with a lever (left or right) and food (grain or sucrose). Overtraining produced a leftward shift in the bisection point. Devaluation treatment induced a differential loss of responding depending on stimulus duration (short versus long) and the level of training (training versus overtraining). The relationships between timing behavior and habitual behavior are discussed.

Oscillation patterns of local field potentials in the dorsal striatum and sensorimotor cortex during the encoding, maintenance, and decision stages for the ordinal comparison of sub- and supra-second signal durations

Ordinal comparison of successively presented signal durations requires (a) the encoding of the first signal duration (standard), (b) maintenance of temporal information specific to the standard duration in memory, and (c) timing of the second signal duration (comparison) during which a comparison is made of the first and second durations. Rats were first trained to make ordinal comparisons of signal durations within three time ranges using 0.5, 1.0, and 3.0-s standard durations. Local field potentials were then recorded from the dorsal striatum and sensorimotor cortex in order to investigate the pattern of neural oscillations during each phase of the ordinal-comparison process. Increased power in delta and theta frequency ranges was observed during both the encoding and comparison stages. Active maintenance of a selected response, "shorter" or "longer" (counter-balanced across left and right levers), was represented by an increase of theta and delta oscillations in the contralateral striatum and cortex. Taken together, these data suggest that neural oscillations in the delta-theta range play an important role in the encoding, maintenance, and comparison of signal durations.

A Perceptual Inference Mechanism for Hallucinations Linked to Striatal Dopamine

Hallucinations, a cardinal feature of psychotic disorders such as schizophrenia, are known to depend on excessive striatal dopamine. However, an underlying cognitive mechanism linking dopamine dysregulation and the experience of hallucinatory percepts remains elusive. Bayesian models explain perception as an optimal combination of prior expectations and new sensory evidence, where perceptual distortions such as illusions and hallucinations may occur if prior expectations are afforded excessive weight. Such excessive weight of prior expectations, in turn, could stem from a gain-control process controlled by neuromodulators such as dopamine. To test for such a dopamine-dependent gain-control mechanism of hallucinations, we studied unmedicated patients with schizophrenia with varying degrees of hallucination severity and healthy individuals using molecular imaging with a pharmacological manipulation of dopamine, structural imaging, and a novel task designed to measure illusory changes in the perceived duration of auditory stimuli under different levels of uncertainty. Hallucinations correlated with a perceptual bias, reflecting disproportional gain on expectations under uncertainty. This bias could be pharmacologically induced by amphetamine, strongly correlated with striatal dopamine release, and related to cortical volume of the dorsal anterior cingulate, a brain region involved in tracking environmental uncertainty. These findings outline a novel dopamine-dependent mechanism for perceptual modulation in physiological conditions and further suggest that this mechanism may confer vulnerability to hallucinations in hyper-dopaminergic states underlying psychosis.

The role of multisensory interplay in enabling temporal expectations

Temporal regularities can guide our attention to focus on a particular moment in time and to be especially vigilant just then. Previous research provided evidence for the influence of temporal expectation on perceptual processing in unisensory auditory, visual, and tactile contexts. However, in real life we are often exposed to a complex and continuous stream of multisensory events. Here we tested - in a series of experiments - whether temporal expectations can enhance perception in multisensory contexts and whether this enhancement differs from enhancements in unisensory contexts. Our discrimination paradigm contained near-threshold targets (subject-specific 75% discrimination accuracy) embedded in a sequence of distractors. The likelihood of target occurrence (early or late) was manipulated block-wise. Furthermore, we tested whether spatial and modality-specific target uncertainty (i.e. predictable vs. unpredictable target position or modality) would affect temporal expectation (TE) measured with perceptual sensitivity (d^') and response times (RT). In all our experiments, hidden temporal regularities improved performance for expected multisensory targets. Moreover, multisensory performance was unaffected by spatial and modality-specific uncertainty, whereas unisensory TE effects on d^' but not RT were modulated by spatial and modality-specific uncertainty. Additionally, the size of the temporal expectation effect, i.e. the increase in perceptual sensitivity and decrease of RT, scaled linearly with the likelihood of expected targets. Finally, temporal expectation effects were unaffected by varying target position within the stream. Together, our results strongly suggest that participants quickly adapt to novel temporal contexts, that they benefit from multisensory (relative to unisensory) stimulation and that multisensory benefits are maximal if the stimulus-driven uncertainty is highest. We propose that enhanced informational content (i.e. multisensory stimulation) enables the robust extraction of temporal regularities which in turn boost (uni-)sensory representations.

Mice optimize timed decisions about probabilistic outcomes under deadlines

Optimal performance in temporal decisions requires the integration of timing uncertainty with environmental statistics such as probability or cost functions. Reward maximization under response deadlines constitutes one of the most stringent examples of these problems. The current study investigated whether and how mice can optimize their timing behavior in a complex experimental setting under a response deadline in which reward maximization required the integration of timing uncertainty with a geometrically increasing probability/decreasing cost function. Mice optimized their performance under seconds-long response deadlines when the underlying function was reward probability but approached this level of performance when the underlying function was reward cost, only under the assumption of logarithmically scaled subjective costs. The same subjects were then tested in a timed response inhibition task characterized by response rules that conflicted with the initial task, not responding earlier than a schedule as opposed to not missing the deadline. Irrespective of original test groups, mice optimized the timing of their inhibitory control in the second experiment. These results provide strong support for the ubiquity of optimal temporal risk assessment in mice.

The effects of payoff manipulations on temporal bisection performance

There is growing evidence that alterations in reward rates modify timing behavior demonstrating the role of motivational factors in interval timing behavior. This study aimed to investigate the effects of manipulations of rewards and penalties on temporal bisection performance in humans. Participants were trained to classify experienced time intervals as short or long based on the reference durations. Two groups of participants were tested under three different bias conditions in which either the relative reward magnitude or penalty associated with correct or incorrect categorizations of short and long reference durations was manipulated. Participants adapted their choice behavior (i.e., psychometric functions shifted) based on these payoff manipulations in directions predicted by reward maximization. The signal detection theory-based analysis of the data revealed that payoff contingencies affected the response bias parameter (B″) without altering participants' sensitivity (A') to temporal distances. Finally, the response time (RT) analysis showed that short categorization RTs increased, whereas long categorization RTs decreased as a function of stimulus durations. However, overall RTs did not exhibit any modulation in response to payoff manipulations. Taken together, this study provides additional support for the effects of motivational variables on temporal decision-making.

Mice and rats fail to integrate exogenous timing noise into their time-based decisions

Endogenous timing uncertainty results in variability in time-based judgments. In many timing tasks, animals need to incorporate their level of endogenous timing uncertainty into their decisions in order to maximize the reward rate. Although animals have been shown to adopt such optimal behavioral strategies in time-based decisions, whether they can optimize their behavior under exogenous noise is an open question. In this study, we tested mice and rats in a task that required them to space their responses for a minimum duration (DRL task) in different task conditions. In one condition, the minimum wait time was fixed, whereas in other conditions minimum wait time was a Gaussian random variable. Although reward maximization entailed waiting longer with added exogenous timing variability, results indicated that both mice and rats became more impulsive and deviated from optimality with increasing levels of exogenous noise. We introduce a reward-rate-dependent sampling function to SET to account for optimal performance in noiseless and suboptimal performance in noisy environments.

Clock Speed as a Window into Dopaminergic Control of Emotion and Time Perception

Although fear-producing treatments (e.g., electric shock) and pleasure-inducing treatments (e.g., methamphetamine) have different emotional valences, they both produce physiological arousal and lead to effects on timing and time perception that have been interpreted as reflecting an increase in speed of an internal clock. In this commentary, we review the results reported by Fayolle et al. (2015):Behav. Process., 120, 135–140) and Meck (1983: J. Exp. Psychol. Anim. Behav. Process., 9, 171–201) using electric shock and by Maricq et al. (1981: J. Exp. Psychol. Anim. Behav. Process., 7, 18–30) using methamphetamine in a duration-bisection procedure across multiple duration ranges. The psychometric functions obtained from this procedure relate the proportion ‘long’ responses to signal durations spaced between a pair of ‘short’ and ‘long’ anchor durations. Horizontal shifts in these functions can be described in terms of attention or arousal processes depending upon whether they are a fixed number of seconds independent of the timed durations (additive) or proportional to the durations being timed (multiplicative). Multiplicative effects are thought to result from a change in clock speed that is regulated by dopamine activity in the medial prefrontal cortex. These dopaminergic effects are discussed within the context of the striatal beat frequency model of interval timing (Matell & Meck, 2004:Cogn. Brain Res.,21, 139–170) and clinical implications for the effects of emotional reactivity on temporal cognition (Parker et al., 2013:Front. Integr. Neurosci., 7, 75).

The amygdalo-nigrostriatal network is critical for an optimal temporal performance

The amygdalo-nigrostriatal (ANS) network plays an essential role in enhanced attention to significant events. Interval timing requires attention to temporal cues. We assessed rats having a disconnected ANS network, due to contralateral lesions of the medial central nucleus of the amygdala (CEm) and dopaminergic afferents to the lateral striatum, as compared to controls (sham and ipsilateral lesions of CEm and dopaminergic afferents to LS) in a temporal bisection task. ANS disconnection induced poorer temporal precision and increased response latencies to a short duration. The present results reveal a role of the ANS network in temporal processing.

Mice plan decision strategies based on previously learned time intervals, locations, and probabilities

Animals can shape their timed behaviors based on experienced probabilistic relations in a nearly optimal fashion. On the other hand, it is not clear if they adopt these timed decisions by making computations based on previously learnt task parameters (time intervals, locations, and probabilities) or if they gradually develop their decisions based on trial and error. To address this question, we tested mice in the timed-switching task, which required them to anticipate when (after a short or long delay) and at which of the two delay locations a reward would be presented. The probability of short trials differed between test groups in two experiments. Critically, we first trained mice on relevant task parameters by signaling the active trial with a discriminative stimulus and delivered the corresponding reward after the associated delay without any response requirement (without inducing switching behavior). During the test phase, both options were presented simultaneously to characterize the emergence and temporal characteristics of the switching behavior. Mice exhibited timed-switching behavior starting from the first few test trials, and their performance remained stable throughout testing in the majority of the conditions. Furthermore, as the probability of the short trial increased, mice waited longer before switching from the short to long location (experiment 1). These behavioral adjustments were in directions predicted by reward maximization. These results suggest that rather than gradually adjusting their time-dependent choice behavior, mice abruptly adopted temporal decision strategies by directly integrating their previous knowledge of task parameters into their timed behavior, supporting the model-based representational account of temporal risk assessment.