Acquisition of "Start" and "Stop" response thresholds in peak-interval timing is differentially sensitive to protein synthesis inhibition in the dorsal and ventral striatum

Influences of temporal and probabilistic expectation on subjective time of emotional stimulus

Subjective time perception can change based on a stimulus's valence and expectancy. Yet, it is unclear how these two factors might interact to shape our sense of how long something lasts. Here, we conducted two experiments examining the effects of temporal and probabilistic expectancy on the perceived duration of images with varying emotional valence. In Experiment 1, we varied the temporal predictive cue with varying stimulus-onset asynchronies (SOAs), while in Experiment 2, we manipulated the cue-emotion probabilistic associations. Our results revealed that stimuli appearing earlier than anticipated were perceived as shorter, whereas less infrequent stimuli seemed to last longer. In addition, negative images were perceived longer than neural ones. However, no significant interaction between expectancy and stimulus valence was observed. We interpret these using the internal clock model, suggesting that while emotional stimuli primarily affect the pacemaker's rhythm through arousal, expectation steers attention, influencing how we register time's passage.

Temporal prediction error triggers amygdala-dependent memory updating in appetitive operant conditioning in rats

Reinforcement learning theories postulate that prediction error, i.e., a discrepancy between the actual and expected outcomes, drives reconsolidation and new learning, inducing an updating of the initial memory. Pavlovian studies have shown that prediction error detection is a fundamental mechanism in triggering amygdala-dependent memory updating, where the temporal relationship between stimuli plays a critical role. However, in contrast to the well-established findings in aversive situations (e.g., fear conditioning), only few studies exist on prediction error in appetitive operant conditioning, and even less with regard to the role of temporal parameters. To explore if temporal prediction error in an appetitive operant paradigm could generate an updating and consequent reconsolidation and/or new learning of temporal association, we ran four experiments in adult male rats. Experiment 1 verified whether an unexpected delay in the time of reward's availability (i.e., a negative temporal prediction error) in a single session produces an updating in long-term memory of temporal expectancy in an appetitive operant conditioning. Experiment 2 showed that negative prediction errors, either due to the temporal change or through reward omission, increased in the basolateral amygdala nucleus (BLA) the activation of a protein that is critical for memory formation. Experiment 3 revealed that the presence of a protein synthesis inhibitor (anisomycin) in the BLA during the session when the reward was delayed (Error session) affected the temporal updating. Finally, Experiment 4 showed that anisomycin, when infused immediately after the Error session, interfered with the long-term memory of the temporal updating. Together, our study demonstrated an involvement of BLA after a change in temporal and reward contingencies, and in the resulting updating in long-term memory in appetitive operant conditioning.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Intra-dorsal striatal acetylcholine M1 but not dopaminergic D1 or glutamatergic NMDA receptor antagonists inhibit consolidation of duration memory in interval timing

The striatal beat frequency model assumes that striatal medium spiny neurons encode duration via synaptic plasticity. Muscarinic 1 (M1) cholinergic receptors as well as dopamine and glutamate receptors are important for neural plasticity in the dorsal striatum. Therefore, we investigated the effect of inhibiting these receptors on the formation of duration memory. After sufficient training in a peak interval (PI)-20-s procedure, rats were administered a single or mixed infusion of a selective antagonist for the dopamine D1 receptor (SCH23390, 0.5 µg per side), N-methyl-D-aspartic acid (NMDA)-type glutamate receptor (D-AP5, 3 µg), or M1 receptor (pirenzepine, 10 µg) bilaterally in the dorsal striatum, immediately before initiating a PI-40 s session (shift session). The next day, the rats were tested for new duration memory (40 s) in a session in which no lever presses were reinforced (test session). In the shift session, the performance was comparable irrespective of the drug injected. However, in the test session, the mean peak time (an index of duration memory) of the M1 + NMDA co-blockade group, but not of the D1 + NMDA co-blockade group, was lower than that of the control group (Experiments 1 and 2). In Experiment 3, the effect of the co-blockade of M1 and NMDA receptors was replicated. Moreover, sole blockade of M1 receptors induced the same effect as M1 and NMDA blockade. These results suggest that in the dorsal striatum, the M1 receptor, but not the D1 or NMDA receptors, is involved in the consolidation of duration memory.

The dorsal hippocampus is required for the formation of long-term duration memories in rats

Interval timing—the perception of durations mainly in seconds or minutes—is a ubiquitous behavior in organisms. Animal studies have suggested that the hippocampus plays an essential role in duration memory; however, the memory processes involved are unclear. To clarify the role of the dorsal hippocampus in the acquisition of long‐term duration memories, we adapted the “time‐shift paradigm” to a peak‐interval procedure. After a sufficient number of training with an initial target duration (20 s), the rats underwent “shift sessions” with a new target duration (40 s) under a muscimol (0.5 µg per side) infusion into the bilateral dorsal hippocampus. The memory of the new target duration was then tested in drug‐free “probe sessions,” including trials in which no lever presses were reinforced. In the probe sessions, the mean response rate distribution of the muscimol group was located leftward to the control group, but these two response rate distributions were superimposed on the standardized time axis, suggesting a scalar property. In the session‐by‐session analysis, the mean peak time (an index of timing accuracy) of the muscimol group was lower than that of the control group in the probe sessions, but not in the shift sessions. These findings suggest that the dorsal hippocampus is required for the formation of long‐term duration memories within the range of interval timing.

Timing behavior in genetic murine models of neurological and psychiatric diseases

How timing behavior is altered in different neurodevelopmental and neurodegenerative disorders is a contemporary research question. Genetic murine models (GMM) that offer high construct validity also serve as useful tools to investigate this question. But the literature on timing behavior of different GMMs largely remains to be consolidated. The current paper addresses this gap by reviewing studies that have been conducted with GMMs of neurodevelopmental (e.g. ADHD, schizophrenia, autism spectrum disorder), neurodegenerative disorders (e.g., Alzheimer's disease, Huntington's disease) as well as circadian and other mutant lines. The review focuses on those studies that specifically utilized the peak interval procedure to improve the comparability of findings both within and between different disease models. The reviewed studies revealed timing deficits that are characteristic of different disorders. Specifically, Huntington's disease models had weaker temporal control over the termination of their anticipatory responses, Alzheimer's disease models had earlier timed responses, schizophrenia models had weaker temporal control, circadian mutants had shifted timed responses consistent with shifts in the circadian periods. The differences in timing behavior were less consistent for other conditions such as attention deficit and hyperactivity disorder and mutations related to intellectual disability. We discuss the implications of these findings for the neural basis of an internal stopwatch. Finally, we make methodological recommendations for future research for improving the comparability of the timing behavior across different murine models.

Temporal Learning Among Prefrontal and Striatal Ensembles

Behavioral flexibility requires the prefrontal cortex and striatum, but it is unclear if these structures play similar or distinct roles in adapting to novel circumstances. Here, we investigate neuronal ensembles in the medial frontal cortex (MFC) and the dorsomedial striatum (DMS) during one form of behavioral flexibility: learning a new temporal interval. We studied corticostriatal neuronal activity as rodents trained to respond after a 12-s fixed interval (FI12) learned to respond at a shorter 3-s fixed interval (FI3). On FI12 trials, we found that a key form of temporal processing—time-related ramping activity—decreased in the MFC but did not change in the DMS as animals learned to respond at a shorter interval. However, while MFC and DMS ramping was stable with successive days of two-interval performance, temporal decoding by DMS ensembles improved on FI3 trials. Finally, when comparing FI12 versus FI3 trials, we found that more DMS neurons than MFC neurons exhibited differential interval-related activity early in two-interval performance. These data suggest that the MFC and DMS play distinct roles during temporal learning and provide insight into corticostriatal circuits.

Internal Clocks, mGluR7 and Microtubules: A Primer for the Molecular Encoding of Target Durations in Cerebellar Purkinje Cells and Striatal Medium Spiny Neurons

The majority of studies in the field of timing and time perception have generally focused on sub- and supra-second time scales, specific behavioral processes, and/or discrete neuronal circuits. In an attempt to find common elements of interval timing from a broader perspective, we review the literature and highlight the need for cell and molecular studies that can delineate the neural mechanisms underlying temporal processing. Moreover, given the recent attention to the function of microtubule proteins and their potential contributions to learning and memory consolidation/re-consolidation, we propose that these proteins play key roles in coding temporal information in cerebellar Purkinje cells (PCs) and striatal medium spiny neurons (MSNs). The presence of microtubules at relevant neuronal sites, as well as their adaptability, dynamic structure, and longevity, makes them a suitable candidate for neural plasticity at both intra- and inter-cellular levels. As a consequence, microtubules appear capable of maintaining a temporal code or engram and thereby regulate the firing patterns of PCs and MSNs known to be involved in interval timing. This proposed mechanism would control the storage of temporal information triggered by postsynaptic activation of mGluR7. This, in turn, leads to alterations in microtubule dynamics through a "read-write" memory process involving alterations in microtubule dynamics and their hexagonal lattice structures involved in the molecular basis of temporal memory.

The differential role of the dorsal hippocampus in initiating and terminating timed responses: A lesion study using the switch-timing task

This study investigated the role of the dorsal hippocampus (dHPC) in the temporal entrainment of behavior, while addressing limitations of previous evidence from peak procedure experiments. Rats were first trained on a switch-timing task in which food was obtained from one of two concurrently available levers; one lever was effective after 8 s and the other after 16  s. After performance stabilized, rats underwent either bilateral NMDA lesions of the dHPC or sham lesions. After recovery, switch-timing training resumed. In a subsequent condition, the switch-timing task was modified such that food was available after either 8 or 32 s. Although dHPC lesions had subtle and complex effects on when rats stopped seeking for food at the 8-s lever (departures), it more systematically reduced the time when rats started seeking for food at the 16-s and 32-s lever (switches). No systematic effect of dHPC lesions were observed on the coefficient of quartile variation (normalized dispersion) of latencies to switch. Within the context of the pacemaker-accumulator framework of interval timing, these findings suggest that partially or wholly independent mechanisms control the initiation and termination of timed responses, and that the dHPC is primarily involved in encoding the time to start responding.

Integrating Models of Interval Timing and Reinforcement Learning

We present an integrated view of interval timing and reinforcement learning (RL) in the brain. The computational goal of RL is to maximize future rewards, and this depends crucially on a representation of time. Different RL systems in the brain process time in distinct ways. A model-based system learns 'what happens when', employing this internal model to generate action plans, while a model-free system learns to predict reward directly from a set of temporal basis functions. We describe how these systems are subserved by a computational division of labor between several brain regions, with a focus on the basal ganglia and the hippocampus, as well as how these regions are influenced by the neuromodulator dopamine.

Probabilistic Information Modulates the Timed Response Inhibition Deficit in Aging Mice

How interval timing is affected by aging constitutes one of the contemporary research questions. There is however a limited number of studies that investigate this research question in animal models of aging. The current study investigated how temporal decision-making is affected by aging. Initially, we trained young (2–3 month-old) and old C57BL/6J male mice (18–19 month-old) independently with short (3 s) and long (9 s) intervals by signaling, in each trial, the hopper associated with the interval that is in effect in that trial. The probability of short and long trials was manipulated (0.25 or 0.75) for different animals in each age group. During testing, both hoppers were illuminated, and thus active trial type was not differentiated. We expected mice to spontaneously combine the independently acquired time interval-location-probability information to adaptively guide their timing behavior in test trials. This adaptive ability and the resultant timing behavior were analyzed and compared between the age groups. Both young and old mice indeed adjusted their timing behavior in an abrupt fashion based on the independently acquired temporal-spatial-probabilistic information. The core timing ability of old mice was also intact. However, old mice had difficulty in terminating an ongoing timed response when the probability for the short trial was higher and this difference disappeared in the group that was exposed to a lower probability of short trials. These results suggest an inhibition problem in old mice as reflected through the threshold modulation process in timed decisions, which is cognitively penetrable to the probabilistic information.

Changes in Magnitude and Variability of Corticospinal Excitability During Rewarded Time-Sensitive Behavior

Reward expectation and time estimation are important for behavior and affect corticospinal excitability. This study investigated changes in corticospinal excitability during rewarded time-sensitive behavioral tasks. The rewarded time-sensitive task comprised three fixed-ratio (FR) schedules: FR_A contained a reward stimulus after every response, FR_B after every two responses, and FR_C after every four responses. The participants were instructed to press a left button with the index finger as quickly as possible in response to the appearance of a red circle. Just after the left button press, the word “10-yen” (approximately $0.1) or “no pay” was presented as feedback. Then, the participant had to mentally estimate/wait for 2.5 s from pressing the left button to pressing the right button. One second after the reward stimulus, transcranial magnetic stimulation (TMS) was delivered to the primary motor cortex at the hotspot of the first dorsal interosseous (FDI) muscle. Each participant received items corresponding to the total monetary reward accumulated at the end of the experiment. The variability of motor evoked potential (MEP) amplitudes transformed from a random process during the resting state into an autoregressive process during the rewarded time-sensitive behavioral task. Additionally, the random variation of MEP amplitudes in the FR_C, FR_B, and FR_A schedules increased in a stepwise fashion. However, the magnitude of MEP amplitudes significantly increased for the FR_B and FR_C schedules compared to the FR_A schedule. The time estimation lag was negative for the three FR schedules but there was no difference among the three FR schedules. The magnitude of corticospinal excitability increased in low reward probability, whereas the variability of corticospinal excitability transformed into an autoregressive process in high reward probability. These results imply that the magnitude and variability of expectation-related corticospinal excitabilities can be differentially altered by reward probability.

Corticospinal excitability is modulated by temporal feedback gaps

The integration of sensorimotor information is important for accurate goal-directed movement and affects corticospinal excitability (CE). This study investigated CE during the motor preparation period in a goal-directed movement task with temporal feedback gaps. Each trial began with a pair of first-informative and second-response beeps presented successively as cues. Trials with temporal feedback gaps showed that virtual hand movements lagged 400 ms behind actual performed movements. The participants were instructed to prepare for movement in accordance with the first beep, start the movement upon hearing the second beep, and perform movements that were both fast and accurate to the virtual target. We delivered a single-pulse of transcranial magnetic stimulation to the first dorsal interosseous muscle 250 ms before the presentation of the response beep. Motor-evoked potential amplitudes with temporal feedback gaps were significantly higher than those without temporal feedback gaps. Moreover, motor-evoked potential amplitudes with temporal feedback gaps gradually decreased over the course of the trials, whereas those without temporal feedback gaps did not change. In summary, CE during the motor preparation period was increased by temporal feedback gaps, and this excitation decreased in accordance with adaptation to temporal feedback gaps.

Oscillation patterns of local field potentials in the dorsal striatum and sensorimotor cortex during the encoding, maintenance, and decision stages for the ordinal comparison of sub- and supra-second signal durations

Ordinal comparison of successively presented signal durations requires (a) the encoding of the first signal duration (standard), (b) maintenance of temporal information specific to the standard duration in memory, and (c) timing of the second signal duration (comparison) during which a comparison is made of the first and second durations. Rats were first trained to make ordinal comparisons of signal durations within three time ranges using 0.5, 1.0, and 3.0-s standard durations. Local field potentials were then recorded from the dorsal striatum and sensorimotor cortex in order to investigate the pattern of neural oscillations during each phase of the ordinal-comparison process. Increased power in delta and theta frequency ranges was observed during both the encoding and comparison stages. Active maintenance of a selected response, "shorter" or "longer" (counter-balanced across left and right levers), was represented by an increase of theta and delta oscillations in the contralateral striatum and cortex. Taken together, these data suggest that neural oscillations in the delta-theta range play an important role in the encoding, maintenance, and comparison of signal durations.

Spontaneous integration of temporal information: implications for representational/computational capacity of animals

How do animals adapt their behaviors to changing conditions? This question relates to the debate between associative versus representational/computational approaches in cognitive science. An influential line of research that has significantly shaped the conceptual development of animal learning over decades has primarily focused on the role of associative dynamics with little-to-no ascription of representational/combinatorial capacities. The common assumption of these models is that behavioral adjustments are incremental and they result from updating of associations based on actions and their outcomes, without encoding the critical information serving as the determinant(s) of such contingencies (e.g., time in interval schedules, number in ratio schedules). On the other hand, an independent line of research provides evidence for behavioral phenomena that cannot be readily accounted for by the conventional associationist approach. In this paper, we will review different sets of findings particularly in the area of interval timing that suggest the ability of animals to make swift spontaneous computations on subjective quantities and incorporate them into their behavior. Findings of these studies constitute empirical challenges for the associationist approaches to behavioral flexibility. We argue that interval timing is a fertile ground for the formulation of critical tests of different theoretical approaches to animal behavior.

Functional coding variation in the presynaptic dopamine transporter associated with neuropsychiatric disorders drives enhanced motivation and context-dependent impulsivity in mice

Recent genetic analyses have provided evidence that clinical commonalities associated with different psychiatric diagnoses often have shared mechanistic underpinnings. The development of animal models expressing functional genetic variation attributed to multiple disorders offers a salient opportunity to capture molecular, circuit and behavioral alterations underlying this hypothesis. In keeping with studies suggesting dopaminergic contributions to attention-deficit hyperactivity disorder (ADHD), bipolar disorder (BPD) and autism spectrum disorder (ASD), subjects with these diagnoses have been found to express a rare, functional coding substitution in the dopamine (DA) transporter (DAT), Ala559Val. We developed DAT Val559 knock-in mice as a construct valid model of dopaminergic alterations that drive multiple clinical phenotypes, and here evaluate the impact of lifelong expression of the variant on impulsivity and motivation utilizing the 5- choice serial reaction time task (5-CSRTT) and Go/NoGo as well as tests of time estimation (peak interval analysis), reward salience (sucrose preference), and motivation (progressive ratio test). Our findings indicate that the DAT Val559 variant induces impulsivity behaviors that are dependent upon the reward context, with increased impulsive action observed when mice are required to delay responding for a reward, whereas mice are able to withhold responding if there is a probability of reward for a correct rejection. Utilizing peak interval and progressive ratio tests, we provide evidence that impulsivity is likely driven by an enhanced motivational phenotype that also may drive faster task acquisition in operant tasks. These data provide critical validation that DAT, and more generally, DA signaling perturbations can drive impulsivity that can manifest in specific contexts and not others, and may rely on motivational alterations, which may also drive increased maladaptive reward seeking.

Mice lacking hippocampal left-right asymmetry show non-spatial learning deficits

Left-right asymmetry is known to exist at several anatomical levels in the brain and recent studies have provided further evidence to show that it also exists at a molecular level in the hippocampal CA3-CA1 circuit. The distribution of N-methyl-d-aspartate (NMDA) receptor NR2B subunits in the apical and basal synapses of CA1 pyramidal neurons is asymmetrical if the input arrives from the left or right CA3 pyramidal neurons. In the present study, we examined the role of hippocampal asymmetry in cognitive function using β2-microglobulin knock-out (β2m KO) mice, which lack hippocampal asymmetry. We tested β2m KO mice in a series of spatial and non-spatial learning tasks and compared the performances of β2m KO and C57BL6/J wild-type (WT) mice. The β2m KO mice appeared normal in both spatial reference memory and spatial working memory tasks but they took more time than WT mice in learning the two non-spatial learning tasks (i.e., a differential reinforcement of lower rates of behavior (DRL) task and a straight runway task). The β2m KO mice also showed less precision in their response timing in the DRL task and showed weaker spontaneous recovery during extinction in the straight runway task. These results indicate that hippocampal asymmetry is important for certain characteristics of non-spatial learning.

Recollection-dependent memory for event duration in large-scale spatial navigation

Time and space represent two key aspects of episodic memories, forming the spatiotemporal context of events in a sequence. Little is known, however, about how temporal information, such as the duration and the order of particular events, are encoded into memory, and if it matters whether the memory representation is based on recollection or familiarity. To investigate this issue, we used a real world virtual reality navigation paradigm where periods of navigation were interspersed with pauses of different durations. Crucially, participants were able to reliably distinguish the durations of events that were subjectively “reexperienced” (i.e., recollected), but not of those that were familiar. This effect was not found in temporal order (ordinal) judgments. We also show that the active experience of the passage of time (holding down a key while waiting) moderately enhanced duration memory accuracy. Memory for event duration, therefore, appears to rely on the hippocampally supported ability to recollect or reexperience an event enabling the reinstatement of both its duration and its spatial context, to distinguish it from other events in a sequence. In contrast, ordinal memory appears to rely on familiarity and recollection to a similar extent.

Updating temporal expectancy of an aversive event engages striatal plasticity under amygdala control

Pavlovian aversive conditioning requires learning of the association between a conditioned stimulus (CS) and an unconditioned, aversive stimulus (US) but also involves encoding the time interval between the two stimuli. The neurobiological bases of this time interval learning are unknown. Here, we show that in rats, the dorsal striatum and basal amygdala belong to a common functional network underlying temporal expectancy and learning of a CS-US interval. Importantly, changes in coherence between striatum and amygdala local field potentials (LFPs) were found to couple these structures during interval estimation within the lower range of the theta rhythm (3-6 Hz). Strikingly, we also show that a change to the CS-US time interval results in long-term changes in cortico-striatal synaptic efficacy under the control of the amygdala. Collectively, this study reveals physiological correlates of plasticity mechanisms of interval timing that take place in the striatum and are regulated by the amygdala.

Cognitive Aging and Time Perception: Roles of Bayesian Optimization and Degeneracy

This review outlines the basic psychological and neurobiological processes associated with age-related distortions in timing and time perception in the hundredths of milliseconds-to-minutes range. The difficulty in separating indirect effects of impairments in attention and memory from direct effects on timing mechanisms is addressed. The main premise is that normal aging is commonly associated with increased noise and temporal uncertainty as a result of impairments in attention and memory as well as the possible reduction in the accuracy and precision of a central timing mechanism supported by dopamine-glutamate interactions in cortico-striatal circuits. Pertinent to these findings, potential interventions that may reduce the likelihood of observing age-related declines in timing are discussed. Bayesian optimization models are able to account for the adaptive changes observed in time perception by assuming that older adults are more likely to base their temporal judgments on statistical inferences derived from multiple trials than on a single trial's clock reading, which is more susceptible to distortion. We propose that the timing functions assigned to the age-sensitive fronto-striatal network can be subserved by other neural networks typically associated with finely-tuned perceptuo-motor adjustments, through degeneracy principles (different structures serving a common function).

Individual trial analysis evidences clock and non-clock based conditioned suppression behaviors in rats

We analyzed the temporal pattern of conditioned suppression of lever-pressing for food in rats conditioned with tone-shock pairings using either a 10 or 15s conditioned stimulus (CS)-unconditioned stimulus (US) interval with a CS duration that was three times the CS-US interval. The analysis of average suppression and of individual trials was performed during Probe CS-alone trials and when a short gap was inserted during the CS. The pattern of suppression followed the classical temporal rules: (1) scalar property, (2) a shift in peak suppression due to a gap, compatible with a Stop rule, (3) a three-state pattern of lever-pressing in individual trials, with abrupt start and stop of suppression. The peak of the average suppression curve, but not the middle time, was anticipatory to the programmed US time. The pattern of lever-pressing in individual trials unraveled two types of start of suppression behavior: a clock-based biphasic responding, with a burst of lever-pressing before suppression, and a non-clock based monophasic reduction of lever-pressing close to the CS onset. The non-clock based type of behavior may be responsible for the anticipatory peak time, and the biphasic pattern of lever-pressing may reflect the decision stage described in clock models.

Temporal averaging across multiple response options: insight into the mechanisms underlying integration

Rats trained on a dual-duration, dual-modality peak-interval procedure (e.g., tone = 10 s/light = 20 s) often show unimodal response distributions with peaks that fall in between the anchor durations when both cues are presented as a simultaneous compound. Two hypotheses can explain this finding. According to the averaging hypothesis, rats integrate the anchor durations into an average during compound trials, with each duration being weighted by its respective reinforcement probability. According to the simultaneous temporal processing hypothesis, rats time both durations veridically and simultaneously during compound trials and respond continuously across both durations, thereby producing a unimodal response distribution with a peak falling in between the anchor durations. In the present compounding experiment, rats were trained to associate a tone and light with two different durations (e.g., 5 and 20 s, respectively). However, in contrast to previous experiments, each cue was also associated with a distinct response requirement (e.g., left nosepoke for tone/right nosepoke for light). On the majority of compound trials, responding on a given nosepoke fell close to its respective duration, but was shifted in the direction of the other cue's duration, suggesting rats timed an average of the two durations. However, more weight appeared to be given to the duration associated with the manipulandum on which the rat responded, rather than the duration associated with a higher reinforcement probability as predicted by the averaging hypothesis. Group differences were also observed, with rats trained to associate the tone and light with the short and long durations, respectively, being more likely to show these shifts than the counterbalanced modality-duration group (i.e., light-short/tone-long). This parallels group differences observed in past studies and suggest that cue weighting in response to stimulus compounds is influenced by the modality-duration relationship of the anchor cues. The current results suggest that temporal averaging is a more flexible process than previously theorized and provide novel insight into the mechanisms that affect cue weighting.

Oscillatory multiplexing of neural population codes for interval timing and working memory

Interval timing and working memory are critical components of cognition that are supported by neural oscillations in prefrontal-striatal-hippocampal circuits. In this review, the properties of interval timing and working memory are explored in terms of behavioral, anatomical, pharmacological, and neurophysiological findings. We then describe the various neurobiological theories that have been developed to explain these cognitive processes - largely independent of each other. Following this, a coupled excitatory - inhibitory oscillation (EIO) model of temporal processing is proposed to address the shared oscillatory properties of interval timing and working memory. Using this integrative approach, we describe a hybrid model explaining how interval timing and working memory can originate from the same oscillatory processes, but differ in terms of which dimension of the neural oscillation is utilized for the extraction of item, temporal order, and duration information. This extension of the striatal beat-frequency (SBF) model of interval timing (Matell and Meck, 2000, 2004) is based on prefrontal-striatal-hippocampal circuit dynamics and has direct relevance to the pathophysiological distortions observed in time perception and working memory in a variety of psychiatric and neurological conditions.

Implicit and explicit timing in oculomotor control

The passage of time can be estimated either explicitly, e.g. before leaving home in the morning, or implicitly, e.g. when catching a flying ball. In the present study, the latency of saccadic eye movements was used to evaluate differences between implicit and explicit timing. Humans were required to make a saccade between a central and a peripheral position on a computer screen. The delay between the extinction of a central target and the appearance of an eccentric target was the independent variable that could take one out of four different values (400, 900, 1400 or 1900 ms). In target trials, the delay period lasted for one of the four durations randomly. At the end of the delay, a saccade was initiated by the appearance of an eccentric target. Cue&target trials were similar to target trials but the duration of the delay was visually cued. In probe trials, the duration of the upcoming delay was cued, but there was no eccentric target and subjects had to internally generate a saccade at the estimated end of the delay. In target and cue&target trials, the mean and variance of latency distributions decreased as delay duration increased. In cue&target trials latencies were shorter. In probe trials, the variance increased with increasing delay duration and scalar variability was observed. The major differences in saccadic latency distributions were observed between visually-guided (target and cue&target trials) and internally-generated saccades (probe trials). In target and cue&target trials the timing of the response was implicit. In probe trials, the timing of the response was internally-generated and explicitly based on the duration of the visual cue. Scalar timing was observed only during probe trials. This study supports the hypothesis that there is no ubiquitous timing system in the brain but independent timing processes active depending on task demands.

Involvement of dopamine signaling in the circadian modulation of interval timing

Duration discrimination within the seconds-to-minutes range, known as interval timing, involves the interaction of cortico-striatal circuits via dopaminergic-glutamatergic pathways. Besides interval timing, most (if not all) organisms exhibit circadian rhythms in physiological, metabolic and behavioral functions with periods close to 24 h. We have previously reported that both circadian disruption and desynchronization impaired interval timing in mice. In this work we studied the involvement of dopamine (DA) signaling in the interaction between circadian and interval timing. We report that daily injections of levodopa improved timing performance in the peak-interval procedure in C57BL/6 mice with circadian disruptions, suggesting that a daily increase of DA is necessary for an accurate performance in the timing task. Moreover, striatal DA levels measured by reverse-phase high-pressure liquid chromatography indicated a daily rhythm under light/dark conditions. This daily variation was affected by inducing circadian disruption under constant light (LL). We also demonstrated a daily oscillation in tyrosine hydroxylase levels, DA turnover (3,4-dihydroxyphenylacetic acid/DA levels), and both mRNA and protein levels of the circadian component Period2 (Per2) in the striatum and substantia nigra, two brain areas relevant for interval timing. None of these oscillations persisted under LL conditions. We suggest that the lack of DA rhythmicity in the striatum under LL - probably regulated by Per2 - could be responsible for impaired performance in the timing task. Our findings add further support to the notion that circadian and interval timing share some common processes, interacting at the level of the dopaminergic system.

Prospective and retrospective duration memory in the hippocampus: is time in the foreground or background?

Psychologists have long distinguished between prospective and retrospective timing to highlight the difference between our sense of duration during an experience in passing and our sense of duration in hindsight. Humans and other animals use prospective timing in the seconds-to-minutes range in order to learn durations, and can organize their behaviour based upon this knowledge when they know that duration information will be important ahead of time. By contrast, when durations are estimated after the fact, thus precluding the subject from consciously attending to temporal information, duration information must be extracted from other memory representations. The accumulated evidence from prospective timing research has generally led to the hippocampus (HPC) being casted in a supporting role with prefrontal-striatal, cortical or cerebellar circuits playing the lead. Here, I review findings from the animal and human literature that have led to this conclusion and consider that the contribution of the HPC to duration memory is understated because we have little understanding about how we remember duration.

Comparison of interval timing behaviour in mice following dorsal or ventral hippocampal lesions with mice having δ-opioid receptor gene deletion

Mice with cytotoxic lesions of the dorsal hippocampus (DH) underestimated 15 s and 45 s target durations in a bi-peak procedure as evidenced by proportional leftward shifts of the peak functions that emerged during training as a result of decreases in both 'start' and 'stop' times. In contrast, mice with lesions of the ventral hippocampus (VH) displayed rightward shifts that were immediately present and were largely limited to increases in the 'stop' time for the 45 s target duration. Moreover, the effects of the DH lesions were congruent with the scalar property of interval timing in that the 15 s and 45 s functions superimposed when plotted on a relative timescale, whereas the effects of the VH lesions violated the scalar property. Mice with DH lesions also showed enhanced reversal learning in comparison to control and VH lesioned mice. These results are compared with the timing distortions observed in mice lacking δ-opioid receptors (Oprd1(-/-)) which were similar to mice with DH lesions. Taken together, these results suggest a balance between hippocampal-striatal interactions for interval timing and demonstrate possible functional dissociations along the septotemporal axis of the hippocampus in terms of motivation, timed response thresholds and encoding in temporal memory.

Retrospective and Prospective Views on the Role of the Hippocampus in Interval Timing and Memory for Elapsed Time

The overlap of neural circuits involved in episodic memory, relational learning, trace conditioning, and interval timing suggests the importance of hippocampal-dependent processes. Identifying the functional and neural mechanisms whereby the hippocampus plays a role in timing and decision-making, however, has been elusive. In this article we describe recent neurobiological findings, including the discovery of hippocampal ‘time cells’, dependency of duration discriminations in the minutes range on hippocampal function, and the correlation of hippocampal theta rhythm with specific features of temporal processing. These results provide novel insights into the ways in which the hippocampus might interact with the striatum in order to support both retrospective and prospective timing. Suggestions are also provided for future research on the role of the hippocampus in memory for elapsed time.

Interval Timing, Dopamine, and Motivation

The dopamine clock hypothesis suggests that the dopamine level determines the speed of the hypothetical internal clock. However, dopaminergic function has also been implicated for motivation and thus the effect of dopaminergic manipulations on timing behavior might also be independently mediated by altered motivational state. Studies that investigated the effect of motivational manipulations on peak responding are reviewed in this paper. The majority of these studies show that a higher reward magnitude leads to a leftward shift, whereas reward devaluation leads to a rightward shift in the initiation of timed anticipatory behavior, typically in the absence of an effect on the timing of response termination. Similar behavioral effects are also present in a number of studies that investigated the effect of dopamine agonists and dopamine-related genetic factors on peak responding. These results can be readily accounted for by independent modulation of decision-thresholds for the initiation and termination of timed responding.

Dissociations between interval timing and intertemporal choice following administration of fluoxetine, cocaine, or methamphetamine

The goal of our study was to characterize the relationship between intertemporal choice and interval timing, including determining how drugs that modulate brain serotonin and dopamine levels influence these two processes. In Experiment 1, rats were tested on a standard 40-s peak-interval procedure following administration of fluoxetine (3, 5, or 8 mg/kg) or vehicle to assess basic effects on interval timing. In Experiment 2, rats were tested in a novel behavioral paradigm intended to simultaneously examine interval timing and impulsivity. Rats performed a variant of the bi-peak procedure using 10-s and 40-s target durations with an additional "defection" lever that provided the possibility of a small, immediate reward. Timing functions remained relatively intact, and 'patience' across subjects correlated with peak times, indicating a negative relationship between 'patience' and clock speed. We next examined the effects of fluoxetine (5 mg/kg), cocaine (15 mg/kg), or methamphetamine (1 mg/kg) on task performance. Fluoxetine reduced impulsivity as measured by defection time without corresponding changes in clock speed. In contrast, cocaine and methamphetamine both increased impulsivity and clock speed. Thus, variations in timing may mediate intertemporal choice via dopaminergic inputs. However, a separate, serotonergic system can affect intertemporal choice without affecting interval timing directly. This article is part of a Special Issue entitled: Associative and Temporal Learning.

Hippocampus, time, and memory--a retrospective analysis

In 1984, there was considerable evidence that the hippocampus was important for spatial learning and some evidence that it was also involved in duration discrimination. The article "Hippocampus, Time, and Memory" (Meck, Church, & Olton, 1984), however, was the first to isolate the effects of hippocampal damage on specific stages of temporal processing. In this review, to celebrate the 30th anniversary of Behavioral Neuroscience, we look back on factors that contributed to the long-lasting influence of this article. The major results were that a fimbria-fornix lesion (a) interferes with the ability to retain information in temporal working memory, and (b) distorts the content of temporal reference memory, but (c) did not decrease sensitivity to signal duration. This was the first lesion experiment in which the results were interpreted by a well-developed theory of behavior (scalar timing theory). It has led to extensive research on the role of the hippocampus in temporal processing by many investigators. The most important ones are the development of computational models with plausible neural mechanisms (such as the striatal beat-frequency model of interval timing), the use of multiple behavioral measures of timing, and empirical research on the neural mechanisms of timing and temporal memory using ensemble recording of neurons in prefrontal-striatal-hippocampal circuits.