Decoupling interval timing and climbing neural activity: a dissociation between CNV and N1P2 amplitudes

Blocked versus interleaved: How range contexts modulate time perception and its EEG signatures

Accurate time perception is a crucial element in a wide range of cognitive tasks, including decision-making, memory, and motor control. One commonly observed phenomenon is that when given a range of time intervals to consider, people's estimates often cluster around the midpoint of those intervals. Previous studies have suggested that the range of these intervals can also influence our judgments, but the neural mechanisms behind this "range effect" are not yet understood. We used both behavioral tests and electroencephalographic (EEG) measures to understand how the range of sample time intervals affects the accuracy of people's subsequent time estimates. Study participants were exposed to two different setups: In the "blocked-range" (BR) session, short and long intervals were presented in separate blocks, whereas in the "interleaved-range" (IR) session, intervals of various lengths were presented randomly. Our findings indicated that the BR context led to more accurate time estimates compared to the IR context. In terms of EEG data, the BR context resulted in quicker buildup of contingent negative variation (CNV), which also reached higher amplitude levels and dissolved more rapidly during the encoding stage. We also observed an enhanced amplitude in the offset P2 component of the EEG signal. Overall, our results suggest that the variability in time intervals, as defined by their range, influences the neural processes that underlie time estimation.

Robust inference of causality in high-dimensional dynamical processes from the Information Imbalance of distance ranks

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a statistical test capable of inferring the relative information content of different distance measures. We test whether the predictability of a putative driven system Y can be improved by incorporating information from a potential driver system X, without explicitly modeling the underlying dynamics and without the need to compute probability densities of the dynamic variables. This framework makes causality detection possible even between high-dimensional systems where only few of the variables are known or measured. Benchmark tests on coupled chaotic dynamical systems demonstrate that our approach outperforms other model-free causality detection methods, successfully handling both unidirectional and bidirectional couplings. We also show that the method can be used to robustly detect causality in human electroencephalography data.

Common neural mechanisms supporting time judgements in humans and monkeys

There has been an increasing interest in identifying the biological underpinnings of human time perception, for which purpose research in non-human primates (NHP) is common. Although previous work, based on behaviour, suggests that similar mechanisms support time perception across species, the neural correlates of time estimation in humans and NHP have not been directly compared. In this study, we assess whether brain evoked responses during a time categorization task are similar across species. Specifically, we assess putative differences in post-interval evoked potentials as a function of perceived duration in human EEG (N = 24) and local field potential (LFP) and spike recordings in pre-supplementary motor area (pre-SMA) of one monkey. Event-related potentials (ERPs) differed significantly after the presentation of the temporal interval between "short" and "long" perceived durations in both species, even when the objective duration of the stimuli was the same. Interestingly, the polarity of the reported ERPs was reversed for incorrect trials (i.e., the ERP of a "long" stimulus looked like the ERP of a "short" stimulus when a time categorization error was made). Hence, our results show that post-interval potentials reflect the perceived (rather than the objective) duration of the presented time interval in both NHP and humans. In addition, firing rates in monkey's pre-SMA also differed significantly between short and long perceived durations and were reversed in incorrect trials. Together, our results show that common neural mechanisms support time categorization in NHP and humans, thereby suggesting that NHP are a good model for investigating human time perception.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Time for What? Dissociating Explicit Timing Tasks through Electrophysiological Signatures

Estimating durations between hundreds of milliseconds and seconds is essential for several daily tasks. Explicit timing tasks, which require participants to estimate durations to make a comparison (time for perception) or to reproduce them (time for action), are often used to investigate psychological and neural timing mechanisms. Recent studies have proposed that mechanisms may depend on specific task requirements. In this study, we conducted electroencephalogram (EEG) recordings on human participants as they estimated intervals in different task contexts to investigate the extent to which timing mechanisms depend on the nature of the task. We compared the neural processing of identical visual reference stimuli in two different tasks, in which stimulus durations were either perceptually compared or motorically reproduced in separate experimental blocks. Using multivariate pattern analyses, we could successfully decode the duration and the task of reference stimuli. We found evidence for both overlapping timing mechanisms across tasks as well as recruitment of task-dependent processes for comparing intervals for different purposes. Our findings suggest both core and specialized timing functions are recruited to support explicit timing tasks.

Neurocomputational Models of Interval Timing: Seeing the Forest for the Trees

Extracting temporal regularities and relations from experience/observation is critical for organisms' adaptiveness (communication, foraging, predation, prediction) in their ecological niches. Therefore, it is not surprising that the internal clock that enables the perception of seconds-to-minutes-long intervals (interval timing) is evolutionarily well-preserved across many species of animals. This comparative claim is primarily supported by the fact that the timing behavior of many vertebrates exhibits common statistical signatures (e.g., on-average accuracy, scalar variability, positive skew). These ubiquitous statistical features of timing behaviors serve as empirical benchmarks for modelers in their efforts to unravel the processing dynamics of the internal clock (namely answering how internal clock "ticks"). In this chapter, we introduce prominent (neuro)computational approaches to modeling interval timing at a level that can be understood by general audience. These models include Treisman's pacemaker accumulator model, the information processing variant of scalar expectancy theory, the striatal beat frequency model, behavioral expectancy theory, the learning to time model, the time-adaptive opponent Poisson drift-diffusion model, time cell models, and neural trajectory models. Crucially, we discuss these models within an overarching conceptual framework that categorizes different models as threshold vs. clock-adaptive models and as dedicated clock/ramping vs. emergent time/population code models.

Diverse Time Encoding Strategies Within the Medial Premotor Areas of the Primate

The measurement of time in the subsecond scale is critical for many sophisticated behaviors, yet its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the neural activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing. During single interval categorization, we found that preSMA encodes a subjective category limit by reaching a peak of activity at a time that divides the set of test intervals into short and long. We also observed neural signals associated with the category selected by the subjects and the reward outcomes of the perceptual decision. On the other hand, we have studied the behavioral and neurophysiological basis of rhythmic timing. First, we have shown in different tapping tasks that macaques are able to produce predictively and accurately intervals that are cued by auditory or visual metronomes or when intervals are produced internally without sensory guidance. In addition, we found that the rhythmic timing mechanism in MPC is governed by different layers of neural clocks. Next, the instantaneous activity of single cells shows ramping activity that encodes the elapsed or remaining time for a tapping movement. In addition, we found MPC neurons that build neural sequences, forming dynamic patterns of activation that flexibly cover all the produced interval depending on the tapping tempo. This rhythmic neural clock resets on every interval providing an internal representation of pulse. Furthermore, the MPC cells show mixed selectivity, encoding not only elapsed time, but also the tempo of the tapping and the serial order element in the rhythmic sequence. Hence, MPC can map different task parameters, including the passage of time, using different cell populations. Finally, the projection of the time varying activity of MPC hundreds of cells into a low dimensional state space showed circular neural trajectories whose geometry represented the internal pulse and the tapping tempo. Overall, these findings support the notion that MPC is part of the core timing mechanism for both single interval and rhythmic timing, using neural clocks with different encoding principles, probably to flexibly encode and mix the timing representation with other task parameters.

Distinct brain dynamics and networks for processing short and long auditory time intervals

Psychophysical studies suggest that time intervals above and below 1.2 s are processed differently in the human brain. However, the neural underpinnings of this dissociation remain unclear. Here, we investigate whether distinct or common brain networks and dynamics support the passive perception of short (below 1.2 s) and long (above 1.2 s) empty time intervals. Twenty participants underwent an EEG recording during an auditory oddball paradigm with .8- and 1.6-s standard time intervals and deviant intervals either shorter (early) or longer (delayed) than the standard interval. We computed the auditory ERPs for each condition at the sensor and source levels. We then performed whole brain cluster-based permutation statistics for the CNV, N1 and P2, components, testing deviants against standards. A CNV was found only for above 1.2 s intervals (delayed deviants), with generators in temporo-parietal, SMA, and motor regions. Deviance detection of above 1.2 s intervals occurred during the N1 period over fronto-central sensors for delayed deviants only, with generators in parietal and motor regions. Deviance detection of below 1.2 s intervals occurred during the P2 period over fronto-central sensors for delayed deviants only, with generators in primary auditory cortex, SMA, IFG, cingulate and parietal cortex. We then identified deviance related changes in directed connectivity using bivariate Granger causality to highlight the networks dynamics associated with interval processing above and below 1.2. These results suggest that distinct brain dynamics and networks support the perception of time intervals above and below 1.2 s.

Encoding, working memory, or decision: how feedback modulates time perception

The hypothesis that individuals can accurately represent temporal information within approximately 3 s is the premise of several theoretical models and empirical studies in the field of temporal processing. The significance of accurately representing time within 3 s and the universality of the overestimation contrast dramatically. To clarify whether this overestimation arises from an inability to accurately represent time or a response bias, we systematically examined whether feedback reduces overestimation at the 3 temporal processing stages of timing (encoding), working memory, and decisions proposed by the scalar timing model. Participants reproduced the time interval between 2 circles with or without feedback, while the electroencephalogram (EEG) was synchronously recorded. Behavioral results showed that feedback shortened reproduced times and significantly minimized overestimation. EEG results showed that feedback significantly decreased the amplitude of contingent negative variation (CNV) in the decision stage but did not modulate the CNV amplitude in the encoding stage or the P2-P3b amplitudes in the working memory stage. These results suggest that overestimation arises from response bias when individuals convert an accurate representation of time into behavior. Our study provides electrophysiological evidence to support the conception that short intervals under approximately 3 s can be accurately represented as "temporal gestalt."

Electrophysiological signatures of temporal context in the bisection task

Despite having relatively accurate timing, subjective time can be influenced by various contexts, such as stimulus spacing and sample frequency. Several electroencephalographic (EEG) components have been associated with timing, including the contingent negative variation (CNV), offset P2, and late positive component of timing (LPCt). However, the specific role of these components in the contextual modulation of perceived time remains unclear. In this study, we conducted two temporal bisection experiments to investigate this issue. Participants had to judge whether a test duration was close to a short or long standard. Unbeknownst to them, we manipulated the stimulus spacing (Experiment 1) and sample frequency (Experiment 2) to create short and long contexts while maintaining consistent test ranges and standards across different sessions. The results revealed that the bisection threshold shifted towards the ensemble mean, and both CNV and LPCt were sensitive to context modulation. In the short context, the CNV exhibited an increased climbing rate compared to the long context, whereas the LPCt displayed reduced amplitude and latency. These findings suggest that the CNV represents an expectancy wave preceding a temporal decision process, while the LPCt reflects the decision-making process itself, with both components influenced by the temporal context.

P3-like signatures of temporal predictions: a computational EEG study

Many cognitive processes, ranging from perception to action, depend on the ability to predict the timing of forthcoming events. Yet, how the brain uses predictive models in the temporal domain is still an unsolved question. In previous work, we began to explore the neural correlates of temporal predictions by using a computational approach in which an ideal Bayesian observer learned the temporal probabilities of target onsets in a simple reaction time task. Because the task was specifically designed to disambiguate updating of predictive models and surprise, changes in temporal probabilities were explicitly cued. However, in the real world, we are usually incidentally exposed to changes in the statistics of the environment. Here, we thus aimed to further investigate the electroencephalographic (EEG) correlates of Bayesian belief updating and surprise associated with incidental learning of temporal probabilities. In line with our previous EEG study, results showed distinct P3-like modulations for updating and surprise. While surprise was indexed by an early fronto-central P3-like modulation, updating was associated with a later and more posterior P3 modulation. Moreover, updating was associated with a P2-like potential at centro-parietal electrodes, likely capturing integration processes between prior beliefs and likelihood of the observed event. These findings support previous evidence of trial-by-trial variability of P3 amplitudes as an index of dissociable inferential processes. Coupled with our previous findings, the present study strongly bolsters the view of the P3 as a key brain signature of temporal Bayesian inference. Data and scripts are shared on OSF: osf.io/sdy8j/.

Filling your time: Auditory flutter alters perceived duration via stimulus-locked responses

In the current article, we examined the flutter-duration illusion; the extension of perceived duration when an interval is filled with auditory flutter. Participants reproduced flutter-filled and empty durations while electrophysiological activity was recorded. As expected, participants over-produced durations when they were filled with auditory flutter rather than unfilled. Using multivariate pattern analysis, we found several differentiating patterns of neural activity while participants listened to either flutter-filled or empty intervals. However, in subsequent single trial analysis, only two of these clusters predicted perceived duration in the flutter condition; one occurring in line with the second click of the flutter, and one in line with the fourth click. We relate this finding to the N1P2 component and P3a component to timing initiation and arousal, respectively.

Modality-Attention Promotes the Neural Effects of Precise Timing Prediction in Early Sensory Processing

Precise timing prediction (TP) enables the brain to accurately predict the occurrence of upcoming events in millisecond timescale, which is fundamental for adaptive behaviors. The neural effect of the TP within a single sensory modality has been widely studied. However, less is known about how precise TP works when the brain is concurrently faced with multimodality sensory inputs. Modality attention (MA) is a crucial cognitive function for dealing with the overwhelming information induced by multimodality sensory inputs. Therefore, it is necessary to investigate whether and how the MA influences the neural effects of the precise TP. This study designed a visual–auditory temporal discrimination task, in which the MA was allocated to visual or auditory modality, and the TP was manipulated into no timing prediction (NTP), matched timing prediction (MTP), and violated timing prediction (VTP) conditions. Behavioral and electroencephalogram (EEG) data were recorded from 27 subjects, event-related potentials (ERP), time–frequency distributions of inter-trial coherence (ITC), and event-related spectral perturbation (ERSP) were analyzed. In the visual modality, precise TP led to N1 amplitude variations and 200–400 ms theta ITC. Such variations only emerged when the MA was attended. In auditory modality, the MTP had the largest P2 amplitude and delta ITC than other TP conditions when the MA was attended, whereas the distinctions disappeared when the MA was unattended. The results suggest that the MA promoted the neural effects of the precise TP in early sensory processing, which provides more neural evidence for better understanding the interactions between the TP and MA.

Post-interval potentials in temporal judgements

Research suggests that post-stimulus positive deflections could be associated with timing. We compared offset-locked potentials N1, P2, N1P2, and late positive component (LPC) in temporal generalization and temporal bisection-with visual probe intervals. In both tasks, the LPC amplitude decreased with the duration of the current probe interval. A larger LPC was found after shorter intervals, whereas other ERP amplitudes did not change between tasks or across durations. We also found that the LPC for different responses indicates subjective time. We discussed our findings in relation to theories of human timing.

Temporal features of concepts are grounded in time perception neural networks: An EEG study

Experimental evidence suggests that modality-specific concept features such as action, motion, and sound partially rely on corresponding action/perception neural networks in the human brain.Little is known, however, about time-related features of concepts. We examined whether temporal features of concepts recruit networks that subserve time perception in the brain in an EEG study using event and object nouns. Results showed significantly larger ERPs for event duration vs object size judgments over right parietal electrodes, a region associated with temporal processing. Additionally, alpha/beta (10-15 Hz) neural oscillation showed a stronger desynchronization for event duration compared to object size in the right parietal electrodes. This difference was not seen in control tasks comparing event vs object valence, suggesting that it is not likely to reflect a general difference between event and object nouns. These results indicate that temporal features of words may be subserved by time perception circuits in the human brain.

Temporal scaling of human scalp-recorded potentials

Neural activity is traditionally thought to occur over fixed timescales. However, recent animal work has suggested that some neural responses occur over varying timescales. We extended this animal result to humans by detecting temporally scaled signals noninvasively at the scalp in four different tasks. Our results suggest that temporal scaling is an important feature of cognitive processes known to unfold over varying timescales.

Much of human behavior is governed by common processes that unfold over varying timescales. Standard event-related potential analysis assumes fixed-duration responses relative to experimental events. However, recent single-unit recordings in animals have revealed neural activity scales to span different durations during behaviors demanding flexible timing. Here, we employed a general linear modeling approach using a combination of fixed-duration and variable-duration regressors to unmix fixed-time and scaled-time components in human magneto-/electroencephalography (M/EEG) data. We use this to reveal consistent temporal scaling of human scalp–recorded potentials across four independent electroencephalogram (EEG) datasets, including interval perception, production, prediction, and value-based decision making. Between-trial variation in the temporally scaled response predicts between-trial variation in subject reaction times, demonstrating the relevance of this temporally scaled signal for temporal variation in behavior. Our results provide a general approach for studying flexibly timed behavior in the human brain.

Neural signatures of evidence accumulation in temporal decisions

Cognitive models of interval timing can be formulated as an accumulation-to-bound process.1-5 However, the physiological manifestation of such processes has not yet been identified. We used electroencephalography (EEG) to measure the neural responses of participants while they performed a temporal bisection task in which they were requested to categorize the duration of visual stimuli as short or long.6 We found that the stimulus-offset and response-locked activity depends on both stimulus duration and the participants' decision. To relate this activity to the underlying cognitive processes, we used a drift-diffusion model.7 The model includes a noisy accumulator starting with the stimulus onset and a decision threshold. According to the model, a stimulus duration will be categorized as "long" if the accumulator reaches the threshold during stimulus presentation. Otherwise, it will be categorized as "short." We found that at the offset of stimulus presentation, an EEG response marks the distance of the accumulator from the threshold. Therefore, this model offers an accurate description of our behavioral data as well as the EEG response using the same two model parameters. We then replicated this finding in an identical experiment conducted in the tactile domain. We also extended this finding to two different temporal ranges (sub- and supra-second). Taken together, the work provides a new way to study the cognitive processes underlying temporal decisions, using a combination of behavior, EEG, and modeling.

Oscillation/Coincidence-Detection Models of Reward-Related Timing in Corticostriatal Circuits

The major tenets of beat-frequency/coincidence-detection models of reward-related timing are reviewed in light of recent behavioral and neurobiological findings. This includes the emphasis on a core timing network embedded in the motor system that is comprised of a corticothalamic-basal ganglia circuit. Therein, a central hub provides timing pulses (i.e., predictive signals) to the entire brain, including a set of distributed satellite regions in the cerebellum, cortex, amygdala, and hippocampus that are selectively engaged in timing in a manner that is more dependent upon the specific sensory, behavioral, and contextual requirements of the task. Oscillation/coincidence-detection models also emphasize the importance of a tuned ‘perception’ learning and memory system whereby target durations are detected by striatal networks of medium spiny neurons (MSNs) through the coincidental activation of different neural populations, typically utilizing patterns of oscillatory input from the cortex and thalamus or derivations thereof (e.g., population coding) as a time base. The measure of success of beat-frequency/coincidence-detection accounts, such as the Striatal Beat-Frequency model of reward-related timing (SBF), is their ability to accommodate new experimental findings while maintaining their original framework, thereby making testable experimental predictions concerning diagnosis and treatment of issues related to a variety of dopamine-dependent basal ganglia disorders, including Huntington’s and Parkinson’s disease.

Electrophysiological Evidence for a Common Magnitude Representation of Spatiotemporal Information in Working Memory

Spatiotemporal interference has attracted increasing attention because it provides a window for studying the neural representation of magnitude in the brain. We aimed to identify the neural basis of spatiotemporal interference using a Kappa effect task in which two circles were presented in sequence with two time intervals and three space distances. Participants reproduced the time intervals while ignoring the space distance when electroencephalogram signals were recorded synchronously. The behavior results showed that production time increased with time interval and space distance. Offset of the time intervals elicited typical P2 and P3b components. Larger parietal P2 and P3b amplitudes were elicited by the combination of longer time intervals and longer space distances. The parietal P2 and P3b amplitudes were positively correlated with the production time, and the corresponding neural source was located in the parietal cortex. The results suggest that the parietal P2 and P3b index updates a common representation of spatiotemporal information in working memory, which provides electrophysiological evidence for the mechanisms underlying spatiotemporal interferences. Our study supports a theory of magnitude, in which different dimensions can be integrated into a common magnitude representation in a generalized magnitude system that is localized at the parietal cortex.

Expectations about dynamic visual objects facilitates early sensory processing of congruent sounds

The perception of a moving object can lead to the expectation of its sound, yet little is known about how visual expectations influence auditory processing. We examined how visual perception of an object moving continuously across the visual field influences early auditory processing of a sound that occurred congruently or incongruently with the object's motion. In Experiment 1, electroencephalogram (EEG) activity was recorded from adults who passively viewed a ball that appeared either on the left or right boundary of a display and continuously traversed along the horizontal midline to make contact and elicit a bounce sound off the opposite boundary. Our main analysis focused on the auditory-evoked event-related potential. For audio-visual (AV) trials, a sound accompanied the visual input when the ball contacted the opposite boundary (AV-synchronous), or the sound occurred before contact (AV-asynchronous). We also included audio-only and visual-only trials. AV-synchronous sounds elicited an earlier and attenuated auditory response relative to AV-asynchronous or audio-only events. In Experiment 2, we examined the roles of expectancy and multisensory integration in influencing this response. In addition to the audio-only, AV-synchronous, and AV-asynchronous conditions, participants were shown a ball that became occluded prior to reaching the boundary of the display, but elicited an expected sound at the point of occluded collision. The auditory response during the AV-occluded condition resembled that of the AV-synchronous condition, suggesting that expectations induced by a moving object can influence early auditory processing. Broadly, the results suggest that dynamic visual stimuli can help generate expectations about the timing of sounds, which then facilitates the processing of auditory information that matches these expectations.

Similar CNV Neurodynamic Patterns between Sub- and Supra-Second Time Perception

In the field of time psychology, the functional significance of the contingent negative variation (CNV) component in time perception and whether the processing mechanisms of sub- and supra-second are similar or different still remain unclear. In the present study, event-related potential (ERP) technology and classical temporal discrimination tasks were used to explore the neurodynamic patterns of sub- and supra-second time perception. In Experiment 1, the standard interval (SI) was fixed at 500 ms, and the comparison interval (CI) ranged from 200 ms to 800 ms. In Experiment 2, the SI was fixed at 2000 ms, and the CI ranged from 1400 ms to 2600 ms. Participants were required to judge whether the CI was longer or shorter than the SI. The ERP results showed similar CNV activity patterns in the two experiments. Specifically, CNV amplitude would be more negative when the CI was longer or closer to the memorized SI. CNV peak latency increased significantly until the CI reached the memorized SI. We propose that CNV amplitude might reflect the process of temporal comparison, and CNV peak latency might represent the process of temporal decision-making. To our knowledge, it is the first ERP task explicitly testing the two temporal scales, sub- and supra-second timing, in one study. Taken together, the present study reveals a similar functional significance of CNV between sub- and supra-second time perception.

Post-interval EEG activity is related to task-goals in temporal discrimination

Studies investigating the neural mechanisms of time perception often measure brain activity while participants perform a temporal task. However, several of these studies are based exclusively on tasks in which time is relevant, making it hard to dissociate activity related to decisions about time from other task-related patterns. In the present study, human participants performed a temporal or color discrimination task of visual stimuli. Participants were informed which magnitude they would have to judge before or after presenting the two stimuli (S1 and S2) in different blocks. Our behavioral results showed, as expected, that performance was better when participants knew beforehand which magnitude they would judge. Electrophysiological data (EEG) was analysed using Linear Discriminant Contrasts (LDC) and a Representational Similarity Analysis (RSA) approach to investigate whether and when information about time and color was encoded. During the presentation of S1, we did not find consistent differences in EEG activity as a function of the task. On the other hand, during S2, we found that temporal and color information was encoded in a task-relevant manner. Taken together, our results suggest that task goals strongly modulate decision-related information in EEG activity.

Temporal Context Actively Shapes EEG Signatures of Time Perception

Our subjective perception of time is optimized to temporal regularities in the environment. This is illustrated by the central tendency effect: When estimating a range of intervals, short intervals are overestimated, whereas long intervals are underestimated to reduce the overall estimation error. Most models of interval timing ascribe this effect to the weighting of the current interval with previous memory traces after the interval has been perceived. Alternatively, the perception of the duration could already be flexibly tuned to its temporal context. We investigated this hypothesis using an interval reproduction task in which human participants (both sexes) reproduced a shorter and longer interval range. As expected, reproductions were biased toward the subjective mean of each presented range. EEG analyses showed that temporal context indeed affected neural dynamics during the perception phase. Specifically, longer previous durations decreased contingent negative variation and P2 amplitude and increased beta power. In addition, multivariate pattern analysis showed that it is possible to decode context from the transient EEG signal quickly after both onset and offset of the perception phase. Together, these results suggest that temporal context creates dynamic expectations which actively affect the perception of duration.SIGNIFICANCE STATEMENT The subjective sense of duration does not arise in isolation, but is informed by previous experiences. This is demonstrated by abundant evidence showing that the production of duration estimates is biased toward previously experienced time intervals. However, it is yet unknown whether this temporal context actively affects perception or only asserts its influence in later, postperceptual stages as proposed by most current formal models of this task. Using an interval reproduction task, we show that EEG signatures flexibly adapt to the temporal context during perceptual encoding. Furthermore, interval history can be decoded from the transient EEG signal even when the current duration was identical. Thus, our results demonstrate that context actively influences perception.

Electrophysiological correlates of the somatotopically organized tactile duration aftereffect

Adaptation to sensory events of long or short duration leads to a negative aftereffect, in which a new target event (of median duration) following the adaptation will be perceived to be shorter or longer than is actually the case. This illusion has been observed in visual, auditory, and tactile modalities. This study used event-related potentials (ERPs) to examine the tactile duration aftereffect, using the contingent negative variation (CNV) and the late positive component (LPC) as a way to characterize the temporal processes. The tactile duration adaptation was found to induce a significant aftereffect within a somatotopic framework. Moreover, the CNV in the contralateral scalp and the LPC in the fronto-central scalp were both modulated by the tactile duration adaptation. Specifically, adaptation to a short tactile duration increased the CNV and LPC amplitudes, whereas adaptation to a long tactile duration decreased them. This modulation was contingent on the topographic distance between fingers, which was only observed when the adapting and test fingers were consistent or adjacent, but not homologous. In sum, these results reveal a coherent behavioral-electrophysiological link in the somatotopically organized tactile duration aftereffect.

Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

Electroencephalographic correlates of temporal Bayesian belief updating and surprise

The brain predicts the timing of forthcoming events to optimize responses to them. Temporal predictions have been formalized in terms of the hazard function, which integrates prior beliefs on the likely timing of stimulus occurrence with information conveyed by the passage of time. However, how the human brain updates prior temporal beliefs is still elusive. Here we investigated electroencephalographic (EEG) signatures associated with Bayes-optimal updating of temporal beliefs. Given that updating usually occurs in response to surprising events, we sought to disentangle EEG correlates of updating from those associated with surprise. Twenty-six participants performed a temporal foreperiod task, which comprised a subset of surprising events not eliciting updating. EEG data were analyzed through a regression-based massive approach in the electrode and source space. Distinct late positive, centro-parietally distributed, event-related potentials (ERPs) were associated with surprise and belief updating in the electrode space. While surprise modulated the commonly observed P3b, updating was associated with a later and more sustained P3b-like waveform deflection. Results from source analyses revealed that neural encoding of surprise comprises neural activity in the cingulo-opercular network (CON) and parietal regions. These data provide evidence that temporal predictions are computed in a Bayesian manner, and that this is reflected in P3 modulations, akin to other cognitive domains. Overall, our study revealed that analyzing P3 modulations provides an important window into the Bayesian brain. Data and scripts are shared on OSF: https://osf.io/ckqa5/.

Medial prefrontal cortex and the temporal control of action

Across species, the medial prefrontal cortex guides actions in time. This process can be studied using behavioral paradigms such as simple reaction-time and interval-timing tasks. Temporal control of action can be influenced by prefrontal neurotransmitters such as dopamine and acetylcholine and is highly relevant to human diseases such as Parkinson's disease, schizophrenia, and attention-deficit hyperactivity disorder (ADHD). We review evidence that across species, medial prefrontal lesions impair the temporal control of action. We then consider neurophysiological correlates in humans, primates, and rodents that might encode temporal processing and relate to cognitive-control mechanisms. These data have informed brain-stimulation studies in rodents and humans that can compensate for timing deficits. This line of work illuminates basic mechanisms of temporal control of action in the medial prefrontal cortex, which underlies a range of high-level cognitive processing and could contribute to new biomarkers and therapies for human brain diseases.

One Tap at a Time: Correlating Sensorimotor Synchronization with Brain Signatures of Temporal Processing

The ability to integrate our perceptions across sensory modalities and across time, to execute and coordinate movements, and to adapt to a changing environment rests on temporal processing. Timing is essential for basic daily tasks, such as walking, social interaction, speech and language comprehension, and attention. Impaired temporal processing may contribute to various disorders, from attention-deficit hyperactivity disorder and schizophrenia to Parkinson’s disease and dementia. The foundational importance of timing ability has yet to be fully understood; and popular tasks used to investigate behavioral timing ability, such as sensorimotor synchronization (SMS), engage a variety of processes in addition to the neural processing of time. The present study utilizes SMS in conjunction with a separate passive listening task that manipulates temporal expectancy while recording electroencephalographic data. Participants display a larger N1-P2 evoked potential complex to unexpected beats relative to temporally predictable beats, a differential we call the timing response index (TRI). The TRI correlates with performance on the SMS task: better synchronizers show a larger brain response to unexpected beats. The TRI, derived from the perceptually driven N1-P2 complex, disentangles the perceptual and motor components inherent in SMS and thus may serve as a neural marker of a more general temporal processing.

Cognitive flexibility and N2/P3 event-related brain potentials

Task switching is often considered for evaluating limitations of cognitive flexibility. Switch costs are behavioural indices of limited cognitive flexibility, and switch costs may be decomposable into stimulus- and response-related fractions, as conjectured by the domain hypothesis of cognitive flexibility. According to the domain hypothesis, there exist separable stimulus- and response-related neural networks for cognitive flexibility, which should be discernible as distinct event-related potentials (ERPs). The present card-matching study allowed isolating stimulus- and response-related switch costs, while measuring ERPs evoked by task cues and target stimuli with a focus on the target-locked N2/P3 complex. Behavioural data revealed that both stimulus-task and response-task bindings contribute to switch costs. Cue-locked ERPs yielded larger anterior negativity/posterior positivity in response to switch cues compared to repeat cues. Target-locked ERPs revealed separable ERP correlates of stimulus- and response-related switch costs. P3 waveforms with fronto-central scalp distributions emerged as a corollary of stimulus-related switch costs. Fronto-centrally distributed N2 waveforms occurred when stimulus-task and response-task bindings contributed jointly to switch costs. The reported N2/P3 ERP data are commensurate with the domain hypothesis according to which there exist separable stimulus- and response-related neural networks for cognitive flexibility.

Dynamic Brain Responses Modulated by Precise Timing Prediction in an Opposing Process

The brain function of prediction is fundamental for human beings to shape perceptions efficiently and successively. Through decades of effort, a valuable brain activation map has been obtained for prediction. However, much less is known about how the brain manages the prediction process over time using traditional neuropsychological paradigms. Here, we implemented an innovative paradigm for timing prediction to precisely study the temporal dynamics of neural oscillations. In the experiment recruiting 45 participants, expectation suppression was found for the overall electroencephalographic activity, consistent with previous hemodynamic studies. Notably, we found that N1 was positively associated with predictability while N2 showed a reversed relation to predictability. Furthermore, the matching prediction had a similar profile with no timing prediction, both showing an almost saturated N1 and an absence of N2. The results indicate that the N1 process showed a 'sharpening' effect for predictable inputs, while the N2 process showed a 'dampening' effect. Therefore, these two paradoxical neural effects of prediction, which have provoked wide confusion in accounting for expectation suppression, actually co-exist in the procedure of timing prediction but work in separate time windows. These findings strongly support a recently-proposed opposing process theory.

Precision Timing with α-β Oscillatory Coupling: Stopwatch or Motor Control?

Precise timing is crucial for many behaviors ranging from conversational speech to athletic performance. The precision of motor timing has been suggested to result from the strength of phase-amplitude coupling (PAC) between the phase of alpha oscillations (α, 8-12 Hz) and the power of beta activity (β, 14-30 Hz), herein referred to as α-β PAC. The amplitude of β oscillations has been proposed to code for temporally relevant information and the locking of β power to the phase of α oscillations to maintain timing precision. Motor timing precision has at least two sources of variability: variability of timekeeping mechanism and variability of motor control. It is ambiguous to which of these two factors α-β PAC should be ascribed: α-β PAC could index precision of stopwatch-like internal timekeeping mechanisms, or α-β PAC could index motor control precision. To disentangle these two hypotheses, we tested how oscillatory coupling at different stages of a time reproduction task related to temporal precision. Human participants encoded and subsequently reproduced a time interval while magnetoencephalography was recorded. The data show a robust α-β PAC during both the encoding and reproduction of a temporal interval, a pattern that cannot be predicted by motor control accounts. Specifically, we found that timing precision resulted from the trade-off between the strength of α-β PAC during the encoding and during the reproduction of intervals. These results support the hypothesis that α-β PAC codes for the precision of temporal representations in the human brain.

Neural anticipatory mechanisms predict faster reaction times and higher fluid intelligence

Higher cognitive ability is reliably linked to better performance on chronometric tasks (i.e., faster reaction times, RT), yet the neural basis of these effects remains unclear. Anticipatory processes represent compelling yet understudied potential mechanisms of these effects, which may facilitate performance through reducing the uncertainty surrounding the temporal onset of stimuli (temporal uncertainty) and/or facilitating motor readiness despite uncertainty about impending target locations (target uncertainty). Specifically, the contingent negative variation (CNV) represents a compelling candidate mechanism of anticipatory motor planning, while the alpha oscillation is thought to be sensitive to temporal contingencies in perceptual systems. The current study undertook a secondary analysis of a large data set (n = 91) containing choice RT, cognitive ability, and EEG measurements to help clarify these issues. Single-trial EEG analysis in conjunction with mixed-effects modeling revealed that higher fluid intelligence corresponded to faster RT on average. When considered together, temporal and target uncertainty moderated the RT-ability relationship, with higher ability being associated with greater resilience to both types of uncertainty. Target uncertainty attenuated the amplitude of the CNV for all participants, but higher ability individuals were more resilient to this effect. Similarly, only higher ability individuals showed increased prestimulus alpha power (at left-lateralized sites) during longer, more easily anticipated interstimulus intervals. Collectively, these findings emphasize top-down anticipatory processes as likely contributors to chronometry-ability correlations.

Relation between centro-parietal positivity and diffusion model parameters in both perceptual and memory-based decision making

Several studies have suggested that the centro-parietal positivity (CPP), an EEG potential occurring approximately 500 ms post-stimulus, reflects the accumulation of evidence for making a decision. Yet, most previous studies of the CPP focused exclusively on perceptual decisions with very simple stimuli. In this study, we examined how the dynamics of the CPP depended on the type of decision being made, and whether its slope was related to parameters of an accumulator model of decision making. We show initial evidence that memory- and perceptual decisions about carefully-controlled face stimuli exhibit similar dynamics, but offset by a time difference in decision onset. Importantly, the individual-trial slopes of the CPP are related to the accumulator model's drift parameter. These findings help to further understand the role of the CPP across different kinds of decisions.

Differences in the temporal processing between identification and categorization of durations: A behavioral and ERP study

This study examined how different forms of decision-making modulate time perception. Participants performed temporal bisection and generalization tasks, requiring them to either categorize a stimulus duration as more similar to short or long standards (bisection), or identify whether or not a duration was the same as a previously-presented standard (generalization). They responded faster in the bisection task than in the generalization one for long durations. This behavioral effect was accompanied by modulation of event-related potentials (ERPs). More specifically, between 500 ms and 600 ms after stimulus offset, a late positive component (LPC), appearing in the centro-parietal region, showed lower amplitude in the bisection task than in the generalization one, for long durations, mirroring the behavioral result. Before (200-500 ms) and after (600-800 ms) this window, the amplitude of the LPC was globally larger in the generalization paradigm, independently of the presented duration. Finally, the LPC amplitude was higher for long durations than for shorter ones at the beginning of the component (between 200 and 300 ms after stimulus extinction) and was then higher for short durations than for longer ones (between 300 and 600 ms after offset), indicating that the decision about the former stimuli was made earlier than for the latter ones. Taken together, these results indicate that the categorization of durations engages fewer cognitive resources than their identification.

Genetic influence alters the brain synchronism in perception and timing

Background

Studies at the molecular level aim to integrate genetic and neurobiological data to provide an increasingly detailed understanding of phenotypes related to the ability in time perception.

Main Text

This study suggests that the polymorphisms genetic SLC6A4 5-HTTLPR, 5HTR2A T102C, DRD2/ANKK1-Taq1A, SLC6A3 3’-UTR VNTR, COMT Val158Met, CLOCK genes and GABRB2 A/C as modification factor at neurochemical levels associated with several neurofunctional aspects, modifying the circadian rhythm and built-in cognitive functions in the timing. We conducted a literature review with 102 studies that met inclusion criteria to synthesize findings on genetic polymorphisms and their influence on the timing.

Conclusion

The findings suggest an association of genetic polymorphisms on behavioral aspects related in timing. However, order to confirm the paradigm of association in the timing as a function of the molecular level, still need to be addressed future research.

Performance-informed EEG analysis reveals mixed evidence for EEG signatures unique to the processing of time

Certain EEG components (e.g., the contingent negative variation, CNV, or beta oscillations) have been linked to the perception of temporal magnitudes specifically. However, it is as of yet unclear whether these EEG components are really unique to time perception or reflect the perception of magnitudes in general. In the current study we recorded EEG while participants had to make judgments about duration (time condition) or numerosity (number condition) in a comparison task. This design allowed us to directly compare EEG signals between the processing of time and number. Stimuli consisted of a series of blue dots appearing and disappearing dynamically on a black screen. Each stimulus was characterized by its duration and the total number of dots that it consisted of. Because it is known that tasks like these elicit perceptual interference effects that we used a maximum-likelihood estimation (MLE) procedure to determine, for each participant and dimension separately, to what extent time and numerosity information were taken into account when making a judgement in an extensive post hoc analysis. This approach enabled us to capture individual differences in behavioral performance and, based on the MLE estimates, to select a subset of participants who suppressed task-irrelevant information. Even for this subset of participants, who showed no or only small interference effects and thus were thought to truly process temporal information in the time condition and numerosity information in the number condition, we found CNV patterns in the time-domain EEG signals for both tasks that was more pronounced in the time-task. We found no substantial evidence for differences between the processing of temporal and numerical information in the time–frequency domain.

Oscillation patterns of local field potentials in the dorsal striatum and sensorimotor cortex during the encoding, maintenance, and decision stages for the ordinal comparison of sub- and supra-second signal durations

Ordinal comparison of successively presented signal durations requires (a) the encoding of the first signal duration (standard), (b) maintenance of temporal information specific to the standard duration in memory, and (c) timing of the second signal duration (comparison) during which a comparison is made of the first and second durations. Rats were first trained to make ordinal comparisons of signal durations within three time ranges using 0.5, 1.0, and 3.0-s standard durations. Local field potentials were then recorded from the dorsal striatum and sensorimotor cortex in order to investigate the pattern of neural oscillations during each phase of the ordinal-comparison process. Increased power in delta and theta frequency ranges was observed during both the encoding and comparison stages. Active maintenance of a selected response, "shorter" or "longer" (counter-balanced across left and right levers), was represented by an increase of theta and delta oscillations in the contralateral striatum and cortex. Taken together, these data suggest that neural oscillations in the delta-theta range play an important role in the encoding, maintenance, and comparison of signal durations.

Spatiotemporal brain dynamics of auditory temporal assimilation

Time is a fundamental dimension, but millisecond-level judgments sometimes lead to perceptual illusions. We previously introduced a “time-shrinking illusion” using a psychological paradigm that induces auditory temporal assimilation (ATA). In ATA, the duration of two successive intervals (T₁ and T₂), marked by three auditory stimuli, can be perceived as equal when they are not. Here, we investigate the spatiotemporal profile of human temporal judgments using magnetoencephalography (MEG). Behavioural results showed typical ATA: participants judged T₁ and T₂ as equal when T₂ − T₁ ≤ +80 ms. MEG source-localisation analysis demonstrated that regional activity differences between judgment and no-judgment conditions emerged in the temporoparietal junction (TPJ) during T₂. This observation in the TPJ may indicate its involvement in the encoding process when T₁ ≠ T₂. Activation in the inferior frontal gyrus (IFG) was enhanced irrespective of the stimulus patterns when participants engaged in temporal judgment. Furthermore, just after the final marker, activity in the IFG was enhanced specifically for the time-shrinking pattern. This indicates that activity in the IFG is also related to the illusory perception of time-interval equality. Based on these observations, we propose neural signatures for judgments of temporal equality in the human brain.

Dynamic representation of time in brain states

The ability to process time on the scale of milliseconds and seconds is essential for behaviour. A growing number of studies have started to focus on brain dynamics as a mechanism for temporal encoding. Although there is growing evidence in favour of this view from computational and in vitro studies, there is still a lack of results from experiments in humans. We show that high-dimensional brain states revealed by multivariate pattern analysis of human EEG are correlated to temporal judgements. First, we show that, as participants estimate temporal intervals, the spatiotemporal dynamics of their brain activity are consistent across trials. Second, we present evidence that these dynamics exhibit properties of temporal perception, such as scale invariance. Lastly, we show that it is possible to predict temporal judgements based on brain states. These results show how scalp recordings can reveal the spatiotemporal dynamics of human brain activity related to temporal processing.

Electrophysiological correlates of motion extrapolation: An investigation on the CNV

Motion extrapolation (ME), the ability to estimate the current position of moving objects hidden by an occluder, is critical to interact with a dynamic environment. In a typical paradigm, participants estimate time to contact (TTC) by pressing a button when they estimate the occluded moving target reaches a certain cue. Research using this paradigm has shown that motion adaptation of the occluded area produces a shift in the TTC estimate (Gilden et al., 1995). We examined the effect of motion adaptation on the contingent negative variation (CNV), a frontal electrophysiological component (Tecce, 1972) that could reflect the activity of an accumulator (Buhusi and Meck, 2005) for time processing. We predicted that longer TTC estimates due to previous visual motion adaptation would result in a larger CNV because the accumulator can collect more time units. Results showed that motion adaptation actually modulates the CNV, but the CNV amplitude did not correlate with TTC duration, falsifying the accumulator hypothesis. We suggest that motion adaptation interferes with the remembered speed (stored during the visible part of the trajectory) that may be used as input by higher cognitive function to guide the temporal update of target position, regardless of the TTC estimate.

Pupillary response indexes the metrical hierarchy of unattended rhythmic violations

The perception of music is a complex interaction between what we hear and our interpretation. This is reflected in beat perception, in which a listener infers a regular pulse from a musical rhythm. Although beat perception is a fundamental human ability, it is still unknown whether attention to the music is necessary to establish the perception of stronger and weaker beats, or meter. In addition, to what extent beat perception is dependent on musical expertise is still a matter of debate. Here, we address these questions by measuring the pupillary response to omissions at different metrical positions in drum rhythms, while participants attended to another task. We found that the omission of the salient first beat elicited a larger pupil dilation than the omission of the less-salient second beat. This result shows that participants not only detected the beat without explicit attention to the music, but also perceived a metrical hierarchy of stronger and weaker beats. This suggests that hierarchical beat perception is an automatic process that requires no or minimal attentional resources. In addition, we found no evidence for the hypothesis that hierarchical beat perception is affected by musical expertise, suggesting that elementary beat perception might be independent from musical expertise. Finally, our results show that pupil dilation reflects surprise without explicit attention, demonstrating that the pupil is an accessible index to signatures of unattentive processing.

The role of cortical beta oscillations in time estimation

Estimation of time is central to perception, action, and cognition. Human functional magnetic resonance imaging (fMRI) and positron emission topography (PET) have revealed a positive correlation between the estimation of multi-second temporal durations and neuronal activity in a circuit of sensory and motor areas, prefrontal and temporal cortices, basal ganglia, and cerebellum. The systems-level mechanisms coordinating the collective neuronal activity in these areas have remained poorly understood. Synchronized oscillations regulate communication in neuronal networks and could hence serve such coordination, but their role in the estimation and maintenance of multi-second time intervals has remained largely unknown. We used source-reconstructed magnetoencephalography (MEG) to address the functional significance of local neuronal synchronization, as indexed by the amplitudes of cortical oscillations, in time-estimation. MEG was acquired during a working memory (WM) task where the subjects first estimated and then memorized the durations, or in the contrast condition, the colors of dynamic visual stimuli. Time estimation was associated with stronger beta (β, 14 - 30 Hz) band oscillations than color estimation in sensory regions and attentional cortical structures that earlier have been associated with time processing. In addition, the encoding of duration information was associated with strengthened gamma- (γ, 30 - 120 Hz), and the retrieval and maintenance with alpha- (α, 8 - 14 Hz) band oscillations. These data suggest that β oscillations may provide a mechanism for estimating short temporal durations, while γ and α oscillations support their encoding, retrieval, and maintenance in memory. Hum Brain Mapp 37:3262-3281, 2016. © 2016 Wiley Periodicals, Inc.