Duration estimation entails predicting when

Blocked versus interleaved: How range contexts modulate time perception and its EEG signatures

Accurate time perception is a crucial element in a wide range of cognitive tasks, including decision-making, memory, and motor control. One commonly observed phenomenon is that when given a range of time intervals to consider, people's estimates often cluster around the midpoint of those intervals. Previous studies have suggested that the range of these intervals can also influence our judgments, but the neural mechanisms behind this "range effect" are not yet understood. We used both behavioral tests and electroencephalographic (EEG) measures to understand how the range of sample time intervals affects the accuracy of people's subsequent time estimates. Study participants were exposed to two different setups: In the "blocked-range" (BR) session, short and long intervals were presented in separate blocks, whereas in the "interleaved-range" (IR) session, intervals of various lengths were presented randomly. Our findings indicated that the BR context led to more accurate time estimates compared to the IR context. In terms of EEG data, the BR context resulted in quicker buildup of contingent negative variation (CNV), which also reached higher amplitude levels and dissolved more rapidly during the encoding stage. We also observed an enhanced amplitude in the offset P2 component of the EEG signal. Overall, our results suggest that the variability in time intervals, as defined by their range, influences the neural processes that underlie time estimation.

Interval timing in a hierarchical violation-of-expectation task: Dissociable effects of local and global predictions

Predictability associated with an event influences its perceived time. The two forms of predictions that are often discussed and have a dissociable influence on perceived time are repetition and expectation. However, predictions based on expectation can be seen at multiple levels, potentially leading to an inconsistency in the pattern in which expectation influences perceived time. Therefore, the present study aimed to investigate how different levels of predictions impact perceived time. In two separate experiments utilizing visual and auditory stimuli, we used a hierarchical violation-of-expectation paradigm that can dissociate two types of predictions based on local and global rules. Results from analysis of variance computed with local and global predictions revealed a pattern of local and global predictions having a distinct influence on perceived time. More specifically, while the local predictions that consider the immediate stimulus exposure reduced the perceived time, the global predictions that consider the overall regularities of a given context increased the perceived time. These results integrate well with the recent theoretical models rooted in a predictive coding framework that emphasizes the opposing effects of the first order and second order predictions on perceived time.

Implicit Versus Explicit Timing-Separate or Shared Mechanisms?

Time implicitly shapes cognition, but time is also explicitly represented, for instance, in the form of durations. Parsimoniously, the brain could use the same mechanisms for implicit and explicit timing. Yet, the evidence has been equivocal, revealing both joint versus separate signatures of timing. Here, we directly compared implicit and explicit timing using magnetoencephalography, whose temporal resolution allows investigating the different stages of the timing processes. Implicit temporal predictability was induced in an auditory paradigm by a manipulation of the foreperiod. Participants received two consecutive task instructions: discriminate pitch (indirect measure of implicit timing) or duration (direct measure of explicit timing). The results show that the human brain efficiently extracts implicit temporal statistics of sensory environments, to enhance the behavioral and neural responses to auditory stimuli, but that those temporal predictions did not improve explicit timing. In both tasks, attentional orienting in time during predictive foreperiods was indexed by an increase in alpha power over visual and parietal areas. Furthermore, pretarget induced beta power in sensorimotor and parietal areas increased during implicit compared to explicit timing, in line with the suggested role for beta oscillations in temporal prediction. Interestingly, no distinct neural dynamics emerged when participants explicitly paid attention to time, compared to implicit timing. Our work thus indicates that implicit timing shapes the behavioral and sensory response in an automatic way and is reflected in oscillatory neural dynamics, whereas the translation of implicit temporal statistics to explicit durations remains somewhat inconclusive, possibly because of the more abstract nature of this task.

Precision Timing with α-β Oscillatory Coupling: Stopwatch or Motor Control?

Precise timing is crucial for many behaviors ranging from conversational speech to athletic performance. The precision of motor timing has been suggested to result from the strength of phase-amplitude coupling (PAC) between the phase of alpha oscillations (α, 8-12 Hz) and the power of beta activity (β, 14-30 Hz), herein referred to as α-β PAC. The amplitude of β oscillations has been proposed to code for temporally relevant information and the locking of β power to the phase of α oscillations to maintain timing precision. Motor timing precision has at least two sources of variability: variability of timekeeping mechanism and variability of motor control. It is ambiguous to which of these two factors α-β PAC should be ascribed: α-β PAC could index precision of stopwatch-like internal timekeeping mechanisms, or α-β PAC could index motor control precision. To disentangle these two hypotheses, we tested how oscillatory coupling at different stages of a time reproduction task related to temporal precision. Human participants encoded and subsequently reproduced a time interval while magnetoencephalography was recorded. The data show a robust α-β PAC during both the encoding and reproduction of a temporal interval, a pattern that cannot be predicted by motor control accounts. Specifically, we found that timing precision resulted from the trade-off between the strength of α-β PAC during the encoding and during the reproduction of intervals. These results support the hypothesis that α-β PAC codes for the precision of temporal representations in the human brain.

A generic deviance detection principle for cortical On/Off responses, omission response, and mismatch negativity

Neural responses to sudden changes can be observed in many parts of the sensory pathways at different organizational levels. For example, deviants that violate regularity at various levels of abstraction can be observed as simple On/Off responses of individual neurons or as cumulative responses of neural populations. The cortical deviance-related responses supporting different functionalities (e.g., gap detection, chunking, etc.) seem unlikely to arise from different function-specific neural circuits, given the relatively uniform and self-similar wiring patterns across cortical areas and spatial scales. Additionally, reciprocal wiring patterns (with heterogeneous combinations of excitatory and inhibitory connections) in the cortex naturally speak in favor of a generic deviance detection principle. Based on this concept, we propose a network model consisting of reciprocally coupled neural masses as a blueprint of a universal change detector. Simulation examples reproduce properties of cortical deviance-related responses including the On/Off responses, the omitted-stimulus response (OSR), and the mismatch negativity (MMN). We propose that the emergence of change detectors relies on the involvement of disinhibition. An analysis of network connection settings further suggests a supportive effect of synaptic adaptation and a destructive effect of N-methyl-D-aspartate receptor (NMDA-r) antagonists on change detection. We conclude that the nature of cortical reciprocal wiring gives rise to a whole range of local change detectors supporting the notion of a generic deviance detection principle. Several testable predictions are provided based on the network model. Notably, we predict that the NMDA-r antagonists would generally dampen the cortical Off response, the cortical OSR, and the MMN.

Activity in perceptual classification networks as a basis for human subjective time perception

Despite being a fundamental dimension of experience, how the human brain generates the perception of time remains unknown. Here, we provide a novel explanation for how human time perception might be accomplished, based on non-temporal perceptual classification processes. To demonstrate this proposal, we build an artificial neural system centred on a feed-forward image classification network, functionally similar to human visual processing. In this system, input videos of natural scenes drive changes in network activation, and accumulation of salient changes in activation are used to estimate duration. Estimates produced by this system match human reports made about the same videos, replicating key qualitative biases, including differentiating between scenes of walking around a busy city or sitting in a cafe or office. Our approach provides a working model of duration perception from stimulus to estimation and presents a new direction for examining the foundations of this central aspect of human experience.

Perceived duration of auditory oddballs: test of a novel pitch-window hypothesis

Unexpected oddball stimuli embedded within a series of otherwise identical standard stimuli tend to be overestimated in duration. The present study tested a pitch-window explanation of the auditory oddball effect on perceived duration in two experiments. For both experiments, participants listened to isochronous sequences consisting of a series of 400 Hz fixed-duration standard tones with an embedded oddball tone that differed in pitch and judged whether the variable-duration oddball was shorter or longer than the standard. Participants were randomly assigned to either a wide or narrow pitch-window condition, in which an anchor oddball was presented with high likelihood at either a far pitch (850 Hz) or a near pitch (550 Hz), respectively. In both pitch-window conditions, probe oddballs were presented with low likelihood at pitches that were either within or outside the frequency range established by the standard and anchor tones. Identical 700 Hz probe oddballs were perceived to be shorter in duration in the wide pitch-window condition than in the narrow pitch-window condition (Experiments 1 and 2), even when matching the overall frequency range of oddballs across conditions (Experiment 2). Results support the proposed pitch-window hypothesis, but are inconsistent with both enhanced processing and predictive coding accounts of the oddball effect.

Diminished neural resources allocation to time processing in Autism Spectrum Disorders

Background

Interval timing, the ability to judge the duration of short events, has been shown to be compromised in Autism Spectrum Disorders (ASD). Timing abilities are ubiquitous and underlie behaviours as varied as sensory integration, motor coordination or communication. It has been suggested that atypical temporal processing in ASD could contribute to some of the disorder's symptoms, in particular motor clumsiness and difficulties in social interaction and communication. Recent behavioural investigations have suggested that interval timing in ASD is characterised by intact sensitivity but reduced precision in duration judgements.

Methods

In this study we investigated the processing of duration as compared to pitch in a group of high-functioning individuals with ASD using magnetoencephalography (MEG). 18 adolescents and adults with ASD and 18 age- and IQ-matched typically-developing control (TDC) individuals compared two consecutive tones according to their duration or pitch in separate experimental blocks. The analysis was carried out exclusively on physically identical stimuli (500 Hz tones lasting 600 ms), which served, according to instruction, as standard or probe in a Duration or Pitch task respectively.

Results

Our results suggest that compared to TDC individuals, individuals with ASD are less able to predict the duration of the standard tone accurately, affecting the sensitivity of the comparison process. In addition, contrary to TDC individuals who allocate resources at different times depending on the nature of the task (pitch or duration discrimination), individuals with ASD seem to engage less resources for the Duration task than for the Pitch task regardless of the context. Although individuals with ASD showed top-down adaptation to the context of the task, this neuronal strategy reflects a bias in the readiness to perform different types of tasks, and in particular a diminished allocation of resources to duration processing which could have cascading effect on learning and development of other cognitive functions.

•

We investigated MEG response associated with duration or pitch comparison in ASD.

•

We found lower sensitivity for duration discrimination behaviourally in ASD.

•

ASD adults are less able to predict the offset of a standard tone.

•

ASD adults engage less neural resources in duration than pitch discrimination task.

Spatiotemporal brain dynamics of auditory temporal assimilation

Time is a fundamental dimension, but millisecond-level judgments sometimes lead to perceptual illusions. We previously introduced a “time-shrinking illusion” using a psychological paradigm that induces auditory temporal assimilation (ATA). In ATA, the duration of two successive intervals (T₁ and T₂), marked by three auditory stimuli, can be perceived as equal when they are not. Here, we investigate the spatiotemporal profile of human temporal judgments using magnetoencephalography (MEG). Behavioural results showed typical ATA: participants judged T₁ and T₂ as equal when T₂ − T₁ ≤ +80 ms. MEG source-localisation analysis demonstrated that regional activity differences between judgment and no-judgment conditions emerged in the temporoparietal junction (TPJ) during T₂. This observation in the TPJ may indicate its involvement in the encoding process when T₁ ≠ T₂. Activation in the inferior frontal gyrus (IFG) was enhanced irrespective of the stimulus patterns when participants engaged in temporal judgment. Furthermore, just after the final marker, activity in the IFG was enhanced specifically for the time-shrinking pattern. This indicates that activity in the IFG is also related to the illusory perception of time-interval equality. Based on these observations, we propose neural signatures for judgments of temporal equality in the human brain.

Electrophysiological correlates of motion extrapolation: An investigation on the CNV

Motion extrapolation (ME), the ability to estimate the current position of moving objects hidden by an occluder, is critical to interact with a dynamic environment. In a typical paradigm, participants estimate time to contact (TTC) by pressing a button when they estimate the occluded moving target reaches a certain cue. Research using this paradigm has shown that motion adaptation of the occluded area produces a shift in the TTC estimate (Gilden et al., 1995). We examined the effect of motion adaptation on the contingent negative variation (CNV), a frontal electrophysiological component (Tecce, 1972) that could reflect the activity of an accumulator (Buhusi and Meck, 2005) for time processing. We predicted that longer TTC estimates due to previous visual motion adaptation would result in a larger CNV because the accumulator can collect more time units. Results showed that motion adaptation actually modulates the CNV, but the CNV amplitude did not correlate with TTC duration, falsifying the accumulator hypothesis. We suggest that motion adaptation interferes with the remembered speed (stored during the visible part of the trajectory) that may be used as input by higher cognitive function to guide the temporal update of target position, regardless of the TTC estimate.

Entire Sound Representations Are Time-Compressed in Sensory Memory: Evidence from MMN

In order to examine the encoding of partial silence included in a sound stimulus in neural representation, time flow of the sound representations was investigated using mismatch negativity (MMN), an ERP component that reflects neural representation in auditory sensory memory. Previous work suggested that time flow of auditory stimuli is compressed in neural representations. The stimuli used were a full-stimulus of 170 ms duration, an early-gap stimulus with silence for a 20–50 ms segment (i.e., an omitted segment), and a late-gap stimulus with an omitted segment of 110–140 ms. Peak MMNm latencies from oddball sequences of these stimuli, with a 500 ms SOA, did not reflect time point of the physical gap, suggesting that temporal information can be compressed in sensory memory. However, it was not clear whether the whole stimulus duration or only the omitted segment duration is compressed. Thus, stimuli were used in which the gap was replaced by a tone segment with a 1/4 sound pressure level (filled), as well as the gap stimuli. Combinations of full-stimuli and one of four gapped or filled stimuli (i.e., early gap, late gap, early filled, and late filled) were presented in an oddball sequence (85 vs. 15%). If compression occurs only for the gap duration, MMN latency for filled stimuli should show a different pattern from those for gap stimuli. MMN latencies for the filled conditions showed the same pattern as those for the gap conditions, indicating that the whole stimulus duration rather than only gap duration is compressed in sensory memory neural representation. These results suggest that temporal aspects of silence are encoded in the same manner as physical sound.

The role of cortical beta oscillations in time estimation

Estimation of time is central to perception, action, and cognition. Human functional magnetic resonance imaging (fMRI) and positron emission topography (PET) have revealed a positive correlation between the estimation of multi-second temporal durations and neuronal activity in a circuit of sensory and motor areas, prefrontal and temporal cortices, basal ganglia, and cerebellum. The systems-level mechanisms coordinating the collective neuronal activity in these areas have remained poorly understood. Synchronized oscillations regulate communication in neuronal networks and could hence serve such coordination, but their role in the estimation and maintenance of multi-second time intervals has remained largely unknown. We used source-reconstructed magnetoencephalography (MEG) to address the functional significance of local neuronal synchronization, as indexed by the amplitudes of cortical oscillations, in time-estimation. MEG was acquired during a working memory (WM) task where the subjects first estimated and then memorized the durations, or in the contrast condition, the colors of dynamic visual stimuli. Time estimation was associated with stronger beta (β, 14 - 30 Hz) band oscillations than color estimation in sensory regions and attentional cortical structures that earlier have been associated with time processing. In addition, the encoding of duration information was associated with strengthened gamma- (γ, 30 - 120 Hz), and the retrieval and maintenance with alpha- (α, 8 - 14 Hz) band oscillations. These data suggest that β oscillations may provide a mechanism for estimating short temporal durations, while γ and α oscillations support their encoding, retrieval, and maintenance in memory. Hum Brain Mapp 37:3262-3281, 2016. © 2016 Wiley Periodicals, Inc.

Single trial beta oscillations index time estimation

Recent work shows that putamen-originating beta power oscillations serve as a carrier for temporal information during tapping tasks, with higher beta power associated with longer temporal reproductions. However, given the nature of tapping tasks, it is difficult to determine whether beta power dynamics observed in these tasks are linked to the generation or execution of motor programs or to the internal representation of time. To assess whether recent findings in animals generalize to human studies we reanalyzed existing EEG data of participants who estimated a 2.5s time interval with self-paced onset and offset keypresses. The results showed that the trial-to-trial beta power measured after the onset predicts the produced duration, such that higher beta power indexes longer produced durations. Moreover, although beta power measured before the first key-press also influenced the estimated interval, it did so independently from post-first-keypress beta power. These results suggest that initial motor inhibition plays an important role in interval production, and that this inhibition can be interpreted as a biased starting point of the decision processes involved in time estimation.

Repetition enhancement and memory effects for duration

A remarkable aspect of conscious perception is that moments carryover from one to the next, also known as temporal continuity. This ability is thus crucial for detecting regularities, such as in speech and music, and may rely on an accurate perception of time. Investigations of human time perception have detailed two electroencephalographic (EEG) components associated with timing, the contingent negative variation (CNV) and late positive component of timing (LPCt); however, the precise roles of these components in timing remain elusive. Recently, we demonstrated that the perception of duration is influenced by durations presented on prior trials, which we explained by the creation of an implicit memory standard that adapts to local changes in sequence presentation. Here, we turn to the neural basis of this effect. Human participants performed a temporal bisection task in which they were required to classify the duration of auditory stimuli into short and long duration categories; crucially, the presentation order was first-order counterbalanced, allowing us to measure the effect of each presented duration on the next. EEG recordings revealed that the CNV and LPCt signals both covaried with the duration presented on the current trial, with CNV predicting reaction time and LPCt predicting choice. Additionally, both signals covaried with the duration presented in the prior trial but in different ways, with the CNV amplitude reflecting the change in the memory standard and the LPCt reflecting decision uncertainty. Furthermore, we observed a repetition enhancement effect of duration only for the CNV, suggesting that this signal additionally indexes the similarity of successive durations. These findings demonstrate dissociable roles for the CNV and LPCt, and demonstrate that both signals are continuously updated on a trial-by-trial basis that reflects shifts in temporal decisions.