Neural correlates of subsecond time distortion in the middle temporal area of visual cortex

The role of perceptual processing in the oddball effect revealed by the Thatcher illusion

When a novel stimulus (oddball) appears after repeated presentation of an identical stimulus, the oddball is perceived to last longer than the repeated stimuli, a phenomenon known as the oddball effect. We investigated whether the perceptual or physical differences between the repeated and oddball stimuli are more important for the oddball effect. To manipulate the perceptual difference while keeping their physical visual features constant, we used the Thatcher illusion, in which an inversion of a face hinders recognition of distortion in its facial features. We found that the Thatcherized face presented after repeated presentation of an intact face induced a stronger oddball effect when the faces were upright than when they were inverted (Experiment 1). However, the difference in the oddball effect between face orientations was not observed when the intact face was presented as the oddball after repeated presentation of a Thatcherized face (Experiment 2). These results were replicated when participants performed both the intact-repeated and Thatcherized-repeated conditions in a single experiment (Experiment 3). Two control experiments confirmed that the repeated presentation of the preceding stimuli is necessary for the difference in duration distortion to occur (Experiments 4 and 5). The results suggest the considerable role of perceptual processing in the oddball effect. We discuss the discrepancy in the results between the intact-repeated and Thatcherized-repeated conditions in terms of predictive coding.

Increase in speed eliminates duration expansion of a novel motion stimulus

A novel motion stimulus is perceived to last longer than the subsequent motion stimulus moving in the opposite direction. A previous study suggested that the discrepancy in the processing latency for different onset types, as measured by reaction time, may play a role in this duration expansion. The present study examined whether the speed of motion stimuli influences this duration expansion. Experiment 1 demonstrated that the duration expansion ceased to occur when the stimulus speed increased. Experiment 2 showed that the increase in the speed reduced the reaction time for various onset types. However, the size of the changes in the reaction time did not match the reduction in the magnitude of the duration expansion observed in Experiment 1. These results suggest that the increase in speed eliminates the duration expansion of the novel motion stimulus, but the difference in the processing latency alone may not be the sole mechanism.

Sound reduces saccadic chronostasis illusion

The saccadic chronostasis illusion refers to the duration overestimation of the first visual stimulation after saccadic eye movement, which is also known as "stopped clock illusion." The present study investigated whether saccadic chronostasis would be observed in the auditory modality and whether the saccade-induced time dilation in the visual modality would be reduced by a synchronously presented sound. In each trial, a unisensory visual stimulus, unisensory sound, or bimodal audio-visual stimulus with a duration of 200-800 ms (probe stimulus) was presented at the saccade target location and temporally around the offset of the saccade, followed by a unisensory visual or auditory standard stimulus for a fixed 500 ms. Participants were required to identify which of the two stimuli (probe or standard) presented in the target modality (visual or auditory) was perceived as longer. The results showed that no saccadic chronostasis was observed in the auditory modality, regardless of whether the sound was presented alone or synchronously accompanied by a visual stimulus. Interestingly, the magnitude of the saccadic chronostasis illusion was reduced by the synchronously presented sound. Moreover, the combined effect of the saccade and sound on visual time perception fits well with the standard scalar model, and the weight of the cross-modal effect was higher than that of saccadic visual time dilation. These results suggest that sound dominates vision in time processing during saccades and linearly modulates saccadic chronostasis, which follows the Scalar Expectancy Theory.

An Illusory Motion in Stationary Stimuli Alters Their Perceived Duration

Despite having equal duration, stimuli in physical motion are perceived to last longer than static ones. Here, we investigate whether illusory motion stimuli produce a time-dilation effect similar to physical motion. Participants performed a duration discrimination task that compared the perceived duration of static stimuli with and without illusory motion to a reference stimulus. In the first experiment, we observed a 4% increase in the number of "longer" responses for the illusory motion images than static stimuli with equal duration. The time-dilation effect, quantified as a shift in the Point of Subjective Equality (PSE), was approximately 55 ms for a 2-second stimulus. Although small, the effect was replicated in a second experiment in which the total number of standard-duration repetitions was reduced from 73 to 19. In the third experiment, we found a positive linear trend between the strength of the illusory motion and the magnitude of the time-dilation effect. These results demonstrate that, similar to physical motion stimuli, illusory motion stimuli are perceived to last longer than static stimuli. Furthermore, the strength of the illusion influences the extent of the lengthening of perceived duration.

Changes in face category induce stronger duration distortion in the temporal oddball paradigm

A novel stimulus embedded in a sequence of repeated stimuli is often perceived to be longer in duration. Studies have indicated the involvement of repetition suppression in this duration distortion, but it remains unclear which processing stages are important. The present study examined whether high-level visual category processing contributes to the oddball's duration distortion. In Experiment 1, we presented a novel face image in either human, monkey, or cat category after a repetition of an identical human face image in the temporal oddball paradigm. We found that the duration distortion of the last stimulus increased when the face changed across different categories, than when it changed within the same category. However, the effect of category change disappeared when globally scrambled and locally scrambled face images were used in Experiments 2 and 3, respectively, suggesting that the difference in duration distortion cannot be attributed to low-level visual properties of the images. Furthermore, in Experiment 4, we again used intact face images and found that category changes can influence the duration distortion even when a series of different human faces was presented before the last stimulus. These findings indicate that high-level visual category processing plays an important role in the duration distortion of oddballs. This study supports the idea that visual processing at higher visual stages is involved in duration perception. (219 words).

Trial-by-trial predictions of subjective time from human brain activity

Human experience of time exhibits systematic, context-dependent deviations from clock time; for example, time is experienced differently at work than on holiday. Here we test the proposal that differences from clock time in subjective experience of time arise because time estimates are constructed by accumulating the same quantity that guides perception: salient events. Healthy human participants watched naturalistic, silent videos of up to 24 seconds in duration and estimated their duration while fMRI was acquired. We were able to reconstruct trial-by-trial biases in participants’ duration reports, which reflect subjective experience of duration, purely from salient events in their visual cortex BOLD activity. By contrast, salient events in neither of two control regions–auditory and somatosensory cortex–were predictive of duration biases. These results held despite being able to (trivially) predict clock time from all three brain areas. Our results reveal that the information arising during perceptual processing of a dynamic environment provides a sufficient basis for reconstructing human subjective time duration.

Our perception of time isn’t like a clock; it varies depending on other aspects of experience, such as what we see and hear in that moment. Previous studies have shown that differences in simple features, such as an image being larger or smaller, or brighter or dimmer, can change how we perceive time for those experiences. But in everyday life, the properties of these simple features can change frequently, presenting a challenge to understanding real-world time perception based on simple lab experiments. To overcome this problem, we developed a computational model of human time perception based on tracking changes in neural activity across brain regions involved in sensory processing (using non-invasive brain imaging). By measuring changes in brain activity patterns across these regions, our approach accommodates the different and changing feature combinations present in natural scenarios, such as walking on a busy street. Our model reproduces people’s duration reports for natural videos (up to almost half a minute long) and, most importantly, predicts whether a person reports a scene as relatively shorter or longer–the biases in time perception that reflect how natural experience of time deviates from clock time.

Interval timing in a hierarchical violation-of-expectation task: Dissociable effects of local and global predictions

Predictability associated with an event influences its perceived time. The two forms of predictions that are often discussed and have a dissociable influence on perceived time are repetition and expectation. However, predictions based on expectation can be seen at multiple levels, potentially leading to an inconsistency in the pattern in which expectation influences perceived time. Therefore, the present study aimed to investigate how different levels of predictions impact perceived time. In two separate experiments utilizing visual and auditory stimuli, we used a hierarchical violation-of-expectation paradigm that can dissociate two types of predictions based on local and global rules. Results from analysis of variance computed with local and global predictions revealed a pattern of local and global predictions having a distinct influence on perceived time. More specifically, while the local predictions that consider the immediate stimulus exposure reduced the perceived time, the global predictions that consider the overall regularities of a given context increased the perceived time. These results integrate well with the recent theoretical models rooted in a predictive coding framework that emphasizes the opposing effects of the first order and second order predictions on perceived time.

Linear vector models of time perception account for saccade and stimulus novelty interactions

Various models (e.g., scalar, state-dependent network, and vector models) have been proposed to explain the global aspects of time perception, but they have not been tested against specific visual phenomena like perisaccadic time compression and novel stimulus time dilation. Here, in two separate experiments (N = 31), we tested how the perceived duration of a novel stimulus is influenced by 1) a simultaneous saccade, in combination with 2) a prior series of repeated stimuli in human participants. This yielded a novel behavioral interaction: pre-saccadic stimulus repetition neutralizes perisaccadic time compression. We then tested these results against simulations of the above models. Our data yielded low correlations against scalar model simulations, high but non-specific correlations for our feedforward neural network, and correlations that were both high and specific for a vector model based on identity of objective and subjective time. These results demonstrate the power of global time perception models in explaining disparate empirical phenomena and suggest that subjective time has a similar essence to time's physical vector.

A sensory integration account for time perception

The connection between stimulus perception and time perception remains unknown. The present study combines human and rat psychophysics with sensory cortical neuronal firing to construct a computational model for the percept of elapsed time embedded within sense of touch. When subjects judged the duration of a vibration applied to the fingertip (human) or whiskers (rat), increasing stimulus intensity led to increasing perceived duration. Symmetrically, increasing vibration duration led to increasing perceived intensity. We modeled real spike trains recorded from vibrissal somatosensory cortex as input to dual leaky integrators-an intensity integrator with short time constant and a duration integrator with long time constant-generating neurometric functions that replicated the actual psychophysical functions of rats. Returning to human psychophysics, we then confirmed specific predictions of the dual leaky integrator model. This study offers a framework, based on sensory coding and subsequent accumulation of sensory drive, to account for how a feeling of the passage of time accompanies the tactile sensory experience.

Early posterior negativity indicates time dilation by arousal

We investigated whether Early Posterior Negativity (EPN) indicated the subjective dilation of time when judging the duration of arousing stimuli. Participants performed a visual temporal bisection task along with high-level and low-level arousing auditory stimuli, while we simultaneously recorded EEG. In accordance with previous studies, arousing stimuli were temporally overestimated and led to higher EPN amplitude. Yet, we observed that time dilation and EPN amplitude were significantly correlated and this effect cannot be explained by confounds from stimulus valence. We interpret our findings in terms of the pacemaker–accumulator model of human timing, and suggest that EPN indicates an arousal-based increasing of the speed of our mental clock.

Genetic influence alters the brain synchronism in perception and timing

Background

Studies at the molecular level aim to integrate genetic and neurobiological data to provide an increasingly detailed understanding of phenotypes related to the ability in time perception.

Main Text

This study suggests that the polymorphisms genetic SLC6A4 5-HTTLPR, 5HTR2A T102C, DRD2/ANKK1-Taq1A, SLC6A3 3’-UTR VNTR, COMT Val158Met, CLOCK genes and GABRB2 A/C as modification factor at neurochemical levels associated with several neurofunctional aspects, modifying the circadian rhythm and built-in cognitive functions in the timing. We conducted a literature review with 102 studies that met inclusion criteria to synthesize findings on genetic polymorphisms and their influence on the timing.

Conclusion

The findings suggest an association of genetic polymorphisms on behavioral aspects related in timing. However, order to confirm the paradigm of association in the timing as a function of the molecular level, still need to be addressed future research.

Visual-auditory differences in duration discrimination depend on modality-specific, sensory-automatic temporal processing: Converging evidence for the validity of the Sensory-Automatic Timing Hypothesis

The Sensory-Automatic Timing Hypothesis assumes visual-auditory differences in duration discrimination to originate from sensory-automatic temporal processing. Although temporal discrimination of extremely brief intervals in the range of tens-of-milliseconds is predicted to depend mainly on modality-specific, sensory-automatic temporal processing, duration discrimination of longer intervals is predicted to require more and more amodal, higher order cognitive resources and decreasing input from the sensory-automatic timing system with increasing interval duration. In two duration discrimination experiments with sensory modality as a within- and a between-subjects variable, respectively, we tested two decisive predictions derived from the Sensory-Automatic Timing Hypothesis: (1) visual-auditory differences in duration discrimination were expected to be larger for brief intervals in the tens-of-milliseconds range than for longer ones, and (2) visual-auditory differences in duration discrimination of longer intervals should disappear when statistically controlled for modality-specific input from the sensory-automatic timing system. In both experiments, visual-auditory differences in duration discrimination were larger for the brief than for the longer intervals. Furthermore, visual-auditory differences observed with longer intervals disappeared when statistically controlled for modality-specific input from the sensory-automatic timing system. Thus, our findings clearly confirmed the validity of the Sensory-Automatic Timing Hypothesis.

Triple dissociation of duration perception regulating mechanisms: Top-down attention is inherent

The brain constantly adjusts perceived duration based on the recent event history. One such lab phenomenon is subjective time expansion induced in an oddball paradigm ("oddball chronostasis"), where the duration of a distinct item (oddball) appears subjectively longer when embedded in a series of other repeated items (standards). Three hypotheses have been separately proposed but it remains unresolved which or all of them are true: 1) attention prolongs oddball duration, 2) repetition suppression reduces standards duration, and 3) accumulative temporal preparation (anticipation) expedites the perceived item onset so as to lengthen its duration. We thus conducted critical systematic experiments to dissociate the relative contribution of all hypotheses, by orthogonally manipulating sequences types (repeated, ordered, or random) and target serial positions. Participants' task was to judge whether a target lasts shorter or longer than its reference. The main finding was that a random item sequence still elicited significant chronostasis even though each item was odd. That is, simply being a target draws top-down attention and induces chronostasis. In Experiments 1 (digits) and 2 (orientations), top-down attention explained about half of the effect while saliency/adaptation explained the other half. Additionally, for non-repeated (ordered and random) sequence types, a target with later serial position still elicited stronger chronostasis, favoring a temporal preparation over a repetition suppression account. By contrast, in Experiment 3 (colors), top-down attention was likely the sole factor. Consequently, top-down attention is necessary and sometimes sufficient to explain oddball chronostasis; saliency/adaptation and temporal preparation are contingent factors. These critical boundary conditions revealed in our study serve as quantitative constraints for neural models of duration perception.

The P3 and the subjective experience of time

Our experience of time is often subject to distortions. For instance, time appears to slow down when unexpected events occur. Previous research has shown that the duration of infrequent stimuli - so-called oddballs - is commonly overestimated, an effect referred to as the temporal oddball effect. Oddballs are also known to cause a posterior P3, an event-related potential elicited by motivationally significant stimuli. Here, we propose that the temporal oddball effect and the posterior P3 share a common mechanism. We hypothesized that the P3 amplitude can be used to predict whether the duration of an oddball will be overestimated or not, even if this P3 precedes the offset of the stimulus. In our task, infrequent red targets were embedded in a series of white standards. All stimuli varied in duration and participants had to estimate the duration of the targets and some of the standards. Our data revealed that the duration of target oddballs, but not of standards, was overestimated and overestimations were associated with larger P3 amplitudes than correct short estimates. Because the P3 peaked before stimulus offset, this effect was independent of actual target oddball duration. Using multivariate pattern analysis, we provided direct evidence that it is indeed the P3 elicited by oddballs that caused this effect. Together, our results suggest that the temporal oddball effect is linked to the posterior P3. Based on these findings and established P3 theories, we propose that the common mechanism underlying both phenomena is a phasic norepinephrine response affecting the subjective experience of time.

Perceived Duration Increases with Contrast, but Only a Little

Recent adaptation studies provide evidence for early visual areas playing a role in duration perception. One explanation for the pronounced duration compression commonly found with adaptation is that it reflects adaptation-driven stimulus-specific reduction in neural activity in early visual areas. If this level of stimulus-associated neural activity does drive duration, then we would expect a strong effect of contrast on perceived duration as electrophysiological studies shows neural activity in early visual areas to be strongly related to contrast. We employed a spatially isotropic noise stimulus where the luminance of each noise element was independently sinusoidally modulated at 4 Hz. Participants matched the perceived duration of a high (0.9) or low (0.1) contrast stimulus to a previously presented standard stimulus (600 ms, contrast = 0.3). To achieve perceptually equivalent durations, the low contrast stimulus had to be presented for longer than the high contrast stimulus. This occurred when we controlled for stimulus size and when we adjusted for individual differences in perceived temporal frequency. Further, we show that the effect cannot be explained by shifts in perceived onset and offset and is not explained by a simple contrast-driven response bias. The direction of our results is clearly consistent with the idea that level of neural activity drives duration. However, the magnitude of the effect (~10% duration difference over a 0.9-0.1 contrast reduction) is in marked contrast to the larger duration distortions that can be found with repetition suppression and the oddball effect; particularly when these may be associated with smaller differences in neural activity than that expected from our contrast difference. Taken together, these results indicate that level of stimulus-related neural activity in early visual areas is unlikely to provide a general mechanism for explaining differences in perceived duration.

Effect of motion coherence on time perception relates to perceived speed

The present study examined the effect of coherence of moving visual objects on time perception. Participants observed stimuli composed of four line segments moving behind or in front of occluders. The line segments appeared to move either coherently as a diamond outline or incoherently, depending on the occlusion. Results from the temporal bisection task indicated that the duration of the coherently moving stimulus was perceived longer or shorter compared to the duration of the incoherently moving stimulus depending on the stimulus configurations. The speed comparison task revealed that the trend of the difference in perceived speed between the coherent and incoherent motions in each stimulus configuration was consistent with that of the difference in perceived duration between them. These results demonstrate the effect of motion coherence on perceived duration, and that this effect may be mediated by changes in perceived speed. Our finding provides evidence supporting the involvement of global motion processing in time perception.

Numerical Context and Time Perception: Contrast Effects and the Perceived Duration of Numbers

In the current study, we examined how the contextual repetition of magnitude information presented in either symbolic (Arabic digits) or nonsymbolic (numerosities) formats impacted on the perceived duration of a later occurring target number. The results of the current study demonstrated a time-magnitude bias in which, on average, large magnitude target numbers were judged to last for longer durations relative to small magnitude target numbers, regardless of notation (symbolic number and numerosity). Furthermore, context effects were found, in which a greater discrepancy in the target's magnitude from the initial context led to longer perceived duration ratings. However, this was found to be asymmetrical, occurring only for large magnitude targets. Additionally, the type of context effect was shown to be determined by whether the context was presented in the same notation as the target or a different notation.

Timing Rhythms: Perceived Duration Increases with a Predictable Temporal Structure of Short Interval Fillers

Variations in the temporal structure of an interval can lead to remarkable differences in perceived duration. For example, it has previously been shown that isochronous intervals, that is, intervals filled with temporally regular stimuli, are perceived to last longer than intervals left empty or filled with randomly timed stimuli. Characterizing the extent of such distortions is crucial to understanding how duration perception works. One account to explain effects of temporal structure is a non-linear accumulator-counter mechanism reset at the beginning of every subinterval. An alternative explanation based on entrainment to regular stimulation posits that the neural response to each filler stimulus in an isochronous sequence is amplified and a higher neural response may lead to an overestimation of duration. If entrainment is the key that generates response amplification and the distortions in perceived duration, then any form of predictability in the temporal structure of interval fillers should lead to the perception of an interval that lasts longer than a randomly filled one. The present experiments confirm that intervals filled with fully predictable rhythmically grouped stimuli lead to longer perceived duration than anisochronous intervals. No general over- or underestimation is registered for rhythmically grouped compared to isochronous intervals. However, we find that the number of stimuli in each group composing the rhythm also influences perceived duration. Implications of these findings for a non-linear clock model as well as a neural response magnitude account of perceived duration are discussed.

Perceived duration is reduced by repetition but not by high-level expectation

A repeated stimulus is judged as briefer than a novel one. It has been suggested that this duration illusion is an example of a more general phenomenon-namely that a more expected stimulus is judged as briefer than a less expected one. To test this hypothesis, we manipulated high-level expectation through the probability of a stimulus sequence, through the regularity of the preceding stimuli in a sequence, or through whether a stimulus violates an overlearned sequence. We found that perceived duration is not reduced by these types of expectation. Repetition of stimuli, on the other hand, consistently reduces perceived duration across our experiments. In addition, the effect of stimulus repetition is constrained to the location of the repeated stimulus. Our findings suggest that estimates of subsecond duration are largely the result of low-level sensory processing.

GABA predicts time perception

Our perception of time constrains our experience of the world and exerts a pivotal influence over a myriad array of cognitive and motor functions. There is emerging evidence that the perceived duration of subsecond intervals is driven by sensory-specific neural activity in human and nonhuman animals, but the mechanisms underlying individual differences in time perception remain elusive. We tested the hypothesis that elevated visual cortex GABA impairs the coding of particular visual stimuli, resulting in a dampening of visual processing and concomitant positive time-order error (relative underestimation) in the perceived duration of subsecond visual intervals. Participants completed psychophysical tasks measuring visual interval discrimination and temporal reproduction and we measured in vivo resting state GABA in visual cortex using magnetic resonance spectroscopy. Time-order error selectively correlated with GABA concentrations in visual cortex, with elevated GABA associated with a rightward horizontal shift in psychometric functions, reflecting a positive time-order error (relative underestimation). These results demonstrate anatomical, neurochemical, and task specificity and suggest that visual cortex GABA contributes to individual differences in time perception.

Subjective duration distortions mirror neural repetition suppression

BACKGROUND

Subjective duration is strongly influenced by repetition and novelty, such that an oddball stimulus in a stream of repeated stimuli appears to last longer in duration in comparison. We hypothesize that this duration illusion, called the temporal oddball effect, is a result of the difference in expectation between the oddball and the repeated stimuli. Specifically, we conjecture that the repeated stimuli contract in duration as a result of increased predictability; these duration contractions, we suggest, result from decreased neural response amplitude with repetition, known as repetition suppression.

METHODOLOGY/PRINCIPAL FINDINGS

Participants viewed trials consisting of lines presented at a particular orientation (standard stimuli) followed by a line presented at a different orientation (oddball stimulus). We found that the size of the oddball effect correlates with the number of repetitions of the standard stimulus as well as the amount of deviance from the oddball stimulus; both of these results are consistent with a repetition suppression hypothesis. Further, we find that the temporal oddball effect is sensitive to experimental context--that is, the size of the oddball effect for a particular experimental trial is influenced by the range of duration distortions seen in preceding trials.

CONCLUSIONS/SIGNIFICANCE

Our data suggest that the repetition-related duration contractions causing the oddball effect are a result of neural repetition suppression. More generally, subjective duration may reflect the prediction error associated with a stimulus and, consequently, the efficiency of encoding that stimulus. Additionally, we emphasize that experimental context effects need to be taken into consideration when designing duration-related tasks.

Time dilation caused by static images with implied motion

The present study examined whether implicit motion information from static images influences perceived duration of image presentation. In Experiments 1 and 2, we presented observers with images of a human and an animal character in running and standing postures. The results revealed that the perceived presentation duration of running images was longer than that of standing images. In Experiments 3 and 4, we used abstract block-like images that imitated the human figures used in Experiment 1, presented with different instructions to change the observers' interpretations of the stimuli. We found that the perceived duration of the block image presented as a man running was longer than that of the image presented as a man standing still. However, this effect diminished when the participants were told the images were green onions (objects with no implied motion), suggesting that the effect of implied motion cannot be attributed to low-level visual differences. These results suggest that implied motion increases the perceived duration of image presentation. The potential involvement of higher-order motion processing and the mirror neuron system is discussed.