Subjective duration distortions mirror neural repetition suppression

The role of perceptual processing in the oddball effect revealed by the Thatcher illusion

When a novel stimulus (oddball) appears after repeated presentation of an identical stimulus, the oddball is perceived to last longer than the repeated stimuli, a phenomenon known as the oddball effect. We investigated whether the perceptual or physical differences between the repeated and oddball stimuli are more important for the oddball effect. To manipulate the perceptual difference while keeping their physical visual features constant, we used the Thatcher illusion, in which an inversion of a face hinders recognition of distortion in its facial features. We found that the Thatcherized face presented after repeated presentation of an intact face induced a stronger oddball effect when the faces were upright than when they were inverted (Experiment 1). However, the difference in the oddball effect between face orientations was not observed when the intact face was presented as the oddball after repeated presentation of a Thatcherized face (Experiment 2). These results were replicated when participants performed both the intact-repeated and Thatcherized-repeated conditions in a single experiment (Experiment 3). Two control experiments confirmed that the repeated presentation of the preceding stimuli is necessary for the difference in duration distortion to occur (Experiments 4 and 5). The results suggest the considerable role of perceptual processing in the oddball effect. We discuss the discrepancy in the results between the intact-repeated and Thatcherized-repeated conditions in terms of predictive coding.

Detecting how time is subjectively perceived based on event-related potentials (ERPs): a machine learning approach

Background and objective: Time perception is essential for the precise performance of many of our activities and the coordination between different modalities. But it is distorted in many diseases and disorders. Event-related potentials (ERP) have long been used to understand better how the human brain perceives time, but machine learning methods have rarely been used to detect a person's time perception from his/her ERPs. Methods: In this study, EEG signals of the individuals were recorded while performing an auditory oddball time discrimination task. After features were extracted from ERPs, data balancing, and feature selection, machine learning models were used to distinguish between the oddball durations of 400 ms and 600 ms from standard durations of 500 ms. ERP results showed that the P3 evoked by the 600 ms oddball stimuli appeared about 200 ms later than that of the 400 ms oddball tones. Classification performance results indicated that support vector machine (SVM) outperformed K-nearest neighbors (KNN), Random Forest, and Logistic regression models. Results: The accuracy of SVM was 91.24, 92.96, and 89.9 for the three used labeling modes, respectively. Another important finding was that most features selected for classification were in the P3 component range, supporting the observed significant effect of duration on the P3. Although all N1, P2, N2, and P3 components contributed to detecting the desired durations. Conclusion: Therefore, results of this study suggest the P3 component as a potential candidate to detect sub-second periods in future researches on brain-computer interface (BCI) applications.

Overlearned sequence and perceived time: possible involvement of attention

Overlearned sequences, characterized by specific ordinal ranks for each element, elicit strong predictions when presented in their natural order. The present study aimed to test the role of predictions on the perceived duration in a stimulus series that followed an overlearned sequence. Participants judged the duration of the target digit in a sequence that followed a regular or random order, while the overall context in which these sequences were presented was varied in two blocks. The results suggest that, with the possible involvement of attention, the target element that followed the regular order was perceived to be relatively accurate. The violation of an overlearned sequence leads to an underestimation of duration, particularly when the participants are aware of the violation. Further, the perceived duration of the target element in an overlearned sequence does not modulate as a function of the global context. These findings contribute to our understanding of the differential effect of various predictive processes on perceived time.

Face adaptation induces duration distortion of subsequent face stimuli in a face category-specific manner

Studies have shown that duration perception depends on several visual processes. However, the stages of visual processes that contribute to duration perception remain unclear. This study examined the effects of categorical differences in face adaptation on perceived duration. In all the experiments, we compared the perceived durations of human, monkey, and cat faces (comparison stimuli) after adapting to a human face. Results revealed that the human comparison stimuli were perceived shorter than the monkey and cat comparison stimuli (categorical face adaptation on duration perception [CFAD]). The difference between the face categories disappeared when the adapting stimulus was rendered unrecognizable by phase scrambling, indicating that adaptation to low-level visual properties cannot fully account for the CFAD effect. Furthermore, CFAD was preserved but attenuated when the adapting stimulus was inverted or a 1,000-ms interval was inserted before the comparison stimuli, which implied that CFAD occurred as long as the adapting stimulus was perceived as a face and not simply based on conceptual category processes. These findings indicate that face adaptation affects perceived duration in a category-specific manner (the CFAD effect) and highlights the involvement of visual categorical processes in duration perception.

Event Probabilities Have a Different Impact on Early and Late Electroencephalographic Measures Regarded as Metrics of Prediction

The oddball protocol has been used to study the neural and perceptual consequences of implicit predictions in the human brain. The protocol involves presenting a sequence of identical repeated events that are eventually broken by a novel "oddball" presentation. Oddball presentations have been linked to increased neural responding and to an exaggeration of perceived duration relative to repeated events. Because the number of repeated events in such protocols is circumscribed, as more repeats are encountered, the conditional probability of a further repeat decreases-whereas the conditional probability of an oddball increases. These facts have not been appreciated in many analyses of oddballs; repeats and oddballs have rather been treated as binary event categories. Here, we show that the human brain is sensitive to conditional event probabilities in an active, visual oddball paradigm. P300 responses (a relatively late component of visually evoked potentials measured with EEG) tended to be greater for less likely oddballs and repeats. By contrast, P1 responses (an earlier component) increased for repeats as a goal-relevant target presentation neared, but this effect occurred even when repeat probabilities were held constant, and oddball P1 responses were invariant. We also found that later, more likely oddballs seemed to last longer, and this effect was largely independent of the number of preceding repeats. These findings speak against a repetition suppression account of the temporal oddball effect. Overall, our data highlight an impact of event probability on later, rather than earlier, electroencephalographic measures previously related to predictive processes-and the importance of considering conditional probabilities in sequential presentation paradigms.

Can't catch the beat: Failure to find simple repetition effects in three types of temporal judgements

More experience results in better performance, usually. In most tasks, the more chances to learn we have, the better we are at it. This does not always appear to be the case in time perception however. In the current article, we use three different methods to investigate the role of the number of standard example durations presented on performance on three timing tasks: rhythm continuation, deviance detection, and final stimulus duration judgement. In Experiments 1a and 1b, rhythms were produced with the same accuracy whether one, two, three, or four examples of the critical duration were presented. In Experiment 2, participants were required to judge which of four stimuli had a different duration from the other three. This judgement did not depend on which of the four stimuli was the deviant one. In Experiments 3a and 3b, participants were just as accurate at judging the duration of a final stimulus in comparison to the prior stimuli regardless of the number of standards presented prior to the final stimulus. In summary, we never found any systematic effect of the number of standards presented on performance on any of the three timing tasks. In the discussion, we briefly relate these findings to three theories of time perception.

Memorable beginnings, but forgettable endings: Intrinsic memorability alters our subjective experience of time

Time is the fabric of experience - yet it is incredibly malleable in the mind of the observer: seeming to drag on, or fly right by at different moments. One of the most influential drivers of temporal distortions is attention, where heightened attention dilates subjective time. But an equally important feature of subjective experience involves not just the objects of attention, but also what information will naturally be remembered or forgotten, independent of attention (i.e. intrinsic image memorability). Here we test how memorability influences time perception. Observers viewed scenes in an oddball paradigm, where the last scene could be a forgettable "oddball" amidst memorable ones, or vice versa. Subjective time dilation occurred only for forgettable oddballs, but not memorable ones - demonstrating an oddball effect where the oddball did not differ in low-level visual features, image category, or even subjective memorability. But more importantly, these results emphasize how memory can interact with temporal experience: forgettable endings amidst memorable sequences dilate our experience of time.

Stimulus (dis)similarity can modify the effect of a task-irrelevant sandwiching stimulus on the perceived duration of brief visual stimuli

The perceived duration of a target visual stimulus is shorter when a brief non-target visual stimulus precedes and trails the target than when it appears alone. This time compression requires spatiotemporal proximity of the target and non-target stimuli, which is one of the perceptual grouping rules. The present study examined whether and how another grouping rule, stimulus (dis)similarity, modulated this effect. In Experiment 1, time compression occurred only when the preceding and trailing stimuli (black-white checkerboard) were dissimilar from the target (unfilled round or triangle) with spatiotemporal proximity. In contrast, it was reduced when the preceding or trailing stimuli (filled rounds or triangles) were similar to the target. Experiment 2 revealed time compression with dissimilar stimuli, independent of the intensity or saliency of the target and non-target stimuli. Experiment 3 replicated the findings of Experiment 1 by manipulating the luminance similarity between target and non-target stimuli. Furthermore, time dilation occurred when the non-target stimuli were indistinguishable from the target stimuli. These results indicate that stimulus dissimilarity with spatiotemporal proximity induces time compression, whereas stimulus similarity with spatiotemporal proximity does not. These findings were discussed in relation to the neural readout model.

Changes in face category induce stronger duration distortion in the temporal oddball paradigm

A novel stimulus embedded in a sequence of repeated stimuli is often perceived to be longer in duration. Studies have indicated the involvement of repetition suppression in this duration distortion, but it remains unclear which processing stages are important. The present study examined whether high-level visual category processing contributes to the oddball's duration distortion. In Experiment 1, we presented a novel face image in either human, monkey, or cat category after a repetition of an identical human face image in the temporal oddball paradigm. We found that the duration distortion of the last stimulus increased when the face changed across different categories, than when it changed within the same category. However, the effect of category change disappeared when globally scrambled and locally scrambled face images were used in Experiments 2 and 3, respectively, suggesting that the difference in duration distortion cannot be attributed to low-level visual properties of the images. Furthermore, in Experiment 4, we again used intact face images and found that category changes can influence the duration distortion even when a series of different human faces was presented before the last stimulus. These findings indicate that high-level visual category processing plays an important role in the duration distortion of oddballs. This study supports the idea that visual processing at higher visual stages is involved in duration perception. (219 words).

Parkinson’s disease deficits in time perception to auditory as well as visual stimuli – A large online study

Cognitive deficits are common in Parkinson’s disease (PD) and range from mild cognitive impairment to dementia, often dramatically reducing quality of life. Physiological models have shown that attention and memory are predicated on the brain’s ability to process time. Perception has been shown to be increased or decreased by activation or deactivation of dopaminergic neurons respectively. Here we investigate differences in time perception between patients with PD and healthy controls. We have measured differences in sub-second- and second-time intervals. Sensitivity and error in perception as well as the response times are calculated. Additionally, we investigated intra-individual response variability and the effect of participant devices on both reaction time and sensitivity. Patients with PD have impaired sensitivity in discriminating between durations of both visual and auditory stimuli compared to healthy controls. Though initially designed as an in-person study, because of the pandemic the experiment was adapted into an online study. This adaptation provided a unique opportunity to enroll a larger number of international participants and use this study to evaluate the feasibility of future virtual studies focused on cognitive impairment. To our knowledge this is the only time perception study, focusing on PD, which measures the differences in perception using both auditory and visual stimuli. The cohort involved is the largest to date, comprising over 800 participants.

Entropy, Amnesia, and Abnormal Déjà Experiences

Previous research has contrasted fleeting erroneous experiences of familiarity with equally convincing, and often more stubborn erroneous experiences of remembering. While a subset of the former category may present as nonpathological “déjà vu,” the latter, termed “déjà vécu” can categorize a delusion-like confabulatory phenomenon first described in elderly dementia patients. Leading explanations for this experience include the dual process view, in which erroneous familiarity and erroneous recollection are elicited by inappropriate activation of the parahippocampal cortex and the hippocampus, respectively, and the more popular encoding-as-retrieval explanation in which normal memory encoding processes are falsely flagged and interpreted as memory retrieval. This paper presents a novel understanding of this recollective confabulation that builds on the encoding-as-retrieval hypothesis but more adequately accounts for the co-occurrence of persistent déjà vécu with both perceptual novelty and memory impairment, the latter of which occurs not only in progressive dementia but also in transient epileptic amnesia (TEA) and psychosis. It makes use of the growing interdisciplinary understanding of the fluidity of time and posits that the functioning of memory and the perception of novelty, long known to influence the subjective experience of time, may have a more fundamental effect on the flow of time.

Interval timing in a hierarchical violation-of-expectation task: Dissociable effects of local and global predictions

Predictability associated with an event influences its perceived time. The two forms of predictions that are often discussed and have a dissociable influence on perceived time are repetition and expectation. However, predictions based on expectation can be seen at multiple levels, potentially leading to an inconsistency in the pattern in which expectation influences perceived time. Therefore, the present study aimed to investigate how different levels of predictions impact perceived time. In two separate experiments utilizing visual and auditory stimuli, we used a hierarchical violation-of-expectation paradigm that can dissociate two types of predictions based on local and global rules. Results from analysis of variance computed with local and global predictions revealed a pattern of local and global predictions having a distinct influence on perceived time. More specifically, while the local predictions that consider the immediate stimulus exposure reduced the perceived time, the global predictions that consider the overall regularities of a given context increased the perceived time. These results integrate well with the recent theoretical models rooted in a predictive coding framework that emphasizes the opposing effects of the first order and second order predictions on perceived time.

Linear vector models of time perception account for saccade and stimulus novelty interactions

Various models (e.g., scalar, state-dependent network, and vector models) have been proposed to explain the global aspects of time perception, but they have not been tested against specific visual phenomena like perisaccadic time compression and novel stimulus time dilation. Here, in two separate experiments (N = 31), we tested how the perceived duration of a novel stimulus is influenced by 1) a simultaneous saccade, in combination with 2) a prior series of repeated stimuli in human participants. This yielded a novel behavioral interaction: pre-saccadic stimulus repetition neutralizes perisaccadic time compression. We then tested these results against simulations of the above models. Our data yielded low correlations against scalar model simulations, high but non-specific correlations for our feedforward neural network, and correlations that were both high and specific for a vector model based on identity of objective and subjective time. These results demonstrate the power of global time perception models in explaining disparate empirical phenomena and suggest that subjective time has a similar essence to time's physical vector.

Neurophysiological responses of globus pallidus internus during the auditory oddball task in Parkinson's disease

Parkinson's disease can be associated with significant cognitive impairment that may lead to dementia. Deep brain stimulation (DBS) of the subthalamic nucleus is an effective therapy for motor symptoms but is associated with cognitive decline. DBS of globus pallidus internus (GPi) poses less risk of cognitive decline so may be the preferred target. A research priority is to identify biomarkers of cognitive decline in this population, but efforts are hampered by a lack of understanding of the role of the different basal ganglia nuclei, such as the globus pallidus, in cognitive processing. During deep brain stimulation (DBS) surgery, we monitored single units, beta oscillatory LFP activity as well as event related potentials (ERPs) from the globus pallidus internus (GPi) of 16 Parkinson's disease patients, while they performed an auditory attention task. We used an auditory oddball task, during which one standard tone is presented at regular intervals and a second deviant tone is presented with a low probability that the subject is requested to count and report at the end of the task. All forms of neuronal activity studied were selective modulated by the attended tones. Of 62 neurons studied, the majority (51 or 82%) responded selectively to the deviant tone. Beta oscillatory activity showed an overall desynchronization during both types of attended tones interspersed by bursts of beta activity giving rise to peaks at a latency of around 200 ms after tone onset. cognitive ERPs recorded in GPi were selective to the attended tone and the right-side cERP was larger than the left side. The averages of trials showing a difference in beta oscillatory activity between deviant and standard also had a significant difference in cERP amplitude. In one block of trials, the random occurrence of 3 deviant tones in short succession silenced the activity of the GPi neuron being recorded. Trial blocks where a clear difference in LFP beta was seen were twice as likely to yield a correct tone count (25 vs 11). The data demonstrate strong modulation of GPi neuronal activity during the auditory oddball task. Overall, this study demonstrates an involvement of GPi in processing of non-motor cognitive tasks such as working memory and attention, and suggests that direct effects of DBS in non-motor GPi may contribute to cognitive changes observed post-operatively.

Non-magnitude sources of bias on duration judgements for blank intervals: conceptual relatedness of interval markers reduces subjective interval duration

We report three experiments in which the events flanking a temporal interval were either related or unrelated, based on overlap in the letter identity of single letters (Experiment 1), in the conceptual congruency of color words and colored rectangles (Experiment 2), or in the conceptual congruency of sentence stems and their terminal words (Experiment 3). In all cases, we observed a bias for participants to judge the duration of temporal intervals as shorter when the flanking events were related. We draw an analogy between these temporal judgement distortions and those reported elsewhere (Alards-Tomalin et al. in J Exp Psychol Learn Mem Cogn 40(2):555-566, 2014) that revealed that the similarity in the relative magnitude of flanking events generate the same type of bias on duration judgements. The observation that non-magnitude dimensions of relatedness between flanking events can also bias duration judgements raise questions about the applicability of two influential theoretical frameworks for understanding the distorting effects that non-temporal stimulus dimensions can have on duration judgments, A Theory of Magnitude (Buetl and Walsh in Philos Trans R Soc B Biol Sci 12:1831-1840, 2009, Walsh in Trends Cogn Sci 7:483-488, 2003) and the Conceptual Metaphor Theory (e.g., Lakoff and Johnson in Philosophy in the flesh: the embodied mind and its challenge to western thought. Basic Books, New York, 1999). In our general discussion, we consider a number of alternative frameworks that may account for these findings.

Sandwiched visual stimuli are perceived as shorter than the stimulus alone

A visual stimulus is perceived as shorter when a short sound is presented immediately before and after the visual target than when the visual target appears alone. It remains unclear whether the time compression occurs in an intramodal condition. Therefore, the present study examined how and when non-target sandwiching stimuli affect the perceived filled duration of target visual stimuli. We further hypothesized that this effect could be modulated by temporal and spatial proximity between the target and non-target stimuli. Experiments 1a, 1b, and 2 showed that non-target stimuli could decrease the perceived duration only when the inter-stimulus interval between these stimuli was 0 ms, using time reproduction and category estimation methods. Experiments 3 revealed that the time compression effect did not occur when both the non-target preceding and trailing stimuli were spatially distinct from the target. Experiment 4 demonstrated that either the preceding or trailing stimulus induced the time compression effect when the non-target stimuli were presented at the same position as the target stimuli. We discuss the implications of the time compression effect induced by non-target sandwiching stimuli with reference to the Scalar Expectancy Theory and the Neural Readout Model. We speculated that the attenuation of neural responses to the target via visual masking or perceptual grouping may be attributable to the time compression effect.

Perceived Duration: The Interplay of Top-Down Attention and Task-Relevant Information

Perception of time is susceptible to distortions; among other factors, it has been suggested that the perceived duration of a stimulus is affected by the observer’s expectations. It has been hypothesized that the duration of an oddball stimulus is overestimated because it is unexpected, whereas repeated stimuli have a shorter perceived duration because they are expected. However, recent findings suggest instead that fulfilled expectations about a stimulus elicit an increase in perceived duration, and that the oddball effect occurs because the oddball is a target stimulus, not because it is unexpected. Therefore, it has been suggested that top-down attention is sometimes sufficient to explain this effect, and sometimes only necessary, with an additional contribution from saliency. However, how the expectedness of a target stimulus and its salient features affect its perceived duration is still an open question. In the present study, participants’ expectations about and the saliency of target stimuli were orthogonally manipulated with stimuli presented on a short (Experiment 1) or long (Experiment 2) temporal scale. Four repetitive standard stimuli preceded each target stimulus in a task in which participants judged whether the target was longer or shorter in duration than the standards. Engagement of top-down attention to target stimuli increased their perceived duration to the same extent irrespective of their expectedness. A small but significant additional contribution to this effect from the saliency of target stimuli was dependent on the temporal scale of stimulus presentation. In Experiment 1, saliency only significantly increased perceived duration in the case of expected target stimuli. In contrast, in Experiment 2, saliency exerted a significant effect on the overestimation elicited by unexpected target stimuli, but the contribution of this variable was eliminated in the case of expected target stimuli. These findings point to top-down attention as the primary cognitive mechanism underlying the perceptual extraction and processing of task-relevant information, which may be strongly correlated with perceived duration. Furthermore, the scalar properties of timing were observed, favoring the pacemaker-accumulator model of timing as the underlying timing mechanism.

Perceived duration of auditory oddballs: test of a novel pitch-window hypothesis

Unexpected oddball stimuli embedded within a series of otherwise identical standard stimuli tend to be overestimated in duration. The present study tested a pitch-window explanation of the auditory oddball effect on perceived duration in two experiments. For both experiments, participants listened to isochronous sequences consisting of a series of 400 Hz fixed-duration standard tones with an embedded oddball tone that differed in pitch and judged whether the variable-duration oddball was shorter or longer than the standard. Participants were randomly assigned to either a wide or narrow pitch-window condition, in which an anchor oddball was presented with high likelihood at either a far pitch (850 Hz) or a near pitch (550 Hz), respectively. In both pitch-window conditions, probe oddballs were presented with low likelihood at pitches that were either within or outside the frequency range established by the standard and anchor tones. Identical 700 Hz probe oddballs were perceived to be shorter in duration in the wide pitch-window condition than in the narrow pitch-window condition (Experiments 1 and 2), even when matching the overall frequency range of oddballs across conditions (Experiment 2). Results support the proposed pitch-window hypothesis, but are inconsistent with both enhanced processing and predictive coding accounts of the oddball effect.

Heat transfer, entropy and time perception: Toward finding a possible relation between subjective and objective time

The interaction between subjective and objective time is an ambiguous issue in physics and psychology. Here, I try to describe these two timing systems within a common framework. To this aim, I will use thermodynamic entropy, which is a parameter that can create the arrow of time in physical systems (i.e. universe and brain). In the universe, which can be thought of as a closed system, heat transfer (dQ) is always positive and it leads to an increase in entropy (dS > 0). The positive dS leads to the generation of the irreversible arrow of time. Given that dS is constant, the time units have a similar direction and magnitude. In contrast to the universe, the brain is an open thermodynamic system which transfers heat to its surroundings. In this system, dQ and dS can become negative. This causes a reversible timing system and time units can be laid along different arrows and have different magnitudes. Theoretically, this mismatch can cause different timing in the brain and universe.

Illuminating ATOM: Taking time across the colour category border

Walsh's A Theory Of Magnitude (ATOM) contends that we represent magnitudes such as number, space, time and luminance on a shared metric, such that "more" of one leads to the perception of "more" of the other (e.g. Walsh, 2003). In support of ATOM, participants have been shown to judge intervals between stimuli that are more discrepant in luminance as having a longer duration than intervals between stimuli whose luminance differs by a smaller degree (Xuan, Zhang, He, & Chen, 2007). We tested the potential limits to the ability of luminance to influence duration perception by investigating the possibility that the luminance-duration relationship might be interrupted by a concurrent change in the colour of that luminance. We showed native Greek and native English speakers sequences of stimuli that could be either light or dark versions of green or blue. Whereas for both groups a shift in green luminance does not comprise a categorical shift in colour, for Greek speakers shifts between light and dark blue cross a colour category boundary (ghalazio and ble respectively). We found that duration judgements were neither interrupted nor inflated by a shift in colour category. These results represent the first evidence that the influence of luminance change on duration perception is resistant to interference from discrete changes within the same perceptual input.

Further Evidence That the Effects of Repetition on Subjective Time Depend on Repetition Probability

Repeated stimuli typically have shorter apparent duration than novel stimuli. Most explanations for this effect have attributed it to the repeated stimuli being more expected or predictable than the novel items, but an emerging body of work suggests that repetition and expectation exert distinct effects on time perception. The present experiment replicated a recent study in which the probability of repetition was varied between blocks of trials. As in the previous work, the repetition effect was smaller when repeats were common (and therefore more expected) than when they were rare. These results add to growing evidence that, contrary to traditional accounts, expectation increases apparent duration whereas repetition compresses subjective time, perhaps via a low-level process like adaptation. These opposing processes can be seen as instances of a more general “processing principle,” according to which subjective time is a function of the perceptual strength of the stimulus representation, and therefore depends on a confluence of “bottom-up” and “top-down” variables.

Expectation, information processing, and subjective duration

In research on psychological time, it is important to examine the subjective duration of entire stimulus sequences, such as those produced by music (Teki, Frontiers in Neuroscience, 10, 2016). Yet research on the temporal oddball illusion (according to which oddball stimuli seem longer than standard stimuli of the same duration) has examined only the subjective duration of single events contained within sequences, not the subjective duration of sequences themselves. Does the finding that oddballs seem longer than standards translate to entire sequences, such that entire sequences that contain oddballs seem longer than those that do not? Is this potential translation influenced by the mode of information processing-whether people are engaged in direct or indirect temporal processing? Two experiments aimed to answer both questions using different manipulations of information processing. In both experiments, musical sequences either did or did not contain oddballs (auditory sliding tones). To manipulate information processing, we varied the task (Experiment 1), the sequence event structure (Experiments 1 and 2), and the sequence familiarity (Experiment 2) independently within subjects. Overall, in both experiments, the sequences that contained oddballs seemed shorter than those that did not when people were engaged in direct temporal processing, but longer when people were engaged in indirect temporal processing. These findings support the dual-process contingency model of time estimation (Zakay, Attention, Perception & Psychophysics, 54, 656-664, 1993). Theoretical implications for attention-based and memory-based models of time estimation, the pacemaker accumulator and coding efficiency hypotheses of time perception, and dynamic attending theory are discussed.

Triple dissociation of duration perception regulating mechanisms: Top-down attention is inherent

The brain constantly adjusts perceived duration based on the recent event history. One such lab phenomenon is subjective time expansion induced in an oddball paradigm ("oddball chronostasis"), where the duration of a distinct item (oddball) appears subjectively longer when embedded in a series of other repeated items (standards). Three hypotheses have been separately proposed but it remains unresolved which or all of them are true: 1) attention prolongs oddball duration, 2) repetition suppression reduces standards duration, and 3) accumulative temporal preparation (anticipation) expedites the perceived item onset so as to lengthen its duration. We thus conducted critical systematic experiments to dissociate the relative contribution of all hypotheses, by orthogonally manipulating sequences types (repeated, ordered, or random) and target serial positions. Participants' task was to judge whether a target lasts shorter or longer than its reference. The main finding was that a random item sequence still elicited significant chronostasis even though each item was odd. That is, simply being a target draws top-down attention and induces chronostasis. In Experiments 1 (digits) and 2 (orientations), top-down attention explained about half of the effect while saliency/adaptation explained the other half. Additionally, for non-repeated (ordered and random) sequence types, a target with later serial position still elicited stronger chronostasis, favoring a temporal preparation over a repetition suppression account. By contrast, in Experiment 3 (colors), top-down attention was likely the sole factor. Consequently, top-down attention is necessary and sometimes sufficient to explain oddball chronostasis; saliency/adaptation and temporal preparation are contingent factors. These critical boundary conditions revealed in our study serve as quantitative constraints for neural models of duration perception.

Duration compression induced by visual and phonological repetition of Chinese characters

Our prior experience heavily influences our subjective time. One of such phenomena is repetition compression, that is, repeated stimuli are perceived shorter than novel stimuli. However, most of the studies on repetition compression used identical stimuli, leaving the question whether similar repetition effects could take place in phonological and semantic level repetition. We used Chinese characters to manipulate different levels of repetition in a duration discrimination task. We replicated earlier findings that repetition of visual identical characters shortened the apparent duration and found the repetition compression was spatially independent. Phonological repetition also caused the duration compression though the effect was weaker than the visual repetition. However, we observed no duration compression during the semantic repetition. The results suggest that repetition compression is mediated by visual and phonological representation of a stimulus in an early stage in processing hierarchy. We explained our findings according to the framework of predictive coding.

The P3 and the subjective experience of time

Our experience of time is often subject to distortions. For instance, time appears to slow down when unexpected events occur. Previous research has shown that the duration of infrequent stimuli - so-called oddballs - is commonly overestimated, an effect referred to as the temporal oddball effect. Oddballs are also known to cause a posterior P3, an event-related potential elicited by motivationally significant stimuli. Here, we propose that the temporal oddball effect and the posterior P3 share a common mechanism. We hypothesized that the P3 amplitude can be used to predict whether the duration of an oddball will be overestimated or not, even if this P3 precedes the offset of the stimulus. In our task, infrequent red targets were embedded in a series of white standards. All stimuli varied in duration and participants had to estimate the duration of the targets and some of the standards. Our data revealed that the duration of target oddballs, but not of standards, was overestimated and overestimations were associated with larger P3 amplitudes than correct short estimates. Because the P3 peaked before stimulus offset, this effect was independent of actual target oddball duration. Using multivariate pattern analysis, we provided direct evidence that it is indeed the P3 elicited by oddballs that caused this effect. Together, our results suggest that the temporal oddball effect is linked to the posterior P3. Based on these findings and established P3 theories, we propose that the common mechanism underlying both phenomena is a phasic norepinephrine response affecting the subjective experience of time.

Associated Information Increases Subjective Perception of Duration

Our sense of time is prone to various biases. For instance, one factor that can dilate an event's perceived duration is the violation of predictions; when a series of repeated stimuli is interrupted by an unpredictable oddball. On the other hand, when the probability of a repetition itself is manipulated, predictable conditions can also increase estimated duration. This suggests that manipulations of expectations have different or even opposing effects on time perception. In previous studies, expectations were generated because stimuli were repeated or because the likelihood of a sequence or a repetition was varied. In the natural environment, however, expectations are often built via associative processes, for example, the context of a kitchen promotes the expectation of plates, appliances, and other associated objects. Here, we manipulated such association-based expectations by using oddballs that were either contextually associated or nonassociated with the standard items. We find that duration was more strongly overestimated for contextually associated oddballs. We reason that top-down attention is biased toward associated information, and thereby dilates subjective duration for associated oddballs. Based on this finding, we propose an interplay between top-down attention and predictive processing in the perception of time.

Perceived Duration Increases with Contrast, but Only a Little

Recent adaptation studies provide evidence for early visual areas playing a role in duration perception. One explanation for the pronounced duration compression commonly found with adaptation is that it reflects adaptation-driven stimulus-specific reduction in neural activity in early visual areas. If this level of stimulus-associated neural activity does drive duration, then we would expect a strong effect of contrast on perceived duration as electrophysiological studies shows neural activity in early visual areas to be strongly related to contrast. We employed a spatially isotropic noise stimulus where the luminance of each noise element was independently sinusoidally modulated at 4 Hz. Participants matched the perceived duration of a high (0.9) or low (0.1) contrast stimulus to a previously presented standard stimulus (600 ms, contrast = 0.3). To achieve perceptually equivalent durations, the low contrast stimulus had to be presented for longer than the high contrast stimulus. This occurred when we controlled for stimulus size and when we adjusted for individual differences in perceived temporal frequency. Further, we show that the effect cannot be explained by shifts in perceived onset and offset and is not explained by a simple contrast-driven response bias. The direction of our results is clearly consistent with the idea that level of neural activity drives duration. However, the magnitude of the effect (~10% duration difference over a 0.9-0.1 contrast reduction) is in marked contrast to the larger duration distortions that can be found with repetition suppression and the oddball effect; particularly when these may be associated with smaller differences in neural activity than that expected from our contrast difference. Taken together, these results indicate that level of stimulus-related neural activity in early visual areas is unlikely to provide a general mechanism for explaining differences in perceived duration.

Numerical Context and Time Perception: Contrast Effects and the Perceived Duration of Numbers

In the current study, we examined how the contextual repetition of magnitude information presented in either symbolic (Arabic digits) or nonsymbolic (numerosities) formats impacted on the perceived duration of a later occurring target number. The results of the current study demonstrated a time-magnitude bias in which, on average, large magnitude target numbers were judged to last for longer durations relative to small magnitude target numbers, regardless of notation (symbolic number and numerosity). Furthermore, context effects were found, in which a greater discrepancy in the target's magnitude from the initial context led to longer perceived duration ratings. However, this was found to be asymmetrical, occurring only for large magnitude targets. Additionally, the type of context effect was shown to be determined by whether the context was presented in the same notation as the target or a different notation.

Attentional entrainment and perceived event duration

This study considered the contribution of dynamic attending theory (DAT) and attentional entrainment to systematic distortions in perceived event duration. Three experiments were conducted using an auditory oddball paradigm, in which listeners judged the duration of a deviant (oddball) stimulus embedded within a series of identical (standard) stimuli. To test for a role of attentional entrainment in perceived oddball duration, oddballs were presented at either temporally expected (on time) or unexpectedly early or late time points relative to extrapolation of the context rhythm. Consistent with involvement of attentional entrainment in perceived duration, duration judgements about the oddball were least distorted when the oddball occurred on time with respect to the entrained rhythm, whereas durations of early and late oddballs were perceived to be shorter and longer, respectively. This pattern of results was independent of the absolute time interval preceding the oddball. Moreover, as expected, an irregularly timed sequence context weakened observed differences between oddballs with on-time and late onsets. Combined with other recent work on the role of temporal preparation in duration distortions, the present findings allot at least a portion of the oddball effect to increased attention to events that are more expected, rather than on their unexpected nature per se.

Perceived duration is reduced by repetition but not by high-level expectation

A repeated stimulus is judged as briefer than a novel one. It has been suggested that this duration illusion is an example of a more general phenomenon-namely that a more expected stimulus is judged as briefer than a less expected one. To test this hypothesis, we manipulated high-level expectation through the probability of a stimulus sequence, through the regularity of the preceding stimuli in a sequence, or through whether a stimulus violates an overlearned sequence. We found that perceived duration is not reduced by these types of expectation. Repetition of stimuli, on the other hand, consistently reduces perceived duration across our experiments. In addition, the effect of stimulus repetition is constrained to the location of the repeated stimulus. Our findings suggest that estimates of subsecond duration are largely the result of low-level sensory processing.

The influence of stimulus repetition on duration judgments with simple stimuli

Two experiments investigated the effects of stimulus repetition vs. stimulus novelty on perceived duration. In a reminder task, a standard and a comparison stimulus were presented consecutively in each trial, and the comparison was either a repetition of the standard or a different stimulus. Pseudowords (Experiment 1) or strings of consonants (Experiment 2) were used as stimuli and the inter-stimulus interval (ISI) between the standard and the comparison was either constant or variable. Participants were asked to judge whether the comparison was shorter or longer than the standard. In both experiments, we observed shorter judged durations for repeated than for novel comparisons whereas the manipulation of the ISI had no pronounced effects on duration judgments. The finding of shorter duration judgments for repeated as compared to novel nonwords replicates the results of a previous study (Matthews, 2011) which employed highly complex stimulus material. The present study shows that changes of simple, semantically meaningless stimuli are sufficient to result in a shorter perceived duration of repeated as compared to novel stimuli.

Temporal perception in visual processing as a research tool

Accumulated evidence has shown that the subjective time in the sub-second range can be altered by different factors; some are related to stimulus features such as luminance contrast and spatial frequency, others are processes like perceptual grouping and contextual modulation. These findings indicate that temporal perception uses neural signals involved in non-temporal feature processes and that perceptual organization plays an important role in shaping the experience of elapsed time. We suggest that the temporal representation of objects can be treated as a feature of objects. This new concept implies that psychological time can serve as a tool to study the principles of neural codes in the perception of objects like “reaction time (RT).” Whereas “RT” usually reflects the state of transient signals crossing decision thresholds, “apparent time” in addition reveals the dynamics of sustained signals, thus providing complementary information of what has been obtained from “RT” studies.

Introducing a control condition in the classic oddball paradigm: Oddballs are overestimated in duration not only because of their oddness

Three experiments assessed whether participants perceive infrequent stimuli (oddballs) to last longer than frequent ones (standards). The classical oddball paradigm was modified so that participants judged the duration of a target stimulus which could either be a standard or an oddball. The target was always the fifth stimulus in the stream and all stimuli were presented at predefined spatial positions. These modifications enabled a direct comparison of duration judgments for oddballs and standards. In Experiments 1 and 2 not only the duration of oddballs but also the duration of standards was overestimated by virtually the same amount. In other words, the overestimation of oddballs was not due to their oddness but reflected a different temporal dilation such as the negative time-order error. In Experiment 3, all stimuli were presented at the same spatial position. Again, both oddballs and standards were overestimated, however, oddballs more so. The present results highlight the importance of comparing the judged duration of oddballs and standards when evaluating the size of the genuine oddball effect. Furthermore, the findings suggest that the occurrence of temporal oddball effects can depend on spatial features of stimulus presentation.

Multiple concurrent temporal recalibrations driven by audiovisual stimuli with apparent physical differences

Out-of-synchrony experiences can easily recalibrate one's subjective simultaneity point in the direction of the experienced asynchrony. Although temporal adjustment of multiple audiovisual stimuli has been recently demonstrated to be spatially specific, perceptual grouping processes that organize separate audiovisual stimuli into distinctive "objects" may play a more important role in forming the basis for subsequent multiple temporal recalibrations. We investigated whether apparent physical differences between audiovisual pairs that make them distinct from each other can independently drive multiple concurrent temporal recalibrations regardless of spatial overlap. Experiment 1 verified that reducing the physical difference between two audiovisual pairs diminishes the multiple temporal recalibrations by exposing observers to two utterances with opposing temporal relationships spoken by one single speaker rather than two distinct speakers at the same location. Experiment 2 found that increasing the physical difference between two stimuli pairs can promote multiple temporal recalibrations by complicating their non-temporal dimensions (e.g., disks composed of two rather than one attribute and tones generated by multiplying two frequencies); however, these recalibration aftereffects were subtle. Experiment 3 further revealed that making the two audiovisual pairs differ in temporal structures (one transient and one gradual) was sufficient to drive concurrent temporal recalibration. These results confirm that the more audiovisual pairs physically differ, especially in temporal profile, the more likely multiple temporal perception adjustments will be content-constrained regardless of spatial overlap. These results indicate that multiple temporal recalibrations are based secondarily on the outcome of perceptual grouping processes.

Duration estimation entails predicting when

The estimation of duration can be affected by context and surprise. Using MagnetoEncephaloGraphy (MEG), we tested whether increased neural activity during surprise and following neural suppression in two different contexts supported subjective time dilation (Eagleman and Pariyadath, 2009; Pariyadath and Eagleman, 2012). Sequences of three 300 ms frequency-modulated (FM, control) or pure tones (test) were presented and followed by a fourth FM varying in duration. In test, the last FM was perceived as significantly longer than veridical duration (Tse et al., 2004) but did not differ from the perceived duration in control. Several novel and distinct neural signatures were observed in duration estimation: first, neural suppression of standard stimuli was observed for the onset but not for the offset auditory evoked responses. Second, ramping activity increased with veridical duration in control whereas at the same latency in test, the amplitude of the midlatency response increased with the distance of deviant durations. Third, in both conditions, the amplitude of the offset auditory evoked responses accounted well for participants' performance: the longer the perceived duration, the larger the offset response. Fourth, neural duration demarcated by the peak latencies of the onset and ramping evoked activities indexed a systematic time compression that reliably predicted subjective time perception. Our findings suggest that interval timing undergoes time compression by capitalizing on the predicted offset of an auditory event.

Continuous carryover of temporal context dissociates response bias from perceptual influence for duration

Recent experimental evidence suggests that the perception of temporal intervals is influenced by the temporal context in which they are presented. A longstanding example is the time-order-error, wherein the perception of two intervals relative to one another is influenced by the order in which they are presented. Here, we test whether the perception of temporal intervals in an absolute judgment task is influenced by the preceding temporal context. Human subjects participated in a temporal bisection task with no anchor durations (partition method). Intervals were demarcated by a Gaussian blob (visual condition) or burst of white noise (auditory condition) that persisted for one of seven logarithmically spaced sub-second intervals. Crucially, the order in which stimuli were presented was first-order counterbalanced, allowing us to measure the carryover effect of every successive combination of intervals. The results demonstrated a number of distinct findings. First, the perception of each interval was biased by the prior response, such that each interval was judged similarly to the preceding trial. Second, the perception of each interval was also influenced by the prior interval, such that perceived duration shifted away from the preceding interval. Additionally, the effect of decision bias was larger for visual intervals, whereas auditory intervals engendered greater perceptual carryover. We quantified these effects by designing a biologically-inspired computational model that measures noisy representations of time against an adaptive memory prior while simultaneously accounting for uncertainty, consistent with a Bayesian heuristic. We found that our model could account for all of the effects observed in human data. Additionally, our model could only accommodate both carryover effects when uncertainty and memory were calculated separately, suggesting separate neural representations for each. These findings demonstrate that time is susceptible to similar carryover effects as other basic stimulus attributes, and that the brain rapidly adapts to temporal context.

Do changes in the pace of events affect one-off judgments of duration?

Five experiments examined whether changes in the pace of external events influence people's judgments of duration. In Experiments 1a-1c, participants heard pieces of music whose tempo accelerated, decelerated, or remained constant. In Experiment 2, participants completed a visuo-motor task in which the rate of stimulus presentation accelerated, decelerated, or remained constant. In Experiment 3, participants completed a reading task in which facts appeared on-screen at accelerating, decelerating, or constant rates. In all experiments, the physical duration of the to-be-judged interval was the same across conditions. We found no significant effects of temporal structure on duration judgments in any of the experiments, either when participants knew that a time estimate would be required (prospective judgments) or when they did not (retrospective judgments). These results provide a starting point for the investigation of how temporal structure affects one-off judgments of duration like those typically made in natural settings.

Why overlearned sequences are special: distinct neural networks for ordinal sequences

Several observations suggest that overlearned ordinal categories (e.g., letters, numbers, weekdays, months) are processed differently than non-ordinal categories in the brain. In synesthesia, for example, anomalous perceptual experiences are most often triggered by members of ordinal categories (Rich et al., 2005; Eagleman, 2009). In semantic dementia (SD), the processing of ordinal stimuli appears to be preserved relative to non-ordinal ones (Cappelletti et al., 2001). Moreover, ordinal stimuli often map onto unconscious spatial representations, as observed in the SNARC effect (Dehaene et al., 1993; Fias, 1996). At present, little is known about the neural representation of ordinal categories. Using functional neuroimaging, we show that words in ordinal categories are processed in a fronto-temporo-parietal network biased toward the right hemisphere. This differs from words in non-ordinal categories (such as names of furniture, animals, cars, and fruit), which show an expected bias toward the left hemisphere. Further, we find that increased predictability of stimulus order correlates with smaller regions of BOLD activation, a phenomenon we term prediction suppression. Our results provide new insights into the processing of ordinal stimuli, and suggest a new anatomical framework for understanding the patterns seen in synesthesia, unconscious spatial representation, and SD.