Opposite Distortions in Interval Timing Perception for Visual and Auditory Stimuli with Temporal Modulations

Modality-dependent distortion effects of temporal frequency on time perception

Time perception has been known to depend on the temporal frequency of the stimulus. Previously, the effect of temporal frequency modulation was assumed to be monotonically lengthening or shortening. However, this study shows that temporal frequency affects time perception in a non-monotonic and modality-dependent manner. Four experiments investigated the time distortion effects induced by modulation of temporal frequency across auditory and visual modalities. Critically, the temporal frequency was parametrically manipulated across four levels (steady stimulus, 10-, 20-, and 30/40-Hz intermittent auditory/visual stimulus). Experiment 1, 2, and 3 consistently showed that a 10-Hz auditory stimulus was perceived as shorter than a steady auditory stimulus. Meanwhile, as the temporal frequency increased, the perceived duration of the intermittent auditory stimulus was lengthened. A 40-Hz auditory stimulus was perceived as longer than a 10- Hz auditory stimulus, but did not differ significantly from a steady one. Experiment 4 showed that, for the visual modality, a 10-Hz visual stimulus was perceived as longer than a steady stimulus, and the perceived duration was lengthened as temporal frequency increased. This study demonstrated that within the scope of the temporal frequencies examined in this study, there were differential distortion effects observed across sensory modalities.

Measuring the perception and metacognition of time

The ability of humans to identify and reproduce short time intervals (in the region of a second) may be affected by many factors ranging from the gender and personality of the individual observer, through the attentional state, to the precise spatiotemporal structure of the stimulus. The relative roles of these very different factors are a challenge to describe and define; several methodological approaches have been used to achieve this to varying degrees of success. Here we describe and model the results of a paradigm affording not only a first-order measurement of the perceived duration of an interval but also a second-order metacognitive judgement of perceived time. This approach, we argue, expands the form of the data generally collected in duration-judgements and allows more detailed comparison of psychophysical behavior to the underlying theory. We also describe a hierarchical Bayesian measurement model that performs a quantitative analysis of the trial-by-trial data calculating the variability of the temporal estimates and the metacognitive judgments allowing direct comparison between an actual and an ideal observer. We fit the model to data collected for judgements of 750 ms (bisecting 1500 ms) and 1500 ms (bisecting 3000 ms) intervals across three stimulus modalities (visual, audio, and audiovisual). This enhanced form of data on a given interval judgement and the ability to track its progression on a trial-by-trial basis offers a way of looking at the different roles that subject-based, task-based and stimulus-based factors have on the perception of time.

The speed and temporal frequency of visual apparent motion modulate auditory duration perception

In the present study, we investigated how the perception of auditory duration could be modulated by a task-irrelevant, concurrent visual apparent motion, induced by visual bars alternating between left and right sides. Moreover, we examined the influence of the speed and temporal frequency of visual apparent motion on the perception of auditory duration. In each trial, the standard visual stimuli (two vertical bars) were presented sequentially, except that visual apparent motion was included in the fourth stimulus. A tone was presented simultaneously with each visual stimulus, while the fourth tone was presented with varied duration. Participants judged whether the fourth tone lasted longer than the other four tones. In Experiment 1, the speed of visual apparent motion (Fast vs. Slow) was manipulated by changing the interval between two bars. The mean point of subjective equality (PSE) in the Slow apparent motion condition was larger than that in the Static condition. Moreover, participants tended to overestimate the duration only in the Static condition, i.e., time dilation effect, which disappeared under apparent motion conditions. In Experiment 2, in addition to speed, we controlled the temporal frequency of apparent motion by manipulating the number of bars, generating four conditions of visual apparent motion (Physical-fast, Perceived-fast, Perceived-slow, vs. Static). The mean PSE was significantly smaller in the Physical-fast condition than in the Static and Perceived-slow conditions. Moreover, we found a time compression effect in both the Perceived-slow and Static conditions but not in the Perceived-fast and Physical-fast conditions. These results suggest that the auditory duration could be modulated by the concurrent, contextual visual apparent motion, and both the speed and temporal frequency of the task-irrelevant visual apparent motion contribute to the bias in perceiving the auditory duration.

Is the past farther than the future? A registered replication and test of the time-expansion hypothesis based on the filling rate of duration

Caruso et al. (2013) reported the Temporal Doppler Effect (TDE), in which people feel that the past is farther than the future. In this study, we made two high-power (N = 2244 in total), direct replication studies of Caruso et al. and additionally examined whether illusory temporal expansion, depending on the degree of fulfillment in durations, is related to the TDE. We predicted that the past would be felt farther than the future because the filling rate of duration of the past should be higher than that of the future. The results showed that psychological distance was significantly closer in the past than in the future and was inconsistently correlated with the filling rate of duration or the number and length of events and errands. Further, in some cases, the correlations were significant in the opposite direction of the predictions. Overall, our results did not replicate the previous findings but were reversed, and the filling rate of duration failed to explain the psychological distance. Based on these findings, we highlight the aspects that need to be clarified in future TDE studies. Preregistered Stage 1 protocol: https://osf.io/d9ec3/ (date of in-principle acceptance: 19/04/2022).

Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention

We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset-offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration.

Feature-based attentional selection affects the perceived duration of a stimulus having two superposed patterns

The perceived duration of a visual event is highly related to stimulus attributes. It is well known that a moving stimulus appears to last longer than a static one does. Previous studies have demonstrated that the time dilation in a moving stimulus can be influenced by perceived motion, rather than by mere physical motion, and that a faster motion appears to last longer than a slower one does. However, whether a top-down attentional set for the feature value can modulate the time dilation in a moving stimulus when two different visual patterns coexist within the same region of the visual field is still unknown. To test this, in Experiment 1, we presented a moving and a static random-dot pattern simultaneously within the same region, and instructed the observer to attend to one of these two patterns. The results demonstrate that perceived duration was longer when attention was directed to the moving, rather than static pattern, although both patterns physically coexisted at the same time and place and for the same duration. In Experiment 2, slow and/or fast moving patterns were presented at the same time and place, and again, feature-based attentional selection affected the perceived duration of the identical physical display. These results suggest that attention to a moving stimulus is an essential factor that determines the time dilation in a moving stimulus. This study revealed that feature-based attention, as opposed to location-based attention, plays an important role in motion-induced time dilation.

Rate after-effects fail to transfer cross-modally: Evidence for distributed sensory timing mechanisms

Accurate time perception is critical for a number of human behaviours, such as understanding speech and the appreciation of music. However, it remains unresolved whether sensory time perception is mediated by a central timing component regulating all senses, or by a set of distributed mechanisms, each dedicated to a single sensory modality and operating in a largely independent manner. To address this issue, we conducted a range of unimodal and cross-modal rate adaptation experiments, in order to establish the degree of specificity of classical after-effects of sensory adaptation. Adapting to a fast rate of sensory stimulation typically makes a moderate rate appear slower (repulsive after-effect), and vice versa. A central timing hypothesis predicts general transfer of adaptation effects across modalities, whilst distributed mechanisms predict a high degree of sensory selectivity. Rate perception was quantified by a method of temporal reproduction across all combinations of visual, auditory and tactile senses. Robust repulsive after-effects were observed in all unimodal rate conditions, but were not observed for any cross-modal pairings. Our results show that sensory timing abilities are adaptable but, crucially, that this change is modality-specific - an outcome that is consistent with a distributed sensory timing hypothesis.

Non-uniform transformation of subjective time during action preparation

Although many studies have reported a distortion of subjective (internal) time during preparation and execution of actions, it is highly controversial whether actions cause a dilation or compression of time. In the present study, we tested a hypothesis that the previous controversy (dilation vs. compression) partly resulted from a mixture of two types of sensory inputs on which a time length was estimated; some studies asked subjects to measure the time of presentation for a single continuous stimulus (stimulus period, e.g. the duration of a long-lasting visual stimulus on a monitor) while others required estimation of a period without continuous stimulations (no-stimulus period, e.g. an inter-stimulus interval between two flashes). Results of our five experiments supported this hypothesis, showing that action preparation induced a dilation of a stimulus period, whereas a no-stimulus period was not subject to this dilation and sometimes can be compressed by action preparation. Those results provided a new insight into a previous view assuming a uniform dilation or compression of subjective time by actions. Our findings about the distinction between stimulus and no-stimulus periods also might contribute to a resolution of mixed results (action-induced dilation vs. compression) in a previous literature.

A Brief History of “The Psychology of Time Perception”

Basic mechanisms of interval timing and associative learning are shared by many animal species, and develop quickly in early life, particularly across infancy, and childhood. Indeed, John Wearden in his book “The Psychology of Time Perception”, which is based on decades of his own research with colleagues, and which our commentary serves to primarily review, has been instrumental in implementing animal models and methods in children and adults, and has revealed important similarities (and differences) between human timing (and that of animals) when considered within the context of scalar timing theory. These seminal studies provide a firm foundation upon which the contemporary multifaceted field of timing and time perception has since advanced. The contents of the book are arguably one piece of a larger puzzle, and as Wearden cautions, “The reader is warned that my own contribution to the field has been exaggerated here, but if you are not interested in your own work, why would anyone else be?” Surely there will be many interested readers, however the book is noticeably lacking in it neurobiological perspective. The mind (however it is conceived) needs a brain (even if behaviorists tend to say “the brain behaves”, and most neuroscientists currently have a tenuous grasp on the neural mechanisms of temporal cognition), and to truly understand the psychology of time, brain and behavior must go hand in hand regardless of the twists, turns, and detours along the way.

Flickering task-irrelevant distractors induce dilation of target duration depending upon cortical distance

Flickering stimuli are perceived to be longer than stable stimuli. This so-called “flicker-induced time dilation” has been investigated in a number of studies, but the factors critical for this effect remain unclear. We explored the spatial distribution of the flicker effect and examined how the flickering task-irrelevant distractors spatially distant from the target induce time dilation. In two experiments, we demonstrated that flickering distractors dilated the perceived duration of the target stimulus even though the target stimulus itself was stable. In addition, when the distractor duration was much longer than the target duration, a flickering distractor located ipsilateral to the target caused greater time dilation than did a contralateral distractor. Thus the amount of dilation depended on the distance between the cortical areas responsible for the stimulus locations. These findings are consistent with the recent study reporting that modulation of neural oscillators encoding the interval duration could explain flicker-induced time dilation.

A single mechanism account of duration and rate processing via the pacemaker-accumulator and beat frequency models

Time is an essential dimension of our environment that allows us to extract meaningful information about speed of movement, speech, motor actions and fine motor control. Traditionally, models of time have tried to quantify how the brain might process the duration of an event. The most commonly cited are the pacemaker-accumulator model and the beat frequency model of interval timing, which explain how duration is perceived, represented and encoded. Here we posit such models as providing a powerful tool for simultaneously extracting, representing and encoding stimulus rate information. That is, any model that can process duration has all the information needed to code stimulus rate. We explore different processing strategies which would enable rate to be read off from both the pacemaker-accumulator and beat frequency model of interval timing. Finally we explore open questions that, when answered, will shed light upon potential mechanisms for duration and rate estimation.

Context-Dependent Neural Modulations in the Perception of Duration

Recent neuroimaging studies have revealed that distinct brain networks are recruited in the perception of sub- and supra-second timescales, whereas psychophysical studies have suggested that there are common or continuous mechanisms for perceiving these two durations. The present study aimed to elucidate the neural implementation of such continuity by examining the neural correlates of peri-second timing. We measured neural activity during a duration reproduction task using functional magnetic resonance imaging. Our results replicate the findings of previous studies in showing that separate neural networks are recruited for sub-versus supra-second time perception: motor systems including the motor cortex and the supplementary motor area for sub-second perception, and the frontal, parietal, and auditory cortical areas for supra-second perception. We further found that the peri-second perception activated both the sub- and supra-second networks, and that the timing system that processed duration perception in previous trials was more involved in subsequent peri-second processing. These results indicate that the sub- and supra-second timing systems overlap at around 1 s, and cooperate to optimally encode duration based on the hysteresis of previous trials.