Timescale- and Sensory Modality-Dependency of the Central Tendency of Time Perception

Visual movement impairs duration discrimination at short intervals

The classic advantage of audition over vision in time processing has been recently challenged by studies using continuously moving visual stimuli such as bouncing balls. Bouncing balls drive beat-based synchronisation better than static visual stimuli (flashes) and as efficiently as auditory ones (beeps). It is yet unknown how bouncing balls modulate performance in duration perception. Our previous study addressing this was inconclusive: there were no differences among bouncing balls, flashes, and beeps, but this could have been due to the fact that intervals were too long to allow sensitivity to modality (visual vs auditory). In this study, we conducted a first experiment to determine whether shorter intervals elicit cross-stimulus differences. We found that short (mean 157 ms) but not medium (326 ms) intervals made duration perception worse for bouncing balls compared with flashes and beeps. In a second experiment, we investigated whether the lower efficiency of bouncing balls was due to experimental confounds, lack of realism, or movement. We ruled out the experimental confounds and found support for the hypothesis that visual movement-be it continuous or discontinuous-impairs duration perception at short interval lengths. Therefore, unlike beat-based synchronisation, duration perception does not benefit from continuous visual movement, which may even have a detrimental effect at short intervals.

A unitary mechanism underlies adaptation to both local and global environmental statistics in time perception

Our duration estimation flexibly adapts to the statistical properties of the temporal context. Humans and non-human species exhibit a perceptual bias towards the mean of durations previously observed as well as serial dependence, a perceptual bias towards the duration of recently processed events. Here we asked whether those two phenomena arise from a unitary mechanism or reflect the operation of two distinct systems that adapt separately to the global and local statistics of the environment. We employed a set of duration reproduction tasks in which the target duration was sampled from distributions with different variances and means. The central tendency and serial dependence biases were jointly modulated by the range and the variance of the prior, and these effects were well-captured by a unitary mechanism model in which temporal expectancies are updated after each trial based on perceptual observations. Alternative models that assume separate mechanisms for global and local contextual effects failed to capture the empirical results.

Auditory timing-tuned neural responses in the human auditory cortices

Perception of sub-second auditory event timing supports multisensory integration, and speech and music perception and production. Neural populations tuned for the timing (duration and rate) of visual events were recently described in several human extrastriate visual areas. Here we ask whether the brain also contains neural populations tuned for auditory event timing, and whether these are shared with visual timing. Using 7T fMRI, we measured responses to white noise bursts of changing duration and rate. We analyzed these responses using neural response models describing different parametric relationships between event timing and neural response amplitude. This revealed auditory timing-tuned responses in the primary auditory cortex, and auditory association areas of the belt, parabelt and premotor cortex. While these areas also showed tonotopic tuning for auditory pitch, pitch and timing preferences were not consistently correlated. Auditory timing-tuned response functions differed between these areas, though without clear hierarchical integration of responses. The similarity of auditory and visual timing tuned responses, together with the lack of overlap between the areas showing these responses for each modality, suggests modality-specific responses to event timing are computed similarly but from different sensory inputs, and then transformed differently to suit the needs of each modality.

The role of neural tuning in quantity perception

Perception of quantities, such as numerosity, timing, and size, is essential for behavior and cognition. Accumulating evidence demonstrates neurons processing quantities are tuned, that is, have a preferred quantity amount, not only for numerosity, but also other quantity dimensions and sensory modalities. We argue that quantity-tuned neurons are fundamental to understanding quantity perception. We illustrate how the properties of quantity-tuned neurons can underlie a range of perceptual phenomena. Furthermore, quantity-tuned neurons are organized in distinct but overlapping topographic maps. We suggest that this overlap in tuning provides the neural basis for perceptual interactions between different quantities, without the need for a common neural representational code.

Time-to-Collision Estimations in Young Drivers with Autism Spectrum Disorder and Attention-Deficit/Hyperactivity Disorder

Individuals with attention-deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) may exhibit driving difficulties due to cognitive impairments such as time perception difficulties, a construct related to the perception of time-to-collision (TTC). This study examined the timing abilities of drivers with ASD and ADHD. Sixty participants (n_ADHD = 20, n_ASD = 20, n_TD = 20) completed a time reproduction task and a TTC estimation task in a driving simulator. Results indicated drivers with ASD were less precise in time reproduction across all time intervals and over-reproduced time at shorter intervals. Drivers with ASD produced larger TTC estimates when driving at a faster speed compared to typically developing drivers. Drivers with ASD, but not ADHD, appear to present difficulties in time estimation abilities.

Disentangling the effects of modality, interval length and task difficulty on the accuracy and precision of older adults in a rhythmic reproduction task

Studies on the functional quality of the internal clock that governs the temporal processing of older adults have demonstrated mixed results as to whether they perceive and produce time slower, faster, or equally well as younger adults. These mixed results are due to a multitude of methodologies applied to study temporal processing: many tasks demand different levels of cognitive ability. To investigate the temporal accuracy and precision of older adults, in Experiment 1, we explored the age-related differences in rhythmic continuation task taking into consideration the effects of attentional resources required by the stimulus (auditory vs. visual; length of intervals). In Experiment 2, we added a dual task to explore the effect of attentional resources required by the task. Our findings indicate that (1) even in an inherently automatic rhythmic task, where older and younger adult’s general accuracy is comparable, accuracy but not precision is altered by the stimulus properties and (2) an increase in task load can magnify age-related differences in both accuracy and precision.

Discrimination of Regular and Irregular Rhythms Explained by a Time Difference Accumulation Model

Perceiving the temporal regularity in a sequence of repetitive sensory events facilitates the preparation and execution of relevant behaviors with tight temporal constraints. How we estimate temporal regularity from repeating patterns of sensory stimuli is not completely understood. We developed a decision-making task in which participants had to decide whether a train of visual, auditory, or tactile pulses, had a regular or an irregular temporal pattern. We tested the hypothesis that subjects categorize stimuli as irregular by accumulating the time differences between the predicted and observed times of sensory pulses defining a temporal rhythm. Results suggest that instead of waiting for a single large temporal deviation, participants accumulate timing-error signals and judge a pattern as irregular when the amount of evidence reaches a decision threshold. Model fits of bounded integration showed that this accumulation occurs with negligible leak of evidence. Consistent with previous findings, we show that participants perform better when evaluating the regularity of auditory pulses, as compared with visual or tactile stimuli. Our results suggest that temporal regularity is estimated by comparing expected and measured pulse onset times, and that each prediction error is accumulated towards a threshold to generate a behavioral choice.

Temporal Context affects interval timing at the perceptual level

There is now ample evidence that when observers are asked to estimate features of an object they take into account recent stimulation history and blend the current sensory evidence with the recent stimulus intensity according to their reliability. Most of this evidence has been obtained via estimation or production paradigms both of which entail a conspicuous post-perceptual decision stage. So it is an unsolved question, as to whether the trace of previous stimulation contributes at the decision stage or as early as the perceptual stage. To this aim we focused on duration judgments, which typically exhibit strong central tendency effects and asked a duration comparison between two intervals, one of which characterized by high uncertainty. We found that the perceived duration of this interval regressed toward the average duration, demonstrating a genuine perceptual bias. Regression did not transfer between the visual and the auditory modality, indicating it is modality specific, but generalized across passively observed and actively produced intervals. These findings suggest that temporal central tendency effects modulate how long an interval appears to us and that integration of current sensory evidence can occur as early as in the sensory systems.

Cross-Modal Conflict Increases With Time-on-Task in a Temporal Discrimination Task

The modality appropriateness hypothesis argues that the auditory modality is preferred over the visual modality in tasks demanding temporal operations; hence, we predicted that responses to visual stimuli would be more sensitive to the detrimental effect of Time-on-Task. We used a bimodal temporal discrimination task. The factors were durational congruency between the modalities and the direction of modality-transmission. Participants needed to decide the duration of the cued stimulus (visual or auditory). The first five blocks of the task lasted about 1.5 h without rest [Time-on-Task (ToT) period]. The participants then had a 12-min break followed by an additional block of trials. Subjective fatigue, reaction time, error rates, and electrocardiographic data were recorded. In the visual modality, we found an enhanced congruency effect as a function of ToT. The cost of attentional shifting was higher in the auditory modality, but remained constant, suggesting that processing of auditory stimuli is robust against the effects of fatigue. Performance did not improve after the break, indicating that the effects of fatigue could not be overcome by taking a brief break. The heart rate variability (HRV) data showed that vagal inhibition increased with ToT, but this increase was not associated with the changes in performance.

Gender Differences in the Effect of Facial Attractiveness on Perception of Time

Time perception plays a fundamental role in human social activities, and it can be influenced in social situations by various factors, including facial attractiveness. However, in the eyes of observers of different genders, the attractiveness of a face varies. The current study aimed to explore whether gender modulates the effect of facial attractiveness on time perception. To account for individual differences in esthetic standards, the critical stimuli presented to each participant were selected from an image pool based on the participant’s own attractiveness judgments. In Experiment 1, men and women performed a stimuli selection task followed by a temporal reproduction task to measure their time perception of faces of different attractiveness levels and gender. To control for the potential influence of task order, Experiment 2 flipped the order of the selection and temporal tasks. Taken together, the experiments showed that both men and women exhibited longer reproduced durations for attractive opposite-sex faces than for unattractive opposite-sex faces; conversely, in the same-sex face condition, women still exhibited longer reproduced durations for attractive faces than for unattractive faces, whereas the effect of facial attractiveness on time perception among men tended to be smaller or even fail to reach significance. These results suggest that gender differences play an important role in the effect of facial attractiveness on time perception.

Optimal multisensory integration leads to optimal time estimation

Our brain compensates sensory uncertainty by combining multisensory information derived from an event, and by integrating the current sensory signal with the prior knowledge about the statistical structure of previous events. There is growing evidence that both strategies are statistically optimal; however, how these two stages of information integration interact and shape an optimal percept remains an open question. In the present study, we investigated the perception of time as an amodal perceptual attribute. The central tendency, a phenomenon of biasing the current percept toward previous stimuli, is used to quantify and model how the prior information affects the current timing behavior. We measured the timing sensitivity and the central tendency for unisensory and multisensory stimuli with sensory uncertainty systematically manipulated by adding noise. Psychophysical results demonstrate that the central tendency increases as the uncertainty increases, and that the multisensory timing improves both the timing sensitivity and the central tendency bias compared to the unisensory timing. Computational models indicate that the optimal multisensory integration precedes the optimal integration of prior information causing the central tendency. Our findings suggest that our brain incorporates the multisensory information and prior knowledge in a statistically optimal manner to realize precise and accurate timing behavior.

Multiple Time Intervals of Visual Events Are Represented as Discrete Items in Working Memory

Previous studies on time perception and temporal memory have focused primarily on single time intervals; it is still unclear how multiple time intervals are perceived and maintained in working memory. In the present study, using Sternberg's item recognition task, we compared the working memory of multiple items with different time intervals and visual textures, for sub- and supra-second ranges, and investigated the characteristics of working memory representation in the framework of the signal detection theory. In Experiments 1-3, gratings with different spatial frequencies and time intervals were sequentially presented as study items, followed by another grating as a probe. Participants determined whether the probe matched one of the study gratings, in either the temporal dimension or in the visual dimension. The results exhibited typical working memory characteristics such as the effects of memory load, serial position, and similarity between probe and study gratings, similarly, to the time intervals and visual textures. However, there were some differences between the two conditions. Specifically, the recency effect for time intervals was smaller, or even absent, as compared to that for visual textures. Further, as compared with visual textures, sub-second intervals were more likely to be judged as remembered in working memory. In addition, we found interactions between visual texture memory and time interval memory, and such visual-interval binding differed between sub- and supra-second ranges. Our results indicate that multiple time intervals are stored as discrete items in working memory, similarly, to visual texture memory, but the former might be more susceptible to decay than the latter. The differences in the binding between sub- and supra-second ranges imply that working memory for sub- and supra-second ranges may differ in the relatively higher decision stage.

Visual-auditory differences in duration discrimination depend on modality-specific, sensory-automatic temporal processing: Converging evidence for the validity of the Sensory-Automatic Timing Hypothesis

The Sensory-Automatic Timing Hypothesis assumes visual-auditory differences in duration discrimination to originate from sensory-automatic temporal processing. Although temporal discrimination of extremely brief intervals in the range of tens-of-milliseconds is predicted to depend mainly on modality-specific, sensory-automatic temporal processing, duration discrimination of longer intervals is predicted to require more and more amodal, higher order cognitive resources and decreasing input from the sensory-automatic timing system with increasing interval duration. In two duration discrimination experiments with sensory modality as a within- and a between-subjects variable, respectively, we tested two decisive predictions derived from the Sensory-Automatic Timing Hypothesis: (1) visual-auditory differences in duration discrimination were expected to be larger for brief intervals in the tens-of-milliseconds range than for longer ones, and (2) visual-auditory differences in duration discrimination of longer intervals should disappear when statistically controlled for modality-specific input from the sensory-automatic timing system. In both experiments, visual-auditory differences in duration discrimination were larger for the brief than for the longer intervals. Furthermore, visual-auditory differences observed with longer intervals disappeared when statistically controlled for modality-specific input from the sensory-automatic timing system. Thus, our findings clearly confirmed the validity of the Sensory-Automatic Timing Hypothesis.

A Bayesian Perspective on Accumulation in the Magnitude System

Several theoretical and empirical work posit the existence of a common magnitude system in the brain. Such a proposal implies that manipulating stimuli in one magnitude dimension (e.g. duration in time) should interfere with the subjective estimation of another magnitude dimension (e.g. size in space). Here, we asked whether a generalized Bayesian magnitude estimation system would sample sensory evidence using a common, amodal prior. Two psychophysical experiments separately tested participants on their perception of duration, surface, and numerosity when the non-target magnitude dimensions and the rate of sensory evidence accumulation were manipulated. First, we found that duration estimation was resilient to changes in surface and numerosity, whereas lengthening (shortening) the duration yielded under- (over-) estimations of surface and numerosity. Second, the perception of surface and numerosity were affected by changes in the rate of sensory evidence accumulation, whereas duration was not. Our results suggest that a generalized magnitude system based on Bayesian computations would minimally necessitate multiple priors.