Visual duration aftereffect is position invariant

Neural correlates of aftereffects induced by adaptations to single and average durations

Duration perception can be heavily distorted owing to repetitive exposure to a relatively long or short sensory event, often causing a duration aftereffect. Here, we used a novel procedure to show that adaptations to both single and average durations produced the duration aftereffect. Participants completed a duration reproduction task (Experiment 1) or a duration category rating task (Experiment 2) after long-term adaptations to a stimulus of medium duration and to stimuli of averagely medium duration. We found that adaptations to both single and average durations resulted in duration aftereffects. The simultaneously recorded functional magnetic resonance imaging (fMRI) data revealed that the reduction in neural activity due to long-term adaptation to single duration was observed in the right supramarginal gyrus (SMG) of the parietal lobe, while adaptation to average duration resulted in fMRI adaptations in the left postcentral gyrus (PCG) and middle cingulate gyrus (MCG). At the individual level, the magnitude of the behavioral aftereffect was positively correlated with the magnitude of fMRI adaptation in the right SMG after adaptation to single duration, while there were no significantly positive correlations between the behavioral aftereffect and fMRI adaptations in the left PCG and MCG. These results suggest that there are different neural mechanisms for aftereffects caused by adaptations to single and average durations.

Modality-specific sensory and decisional carryover effects in duration perception

BACKGROUND

The brain uses recent history when forming perceptual decisions. This results in carryover effects in perception. Although separate sensory and decisional carryover effects have been shown in many perceptual tasks, their existence and nature in temporal processing are unclear. Here, we investigated whether and how previous stimuli and previous choices affect subsequent duration perception, in vision and audition.

RESULTS

In a series of three experiments, participants were asked to classify visual or auditory stimuli into "shorter" or "longer" duration categories. In experiment 1, visual and auditory stimuli were presented in separate blocks. Results showed that current duration estimates were repelled away from the previous trial's stimulus duration, but attracted towards the previous choice, in both vision and audition. In experiment 2, visual and auditory stimuli were pseudorandomly presented in one block. We found that sensory and decisional carryover effects occurred only when previous and current stimuli were from the same modality. Experiment 3 further investigated the stimulus dependence of carryover effects within each modality. In this experiment, visual stimuli with different shape topologies (or auditory stimuli with different audio frequencies) were pseudorandomly presented in one visual (or auditory) block. Results demonstrated sensory carryover (within each modality) despite task-irrelevant differences in visual shape topology or audio frequency. By contrast, decisional carryover was reduced (but still present) across different visual topologies and completely absent across different audio frequencies.

CONCLUSIONS

These results suggest that serial dependence in duration perception is modality-specific. Moreover, repulsive sensory carryover effects generalize within each modality, whereas attractive decisional carryover effects are contingent on contextual details.

Visual timing-tuned responses in human association cortices and response dynamics in early visual cortex

Quantifying the timing (duration and frequency) of brief visual events is vital to human perception, multisensory integration and action planning. Tuned neural responses to visual event timing have been found in association cortices, in areas implicated in these processes. Here we ask how these timing-tuned responses are related to the responses of early visual cortex, which monotonically increase with event duration and frequency. Using 7-Tesla functional magnetic resonance imaging and neural model-based analyses, we find a gradual transition from monotonically increasing to timing-tuned neural responses beginning in the medial temporal area (MT/V5). Therefore, across successive stages of visual processing, timing-tuned response components gradually become dominant over inherent sensory response modulation by event timing. This additional timing-tuned response component is independent of retinotopic location. We propose that this hierarchical emergence of timing-tuned responses from sensory processing areas quantifies sensory event timing while abstracting temporal representations from spatial properties of their inputs.

Early visual cortical responses increase with event duration and frequency, while later timing-tuned responses quantify event timing. Here, the authors show timing tuning gradually emerges up the visual hierarchy, and separates temporal and spatial event features.

Color Sensitivity of the Duration Aftereffect Depends on Sub- and Supra-second Durations

The perception of duration becomes biased after repetitive duration adaptation; this is known as the duration aftereffect. The duration aftereffect exists in both the sub-second and supra-second ranges. However, it is unknown whether the properties and mechanisms of the adaptation aftereffect differ between sub-second and supra-second durations. In the present study, we addressed this question by investigating the color sensitivity of the duration aftereffect in the sub-second (Experiment 1) and supra-second (Experiment 2) ranges separately. We found that the duration aftereffect in the sub-second range could only partly transfer across different visual colors, whereas the duration aftereffect in the supra-second range could completely transfer across different visual colors. That is, the color-sensitivity of the duration aftereffect in the sub-second duration was stronger than that in the supra-second duration. These results imply that the mechanisms underlying the adaptation aftereffects of the sub-second and supra-second ranges are distinct.

Adaptation to average duration

There has been a recent surge of research examining how the visual system compresses information by representing the average properties of sets of similar objects to circumvent strict capacity limitations. Efficient representation by perceptual averaging helps to maintain the balance between the needs to perceive salient events in the surrounding environment and sustain the illusion of stable and complete perception. Whereas there have been many demonstrations that the visual system encodes spatial average properties, such as average orientation, average size, and average numerosity along single dimensions, there has been no investigation of whether the fundamental nature of average representations extends to the temporal domain. Here, we used an adaptation paradigm to demonstrate that the average duration of a set of sequentially presented stimuli negatively biases the perceived duration of subsequently presented information. This negative adaptation aftereffect is indicative of a fundamental visual property, providing the first evidence that average duration is encoded along a single visual dimension. Our results not only have important implications for how the visual system efficiently encodes redundant information to evaluate salient events as they unfold within the dynamic context of the surrounding environment, but also contribute to the long-standing debate regarding the neural underpinnings of temporal encoding.

Duration Selectivity in Right Parietal Cortex Reflects the Subjective Experience of Time

The perception of duration in the subsecond range has been hypothesized to be mediated by the population response of duration-sensitive units, each tuned to a preferred duration. One line of support for this hypothesis comes from neuroimaging studies showing that cortical regions, such as in parietal cortex exhibit duration tuning. It remains unclear whether this representation is based on the physical duration of the sensory input or the subjective duration, a question that is important given that our perception of the passage of time is often not veridical, but rather, biased by various contextual factors. Here we used fMRI to examine the neural correlates of subjective time perception in human participants. To manipulate perceived duration while holding physical duration constant, we used an adaptation method, in which, before judging the duration of a test stimulus, the participants were exposed to a train of adapting stimuli of a fixed duration. Behaviorally, this procedure produced a pronounced negative aftereffect: A short adaptor biased participants to judge stimuli as longer and a long adaptor-biased participants to judge stimuli as shorter. Duration tuning modulation, manifest as an attenuated BOLD response to stimuli similar in duration to the adaptor, was only observed in the right supramarginal gyrus (SMG) of the parietal lobe and middle occipital gyrus, bilaterally. Across individuals, the magnitude of the behavioral aftereffect was positively correlated with the magnitude of duration tuning modulation in SMG. These results indicate that duration-tuned neural populations in right SMG reflect the subjective experience of time.SIGNIFICANCE STATEMENT The subjective sense of time is a fundamental dimension of sensory experience. To investigate the neural basis of subjective time, we conducted an fMRI study, using an adaptation procedure that allowed us to manipulate perceived duration while holding physical duration constant. Regions within the occipital cortex and right parietal lobe showed duration tuning that was modulated when the test stimuli were similar in duration to the adaptor. Moreover, the magnitude of the distortion in perceived duration was correlated with the degree of duration tuning modulation in the parietal region. These results provide strong physiological evidence that the population coding of time in the right parietal cortex reflects our subjective experience of time.

Adaptation reveals multi-stage coding of visual duration

In conflict with historically dominant models of time perception, recent evidence suggests that the encoding of our environment's temporal properties may not require a separate class of neurons whose raison d'être is the dedicated processing of temporal information. If true, it follows that temporal processing should be imbued with the known selectivity found within non-temporal neurons. In the current study, we tested this hypothesis for the processing of a poorly understood stimulus parameter: visual event duration. We used sensory adaptation techniques to generate duration aftereffects: bidirectional distortions of perceived duration. Presenting adapting and test durations to the same vs different eyes utilises the visual system's anatomical progression from monocular, pre-cortical neurons to their binocular, cortical counterparts. Duration aftereffects exhibited robust inter-ocular transfer alongside a small but significant contribution from monocular mechanisms. We then used novel stimuli which provided duration information that was invisible to monocular neurons. These stimuli generated robust duration aftereffects which showed partial selectivity for adapt-test changes in retinal disparity. Our findings reveal distinct duration encoding mechanisms at monocular, depth-selective and depth-invariant stages of the visual hierarchy.

Feature-based attentional selection affects the perceived duration of a stimulus having two superposed patterns

The perceived duration of a visual event is highly related to stimulus attributes. It is well known that a moving stimulus appears to last longer than a static one does. Previous studies have demonstrated that the time dilation in a moving stimulus can be influenced by perceived motion, rather than by mere physical motion, and that a faster motion appears to last longer than a slower one does. However, whether a top-down attentional set for the feature value can modulate the time dilation in a moving stimulus when two different visual patterns coexist within the same region of the visual field is still unknown. To test this, in Experiment 1, we presented a moving and a static random-dot pattern simultaneously within the same region, and instructed the observer to attend to one of these two patterns. The results demonstrate that perceived duration was longer when attention was directed to the moving, rather than static pattern, although both patterns physically coexisted at the same time and place and for the same duration. In Experiment 2, slow and/or fast moving patterns were presented at the same time and place, and again, feature-based attentional selection affected the perceived duration of the identical physical display. These results suggest that attention to a moving stimulus is an essential factor that determines the time dilation in a moving stimulus. This study revealed that feature-based attention, as opposed to location-based attention, plays an important role in motion-induced time dilation.

Representations of time in human frontoparietal cortex

Precise time estimation is crucial in perception, action and social interaction. Previous neuroimaging studies in humans indicate that perceptual timing tasks involve multiple brain regions; however, whether the representation of time is localized or distributed in the brain remains elusive. Using ultra-high-field functional magnetic resonance imaging combined with multivariate pattern analyses, we show that duration information is decoded in multiple brain areas, including the bilateral parietal cortex, right inferior frontal gyrus and, albeit less clearly, the medial frontal cortex. Individual differences in the duration judgment accuracy were positively correlated with the decoding accuracy of duration in the right parietal cortex, suggesting that individuals with a better timing performance represent duration information in a more distinctive manner. Our study demonstrates that although time representation is widely distributed across frontoparietal regions, neural populations in the right parietal cortex play a crucial role in time estimation.

Masamichi Hayashi et al. combine high field neuroimaging (7T fMRI) and multivariate pattern analyses to show that the pattern of functional MRI activity in the right parietal lobe can predict the perception of time in individual participants. They find that while time representation is distributed across frontoparietal regions, the right parietal cortex plays a key role.

Object size determines the spatial spread of visual time

A key question for temporal processing research is how the nervous system extracts event duration, despite a notable lack of neural structures dedicated to duration encoding. This is in stark contrast with the orderly arrangement of neurons tasked with spatial processing. In this study, we examine the linkage between the spatial and temporal domains. We use sensory adaptation techniques to generate after-effects where perceived duration is either compressed or expanded in the opposite direction to the adapting stimulus' duration. Our results indicate that these after-effects are broadly tuned, extending over an area approximately five times the size of the stimulus. This region is directly related to the size of the adapting stimulus-the larger the adapting stimulus the greater the spatial spread of the after-effect. We construct a simple model to test predictions based on overlapping adapted versus non-adapted neuronal populations and show that our effects cannot be explained by any single, fixed-scale neural filtering. Rather, our effects are best explained by a self-scaled mechanism underpinned by duration selective neurons that also pool spatial information across earlier stages of visual processing.

Duration Aftereffect Depends on the Duration of Adaptation

It has been widely demonstrated that a prolonged adaptation to a relatively long or short stimulus leads to a robust repulsive duration aftereffect. However, little is known about the rapid adaptation to stimulus duration. In this study, we investigated whether the duration aftereffect could also be induced by short-term adaptation to stimuli of both sub- and supra-second durations. To control for the internal reference for duration judgment, participants were adapted to a stimulus of medium duration, and then tested with both longer and shorter stimuli. We found that the duration aftereffect was only observed after long-term adaptation to stimuli of both sub- and supra-second durations, which suggests that the exposure time to the adaptor is a fundamental factor in determining the duration aftereffect. Our findings offer further evidence of the duration aftereffect, which in this study was dissociated from the anchor effect and high-level aftereffects.

An investigation of the spatial selectivity of the duration after-effect

Adaptation to the duration of a visual stimulus causes the perceived duration of a subsequently presented stimulus with a slightly different duration to be skewed away from the adapted duration. This pattern of repulsion following adaptation is similar to that observed for other visual properties, such as orientation, and is considered evidence for the involvement of duration-selective mechanisms in duration encoding. Here, we investigated whether the encoding of duration - by duration-selective mechanisms - occurs early on in the visual processing hierarchy. To this end, we investigated the spatial specificity of the duration after-effect in two experiments. We measured the duration after-effect at adapter-test distances ranging between 0 and 15° of visual angle and for within- and between-hemifield presentations. We replicated the duration after-effect: the test stimulus was perceived to have a longer duration following adaptation to a shorter duration, and a shorter duration following adaptation to a longer duration. Importantly, this duration after-effect occurred at all measured distances, with no evidence for a decrease in the magnitude of the after-effect at larger distances or across hemifields. This shows that adaptation to duration does not result from adaptation occurring early on in the visual processing hierarchy. Instead, it seems likely that duration information is a high-level stimulus property that is encoded later on in the visual processing hierarchy.

Multiple channels of visual time perception

The proposal that the processing of visual time might rely on a network of distributed mechanisms that are vision-specific and timescale-specific stands in contrast to the classical view of time perception as the product of a single supramodal clock. Evidence showing that some of these mechanisms have a sensory component that can be locally adapted is at odds with another traditional assumption, namely that time is completely divorced from space. Recent evidence suggests that multiple timing mechanisms exist across and within sensory modalities and that they operate in various neural regions. The current review summarizes this evidence and frames it into the broader scope of models for time perception in the visual domain.

Duration Adaptation Occurs Across the Sub- and Supra-Second Systems

After repetitive exposure to a stimulus of relatively short duration, a subsequent stimulus of long duration is perceived as being even longer, and after repetitive exposure to a stimulus of relatively long duration, a subsequent stimulus of short duration is perceived as being even shorter. This phenomenon is called duration adaptation, and has been reported only for sub-second durations. We examined whether duration adaptation also occurs for supra-second durations (Experiment 1) and whether duration adaptation occurs across sub- and supra-second durations (Experiment 2). Duration adaptation occurred not only for sub-second durations, but also for supra-second durations and across sub- and supra-second durations. These results suggest that duration adaptation involves an interval-independent system or two functionally related systems that are associated with both the sub- and supra-second durations.