Adaptation reveals multi-stage coding of visual duration

Memorability shapes perceived time (and vice versa)

Visual stimuli are known to vary in their perceived duration. Some visual stimuli are also known to linger for longer in memory. Yet, whether these two features of visual processing are linked is unknown. Despite early assumptions that time is an extracted or higher-order feature of perception, more recent work over the past two decades has demonstrated that timing may be instantiated within sensory modality circuits. A primary location for many of these studies is the visual system, where duration-sensitive responses have been demonstrated. Furthermore, visual stimulus features have been observed to shift perceived duration. These findings suggest that visual circuits mediate or construct perceived time. Here we present evidence across a series of experiments that perceived time is affected by the image properties of scene size, clutter and memorability. More specifically, we observe that scene size and memorability dilate time, whereas clutter contracts it. Furthermore, the durations of more memorable images are also perceived more precisely. Conversely, the longer the perceived duration of an image, the more memorable it is. To explain these findings, we applied a recurrent convolutional neural network model of the ventral visual system, in which images are progressively processed over time. We find that more memorable images are processed faster, and that this increase in processing speed predicts both the lengthening and the increased precision of perceived durations. These findings provide evidence for a link between image features, time perception and memory that can be further explored with models of visual processing.

Color Sensitivity of the Duration Aftereffect Depends on Sub- and Supra-second Durations

The perception of duration becomes biased after repetitive duration adaptation; this is known as the duration aftereffect. The duration aftereffect exists in both the sub-second and supra-second ranges. However, it is unknown whether the properties and mechanisms of the adaptation aftereffect differ between sub-second and supra-second durations. In the present study, we addressed this question by investigating the color sensitivity of the duration aftereffect in the sub-second (Experiment 1) and supra-second (Experiment 2) ranges separately. We found that the duration aftereffect in the sub-second range could only partly transfer across different visual colors, whereas the duration aftereffect in the supra-second range could completely transfer across different visual colors. That is, the color-sensitivity of the duration aftereffect in the sub-second duration was stronger than that in the supra-second duration. These results imply that the mechanisms underlying the adaptation aftereffects of the sub-second and supra-second ranges are distinct.

Duration Selectivity in Right Parietal Cortex Reflects the Subjective Experience of Time

The perception of duration in the subsecond range has been hypothesized to be mediated by the population response of duration-sensitive units, each tuned to a preferred duration. One line of support for this hypothesis comes from neuroimaging studies showing that cortical regions, such as in parietal cortex exhibit duration tuning. It remains unclear whether this representation is based on the physical duration of the sensory input or the subjective duration, a question that is important given that our perception of the passage of time is often not veridical, but rather, biased by various contextual factors. Here we used fMRI to examine the neural correlates of subjective time perception in human participants. To manipulate perceived duration while holding physical duration constant, we used an adaptation method, in which, before judging the duration of a test stimulus, the participants were exposed to a train of adapting stimuli of a fixed duration. Behaviorally, this procedure produced a pronounced negative aftereffect: A short adaptor biased participants to judge stimuli as longer and a long adaptor-biased participants to judge stimuli as shorter. Duration tuning modulation, manifest as an attenuated BOLD response to stimuli similar in duration to the adaptor, was only observed in the right supramarginal gyrus (SMG) of the parietal lobe and middle occipital gyrus, bilaterally. Across individuals, the magnitude of the behavioral aftereffect was positively correlated with the magnitude of duration tuning modulation in SMG. These results indicate that duration-tuned neural populations in right SMG reflect the subjective experience of time.SIGNIFICANCE STATEMENT The subjective sense of time is a fundamental dimension of sensory experience. To investigate the neural basis of subjective time, we conducted an fMRI study, using an adaptation procedure that allowed us to manipulate perceived duration while holding physical duration constant. Regions within the occipital cortex and right parietal lobe showed duration tuning that was modulated when the test stimuli were similar in duration to the adaptor. Moreover, the magnitude of the distortion in perceived duration was correlated with the degree of duration tuning modulation in the parietal region. These results provide strong physiological evidence that the population coding of time in the right parietal cortex reflects our subjective experience of time.