Perceptual Content, Not Physiological Signals, Determines Perceived Duration When Viewing Dynamic, Natural Scenes

Memorability shapes perceived time (and vice versa)

Visual stimuli are known to vary in their perceived duration. Some visual stimuli are also known to linger for longer in memory. Yet, whether these two features of visual processing are linked is unknown. Despite early assumptions that time is an extracted or higher-order feature of perception, more recent work over the past two decades has demonstrated that timing may be instantiated within sensory modality circuits. A primary location for many of these studies is the visual system, where duration-sensitive responses have been demonstrated. Furthermore, visual stimulus features have been observed to shift perceived duration. These findings suggest that visual circuits mediate or construct perceived time. Here we present evidence across a series of experiments that perceived time is affected by the image properties of scene size, clutter and memorability. More specifically, we observe that scene size and memorability dilate time, whereas clutter contracts it. Furthermore, the durations of more memorable images are also perceived more precisely. Conversely, the longer the perceived duration of an image, the more memorable it is. To explain these findings, we applied a recurrent convolutional neural network model of the ventral visual system, in which images are progressively processed over time. We find that more memorable images are processed faster, and that this increase in processing speed predicts both the lengthening and the increased precision of perceived durations. These findings provide evidence for a link between image features, time perception and memory that can be further explored with models of visual processing.

Perceived time expands and contracts within each heartbeat

Perception of passing time can be distorted.¹ Emotional experiences, particularly arousal, can contract or expand experienced duration via their interactions with attentional and sensory processing mechanisms.^2,3 Current models suggest that perceived duration can be encoded from accumulation processes^4,5 and from temporally evolving neural dynamics.^6,7 Yet all neural dynamics and information processing ensue at the backdrop of continuous interoceptive signals originating from within the body. Indeed, phasic fluctuations within the cardiac cycle impact neural and information processing.^{8,9,10,11,12,13,14,15} Here, we show that these momentary cardiac fluctuations distort experienced time and that their effect interacts with subjectively experienced arousal. In a temporal bisection task, durations (200-400 ms) of an emotionally neutral visual shape or auditory tone (experiment 1) or of an image displaying happy or fearful facial expressions (experiment 2) were categorized as short or long.¹⁶ Across both experiments, stimulus presentation was time-locked to systole, when the heart contracts and baroreceptors fire signals to the brain, and to diastole, when the heart relaxes, and baroreceptors are quiescent. When participants judged the duration of emotionally neural stimuli (experiment 1), systole led to temporal contraction, whereas diastole led to temporal expansion. Such cardiac-led distortions were further modulated by the arousal ratings of the perceived facial expressions (experiment 2). At low arousal, systole contracted while diastole expanded time, but as arousal increased, this cardiac-led time distortion disappeared, shifting duration perception toward contraction. Thus, experienced time contracts and expands within each heartbeat-a balance that is disrupted under heightened arousal.

Movie editing influences spectators' time perception

Filmmakers use different techniques (e.g., camera movements, editing) to shape viewers' experience. In particular, editing can be used to handle the temporal unfolding of events represented in a movie. Nevertheless, little is known about how different editing types impact viewers' time perception. In an exploratory on-line study (90 participants) and a pre-registered conceptual replication study (60 participants), we asked participants to judge (Study 1) or reproduce (Study 2) the duration of 45 excerpts of the movie "Le Ballon Rouge" containing either continuous editing, action discontinuity editing or no editing. Each excerpt was formatted in three durations (2000, 2500 or 3000 ms). In both studies, we reported that scenes containing continuous editing were perceived as longer than the other two scene types. Moreover, scenes containing action discontinuity editing were perceived as longer than scenes with no editing. This study contributes to the emerging field of psycho-cinematics which could ultimately develop the dialog between arts and science.

Trial-by-trial predictions of subjective time from human brain activity

Human experience of time exhibits systematic, context-dependent deviations from clock time; for example, time is experienced differently at work than on holiday. Here we test the proposal that differences from clock time in subjective experience of time arise because time estimates are constructed by accumulating the same quantity that guides perception: salient events. Healthy human participants watched naturalistic, silent videos of up to 24 seconds in duration and estimated their duration while fMRI was acquired. We were able to reconstruct trial-by-trial biases in participants’ duration reports, which reflect subjective experience of duration, purely from salient events in their visual cortex BOLD activity. By contrast, salient events in neither of two control regions–auditory and somatosensory cortex–were predictive of duration biases. These results held despite being able to (trivially) predict clock time from all three brain areas. Our results reveal that the information arising during perceptual processing of a dynamic environment provides a sufficient basis for reconstructing human subjective time duration.

Our perception of time isn’t like a clock; it varies depending on other aspects of experience, such as what we see and hear in that moment. Previous studies have shown that differences in simple features, such as an image being larger or smaller, or brighter or dimmer, can change how we perceive time for those experiences. But in everyday life, the properties of these simple features can change frequently, presenting a challenge to understanding real-world time perception based on simple lab experiments. To overcome this problem, we developed a computational model of human time perception based on tracking changes in neural activity across brain regions involved in sensory processing (using non-invasive brain imaging). By measuring changes in brain activity patterns across these regions, our approach accommodates the different and changing feature combinations present in natural scenarios, such as walking on a busy street. Our model reproduces people’s duration reports for natural videos (up to almost half a minute long) and, most importantly, predicts whether a person reports a scene as relatively shorter or longer–the biases in time perception that reflect how natural experience of time deviates from clock time.

A proxy measure of striatal dopamine predicts individual differences in temporal precision

The perception of time is characterized by pronounced variability across individuals, with implications for a diverse array of psychological functions. The neurocognitive sources of this variability are poorly understood, but accumulating evidence suggests a role for inter-individual differences in striatal dopamine levels. Here we present a pre-registered study that tested the predictions that spontaneous eyeblink rates, which provide a proxy measure of striatal dopamine availability, would be associated with aberrant interval timing (lower temporal precision or overestimation bias). Neurotypical adults (N = 69) underwent resting state eye tracking and completed visual psychophysical interval timing and control tasks. Elevated spontaneous eyeblink rates were associated with poorer temporal precision but not with inter-individual differences in perceived duration or performance on the control task. These results signify a role for striatal dopamine in variability in human time perception and can help explain deficient temporal precision in psychiatric populations characterized by elevated dopamine levels.