Motor commands induce time compression for tactile stimuli

Lost in time: Relocating the perception of duration outside the brain

It is well-accepted in neuroscience that animals process time internally to estimate the duration of intervals lasting between one and several seconds. More than 100 years ago, Henri Bergson nevertheless remarked that, because animals have memory, their inner experience of time is ever-changing, making duration impossible to measure internally and time a source of change. Bergson proposed that quantifying the inner experience of time requires its externalization in movements (observed or self-generated), as their unfolding leaves measurable traces in space. Here, studies across species are reviewed and collectively suggest that, in line with Bergson's ideas, animals spontaneously solve time estimation tasks through a movement-based spatialization of time. Moreover, the well-known scalable anticipatory responses of animals to regularly spaced rewards can be explained by the variable pressure of time on reward-oriented actions. Finally, the brain regions linked with time perception overlap with those implicated in motor control, spatial navigation and motivation. Thus, instead of considering time as static information processed by the brain, it might be fruitful to conceptualize it as a kind of force to which animals are more or less sensitive depending on their internal state and environment.

Hand movements influence the perception of time in a prediction motion task

Human perception of time is far from accurate and is subject to distortions. Previous research has demonstrated that any manipulation that distorts the perceived velocity of visible moving objects may shift prediction motion (PM) performance during occlusion. However, it is not clear whether motor action has the same influence during occlusion in the PM task. This work evaluated the influence of action on PM performance in two experiments. In both cases, participants performed an interruption paradigm, evaluating if an occluded object had reappeared earlier or later than expected. This task was done simultaneously with a motor action. In Experiment 1, we compared the PM performance according to the timing of the action made while the object was still visible or occluded. In Experiment 2, participants had to perform (or not) a motor action if the target was green (or red). In both experiments, our results showed that the duration of the object's occlusion was underestimated in the specific case of acting during the occlusion period. These results suggest that action and temporal perception share similar neural bases. Future research is needed to confirm this hypothesis.

Evidence for a cost of time in the invigoration of isometric reaching movements

How the brain determines the vigor of goal-directed movements is a fundamental question in neuroscience. Recent evidence has suggested that vigor results from a trade-off between a cost related to movement production (cost of movement) and a cost related to our brain's tendency to temporally discount the value of future reward (cost of time). However, whether it is critical to hypothesize a cost of time to explain the vigor of basic reaching movements with intangible reward is unclear because the cost of movement may be theoretically sufficient for this purpose. Here we directly address this issue by designing an isometric reaching task whose completion can be accurate and effortless in prefixed durations. The cost of time hypothesis predicts that participants should be prone to spend energy to save time even if the task can be accomplished at virtually no motor cost. Accordingly, we found that all participants generated substantial amounts of force to invigorate task accomplishment, especially when the prefixed duration was long enough. Remarkably, the time saved by each participant was linked to their original vigor in the task and predicted by an optimal control model balancing out movement and time costs. Taken together, these results supports the existence of an idiosyncratic, cognitive cost of time that underlies the invigoration of basic isometric reaching movements.

Slowing the body slows down time perception

Interval timing is a fundamental component of action and is susceptible to motor-related temporal distortions. Previous studies have shown that concurrent movement biases temporal estimates, but have primarily considered self-modulated movement only. However, real-world encounters often include situations in which movement is restricted or perturbed by environmental factors. In the following experiments, we introduced viscous movement environments to externally modulate movement and investigated the resulting effects on temporal perception. In two separate tasks, participants timed auditory intervals while moving a robotic arm that randomly applied four levels of viscosity. Results demonstrated that higher viscosity led to shorter perceived durations. Using a drift-diffusion model and a Bayesian observer model, we confirmed these biasing effects arose from perceptual mechanisms, instead of biases in decision making. These findings suggest that environmental perturbations are an important factor in movement-related temporal distortions, and enhance the current understanding of the interactions of motor activity and cognitive processes.

Effect of Exercise-Related Factors on the Perception of Time

The concept of time whether considered through the lenses of physics or physiology is a relative measure. Alterations in time perception can have serious implications in sport, fitness and work. Accurate perception of time is an important skill with many time constrained sports (i.e., basketball, North American football, tennis, gymnastics, figure skating, ice hockey, and others), and work environments (i.e., workers who need to synchronize their actions such as police and military). In addition, time distortions may play a role in exercise adherence. Individuals may be disinclined to continue with healthy, exercise activities that seem protracted (time dilation). Two predominant theories (scalar expectancy theory and striatal beat frequency model) emphasize the perception of the number of events in a period and the role of neurotransmitters in activating and coordinating cortical structures, respectively. A number of factors including age, sex, body temperature, state of health and fitness, mental concentration and exercise intensity level have been examined for their effect on time perception. However, with the importance of time perception for work, sport and exercise, there is limited research on this area. Since work, sports, and exercise can involve an integration of many of these aforementioned factors, they are interventions that need further investigations. The multiplicity of variables involved with work, sport, and exercise offer an underdeveloped but fruitful field for future research. Thus, the objective of this review was to examine physiological and psychological factors affecting human perception of time and the mechanisms underlying time perception and distortion with activity.

Action-induced changes in the perceived temporal features of visual events

Perceived duration can be subject to deviations around the time of a voluntary action. Whether the mechanisms underlying action-induced visual duration effects are effector-specific or require a more generalized action-linked multimodal calibration with the transient visual system, however, is a question yet to be answered. Here, we investigate this using dynamic visual stimuli presented as contingent upon the execution of an arbitrarily associated voluntary manual response. Our results demonstrate that the duration of intervals with arbitrarily associated keypress-visual event pair is perceived as shorter than the duration in a pure visual condition, where the same stimuli are rather passively observed without the execution of a concurrent action. Whereas the control experiments show that motor memory and attention cannot explain the action-induced changes in perceived temporal features, action-induced changes in perceived speed are dissociated from those in perceived duration, and that the duration compression disappears using isoluminant or static stimuli, which together provide evidence that these two effects can be modulated in the motion-processing units, although via separate neural mechanisms.

Sensory- and Action-Oriented Embodiment of Neurally-Interfaced Robotic Hand Prostheses

Embodiment is the percept that something not originally belonging to the self becomes part of the body. Feeling embodiment for a prosthesis may counteract amputees' altered image of the body and increase prosthesis acceptability. Prosthesis embodiment has been studied longitudinally in an amputee receiving feedback through intraneural and perineural multichannel electrodes implanted in her stump. Three factors-invasive (vs non-invasive) stimulation, training, and anthropomorphism-have been tested through two multisensory integration tasks: visuo-tactile integration (VTI) and crossing-hand effect in temporal order judgment (TOJ), the former more sensible to an extension of a safe margin around the body and the latter to action-oriented remapping. Results from the amputee participant were compared with the ones from healthy controls. Testing the participant with intraneural stimulation produced an extension of peripersonal space, a sign of prosthesis embodiment. One-month training extended the peripersonal space selectively on the side wearing the prostheses. More and less-anthropomorphic prostheses benefited of intraneural feedback and extended the peripersonal space. However, the worsening of TOJ performance following arm crossing was present only wearing the more trained, despite less anthropomorphic, prosthesis, suggesting that training was critical for our participant to achieve operative tool-like embodiment.

Movement Improves the Quality of Temporal Perception and Decision-Making

A critical aspect of behavior is that mobile organisms must be able to precisely determine where and when to move. A better understanding of the mechanisms underlying precise movement timing and action planning is therefore crucial to understanding how we interact with the world around us. Recent evidence suggests that our experience of time is directly and intrinsically computed within the motor system, consistent with the theory of embodied cognition. To investigate the role of the motor system, we tested human subjects (n = 40) on a novel task combining reaching and time estimation. In this task, subjects were required to move a robotic manipulandum to one of two physical locations to categorize a concurrently timed suprasecond. Critically, subjects were divided into two groups: one in which movement during the interval was unrestricted and one in which they were restricted from moving until the stimulus interval had elapsed. Our results revealed a higher degree of precision for subjects in the free-moving group. A further experiment (n = 14) verified that these findings were not due to proximity to the target, counting strategies, bias, or movement length. A final experiment (n = 10) replicated these findings using a within-subjects design, performing a time reproduction task, in which movement during encoding of the interval led to more precise performance. Our findings suggest that time estimation may be instantiated within the motor system as an ongoing readout of timing judgment and confidence.

The role of time perception in temporal binding: Impaired temporal resolution in causal sequences

Causality affects our perception of time; events that appear as causally related are perceived as closer together in time than unrelated events. This effect is known as temporal binding. One potential explanation of this effect is that causality slows an "internal clock" that is used in interval estimation. To explore this hypothesis, we first examined participants' perceived duration of a range of intervals between a causal action and an effect, or between two unrelated events. If (apparent) causality slows the internal clock, then plotting perceived duration against actual duration should reveal a shallower slope in the causality condition (a relative compression of perceived time). This pattern was found. We then examined an interesting corollary: that a slower rate during causal sequences would result in reduced temporal acuity. This is what we found: Duration discrimination thresholds were higher for causal compared to non-causal sequences. These results are compatible with a clock-slowing account of temporal binding. Implications for sensory recalibration accounts of binding are discussed.

The Common Rhythm of Action and Perception

Research in the last decade has undermined the idea of perception as a continuous process, providing strong empirical support for its rhythmic modulation. More recently, it has been revealed that the ongoing motor processes influence the rhythmic sampling of sensory information. In this review, we will focus on a growing body of evidence suggesting that oscillation-based mechanisms may structure the dynamic interplay between the motor and sensory system and provide a unified temporal frame for their effective coordination. We will describe neurophysiological data, primarily collected in animals, showing phase-locking of neuronal oscillations to the onset of (eye) movements. These data are complemented by novel evidence in humans, which demonstrate the behavioral relevance of these oscillatory modulations and their domain-general nature. Finally, we will discuss the possible implications of these modulations for action-perception coupling mechanisms.

Rhythmic motor behaviour influences perception of visual time

Temporal processing is fundamental for an accurate synchronization between motor behaviour and sensory processing. Here, we investigate how motor timing during rhythmic tapping influences perception of visual time. Participants listen to a sequence of four auditory tones played at 1 Hz and continue the sequence (without auditory stimulation) by tapping four times with their finger. During finger tapping, they are presented with an empty visual interval and are asked to judge its length compared to a previously internalized interval of 150 ms. The visual temporal estimates show non-monotonic changes locked to the finger tapping: perceived time is maximally expanded at halftime between the two consecutive finger taps, and maximally compressed near tap onsets. Importantly, the temporal dynamics of the perceptual time distortion scales linearly with the timing of the motor tapping, with maximal expansion always being anchored to the centre of the inter-tap interval. These results reveal an intrinsic coupling between distortion of perceptual time and production of self-timed motor rhythms, suggesting the existence of a timing mechanism that keeps perception and action accurately synchronized.

Audio Feedback Associated With Body Movement Enhances Audio and Somatosensory Spatial Representation

In the last years, the positive impact of sensorimotor rehabilitation training on spatial abilities has been taken into account, e.g., providing evidence that combined multimodal compared to unimodal feedback improves responsiveness to spatial stimuli. To date, it still remains unclear to which extent spatial learning is influenced by training conditions. Here we investigated the effects of active and passive audio-motor training on spatial perception in the auditory and proprioceptive domains on 36 healthy young adults. First, to investigate the role of voluntary movements on spatial perception, we compared the effects of active vs. passive multimodal training on auditory and proprioceptive spatial localization. Second, to investigate the effectiveness of unimodal training conditions on spatial perception, we compared the impact of only proprioceptive or only auditory sensory feedback on spatial localization. Finally, to understand whether the positive effects of multimodal and unimodal trainings generalize to the untrained part, both dominant and non-dominant arms were tested. Results indicate that passive multimodal training (guided movement) is more beneficial than active multimodal training (active exploration) and only in passive condition the improvement is generalized also on the untrained hand. Moreover, we found that combined audio-motor training provides the strongest benefit because it significantly affects both auditory and somatosensory localization, while the effect of a single feedback modality is limited to a single domain, indicating a cross-modal influence of the two domains. Therefore, the use of multimodal feedback is more efficient in improving spatial perception. These results indicate that combined sensorimotor signals are effective in recalibrating auditory and proprioceptive spatial perception and that the beneficial effect is mainly due to the combination of auditory and proprioceptive spatial cues.

Perceptual Oscillation of Audiovisual Time Simultaneity

Action and perception are tightly coupled systems requiring coordination and synchronization over time. How the brain achieves synchronization is still a matter of debate, but recent experiments suggest that brain oscillations may play an important role in this process. Brain oscillations have been also proposed to be fundamental in determining time perception. Here, we had subjects perform an audiovisual temporal order judgment task to investigate the fine dynamics of temporal bias and sensitivity before and after the execution of voluntary hand movement (button-press). The reported order of the audiovisual sequence was rhythmically biased as a function of delay from hand action execution. Importantly, we found that it oscillated at a theta range frequency, starting ∼500 ms before and persisting ∼250 ms after the button-press, with consistent phase-locking across participants. Our results show that the perception of cross-sensory simultaneity oscillates rhythmically in synchrony with the programming phase of a voluntary action, demonstrating a link between action preparation and bias in temporal perceptual judgments.

Sub-Second Temporal Integration of Vibro-Tactile Stimuli: Intervals between Adjacent, Weak, and Within-Channel Stimuli Are Underestimated

Tactile estimation of sub-second time is essential for correct recognition of sensory inputs and dexterous manipulation of objects. Despite our intuitive understanding that time is robustly estimated in any situation, tactile sub-second time is altered by, for example, body movement, similar to how visual time is modulated by eye movement. The effects of simpler factors, such as stimulus location, intensity, and frequency, have also been reported in temporal tasks in other modalities, but their effects on tactile sub-second interval estimation remain obscure. Here, we were interested in whether a perceived short interval presented by tactile stimuli is altered only by changing stimulus features. The perceived interval between a pair of stimuli presented on the same finger apparently became short relative to that on different fingers; that of a weak-intensity pair relative to that of a pair with stronger intensity was decreased; and that of a pair with the same frequency relative to one with different frequencies was underestimated. These findings can be ascribed to errors in encoding temporal relationships: nearby-space/weak-intensity/similar-frequency stimuli presented within a short time difference are likely to be integrated into a single event and lead to relative time compression.

Theta oscillations locked to intended actions rhythmically modulate perception

Ongoing brain oscillations are known to influence perception, and to be reset by exogenous stimulations. Voluntary action is also accompanied by prominent rhythmic activity, and recent behavioral evidence suggests that this might be coupled with perception. Here, we reveal the neurophysiological underpinnings of this sensorimotor coupling in humans. We link the trial-by-trial dynamics of EEG oscillatory activity during movement preparation to the corresponding dynamics in perception, for two unrelated visual and motor tasks. The phase of theta oscillations (~4 Hz) predicts perceptual performance, even >1 s before movement. Moreover, theta oscillations are phase-locked to the onset of the movement. Remarkably, the alignment of theta phase and its perceptual relevance unfold with similar non-monotonic profiles, suggesting their relatedness. The present work shows that perception and movement initiation are automatically synchronized since the early stages of motor planning through neuronal oscillatory activity in the theta range.

Auditory adaptation improves tactile frequency perception

Our ability to process temporal frequency information by touch underlies our capacity to perceive and discriminate surface textures. Auditory signals, which also provide extensive temporal frequency information, can systematically alter the perception of vibrations on the hand. How auditory signals shape tactile processing is unclear; perceptual interactions between contemporaneous sounds and vibrations are consistent with multiple neural mechanisms. Here we used a crossmodal adaptation paradigm, which separated auditory and tactile stimulation in time, to test the hypothesis that tactile frequency perception depends on neural circuits that also process auditory frequency. We reasoned that auditory adaptation effects would transfer to touch only if signals from both senses converge on common representations. We found that auditory adaptation can improve tactile frequency discrimination thresholds. This occurred only when adaptor and test frequencies overlapped. In contrast, auditory adaptation did not influence tactile intensity judgments. Thus auditory adaptation enhances touch in a frequency- and feature-specific manner. A simple network model in which tactile frequency information is decoded from sensory neurons that are susceptible to auditory adaptation recapitulates these behavioral results. Our results imply that the neural circuits supporting tactile frequency perception also process auditory signals. This finding is consistent with the notion of supramodal operators performing canonical operations, like temporal frequency processing, regardless of input modality.NEW & NOTEWORTHY Auditory signals can influence the tactile perception of temporal frequency. Multiple neural mechanisms could account for the perceptual interactions between contemporaneous auditory and tactile signals. Using a crossmodal adaptation paradigm, we found that auditory adaptation causes frequency- and feature-specific improvements in tactile perception. This crossmodal transfer of aftereffects between audition and touch implies that tactile frequency perception relies on neural circuits that also process auditory frequency.

Non-uniform transformation of subjective time during action preparation

Although many studies have reported a distortion of subjective (internal) time during preparation and execution of actions, it is highly controversial whether actions cause a dilation or compression of time. In the present study, we tested a hypothesis that the previous controversy (dilation vs. compression) partly resulted from a mixture of two types of sensory inputs on which a time length was estimated; some studies asked subjects to measure the time of presentation for a single continuous stimulus (stimulus period, e.g. the duration of a long-lasting visual stimulus on a monitor) while others required estimation of a period without continuous stimulations (no-stimulus period, e.g. an inter-stimulus interval between two flashes). Results of our five experiments supported this hypothesis, showing that action preparation induced a dilation of a stimulus period, whereas a no-stimulus period was not subject to this dilation and sometimes can be compressed by action preparation. Those results provided a new insight into a previous view assuming a uniform dilation or compression of subjective time by actions. Our findings about the distinction between stimulus and no-stimulus periods also might contribute to a resolution of mixed results (action-induced dilation vs. compression) in a previous literature.

Perceived visual time depends on motor preparation and direction of hand movements

Perceived time undergoes distortions when we prepare and perform movements, showing compression and/or expansion for visual, tactile and auditory stimuli. However, the actual motor system contribution to these time distortions is far from clear. In this study we investigated visual time perception during preparation of isometric contractions and real movements of the hand in two different directions (right/left). Comparable modulations of visual event-timing are found in the isometric and in the movement condition, excluding explanations based on movement-induced sensory masking or attenuation. Most importantly, and surprisingly, visual time depends on the movement direction, being expanded for hand movements pointing away from the body and compressed in the other direction. Furthermore, the effect of movement direction is not constant, but rather undergoes non-monotonic modulations in the brief moments preceding movement initiation. Our findings indicate that time distortions are strongly linked to the motor system, and they may be unavoidable consequences of the mechanisms subserving sensory-motor integration.

Voluntary action and tactile sensory feedback in the intentional binding effect

The intentional binding effect refers to a subjective compression over a temporal interval between the start point initialized by a voluntary action and the endpoint signaled by an external sensory (visual or audio) feedback. The present study aimed to explore the influence of tactile sensory feedback on this binding effect by comparing voluntary key-press actions with voluntary key-release actions. In experiment 1, each participant was instructed to report the perceived interval (in ms) between an action and the subsequent visual sensory feedback. In this task, either the action (key-press or key-release) was voluntarily performed by the participant or a kinematically identical movement was passively applied to the left index finger of the participant. In experiment 2, we explored whether the difference in the perception of time was affected by the direction of action. In experiment 3, we developed an apparatus in which two parallel laser beams were generated by a laser emission unit and detected by a laser receiver unit; this allowed the movement of the left index finger to be detected without it touching a keyboard (i.e., without any tactile sensory feedback). Convergent results from all of the experiments showed that the temporal binding effect was only observed when the action was both voluntary and involved physical contact with the key, suggesting that the combination of intention and tactile sensory feedback, as a form of top-down processing, likely distracted attention from temporal events and caused the different binding effects.

Multiple channels of visual time perception

The proposal that the processing of visual time might rely on a network of distributed mechanisms that are vision-specific and timescale-specific stands in contrast to the classical view of time perception as the product of a single supramodal clock. Evidence showing that some of these mechanisms have a sensory component that can be locally adapted is at odds with another traditional assumption, namely that time is completely divorced from space. Recent evidence suggests that multiple timing mechanisms exist across and within sensory modalities and that they operate in various neural regions. The current review summarizes this evidence and frames it into the broader scope of models for time perception in the visual domain.

Predictive coding of multisensory timing

The sense of time is foundational for perception and action, yet it frequently departs significantly from physical time. In the paper we review recent progress on temporal contextual effects, multisensory temporal integration, temporal recalibration, and related computational models. We suggest that subjective time arises from minimizing prediction errors and adaptive recalibration, which can be unified in the framework of predictive coding, a framework rooted in Helmholtz's 'perception as inference'.

Rhythmic oscillations of visual contrast sensitivity synchronized with action

It is well known that the motor and the sensory systems structure sensory data collection and cooperate to achieve an efficient integration and exchange of information. Increasing evidence suggests that both motor and sensory functions are regulated by rhythmic processes reflecting alternating states of neuronal excitability, and these may be involved in mediating sensory-motor interactions. Here we show an oscillatory fluctuation in early visual processing time locked with the execution of voluntary action, and, crucially, even for visual stimuli irrelevant to the motor task. Human participants were asked to perform a reaching movement toward a display and judge the orientation of a Gabor patch, near contrast threshold, briefly presented at random times before and during the reaching movement. When the data are temporally aligned to the onset of movement, visual contrast sensitivity oscillates with periodicity within the theta band. Importantly, the oscillations emerge during the motor planning stage, ∼500 ms before movement onset. We suggest that brain oscillatory dynamics may mediate an automatic coupling between early motor planning and early visual processing, possibly instrumental in linking and closing up the visual-motor control loop.

Apparent time interval of visual stimuli is compressed during fast hand movement

The influence of body movements on visual time perception is receiving increased attention. Past studies showed apparent expansion of visual time before and after the execution of hand movements and apparent compression of visual time during the execution of eye movements. Here we examined whether the estimation of sub-second time intervals between visual events is expanded, compressed, or unaffected during the execution of hand movements. The results show that hand movements, at least the fast ones, reduced the apparent time interval between visual events. A control experiment indicated that the apparent time compression was not produced by the participants’ involuntary eye movements during the hand movements. These results, together with earlier findings, suggest hand movement can change apparent visual time either in a compressive way or in an expansive way, depending on the relative timing between the hand movement and visual stimulus.