Time perception of visual motion is tuned by the motor representation of human actions

Weight discrimination ability during an action observation task is dependent on the type of muscle contraction

Concentric and eccentric contractions show different patterns of neural activity at both peripheral and cortical levels, which are thought to influence the perception of action properties such as the weight of objects moved by others. The aim of this study was to investigate how the type of muscle contraction influences weight estimation during action observation. Forty-eight volunteers completed the Main experiment and the Control experiment. In the Main experiment, they performed a weight discrimination video task in which they watched videos of an actor moving two objects, a comparison, and a reference box, executing concentric or eccentric contractions and they had to indicate which box was the heaviest. Sensitivity analysis and psychometric functions were used to analyse the data. In the Control experiment, observers judged the actor's effort in moving the boxes. The results of the Main experiment showed that the weight discrimination sensitivity was higher in the eccentric condition for the light boxes. Conversely, for the heaviest boxes, discrimination sensitivity was higher in the concentric condition. These results were confirmed by the psychometric function analysis. The control experiment showed that the perceived difference in effort between the comparison and reference stimuli was greater in the eccentric than in the concentric condition for light stimuli. These results showed that the ability to evaluate the weight of the object involved in the observed action was influenced by the type of contraction and the amount of weight. The effort attributed to the actor influenced the observer's perception.

Validating virtual reality for time perception research: Virtual reality changes expectations about the duration of physical processes, but not the sense of time

Immersive virtual reality (VR) provides a versatile method for investigating human time perception, because it allows the manipulation and control of relevant variables (e.g., the speed of environmental changes) that cannot be modified in the real world. However, an important premise for interpreting the results of VR studies, namely that the method itself does not affect time perception, has received little attention. Here we tested this assumption by comparing timing performance in a real environment and a VR scenario. Participants performed two timing tasks, requiring the production of intervals defined either by numerical values ("eight seconds") or by a physical process ("the time it takes for a bottle to run out when turned over"). We found that the experience of immersive VR exclusively altered judgments about the duration of physical processes, whereas judgments about the duration of abstract time units were unaffected. These results demonstrate that effects of VR on timing performance are not driven by changes in time perception itself, but rather by altered expectations regarding the duration of physical processes. The present study validates the use of VR in time perception research and strengthens the interpretation of changed timing behaviour induced by manipulations within VR.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Right frontal HD-tDCS reveals causal involvement of time perception networks in temporal processing of concepts

Evidence suggests that perceptual and action related features of concepts are grounded in the corresponding sensory-motor networks in the human brain. However, less is known about temporal features of event concepts (e.g., a lecture) and whether they are grounded in time perception networks. We examined this question by stimulating the right dorsolateral prefrontal cortex (rDLPFC)-a part of time perception network-using HD-tDCS and subsequently recording EEG while participants performed semantic and time perception tasks. Semantic tasks were composed of event noun duration judgment (EDur), object noun size judgement (OSize), event (EVal) and object noun valence judgement. In the time perception task, participants judged the durations of pure tones. Results showed that cathodal stimulation accelerated responses for time perception task and decreased the magnitude of global field power (GFP) compared to sham stimulation. Semantic tasks results revealed that cathodal, but not sham, stimulation significantly decreased GFP for EDur relative to OSize, and to EVal. These findings provide first causal evidence that temporal features of event words are grounded in the rDLPFC as part of the temporal cognition network and shed light on the conceptual processing of time.

On the perception of movement vigour

It is common to get the impression that someone moves rather slowly or quickly in everyday life. In motor control, the natural pace of movement is captured by the concept of vigour, which is often quantified from the speed or duration of goal-directed actions. A common phenomenon, here referred to as the vigour law, is that preferred speed and duration idiosyncratically increase with the magnitude of the motion. According to the direct-matching hypothesis, this vigour law could thus underlie the judgement of someone else's movement vigour. We conducted a series of three experiments (N = 80) to test whether the vigour law also exists in perception and whether it is linked to that of action. In addition to measuring participants' vigour, we also asked them to judge the quickness of stimuli representing horizontal arm reaching movements varying through amplitudes, speeds, and durations. Results showed that speed and duration of movements perceived as neither fast nor slow (i.e., natural pace) increased with amplitude, thereby indicating that the vigour law holds when an observer judges the natural pace of others' movements. Results also revealed that this judgement was population-based (related to the average vigour of all participants) rather than individual-based (participant's own vigour).

Temporal learning in the suprasecond range: insights from cognitive style

The acquisition of information on the timing of events or actions (temporal learning) occurs in both the subsecond and suprasecond range. However, although relevant differences between participants have been reported in temporal learning, the role of dimensions of individual variability in affecting performance in such tasks is still unclear. Here we investigated this issue, assessing the effect of field-dependent/independent cognitive style on temporal learning in the suprasecond range. Since different mechanisms mediate timing when a temporal representation is self-generated, and when it depends on an external referent, temporal learning was assessed in two conditions. Participants observed a stimulus across six repetitions and reproduced it. Unbeknownst to them, in an internally-based learning (IBL) condition, the stimulus duration was fixed within a trial, although the number of events defining it varied; in an externally-cued learning (ECL) condition, the stimulus was defined by the same number of events within each trial, although its duration varied. The effect of the reproduction modality was also assessed (motor vs. perceptual). Error scores were higher in IBL compared to ECL; the reverse was true for variability. Field-independent individuals performed better than field-dependent ones only in IBL, as further confirmed by correlation analyses. Findings provide evidence that differences in dimensions of variability in high-level cognitive functioning, such as field dependence/independence, significantly affect temporal learning in the suprasecond range, and that this effect depends on the type of temporal representation fostered by the specific task demands.

Motor invariants in action execution and perception

The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.

Slow motion bias: Exploring the relation between time overestimation and increased perceived intentionality

Recent research on time perception has revealed that actions which are replayed in slow motion are perceived to take longer and rated to be more intentional (e.g., foul plays). Interestingly, the bias on duration estimations seems to disappear when information on the slow motion factor (i.e., the degree the video was slowed down) was provided. Here, we scrutinize the question whether also the intentionality bias disappears when explicit information about the slow motion factor is provided. To this end, two groups watched the same video clips, all displaying foul situations in a basketball match, in different video speeds. While the uninformed group saw the videos without further information, the informed group received additional information about the current slow motion factor. This study replicated the overestimation of original duration with increasing slow motion and indicated that this effect might be reduced when information about the slow motion factor is provided. However, despite generally lower intentionality ratings in the informed group, video speed information was not able to reduce the rise in intentionality ratings with increasing slow motion. Potential reasons and open questions regarding the nature and mechanisms behind these perceptual temporal biases (e.g., different time processing systems) are discussed.

How movements shape the perception of time

In order to keep up with a changing environment, mobile organisms must be capable of deciding both where and when to move. This precision necessitates a strong sense of time, as otherwise we would fail in many of our movement goals. Yet, despite this intrinsic link, only recently have researchers begun to understand how these two features interact. Primarily, two effects have been observed: movements can bias time estimates, but they can also make them more precise. Here we review this literature and propose that both effects can be explained by a Bayesian cue combination framework, in which movement itself affords the most precise representation of time, which can influence perception in either feedforward or active sensing modes.

The Editing Density of Moving Images Influences Viewers' Time Perception: The Mediating Role of Eye Movements

The present study examined whether cinematographic editing density affects viewers' perception of time. As a second aim, based on embodied models that conceive time perception as strictly connected to the movement, we tested the hypothesis that the editing density of moving images also affects viewers' eye movements and that these later mediate the effect of editing density on viewers' temporal judgments. Seventy participants watched nine video clips edited by manipulating the number of cuts (slow- and fast-paced editing against a master shot, unedited condition). For each editing density, multiple video clips were created, representing three different kinds of routine actions. The participants' eye movements were recorded while watching the video, and the participants were asked to report duration judgments and subjective passage of time judgments after watching each clip. The results showed that participants subjectively perceived that time flew more while watching fast-paced edited videos than slow-paced or unedited videos; by contrast, concerning duration judgments, participants overestimated the duration of fast-paced videos compared to the master-shot videos. Both the slow- and the fast-paced editing generated shorter fixations than the master shot, and the fast-paced editing led to shorter fixations than the slow-paced editing. Finally, compared to the unedited condition, editing led to an overestimation of durations through increased eye mobility. These findings suggest that the editing density of moving images by increasing the number of cuts effectively altered viewers' experience of time and add further evidence to prior research showing that performed eye movement is associated with temporal judgments.

Slowing the body slows down time perception

Interval timing is a fundamental component of action and is susceptible to motor-related temporal distortions. Previous studies have shown that concurrent movement biases temporal estimates, but have primarily considered self-modulated movement only. However, real-world encounters often include situations in which movement is restricted or perturbed by environmental factors. In the following experiments, we introduced viscous movement environments to externally modulate movement and investigated the resulting effects on temporal perception. In two separate tasks, participants timed auditory intervals while moving a robotic arm that randomly applied four levels of viscosity. Results demonstrated that higher viscosity led to shorter perceived durations. Using a drift-diffusion model and a Bayesian observer model, we confirmed these biasing effects arose from perceptual mechanisms, instead of biases in decision making. These findings suggest that environmental perturbations are an important factor in movement-related temporal distortions, and enhance the current understanding of the interactions of motor activity and cognitive processes.

Time perception in human movement: Effects of speed and agency on duration estimation

While the effects of synthesised visual stimuli on time perception processes are well documented, very little research on time estimation in human movement stimuli exists. This study investigated the effects of movement speed and agency on duration estimation of human motion. Participants were recorded using optical motion capture while they performed dance-like movements at three different speeds. They later returned for a perceptual experiment in which they watched point-light displays of themselves and one other participant. Participants were asked to identify themselves, to estimate the duration of the recordings, and to rate expressivity and quality of the movements. Results indicate that speed of movement affected duration estimations such that faster speeds were rated longer, in accordance with previous findings in non-biological motion. The biasing effects of speed were stronger for watching others' movements than for watching one's own point-light movements. Duration estimations were longer after acting out the movement compared with watching it, and speed differentially affected ratings of expressivity and quality. Findings suggest that aspects of temporal processing of visual stimuli may be modulated by inner motor representations of previously performed movements, and by physically carrying out an action compared with just watching it. Results also support the inner clock and change theories of time perception for the processing of human motion stimuli, which can inform the temporal mechanisms of the hypothesised separate processor for human movement information.

Why Do Actions in Slow Motion Appear to Last Longer? On the Effect of Video Speed Information

When displayed in slow motion, actions are often perceived longer compared with original speed. However, it remains to be determined why this bias exists. Is it possible that the bias emerges because participants underestimate the factor by which a video was slowed down and hence arrive at erroneous conclusions about the original duration? If true, providing explicit information about the respective video speed should eliminate this slow motion effect. To scrutinize the nature of this bias, participants rated the original duration of sports actions displayed at original speed or slow motion. Results revealed the expected overestimation bias consisting in longer ratings with increasing slow motion. However, the bias disappeared when information about the current video speed was provided. The observations suggest an influence of knowledge about video playback speed on cognitive-evaluative processes which may hold important implications for future research and practice.

Differences in perceived durations between plausible biological and non-biological stimuli

Visual motion stimuli can sometimes distort our perception of time. This effect is dependent on the apparent speed of the moving stimulus, where faster stimuli are usually perceived lasting longer than slower stimuli. Although it has been shown that neural and cognitive processing of biological motion stimuli differ from non-biological motion stimuli, no study has yet investigated whether perceived durations of biological stimuli differ from non-biological stimuli across different speeds. Here, a prospective temporal reproduction task was used to assess that question. Biological motion stimuli consisted of a human silhouette running in place. Non-biological motion stimuli consisted of a rectangle moving in a pendular way. Amount and plausibility of movement for each stimulus and frame-rate (speed) were evaluated by an independent group of participants. Although the amount of movement perceived was positively correlated to frame rate both for biological and non-biological stimuli, movie clips involving biological motion stimuli were judged to last longer than non-biological motion stimuli only at frame rates for which movement was rated as plausible. These results suggest that plausible representations of biomechanical movement induce additional temporal distortions to those modulated by increases in stimulus speed. Moreover, most studies reporting neural and cognitive differences in the processing of biological and non-biological motion stimuli acquired neurophysiological data using fMRI. Here, we report differences in the processing of biological and non-biological motion stimuli across different speeds using functional near-infrared spectroscopy (fNIRS), a less costly and portable form of neurophysiological data acquisition.

Non-immersive 3D virtual stimulus alter the time production task performance and increase the EEG theta power in dorsolateral prefrontal cortex

AIM

The study investigated the cortical activity changes and time production task performance induced by changes in motion speed of a non-immersive 3D virtual stimulus.

MATERIAL AND METHODS

Twenty-one individuals were participated in the crossover study with the visual-time reproduction task under three-speed conditions: original, slow and fast virtual stimulus. In addition, the electroencephalographic analysis of the theta band power in the dorsolateral prefrontal cortex was done simultaneously with time production task execution.

RESULTS

The results demonstrated that in the slow speed condition, there is an increase in the error in the time production task after virtual reality (p < 0.05). There is also increased EEG theta power in the right dorsolateral prefrontal cortex in all speed conditions (p < 0.05).

CONCLUSIONS

We propose that the modulations of speed of virtual stimulus may underlie the accumulation of temporal pulses, which could be responsible for changes in the performance of the production task of the time intervals and a substantial increase in right dorsolateral prefrontal cortex activity related to attention and memory, acting in cognitive domains of supraseconds.

Mouse Tracking to Explore Motor Inhibition Processes in Go/No-Go and Stop Signal Tasks

Response inhibition relies on both proactive and reactive mechanisms that exert a synergic control on goal-directed actions. It is typically evaluated by the go/no-go (GNG) and the stop signal task (SST) with response recording based on the key-press method. However, the analysis of discrete variables (i.e., present or absent responses) registered by key-press could be insufficient to capture dynamic aspects of inhibitory control. Trying to overcome this limitation, in the present study we used a mouse tracking procedure to characterize movement profiles related to proactive and reactive inhibition. A total of fifty-three participants performed a cued GNG and an SST. The cued GNG mainly involves proactive control whereas the reactive component is mainly engaged in the SST. We evaluated the velocity profile from mouse trajectories both for responses obtained in the Go conditions and for inhibitory failures. Movements were classified as one-shot when no corrections were observed. Multi-peaked velocity profiles were classified as non-one-shot. A higher proportion of one-shot movements was found in the SST compared to the cued GNG when subjects failed to inhibit responses. This result suggests that proactive control may be responsible for unsmooth profiles in inhibition failures, supporting a differentiation between these tasks.

Action-induced changes in the perceived temporal features of visual events

Perceived duration can be subject to deviations around the time of a voluntary action. Whether the mechanisms underlying action-induced visual duration effects are effector-specific or require a more generalized action-linked multimodal calibration with the transient visual system, however, is a question yet to be answered. Here, we investigate this using dynamic visual stimuli presented as contingent upon the execution of an arbitrarily associated voluntary manual response. Our results demonstrate that the duration of intervals with arbitrarily associated keypress-visual event pair is perceived as shorter than the duration in a pure visual condition, where the same stimuli are rather passively observed without the execution of a concurrent action. Whereas the control experiments show that motor memory and attention cannot explain the action-induced changes in perceived temporal features, action-induced changes in perceived speed are dissociated from those in perceived duration, and that the duration compression disappears using isoluminant or static stimuli, which together provide evidence that these two effects can be modulated in the motion-processing units, although via separate neural mechanisms.

The last chance to pass the ball: investigating the role of temporal expectation and motor resonance in processing temporal errors in motor actions

Humans can acquire information on others' motor outputs (action prediction) and intentions (action understanding) according to their individual motor repertoire and to the detected gesture's features (e.g. temporal patterns). We aimed at dissociating between action prediction and action understanding abilities in soccer players and novices observing soccer action videos including correct timing pass (CTP) or delayed pass (DP). First, we used an occluding paradigm to evaluate participants' ability to predict the correct time to pass the ball. Although soccer players showed reduced reaction times, all subjects showed a similar pattern of performance: during DP observation, responses appeared delayed with respect to the other conditions but anticipated with respect to the observed DP. In a separate experiment, we investigated the ability to recognize CTP vs DP and the modulation of primary motor cortex (M1) excitability associated to video observation. Only soccer players showed selective modulation of M1 according to the plausibility of the observed action, with increased excitability during the observation of the CTP and in a phase preceding the DP. In conclusion, action prediction ability seems to be independent from the individual motor repertoire. By contrast, only subjects with previously acquired sensorimotor skills are able to infer the observed action's long-term intention.

Development of visual perception of others' actions: Children's judgment of lifted weight

Humans are excellent at perceiving different features of the actions performed by others. For instance, by viewing someone else manipulating an unknown object, one can infer its weight–an intrinsic feature otherwise not directly accessible through vision. How such perceptual skill develops during childhood remains unclear. To confront this gap, the current study had children (N:63, 6–10 years old) and adults (N:21) judge the weight of objects after observing videos of an actor lifting them. Although 6-year-olds could already discriminate different weights, judgment accuracy had not reached adult-like levels by 10 years of age. Additionally, children’s stature was a more reliable predictor of their ability to read others’ actions than was their chronological age. This paper discusses the results in light of a potential link between motor development and action perception.

Action Observation Combined With Conventional Training Improves the Rugby Lineout Throwing Performance: A Pilot Study

Combining action observation (AO) and physical practice contributes to motor skill learning, and a number of studies pointed out the beneficial role of AO training in improving the motor performance and the athletes' movement kinematics. The aim of this study was to investigate if AO combined with immediate conventional training was able to improve motor performance and kinematic parameters of a complex motor skill such as the lineout throw, a gesture that represents a key aspect of rugby, that is unique to this sport. Twenty elite rugby players were divided into two groups. The AO group watched a 5-min video-clip of an expert model performing the lineout throw toward a target at 7 m distance and, immediately after the AO, this group executed the conventional training, consisting of six repetitions x five blocks of throws. The CONTROL group performed only the conventional lineout training. Intervention period lasted 4 weeks, 3 sessions/week. The AO group showed significant improvements in throwing accuracy (i.e., number of throws hitting the target), whilst no significant changes were observed in the CONTROL group. As concerns kinematic parameters, hooker's arm mean velocity significantly increased in both groups, but the increase was higher in AO group compared to CONTROL group. Ball velocity significantly increased only in the AO group, whereas ball angle release and ball spinning significantly decreased in both groups, with no differences between groups. Finally, no significant changes in knee and elbow angles were observed. Our results showed that the combination of AO and conventional training was more effective than a conventional training alone in improving the performance of elite rugby players, in executing a complex motor skill, such as the lineout. This combined training led to significant improvements in throwing accuracy and in hooker's and ball's kinematic parameters. Since AO can be easily implemented in combination with conventional training, the results of this study can encourage coaches in designing specific lineout training programs, which include AO cognitive training.

Independent adaptation mechanisms for numerosity and size perception provide evidence against a common sense of magnitude

How numerical quantity is processed is a central issue for cognition. On the one hand the "number sense theory" claims that numerosity is perceived directly, and may represent an early precursor for acquisition of mathematical skills. On the other, the "theory of magnitude" notes that numerosity correlates with many continuous properties such as size and density, and may therefore not exist as an independent feature, but be part of a more general system of magnitude. In this study we examined interactions in sensitivity between numerosity and size perception. In a group of children, we measured psychophysically two sensory parameters: perceptual adaptation and discrimination thresholds for both size and numerosity. Neither discrimination thresholds nor adaptation strength for numerosity and size correlated across participants. This clear lack of correlation (confirmed by Bayesian analyses) suggests that numerosity and size interference effects are unlikely to reflect a shared sensory representation. We suggest these small interference effects may rather result from top-down phenomena occurring at late decisional levels rather than a primary "sense of magnitude".

When "Extraneous" Becomes "Mine". Neurophysiological Evidence of Sensorimotor Integration During Observation of Suboptimal Movement Patterns Performed by People with Multiple Sclerosis

Action observation is known to enhance sensorimotor system activation, and such effect has been linked to neural priming and response facilitation mechanisms. This facilitation effect, however, has been primarily studied by focusing on high-level motor proficiency, whereas evidence on the effect of observing poorly performed actions is still lacking. We then devised a study to investigate neural correlates of the observation of suboptimal motor acts as mirrored by corticospinal activation (via transcranial magnetic stimulation (TMS), Experiment 1) and by modulation of cortical oscillatory activity (via electroencephalography (EEG), Experiment 2). 40 participants were presented with four randomly reiterated videos. Videos depicted a healthy confederate, a minimally impaired multiple sclerosis (MS) patient, a mildly impaired MS patient, or a confederate trying to simulate mild motor difficulties performing a test concerning fine motor abilities. In Experiment 1 we analyzed TMS-induced motor-evoked potentials during the observation of videos. In Experiment 2 EEG data were analyzed in the frequency-domain. Analyses highlighted both increased corticospinal excitability and desynchronized alpha-beta oscillations during the observation of poorly performed motor acts performed by the mildly impaired MS patient. Further, we observed gradually increasing beta activity across videos reiterations, specifically for the minimally impaired patient's video. Reported findings corroborate the hypotheses that the action-observation network and the motor system might be involved in processes evoked in the attempt to understand and predict observed actions which do not belong to the onlookers' motor repertoire, reflecting in an increased sensorimotor activity.

Analyses of EEG Oscillatory Activities during Slow and Fast Repetitive Movements using Holo-Hilbert Spectral Analysis

Neural oscillatory activities existing in multiple fre-quency bands usually represent different levels of neurophysiolog-ical meanings, from micro-scale to macro-scale organizations. In this study, we adopted Holo-Hilbert spectral analysis (HHSA) to study the amplitude-modulated (AM) and frequency-modulated (FM) components in sensorimotor Mu rhythm, induced by slow- and fast-rate repetitive movements. The HHSA-based approach is a two-layer empirical mode decomposition (EMD) architecture, which firstly decomposes the EEG signal into a series of frequency-modulated intrinsic mode functions (IMF) and then decomposes each frequency-modulated IMF into a set of amplitude-modulated IMFs. With the HHSA, the FM and AM components were incor-porated with their instantaneous power to achieve full-informa-tional spectral analysis. We observed that the instantaneous power induced by slow-rate movements was significantly higher than that induced by fast-rate movements (p < 0.01, Wilcoxon signed rank test). The alpha-band AM frequencies induced by slow-rate movements were higher than those induced by fast-rate move-ments, while no statistical difference was found in beta-band AM frequencies. In addition, to study the functional coupling between the primary sensorimotor area and other brain regions, spectral coherence was applied and statistical difference was found in frontal area in slow-rate versus fast-rate movements. The discrep-ancy between slow- and fast-rate movements might be owing to the change of motor functional modes from default mode network (DMN) to automatic timing with the increase of movement rates. The use of HHSA for oscillatory activity analysis can be an effi-cient tool to provide informative interaction among different fre-quency bands.

Feel the Time. Time Perception as a Function of Interoceptive Processing

The nature of time is rooted in our body. Constellations of impulses arising from the flesh constantly create our interoceptive perception and, in turn, the unfolding of these perceptions defines human awareness of time. This study explored the connection between time perception and interoception and proposes the Interoceptive Buffer saturation (IBs) index. IBs evaluates subjects’ ability to process salient stimuli from the body by measuring subjective distortions of interoceptive time perception, i.e., the estimated duration of tactile interoceptive stimulations. Thirty female healthy subjects were recruited through consecutive sampling and assessed for common variables related to interoceptive alterations: depressive symptoms (Beck Depression Inventory, BDI-II), eating disorders (EDI-3) risk, and anxiety levels (State Trait Anxiety Inventory, STAI). Interoceptive cardiac accuracy (IAc) was assessed as well. Subjects performed verbal time estimation of interoceptive stimuli (IBs) delivered using a specifically designed interoceptive tactile stimulator, as well as verbal time estimation of visual and auditory stimuli. Results showed that IBs index positively correlated with IAc, and negatively with EDI-3 Drive for Thinness (DT) risk subscale. Moreover, IBs index was positively predicted by IAc, and negatively predicted by DT and somatic factors of depression. Our results suggest that underestimations in interoceptive time perception are connected to different psychological conditions characterized by a diminished processing of high salience stimuli from the body. Conversely, overestimations of the duration of interoceptive stimuli appear to be function of subjects’ ability to correctly perceive their own bodily information. Evidence supported IBs index, fostering the concept of interoceptive treatments for clinical purposes.

Sensorimotor Skills Impact on Temporal Expectation: Evidence from Swimmers

Aim of this study was to assess whether the ability to predict the temporal outcome of a sport action was influenced by the sensorimotor skills previously acquired during a specific sport training. Four groups, each of 30 subjects, were enrolled in this study; subjects of three groups practiced different sports disciplines (i.e., swimming, rhythmic gymnastics, and water polo) at competitive level whilst the fourth group consisted of control subjects. Subjects were asked to observe a video showing a swimmer doing two laps in crawl style. This video was shown 36 times, and was occluded after variable intervals, randomized across trials, by a dark window that started 3, 6, and 12 s before the swimmer touched the poolside. During the occluded interval, subjects were asked to indicate when the swimmer touched the edge of the pool by clicking on any button of the laptop keyboard. We found that swimmers were more accurate than subjects performing other sports in temporally predicting the final outcome of the swimming task. Particularly, we observed a significant difference in absolute timing error that was lower in swimmers compared to other groups when they were asked to make a temporal prediction with the occluded interval of short duration (i.e., 3 s). Our findings demonstrate that the ability to extract temporal patterns of a motor action depends largely on the subjective expertise, suggesting that sport-acquired sensorimotor skills impact on the temporal representation of the previously observed action, allowing subjects to predict the time course of the action in absence of visual information.

Interacting With Robots to Investigate the Bases of Social Interaction

Humans show a great natural ability at interacting with each other. Such efficiency in joint actions depends on a synergy between planned collaboration and emergent coordination, a subconscious mechanism based on a tight link between action execution and perception. This link supports phenomena as mutual adaptation, synchronization, and anticipation, which cut drastically the delays in the interaction and the need of complex verbal instructions and result in the establishment of joint intentions, the backbone of social interaction. From a neurophysiological perspective, this is possible, because the same neural system supporting action execution is responsible of the understanding and the anticipation of the observed action of others. Defining which human motion features allow for such emergent coordination with another agent would be crucial to establish more natural and efficient interaction paradigms with artificial devices, ranging from assistive and rehabilitative technology to companion robots. However, investigating the behavioral and neural mechanisms supporting natural interaction poses substantial problems. In particular, the unconscious processes at the basis of emergent coordination (e.g., unintentional movements or gazing) are very difficult-if not impossible-to restrain or control in a quantitative way for a human agent. Moreover, during an interaction, participants influence each other continuously in a complex way, resulting in behaviors that go beyond experimental control. In this paper, we propose robotics technology as a potential solution to this methodological problem. Robots indeed can establish an interaction with a human partner, contingently reacting to his actions without losing the controllability of the experiment or the naturalness of the interactive scenario. A robot could represent an "interactive probe" to assess the sensory and motor mechanisms underlying human-human interaction. We discuss this proposal with examples from our research with the humanoid robot iCub, showing how an interactive humanoid robot could be a key tool to serve the investigation of the psychological and neuroscientific bases of social interaction.

The Mechanical Representation of Temporal Delays

When we knock on a door, we perceive the impact as a collection of simultaneous events, combining sound, sight, and tactile sensation. In reality, information from different modalities but from a single source is flowing inside the brain along different pathways, reaching processing centers at different times. Therefore, interpreting different sensory modalities which seem to occur simultaneously requires information processing that accounts for these different delays. As in a computer-based robotic system, does the brain use some explicit estimation of the time delay, to realign the sensory flows? Or does it compensate for temporal delays by representing them as changes in the body/environment mechanics? Using delayed-state or an approximation for delayed-state manipulations between visual and proprioceptive feedback during a tracking task, we show that tracking errors, grip forces, and learning curves are consistent with predictions of a representation that is based on approximation for delay, refuting an explicit delayed-state representation. Delayed-state representations are based on estimating the time elapsed between the movement commands and their observed consequences. In contrast, an approximation for delay representations result from estimating the instantaneous relation between the expected and observed motion variables, without explicit reference to time.

As time passes by: Observed motion-speed and psychological time during video playback

Research shows that psychological time (i.e., the subjective experience and assessment of the passage of time) is malleable and that the central nervous system re-calibrates temporal information in accordance with situational factors so that psychological time flows slower or faster. Observed motion-speed (e.g., the visual perception of a rolling ball) is an important situational factor which influences the production of time estimates. The present study examines previous findings showing that observed slow and fast motion-speed during video playback respectively results in over- and underproductions of intervals of time. Here, we investigated through three separate experiments: a) the main effect of observed motion-speed during video playback on a time production task and b) the interactive effect of the frame rate (frames per second; fps) and motion-speed during video playback on a time production task. No main effect of video playback-speed or interactive effect between video playback-speed and frame rate was found on time production.

Embodiment and the origin of interval timing: kinematic and electromyographic data

Recent evidence suggests that interval timing (the judgment of durations lasting from approximately 500 ms. to a few minutes) is closely coupled to the action control system. We used surface electromyography (EMG) and motion capture technology to explore the emergence of this coupling in 4-, 6-, and 8-month-olds. We engaged infants in an active and socially relevant arm-raising task with seven cycles and response period. In one condition, cycles were slow (every 4 s); in another, they were fast (every 2 s). In the slow condition, we found evidence of time-locked sub-threshold EMG activity even in the absence of any observed overt motor responses at all three ages. This study shows that EMGs can be a more sensitive measure of interval timing in early development than overt behavior.

Study of Repetitive Movements Induced Oscillatory Activities in Healthy Subjects and Chronic Stroke Patients

Repetitive movements at a constant rate require the integration of internal time counting and motor neural networks. Previous studies have proved that humans can follow short durations automatically (automatic timing) but require more cognitive efforts to track or estimate long durations. In this study, we studied sensorimotor oscillatory activities in healthy subjects and chronic stroke patients when subjects were performing repetitive finger movements. We found the movement-modulated changes in alpha and beta oscillatory activities were decreased with the increase of movement rates in finger lifting of healthy subjects and the non-paretic hands in stroke patients, whereas no difference was found in the paretic-hand movements at different movement rates in stroke patients. The significant difference in oscillatory activities between movements of non-paretic hands and paretic hands could imply the requirement of higher cognitive efforts to perform fast repetitive movements in paretic hands. The sensorimotor oscillatory response in fast repetitive movements could be a possible indicator to probe the recovery of motor function in stroke patients.

The Remapping of Time by Active Tool-Use

Multiple, action-based space representations are each based on the extent to which action is possible toward a specific sector of space, such as near/reachable and far/unreachable. Studies on tool-use revealed how the boundaries between these representations are dynamic. Space is not only multidimensional and dynamic, but it is also known for interacting with other dimensions of magnitude, such as time. However, whether time operates on similar action-driven multiple representations and whether it can be modulated by tool-use is yet unknown. To address these issues, healthy participants performed a time bisection task in two spatial positions (near and far space) before and after an active tool-use training, which consisted of performing goal-directed actions holding a tool with their right hand (Experiment 1). Before training, perceived stimuli duration was influenced by their spatial position defined by action. Hence, a dissociation emerged between near/reachable and far/unreachable space. Strikingly, this dissociation disappeared after the active tool-use training since temporal stimuli were now perceived as nearer. The remapping was not found when a passive tool-training was executed (Experiment 2) or when the active tool-training was performed with participants' left hand (Experiment 3). Moreover, no time remapping was observed following an equivalent active hand-training but without a tool (Experiment 4). Taken together, our findings reveal that time processing is based on action-driven multiple representations. The dynamic nature of these representations is demonstrated by the remapping of time, which is action- and effector-dependent.

Binding space and time through action

Space and time are intimately coupled dimensions in the human brain. Several lines of evidence suggest that space and time are processed by a shared analogue magnitude system. It has been proposed that actions are instrumental in establishing this shared magnitude system. Here we provide evidence in support of this hypothesis, by showing that the interaction between space and time is enhanced when magnitude information is acquired through action. Participants observed increases or decreases in the height of a visual bar (spatial magnitude) while judging whether a simultaneously presented sequence of acoustic tones had accelerated or decelerated (temporal magnitude). In one condition (Action), participants directly controlled the changes in bar height with a hand grip device, whereas in the other (No Action), changes in bar height were externally controlled but matched the spatial/temporal profile of the Action condition. The sign of changes in bar height biased the perceived rate of the tone sequences, where increases in bar height produced apparent increases in tone rate. This effect was amplified when the visual bar was actively controlled in the Action condition, and the strength of the interaction was scaled by the magnitude of the action. Subsequent experiments ruled out that this was simply explained by attentional factors, and additionally showed that a monotonic mapping is also required between grip force and bar height in order to bias the perception of the tones. These data provide support for an instrumental role of action in interfacing spatial and temporal quantities in the brain.

Spontaneous movement tempo can be influenced by combining action observation and somatosensory stimulation

Spontaneous movement tempo (SMT) was a popular field of study of the Gestalt psychologists It can be determined from subjects freely tapping out a rhythm with their finger, and it has been found to average about 2 Hz. A previous study showed that SMT changed after the observation of rhythmical movements performed at frequency different from the SMT. This effect was long-lasting only when movement execution immediately followed action observation (AO). We recently demonstrated that only when AO was combined with peripheral nerve stimulation (AO-PNS) was it possible to induce plastic changes in the excitability of the motor cortex, whereas AO and PNS alone did not evoke any changes. Here we investigated whether the observation of rhythmical actions at a frequency higher than the SMT combined with PNS induced lasting changes in SMT even in absence of immediate movement execution. Forty-eight participants were assigned to four groups. In AO-PNS group they observed a video showing a right hand performing a finger opposition movement sequence at 3 Hz and contemporarily received an electrical stimulation at the median nerve; in AO group and PNS group participants either observed the same video or received the same electrical stimulation of the AO-PNS group, respectively; in LANDSCAPE group subjects observed a neutral video. Participants performed a finger opposition movement sequence at spontaneous movement rate before and 30 min after the conditioning protocols. Results showed that SMT significantly changed only after AO-PNS. This result suggested that the AO-PNS protocol was able to induce lasting changes in SMT due to neuroplasticity mechanisms, indicating possible application of AO-PNS in rehabilitative treatments.

Action observation: mirroring across our spontaneous movement tempo

During action observation (AO), the activity of the “mirror system” is influenced by the viewer’s expertise in the observed action. A question that remains open is whether the temporal aspects of the subjective motor repertoire can influence the “mirror system” activation.

The effect of force feedback delay on stiffness perception and grip force modulation during tool-mediated interaction with elastic force fields

During interaction with objects, we form an internal representation of their mechanical properties. This representation is used for perception and for guiding actions, such as in precision grip, where grip force is modulated with the predicted load forces. In this study, we explored the relationship between grip force adjustment and perception of stiffness during interaction with linear elastic force fields. In a forced-choice paradigm, participants probed pairs of virtual force fields while grasping a force sensor that was attached to a haptic device. For each pair, they were asked which field had higher level of stiffness. In half of the pairs, the force feedback of one of the fields was delayed. Participants underestimated the stiffness of the delayed field relatively to the nondelayed, but their grip force characteristics were similar in both conditions. We analyzed the magnitude of the grip force and the lag between the grip force and the load force in the exploratory probing movements within each trial. Right before answering which force field had higher level of stiffness, both magnitude and lag were similar between delayed and nondelayed force fields. These results suggest that an accurate internal representation of environment stiffness and time delay was used for adjusting the grip force. However, this representation did not help in eliminating the bias in stiffness perception. We argue that during performance of a perceptual task that is based on proprioceptive feedback, separate neural mechanisms are responsible for perception and action-related computations in the brain.

Motor activity improves temporal expectancy

Certain brain areas involved in interval timing are also important in motor activity. This raises the possibility that motor activity might influence interval timing. To test this hypothesis, we assessed interval timing in healthy adults following different types of training. The pre- and post-training tasks consisted of a button press in response to the presentation of a rhythmic visual stimulus. Alterations in temporal expectancy were evaluated by measuring response times. Training consisted of responding to the visual presentation of regularly appearing stimuli by either: (1) pointing with a whole-body movement, (2) pointing only with the arm, (3) imagining pointing with a whole-body movement, (4) simply watching the stimulus presentation, (5) pointing with a whole-body movement in response to a target that appeared at irregular intervals (6) reading a newspaper. Participants performing a motor activity in response to the regular target showed significant improvements in judgment times compared to individuals with no associated motor activity. Individuals who only imagined pointing with a whole-body movement also showed significant improvements. No improvements were observed in the group that trained with a motor response to an irregular stimulus, hence eliminating the explanation that the improved temporal expectations of the other motor training groups was purely due to an improved motor capacity to press the response button. All groups performed a secondary task equally well, hence indicating that our results could not simply be attributed to differences in attention between the groups. Our results show that motor activity, even when it does not play a causal or corrective role, can lead to improved interval timing judgments.

Visuomotor adaptation to a visual rotation is gravity dependent

Humans perform vertical and horizontal arm motions with different temporal patterns. The specific velocity profiles are chosen by the central nervous system by integrating the gravitational force field to minimize energy expenditure. However, what happens when a visuomotor rotation is applied, so that a motion performed in the horizontal plane is perceived as vertical? We investigated the dynamic of the adaptation of the spatial and temporal properties of a pointing motion during prolonged exposure to a 90° visuomotor rotation, where a horizontal movement was associated with a vertical visual feedback. We found that participants immediately adapted the spatial parameters of motion to the conflicting visual scene in order to keep their arm trajectory straight. In contrast, the initial symmetric velocity profiles specific for a horizontal motion were progressively modified during the conflict exposure, becoming more asymmetric and similar to those appropriate for a vertical motion. Importantly, this visual effect that increased with repetitions was not followed by a consistent aftereffect when the conflicting visual feedback was absent (catch and washout trials). In a control experiment we demonstrated that an intrinsic representation of the temporal structure of perceived vertical motions could provide the error signal allowing for this progressive adaptation of motion timing. These findings suggest that gravity strongly constrains motor learning and the reweighting process between visual and proprioceptive sensory inputs, leading to the selection of a motor plan that is suboptimal in terms of energy expenditure.

Moving time: the influence of action on duration perception

Perceiving the sensory consequences of action accurately is essential for appropriate interaction with our physical and social environments. Prediction mechanisms are considered necessary for fine-tuned sensory control of action, yet paradoxically may distort perception. Here, we examine this paradox by addressing how movement influences the perceived duration of sensory outcomes congruent with action. Experiment 1 required participants to make judgments about the duration of vibrations applied to a moving or stationary finger. In Experiments 2 and 3, participants judged observed finger movements that were congruent or incongruent with their own actions. In all experiments, target events were perceived to be longer when congruent with movement. Interestingly, this temporal dilation did not differ as a function of stimulus perspective (1st or 3rd person) or spatial location. We propose that this bias may reflect the operation of an adaptive mechanism for sensorimotor selection and control that preactivates anticipated outcomes of action. The bias itself may have surprising implications for both action control and perception of others: we may be in contact with grasped objects for less time than we realize, and others' reactions to us may be briefer than we believe.

Visual tracking combined with hand-tracking improves time perception of moving stimuli

A number of studies have shown that performing a secondary task while executing a time-judgment task impairs performance on the latter task. However, this turns out not to be the case for certain motor secondary tasks. We show that concomitant secondary motor tasks involving pointing, when performed during a time-judgment task, can actually improve our time-judgment abilities. We compared adult participants' performance in a time-of-movement paradigm with visual pursuit-only and with visual pursuit plus hand pursuit. Rather than interfering with their estimation of stimulus movement duration, the addition of hand pursuit significantly improved their judgment. In addition, we considered the effect of three different movement profiles and four different movement speeds for the moving stimulus. As predicted by Vierordt's law, time judgments of shorter stimuli are overestimated and longer stimuli underestimated. Finally, timing performances appear to improve when the moving target follows a “biological” velocity profile.

Time perception during apparent biological motion reflects subjective speed of movement, not objective rate of visual stimulation

We have investigated links between biological motion perception and time perception. Participants compared the durations of two paired visual frames, inside which task-irrelevant sequences of static body postures were presented. The sequences produced apparent movements of shorter and longer path lengths, depending on the sequential order of body postures (ABC or ACB). Shorter and longer path lengths were paired with shorter and longer interstimulus intervals (ISIs) to produce path/ISI congruent sequences with intermediate subjective speeds and path/ISI incongruent sequences with slowest and fastest subjective speeds. Participants compared the duration of the visual frames surrounding these sequences; body postures and biological motion were irrelevant. The ability to discriminate the duration of the frames (as measured by the just noticeable difference, JND) was reduced for pairs of path/ISI congruent sequences as compared to pairs of path/ISI incongruent sequences. That is, duration discrimination improved when implied speed differed between the two sequences of a pair compared to when the implied speed was the same. Since stimuli showed no actual movement and were fully matched for lower-level visual input and objective stimulus durations, our findings suggest an involvement of higher-order visual or even motor areas in temporal biases during apparent biological motion perception. We show that apparent speed is the primary dimension of such percepts consistent with a dominant role of movement dynamics in the perception of other people's actions. Our results also confirm an intimate relation between time perception and processing of human movement.