Predicting the effects of actions: interactions of perception and action

An EEG frequency tagging study on biological motion perception in children with DCD

BACKGROUND

The perception of biological motion requires accurate prediction of the spatiotemporal dynamics of human movement. Research on Developmental Coordination Disorder (DCD) suggests deficits in accurate motor prediction, raising the question whether not just action execution, but also action perception is perturbed in this disorder.

AIMS

To examine action perception by comparing the neural response to the observation of apparent biological motion in children with and without DCD.

METHODS AND PROCEDURES

Thirty-three participants with and 33 without DCD, matched based on age (13.0 ± 2.0), sex and writing hand, observed sequences of static body postures that showed either fluent or non-fluent motion, in which only the fluent condition depicted apparent biological motion. Using a recently validated paradigm combining EEG frequency tagging and apparent biological motion (Cracco et al., 2023), the perception of biological motion was contrasted with the perception of individual body postures.

OUTCOMES AND CONCLUSIONS

Children with DCD did not show reduced sensitivity to apparent biological motion compared with typically developing children. However, the DCD group did show a reduced brain response to repetitive visual stimuli, suggesting altered predictive processing in the perceptual domain in this group. Suggestions for further research on biological motion perception in DCD are identified.

Effector-specific improvements in action prediction in left-handed individuals after short-term physical practice

Research has established the influence of short-term physical practice for enhancing action prediction in right-handed (RH) individuals. In addition to benefits of physical practice for these later assessed perceptual-cognitive skills, effector-specific interference has been shown through action-incongruent secondary tasks (motor interference tasks). Here we investigated this experience-driven facilitation of action predictions and effector-specific interference in left-handed (LH) novices, before and after practicing a dart throwing task. Participants watched either RH (n = 19) or LH (n = 24) videos of temporally occluded dart throws, across a control condition and three secondary-task conditions: tone-monitoring, RH or LH force monitoring. These conditions were completed before and after physical practice throwing with the LH. Significantly greater improvement in prediction accuracy was shown post-practice for the LH- versus RH-video group. Consistent with previous work, effector-specific interference was shown, exclusive to the LH-video group. Only when doing the LH force monitoring task did the LH-video group show secondary task interference in prediction accuracy. These data support the idea that short-term physical practice resulted in the development of an effector-specific motor representation. The results are also consistent with other work in RH individuals (showing RH motor interference) and hence rule out the interpretation that these effector specific effects are due to the disruption of more generalized motor processes, thought to be lateralized to the left-hemisphere of the brain.

Individual differences and motor planning influence self-recognition of actions

Although humans can recognize their body movements in point-light displays, self-recognition ability varies substantially across action types and participants. Are these variations primarily due to an awareness of visually distinct movement patterns, or to underlying factors related to motoric planning and/or individual differences? To address this question, we conducted a large-scale study in self-action recognition (N = 101). We motion captured whole-body movements of participants who performed 27 different actions across action goals and degree of motor planning. After a long delay period (~ 1 month), participants were tested in a self-recognition task: identifying their point-light action amongst three other point-light actors performing identical actions. We report a self-advantage effect from point-light actions, consistent with prior work in self-action recognition. Further, we found that self-recognition was modulated by the action complexity (associated with the degree of motor planning in performed actions) and individual differences linked to motor imagery and subclinical autism and schizotypy. Using dynamic time warping, we found sparse evidence in support of visual distinctiveness as a primary contributor to self-recognition, though speed distinctiveness negatively influenced self-recognition performance. Together, our results reveal that self-action recognition involves more than an awareness of visually distinct movements, with important implications for how the motor system may be involved.

Processing of visual social-communication cues during a social-perception of action task in autistic and non-autistic observers

Social perception and communication differ between those with and without autism, even when verbal fluency and intellectual ability are equated. Previous work found that observers responded more quickly to an actor's points if the actor had chosen by themselves where to point instead of being directed where to point. Notably, this 'choice-advantage' effect decreased across non-autistic participants as the number of autistic-like traits and tendencies increased (Pesquita et al., 2016). Here, we build on that work using the same task to study individuals over a broader range of the spectrum, from autistic to non-autistic, measuring both response initiation and mouse movement times, and considering the response to each actor separately. Autistic and non-autistic observers viewed videos of three different actors pointing to one of two locations, without knowing that the actors were sometimes freely choosing to point to one target and other times being directed where to point. All observers exhibited a choice-advantage overall, meaning they responded more rapidly when actors were freely choosing versus when they were directed, indicating a sensitivity to the actors' postural cues and movements. Our fine-grained analyses found a more robust choice-advantage to some actors than others, with autistic observers showing a choice-advantage only in response to one of the actors, suggesting that both actor and observer characteristics influence the overall effect. We briefly explore existing actor characteristics that may have contributed to this effect, finding that both duration of exposure to pre-movement cues and kinematic cues of the actors likely influence the choice advantage to different degrees across the groups. Altogether, the evidence suggested that both autistic and non-autistic individuals could detect the choice-advantage signal, but that for autistic observers the choice-advantage was actor specific. Notably, we found that the influence of the signal, when present, was detected early for all actors by the non-autistic observers, but detected later and only for one actor by the autistic observers. Altogether, we have more accurately characterized the ability of social-perception in autistic individuals as intact, but highlighted that detection of signal is likely delayed/distributed compared to non-autistic observers and that it is important to investigate actor characteristics that may influence detection and use of their social-perception signals.

Memory benefits when actively, rather than passively, viewing images

Serial visual presentations of images exist both in the laboratory and increasingly on virtual platforms such as social media feeds. However, the way we interact with information differs between these. In many laboratory experiments participants view stimuli passively, whereas on social media people tend to interact with information actively. This difference could influence the way information is remembered, which carries practical and theoretical implications. In the current study, 821 participants viewed streams containing seven landscape images that were presented at either a self-paced (active) or an automatic (passive) rate. Critically, the presentation speed in each automatic trial was matched to the speed of a self-paced trial for each participant. Both memory accuracy and memory confidence were greater on self-paced compared to automatic trials. These results indicate that active, self-paced progression through images increases the likelihood of them being remembered, relative to when participants have no control over presentation speed and duration.

Deconstructing the Functional Significance of the Error-related Negativity (ERN) and Midline Frontal Theta Oscillations Using Stepwise Time-locking and Single-trial Response Dynamics

Error-related electroencephalographic potentials have been used for decades to develop theoretical models of response monitoring processes, study altered cognitive functioning in clinical populations, and more recently, to improve the performance of brain-computer interfaces. However, the vast majority of this research relies on discrete behavioral responses that confound error detection, response cancellation, error correction, and post-error cognitive and affective processes. By contrast, the present study demonstrates a novel, complementary method for isolating the functional correlates of error-related electroencephalographic responses using single-trial kinematic analyses of cursor trajectories and a stepwise time-locking analysis. The results reveal that the latency of the ERN, Pe, and medial-frontal theta oscillations are all strongly positively correlated with the latency at which an initiated error response is canceled, as indicated by the peak deceleration of the initiated movement prior to a corrective response. Results are discussed with respect to current theoretical models of error-related brain potentials and potential relevance to clinical applications.

Motor outcomes congruent with intentions may sharpen metacognitive representations

We can monitor our intentional movements and form explicit representations about our movements, allowing us to describe how we move our bodies. But it is unclear which information this metacognitive monitoring relies on. For example, when throwing a ball to hit a target, we might use the visual information about how the ball flew to metacognitively assess our performance. Alternatively, we might disregard the ball trajectory - given that it is not directly relevant to our goal - and metacognitively assess our performance based solely on whether we reached the goal of hitting the target. In two experiments we aimed to distinguish between these two alternatives and asked whether the distal outcome of a goal-directed action (hitting or missing a target) informs the metacognitive representations of our own movements. Participants performed a semi-virtual task where they moved their arm to throw a virtual ball at a target. After each throw, participants discriminated which of two ball trajectories displayed on the screen corresponded to the flight path of their throw and then rated their confidence in this decision. The task included two conditions that differed on whether the distal outcome of the two trajectories shown matched (congruent) or differed (incongruent). Participants were significantly more accurate in discriminating between the two trajectories, and responded faster in the incongruent condition and, accordingly, were significantly more confident on these trials. Crucially, we found significant differences in metacognitive performance (measured as meta-d'/d') between the two conditions only on successful trials, where the virtual ball had hit the target. These results indicate that participants successfully incorporated information about the outcome of the movement into both their discrimination and confidence responses. However, information about the outcome selectively sharpened the precision of confidence ratings only when the outcome of their throw matched their intention. We argue that these findings underline the separation between the different levels of information that may contribute to body monitoring, and we provide evidence that intentions might play a central role in metacognitive motor representations.

The influence of action on perception spans different effectors

Perception and action are fundamental processes that characterize our life and our possibility to modify the world around us. Several pieces of evidence have shown an intimate and reciprocal interaction between perception and action, leading us to believe that these processes rely on a common set of representations. The present review focuses on one particular aspect of this interaction: the influence of action on perception from a motor effector perspective during two phases, action planning and the phase following execution of the action. The movements performed by eyes, hands, and legs have a different impact on object and space perception; studies that use different approaches and paradigms have formed an interesting general picture that demonstrates the existence of an action effect on perception, before as well as after its execution. Although the mechanisms of this effect are still being debated, different studies have demonstrated that most of the time this effect pragmatically shapes and primes perception of relevant features of the object or environment which calls for action; at other times it improves our perception through motor experience and learning. Finally, a future perspective is provided, in which we suggest that these mechanisms can be exploited to increase trust in artificial intelligence systems that are able to interact with humans.

The pleasantness and unpleasantness of an object distinctively drives its grasping prediction: behavioral evidence

Action and perception share a common sensorimotor network permitting a functional action-perception coupling. This coupling would permit to predict the outcome of others' actions. Moreover, recent findings suggest that action-perception linkage could be sensitive to emotional content of the visual scene. The present study sought to address how emotion inherent to an object (pleasantness and unpleasantness) affects action prediction processing. To this end, we compared the participants' temporal estimative of the hand contact with emotional objects in occlusion and full vision conditions. We found that the emotion strongly interfered in the prediction of its grasping. Indeed, the participants highly anticipated the touch instant for unpleasant valence compared to pleasant and neutral ones. Moreover, the visual conditions (i.e., occlusion and full vision) affect the magnitude of the predictive error except to unpleasant object. Accordingly, the present results unveil that pleasantness and unpleasantness of an object distinctively drive the prediction of its touch instant.

Imagining interceptions: Eye movements as an online indicator of covert motor processes during motor imagery

The analysis of eye movements during motor imagery has been used to understand the influence of covert motor processes on visual-perceptual activity. There is evidence showing that gaze metrics seem to be affected by motor planning often dependent on the spatial and temporal characteristics of a task. However, previous research has focused on simulated actions toward static targets with limited empirical evidence of how eye movements change in more dynamic environments. The study examined the characteristics of eye movements during motor imagery for an interception task. Twenty-four participants were asked to track a moving target over a computer display and either mentally simulate an interception or rest. The results showed that smooth pursuit variables, such as duration and gain, were lower during motor imagery when compared to passive observation. These findings indicate that motor plans integrate visual-perceptual information based on task demands and that eye movements during imagery reflect such constraint.

A reference-based theory of motivation and effort allocation

Motivation is key for performance in domains such as work, sport, and learning. Research has established that motivation and the willingness to invest effort generally increase as a function of reward. However, this view struggles to explain some empirical observations-for example, in the domain of sport, athletes sometimes appear to lose motivation when playing against weak opponents-this despite objective rewards being high. This and similar evidence highlight the role of subjective value in motivation and effort allocation. To capture this, here, we advance a novel theory and computational model where motivation and effort allocation arise from reference-based evaluation processes. Our proposal argues that motivation (and the ensuing willingness to exert effort) stems from subjective value, which in turns depends on one's standards about performance and on the confidence about these standards. In a series of simulations, we show that the model explains puzzling motivational dynamics and associated feelings. Crucially, the model identifies realistic standards (i.e., those matching one's own actual ability) as those more beneficial for motivation and performance. On this basis, the model establishes a normative solution to the problem of optimal allocation of effort, analogous to the optimal allocation of neural and computational resources as in efficient coding.

Social Action Effects: Representing Predicted Partner Responses in Social Interactions

The sociomotor framework outlines a possible role of social action effects on human action control, suggesting that anticipated partner reactions are a major cue to represent, select, and initiate own body movements. Here, we review studies that elucidate the actual content of social action representations and that explore factors that can distinguish action control processes involving social and inanimate action effects. Specifically, we address two hypotheses on how the social context can influence effect-based action control: first, by providing unique social features such as body-related, anatomical codes, and second, by orienting attention towards any relevant feature dimensions of the action effects. The reviewed empirical work presents a surprisingly mixed picture: while there is indirect evidence for both accounts, previous studies that directly addressed the anatomical account showed no signs of the involvement of genuinely social features in sociomotor action control. Furthermore, several studies show evidence against the differentiation of social and non-social action effect processing, portraying sociomotor action representations as remarkably non-social. A focus on enhancing the social experience in future studies should, therefore, complement the current database to establish whether such settings give rise to the hypothesized influence of social context.

Action Intentions, Predictive Processing, and Mind Reading: Turning Goalkeepers Into Penalty Killers

The key to action control is one’s ability to adequately predict the consequences of one’s actions. Predictive processing theories assume that forward models enable rapid “preplay” to assess the match between predicted and intended action effects. Here we propose the novel hypothesis that “reading” another’s action intentions requires a rich forward model of that agent’s action. Such a forward model can be obtained and enriched through learning by either practice or simulation. Based on this notion, we ran a series of studies on soccer goalkeepers and novices, who predicted the intended direction of penalties being kicked at them in a computerized penalty-reading task. In line with hypotheses, extensive practice in penalty kicking improved performance in penalty reading among goalkeepers who had extensive prior experience in penalty blocking but not in penalty kicking. A robust benefit in penalty reading did not result from practice in kinesthetic motor imagery of penalty kicking in novice participants. To test whether goalkeepers actually use such penalty-kicking imagery in penalty reading, we trained a machine-learning classifier on multivariate fMRI activity patterns to distinguish motor-imagery-related from attention-related strategies during a penalty-imagery training task. We then applied that classifier to fMRI data related to a separate penalty-reading task and showed that 2/3 of all correctly read penalty kicks were classified as engaging the motor-imagery circuit rather than merely the attention circuit. This study provides initial evidence that, in order to read our opponent’s action intention, it helps to observe their action kinematics, and use our own forward model to predict the sensory consequences of “our” penalty kick if we were to produce these action kinematics ourselves. In sum, it takes practice as a penalty kicker to become a penalty killer.

Observational vs coaching feedback on non-dominant whole-body motor skill performance - application to technique training

We studied the effect of peer- and self-observational feedback versus coaching feedback during technique training on performance in competitive adolescent cross-country skiers. Fifty-four skiers (14.3 ± 0.6 years) were divided into a control group and three intervention groups (dyad practice, video, or coaching feedback), which practiced in the asymmetrical uphill sub-technique G2 on one side (non-dominant side), but not the other (dominant side) for 6 × 30 min over a 5 weeks period, on roller skis outdoors. High-speed performance and skiing economy were assessed on a roller ski treadmill before and after the intervention, and a questionnaire was answered post-intervention. The video feedback (p = .025, d = .65) and coaching feedback (p = .007, d = .89) groups improved high-speed performance during the intervention and an ANCOVA showed a tendency for different change scores between interventions (F_3,49  = 2.5, p = .068, η p 2  = .134), with a difference between the coaching feedback and dyad practice (p = .05). No change was seen in skiing economy in any group. Coaching feedback ranked higher on enjoyment compared with dyad practice (p < .001) and led to higher self-perception of improved technique compared with the control group (p = .038). Overall, feedback from a competent coach seems better than observation for improving performance in young athletes, although self-observation through video with attentional cues seems a promising tool for increasing individual feedback when coaching large groups.

Not all errors are alike: modulation of error-related neural responses in musical joint action

During joint action, the sense of agency enables interaction partners to implement corrective and adaptive behaviour in response to performance errors. When agency becomes ambiguous (e.g. when action similarity encourages perceptual self-other overlap), confusion as to who produced what may disrupt this process. The current experiment investigated how ambiguity of agency affects behavioural and neural responses to errors in a joint action domain where self-other overlap is common: musical duos. Pairs of pianists performed piano pieces in synchrony, playing either the same pitches (ambiguous agency) or different pitches (unambiguous agency) while electroencephalography (EEG) was recorded for each individual. Behavioural and event-related potential results showed no effects of the agency manipulation but revealed differences in how distinct error types are processed. Self-produced 'wrong note' errors (substitutions) were left uncorrected, showed post-error slowing and elicited an error-related negativity (ERN) peaking before erroneous keystrokes (pre-ERN). In contrast, self-produced 'extra note' errors (additions) exhibited pre-error slowing, error and post-error speeding, were rapidly corrected and elicited the ERN. Other-produced errors evoked a feedback-related negativity but no behavioural effects. Overall findings shed light upon how the nervous system supports fluent interpersonal coordination in real-time joint action by employing distinct mechanisms to manage different types of errors.

Adaptive Prediction for Social Contexts: The Cerebellar Contribution to Typical and Atypical Social Behaviors

Social interactions involve processes ranging from face recognition to understanding others' intentions. To guide appropriate behavior in a given context, social interactions rely on accurately predicting the outcomes of one's actions and the thoughts of others. Because social interactions are inherently dynamic, these predictions must be continuously adapted. The neural correlates of social processing have largely focused on emotion, mentalizing, and reward networks, without integration of systems involved in prediction. The cerebellum forms predictive models to calibrate movements and adapt them to changing situations, and cerebellar predictive modeling is thought to extend to nonmotor behaviors. Primary cerebellar dysfunction can produce social deficits, and atypical cerebellar structure and function are reported in autism, which is characterized by social communication challenges and atypical predictive processing. We examine the evidence that cerebellar-mediated predictions and adaptation play important roles in social processes and argue that disruptions in these processes contribute to autism.

Anticipation and compensation for somatosensory deficits in object handling: evidence from a patient with large fiber sensory neuropathy

The purpose of this study was to determine the contributions of feedforward and feedback processes on grip force regulation and object orientation during functional manipulation tasks. One patient with massive somatosensory loss resulting from large fiber sensory neuropathy and 10 control participants were recruited. Three experiments were conducted: 1) perturbation to static holding; 2) discrete vertical movement; and 3) functional grasp and place. The availability of visual feedback was also manipulated to assess the nature of compensatory mechanisms. Results from experiment 1 indicated that both the deafferented patient and controls used anticipatory grip force adjustments before self-induced perturbation to static holding. The patient exhibited increased grip response time, but the magnitude of grip force adjustments remained correlated with perturbation forces in the self-induced and external perturbation conditions. In experiment 2, the patient applied peak grip force substantially in advance of maximum load force. Unlike controls, the patient's ability to regulate object orientation was impaired without visual feedback. In experiment 3, the duration of unloading, transport, and release phases were longer for the patient, with increased deviation of object orientation at phase transitions. These findings show that the deafferented patient uses distinct modes of anticipatory control according to task constraints and that responses to perturbations are mediated by alternative afferent information. The loss of somatosensory feedback thus appears to impair control of object orientation, whereas variation in the temporal organization of functional tasks may reflect strategies to mitigate object instability associated with changes in movement dynamics.NEW & NOTEWORTHY This study evaluates the effects of sensory neuropathy on the scaling and timing of grip force adjustments across different object handling tasks (i.e., holding, vertical movement, grasping, and placement). In particular, these results illustrate how novel anticipatory and online control processes emerge to compensate for the loss of somatosensory feedback. In addition, we provide new evidence on the role of somatosensory feedback for regulating object orientation during functional prehensile movement.

Experience has a limited effect on humans' ability to predict the outcome of social interactions in children, dogs and macaques

The ability to predict others' behaviour represents a crucial mechanism which allows individuals to react faster and more appropriately. To date, several studies have investigated humans' ability to predict conspecifics' behaviour, but little is known on our ability to predict behaviour in other species. Here, we aimed to test humans' ability to predict social behaviour in dogs, macaques and humans, and assess the role played by experience and evolution on the emergence of this ability. For this purpose, we presented participants with short videoclips of real-life social interactions in dog, child and macaque dyads, and then asked them to predict the outcome of the observed interactions (i.e. aggressive, neutral or playful). Participants were selected according to their previous species-specific experience with dogs, children and non-human primates. Our results showed a limited effect of experience on the ability to predict the outcome of social interactions, which was mainly restricted to macaques. Moreover, we found no support to the co-domestication hypothesis, in that participants were not especially skilled at predicting dog behaviour. Finally, aggressive outcomes in dogs were predicted significantly worse than playful or neutral ones. Based on our findings, we suggest possible lines for future research, like the inclusion of other primate species and the assessment of cultural factors on the ability to predict behaviour across species.

Neurotypical individuals fail to understand action vitality form in children with autism spectrum disorder

Action vitality forms are highly pervasive aspects of daily life and have been widely assumed to be critical for basic social interactions. Previous evidence indicates that ASD children express their own vitality forms in a way that is motorically dissimilar to TD children. Here we demonstrate that this motor dissimilarity prevents neurotypical adults from recognizing vitality forms, when observing ASD children acting gently or rudely. Although ASD children differentiate these vitality forms, neurotypical adults were remarkably inaccurate in identifying them. This indicates that difficulty in social interaction for ASD individuals should not be entirely ascribed to their lack of understanding others, as standardly assumed. The failure of neurotypical individuals to understand them plays a critical role too.

Any defects of sociality in individuals diagnosed with autism spectrum disorder (ASD) are standardly explained in terms of those individuals’ putative impairments in a variety of cognitive functions. Recently, however, the need for a bidirectional approach to social interaction has been emphasized. Such an approach highlights differences in basic ways of acting between ASD and neurotypical individuals which would prevent them from understanding each other. Here we pursue this approach by focusing on basic action features reflecting the agent’s mood and affective states. These are action features Stern named “vitality forms,” and which are widely assumed to substantiate core social interactions [D. N. Stern, The Interpersonal World of the Infant (1985); D. N. Stern, Forms of Vitality Exploring Dynamic Experience in Psychology, Arts, Psychotherapy, and Development (2010)]. Previously we demonstrated that, although ASD and typically developing (TD) children alike differentiate vitality forms when performing actions, ASD children express them in a way that is motorically dissimilar to TD children. To assess whether this motor dissimilarity may have consequences for vitality form recognition, we asked neurotypical participants to identify the vitality form of different types of action performed by ASD or TD children. We found that participants exhibited remarkable inaccuracy in identifying ASD children’s vitality forms. Interestingly, their performance did not benefit from information feedback. This indicates that how people act matters for understanding others and for being understood by them. Because vitality forms pervade every aspect of daily life, our findings promise to open the way to a deeper comprehension of the bidirectional difficulties for both ASD and neurotypical individuals in interacting with one another.

Visually evoked responses are enhanced when engaging in a video game

While it is well known that vision guides movement, less appreciated is that the motor cortex also provides input to the visual system. Here, we asked whether neural processing of visual stimuli is acutely modulated during motor activity, hypothesizing that visual evoked responses are enhanced when engaged in a motor task that depends on the visual stimulus. To test this, we told participants that their brain activity was controlling a video game that was in fact the playback of a prerecorded game. The deception, which was effective in half of participants, aimed to engage the motor system while avoiding evoked responses related to actual movement or somatosensation. In other trials, subjects actively played the game with keyboard control or passively watched a playback. The strength of visually evoked responses was measured as the temporal correlation between the continuous stimulus and the evoked potentials on the scalp. We found reduced correlation during passive viewing, but no difference between active and sham play. Alpha‐band (8–12 Hz) activity was reduced over central electrodes during sham play, indicating recruitment of motor cortex despite the absence of overt movement. To account for the potential increase of attention during gameplay, we conducted a second study with subjects counting screen items during viewing. We again found increased correlation during sham play, but no difference between counting and passive viewing. While we cannot fully rule out the involvement of attention, our findings do demonstrate an enhancement of visual evoked responses during active vision.

Shadowing in the manual modality

Motor simulation has emerged as a mechanism for both predictive action perception and language comprehension. By deriving a motor command, individuals can predictively represent the outcome of an unfolding action as a forward model. Evidence of simulation can be seen via improved participant performance for stimuli that conform to the participant's individual characteristics (an egocentric bias). There is little evidence, however, from individuals for whom action and language take place in the same modality: sign language users. The present study asked signers and nonsigners to shadow (perform actions in tandem with various models), and the delay between the model and participant ("lag time") served as an indicator of the strength of the predictive model (shorter lag time = more robust model). This design allowed us to examine the role of (a) motor simulation during action prediction, (b) linguistic status in predictive representations (i.e., pseudosigns vs. grooming gestures), and (c) language experience in generating predictions (i.e., signers vs. nonsigners). An egocentric bias was only observed under limited circumstances: when nonsigners began shadowing grooming gestures. The data do not support strong motor simulation proposals, and instead highlight the role of (a) production fluency and (b) manual rhythm for signer productions. Signers showed significantly faster lag times for the highly skilled pseudosign model and increased temporal regularity (i.e., lower standard deviations) compared to nonsigners. We conclude sign language experience may (a) reduce reliance on motor simulation during action observation, (b) attune users to prosodic cues (c) and induce temporal regularities during action production.

Listeners are better at predicting speakers similar to themselves

Although it takes several hundred milliseconds to prepare a spoken contribution, gaps between turns in conversation tend to be much shorter. To produce these short gaps, it appears that interlocutors predict the end of their partner's turn. The theory of prediction-by-simulation proposes that individuals use their own motor system to model a partner's upcoming actions by referring to prior production experience. In this study we investigate the role of motor experience for both predicting a turn-end and producing a spoken response by manipulating the similarity of heard speech to participants' own production style. We hypothesised that they would be better at predicting, and initiating responses to, speech produced in the style they speak themselves. Participants recorded a series of questions in two sessions, and several months later they listened to their own speech and that of a stylistically similar and a stylistically dissimilar participant (as assessed by independent raters). Participants predicted the end of 60 of these questions by pressing a button, and for the remaining 60 questions, by producing a spoken response. An analysis of response times showed that participants' button-press responses were faster for utterances spoken by themselves and by a stylistically similar partner, than for utterances spoken by a stylistically dissimilar partner. We conclude that simulation facilitates prediction of similar speakers.

•

Prediction-by-simulation proposes that prediction is based on one's motor experience.

•

If this is the case, predictions should be better for people more like oneself.

•

We tested if speech-style similarity affected prediction during speech listening.

•

Similarity led to better predictions of turn-ends, but not quicker turn-taking.

•

We argue simulation facilitates prediction of similar speakers.

Somatosensory-visual effects in visual biological motion perception

Social cognition is dependent on the ability to extract information from human stimuli. Of those, patterns of biological motion (BM) and in particular walking patterns of other humans, are prime examples. Although most often tested in isolation, BM outside the laboratory is often associated with multisensory cues (i.e. we often hear and see someone walking) and there is evidence that vision-based judgments of BM stimuli are systematically influenced by motor signals. Furthermore, cross-modal visuo-tactile mechanisms have been shown to influence perception of bodily stimuli. Based on these observations, we here investigated if somatosensory inputs would affect visual BM perception. In two experiments, we asked healthy participants to perform a speed discrimination task on two point light walkers (PLW) presented one after the other. In the first experiment, we quantified somatosensory-visual interactions by presenting PLW together with tactile stimuli either on the participants' forearms or feet soles. In the second experiment, we assessed the specificity of these interactions by presenting tactile stimuli either synchronously or asynchronously with upright or inverted PLW. Our results confirm that somatosensory input in the form of tactile foot stimulation influences visual BM perception. When presented with a seen walker's footsteps, additional tactile cues enhanced sensitivity on a speed discrimination task, but only if the tactile stimuli were presented on the relevant body-part (under the feet) and when the tactile stimuli were presented synchronously with the seen footsteps of the PLW, whether upright or inverted. Based on these findings we discuss potential mechanisms of somatosensory-visual interactions in BM perception.

Early warning signals in motion inference

The ability to infer intention lies at the basis of many social interactions played out via motor actions. We consider a simple paradigm of this ability in humans using data from experiments simulating an antagonistic game between an Attacker and a Blocker. Evidence shows early inference of an Attacker move by as much as 100ms but the nature of the informational cues signaling the impending move remains unknown. We show that the transition to action has the hallmark of a critical transition that is accompanied by early warning signals. These early warning signals occur as much as 130 ms before motion ensues-showing a sharp rise in motion autocorrelation at lag-1 and a sharp rise in the autocorrelation decay time. The early warning signals further correlate strongly with Blocker response times. We analyze the variance of the motion near the point of transition and find that it diverges in a manner consistent with the dynamics of a fold-transition. To test if humans can recognize and act upon these early warning signals, we simulate the dynamics of fold-transition events and ask people to recognize the onset of directional motion: participants react faster to fold-transition dynamics than to its uncorrelated counterpart. Together, our findings suggest that people can recognize the intent and onset of motion by inferring its early warning signals.

Emotional expressivity of the observer mediates recognition of affective states from human body movements

Research on human motion perception shows that people are highly adept at inferring emotional states from body movements. Yet, this process is mediated by a number of individual factors and experiences. Within this study, we tackle two questions. Firstly, we ask which part of the body transmits the key information that is used to infer affective states. Secondly, we address how the observer's own emotional expressivity influences the recognition process. We used two types of impoverished point-light displays depicting the same emotional interactions as either arm or trunk movements. Results showed that participants used different sources of information in an emotion-specific manner. Participants with richer self-reported emotional expressivity showed higher recognition accuracies overall but also benefited more from information delivered by arm gestures. We interpret our findings in terms of embodied simulation, suggesting that emotion perception constitutes a function of the expressing body and the individual observer.

Decoding identity from motion: how motor similarities colour our perception of self and others

For more than 4 decades, it has been shown that humans are particularly sensitive to biological motion and extract socially relevant information from it such as gender, intentions, emotions or a person’s identity. A growing number of findings, however, indicate that identity perception is not always highly accurate, especially due to large inter-individual differences and a fuzzy self-recognition advantage compared to the recognition of others. Here, we investigated the self-other identification performance and sought to relate this performance to the metric properties of perceptual/physical representations of individual motor signatures. We show that identity perception ability varies substantially across individuals and is associated to the perceptual/physical motor similarities between self and other stimuli. Specifically, we found that the perceptual representations of postural signatures are veridical in the sense that closely reflects the physical postural trajectories and those similarities between people’ actions elicit numerous misattributions. While, on average, people can well recognize their self-generated actions, they more frequently attribute to themselves the actions of those acting in a similar way. These findings are consistent with the common coding theory and support that perception and action are tightly linked and may modulate each other by virtue of similarity.

Subtle predictive movements reveal actions regardless of social context

Humans have a remarkable ability to predict the actions of others. To address what information enables this prediction and how the information is modulated by social context, we used videos collected during an interactive reaching game. Two participants (an “initiator” and a “responder”) sat on either side of a plexiglass screen on which two targets were affixed. The initiator was directed to tap one of the two targets, and the responder had to either beat the initiator to the target (competition) or arrive at the same time (cooperation). In a psychophysics experiment, new observers predicted the direction of the initiators' reach from brief clips, which were clipped relative to when the initiator began reaching. A machine learning classifier performed the same task. Both humans and the classifier were able to determine the direction of movement before the finger lift-off in both social conditions. Further, using an information mapping technique, the relevant information was found to be distributed throughout the body of the initiator in both social conditions. Our results indicate that we reveal our intentions during cooperation, in which communicating the future course of actions is beneficial, and also during competition despite the social motivation to reveal less information.

Happy you, happy me: expressive changes on a stranger's voice recruit faster implicit processes than self-produced expressions

In social interactions, people have to pay attention both to the ‘what’ and ‘who’. In particular, expressive changes heard on speech signals have to be integrated with speaker identity, differentiating e.g. self- and other-produced signals. While previous research has shown that self-related visual information processing is facilitated compared to non-self stimuli, evidence in the auditory modality remains mixed. Here, we compared electroencephalography (EEG) responses to expressive changes in sequence of self- or other-produced speech sounds using a mismatch negativity (MMN) passive oddball paradigm. Critically, to control for speaker differences, we used programmable acoustic transformations to create voice deviants that differed from standards in exactly the same manner, making EEG responses to such deviations comparable between sequences. Our results indicate that expressive changes on a stranger’s voice are highly prioritized in auditory processing compared to identical changes on the self-voice. Other-voice deviants generate earlier MMN onset responses and involve stronger cortical activations in a left motor and somatosensory network suggestive of an increased recruitment of resources for less internally predictable, and therefore perhaps more socially relevant, signals.

Tapping doesn't help: Synchronized self-motion and judgments of musical tempo

For both musicians and music psychologists, beat rate (BPM) has often been regarded as a transparent measure of musical speed or tempo, yet recent research has shown that tempo is more than just BPM. In a previous study, London, Burger, Thompson, and Toiviainen (Acta Psychologica, 164, 70-80, 2016) presented participants with original as well as "time-stretched" versions of classic R&B songs; time stretching slows down or speeds up a recording without changing its pitch or timbre. In that study we discovered a tempo anchoring effect (TAE): Although relative tempo judgments (original vs. time-stretched versions of the same song) were correct, they were at odds with BPM rates of each stimulus. As previous studies have shown that synchronous movement enhances rhythm perception, we hypothesized that tapping along to the beat of these songs would reduce or eliminate the TAE and increase the salience of the beat rate of each stimulus. In the current study participants were presented with the London et al. (Acta Psychologica, 164, 70-80, 2016) stimuli in nonmovement and movement conditions. We found that although participants were able to make BPM-based tempo judgments of generic drumming patterns, and were able to tap along to the R&B stimuli at the correct beat rates, the TAE persisted in both movement and nonmovement conditions. Thus, contrary to our hypothesis that movement would reduce or eliminate the TAE, we found a disjunction between correctly synchronized motor behavior and tempo judgment. The implications of the tapping-TAE dissociation in the broader context of tempo and rhythm perception are discussed, and further approaches to studying the TAE-tapping dissociation are suggested.

An Ontology for Human-Human Interactions and Learning Interaction Behavior Policies

Robots are expected to possess similar capabilities that humans exhibit during close proximity dyadic interaction. Humans can easily adapt to each other in a multitude of scenarios, ensuring safe and natural interaction. Even though there have been attempts to mimic human motions for robot control, understanding the motion patterns emerging during dyadic interaction has been neglected. In this work, we analyze close-proximity human-human interaction and derive an ontology that describes a broad range of possible interaction scenarios by abstracting tasks and using insights from attention theory. This ontology enables us to group interaction behaviors into separate cases, each of which can be represented by a particular graph. Using imitation learning, we train unique interaction policies with recurrent neural networks for each case. The ontology offers a unified and generic approach to categorically analyze and learn close-proximity interaction behaviors that can both be utilized as base models for future studies and enhance natural human-robot collaboration.

Representational Momentum in the Expertise Context: Support for the Theory of Event Coding as an Explanation for Action Anticipation

This study aimed to extend the notion of the theory of event coding as an explanation of action anticipation in expert sport performers. This was achieved by investigating the degree with which automatic anticipation depends on the ecological congruency between the perceived action and its distal effect. In a novel approach, the representational momentum paradigm was adopted to address this notion. Expert (N = 16) and novice (N = 20) rugby players observed a dynamic video of a short pass that was displayed as either toward or away from a receiver. Following an occlusion interval, participants were required to judge whether the video resumed at the same place, further forward or further backward than its original stopping place. Experts demonstrated stronger anticipatory tendencies when the action was directed toward the receiver. This relationship was modulated by a leftward directional bias that is discussed in the context of a bias in viewing behavior that is underpinned by attention. Novice anticipatory tendencies were independent of context. These findings show support for the extension of the theory of event coding.

Should agility training for novice badminton players be physically or perceptually challenging?

BACKGROUND

Despite its well-known importance in sports, agility is ambiguously defined and lack of research. Shuttle Run (SR) challenges physical quickness and is commonly used to improve the on-court agility of badminton players. In contrast, Reactive Initiation Training (RIT) challenges perceptual quickness, merely demanding rapid initiation of step toward the direction of shuttlecock.

METHODS

The current study explores to compare SR with RIT to determine the relative effectiveness of these training on improving the on-court agility of badminton. 20 novice badminton players were split in half to receive either RIT or SR on court for five days. Before and after training, the on-court agility test with and without anticipation was administered.

RESULTS

The results showed that both training methods shortened the mean running time, however, only RIT additionally reduced the initiation time and its proportion on those time-consuming positions when agility was assessed without anticipation.

CONCLUSIONS

Therefore, the agility training for novice badminton players should be more perceptually than physically challenging to avoid vain effort and unnecessary injuries.

Pupils say more than a thousand words: Pupil size reflects how observed actions are interpreted

Humans attend to others' facial expressions and body language to better understand their emotions and predict goals and intentions. The eyes and its pupils reveal important social information. Because pupil size is beyond voluntary control yet reflective of a range of cognitive and affective processes, pupils in principal have the potential to convey whether others' actions are interpreted correctly or not. Here, we measured pupil size while participants observed video-clips showing reach-to-grasp arm movements. Expressors in the video-clips were playing a board game and moved a dowel to a new position. Participants' task was to decide whether the dowel was repositioned with the intention to be followed up by another move of the same expressor (personal intention) or whether the arm movement carried the implicit message that expressor's turn was over (social intention). Replicating earlier findings, results showed that participants recognized expressors' intentions on the basis of their arm kinematics. Results further showed that participants' pupil size was larger when observing actions reflecting personal compared to social intentions. Most interestingly, before participants indicated how they interpreted the observed actions by choosing to press one of two keys (corresponding to the personal or social intention), their pupils within a split second, had already given away how they interpreted the expressor's movement. In sum, this study underscores the importance of nonverbal behavior in helping social messages get across quickly. Revealing how actions are interpreted, pupils may provide additional feedback for effective social interactions.

Influence of skill level on predicting the success of one's own basketball free throws

Basketball players sometimes claim to know when their shot is good, even before it goes in. This is likely because shooter proprioception can help determine shot outcome, even before their eyes confirm it. This phenomenon, however, has not been systematically explored for collegiate and recreational shooters. This study compared how well collegiate shooters and recreational shooters could predict outcomes of their own free throws without seeing the shot result. Forty collegiate and recreational shooters shot standard free throws while wearing liquid-crystal occlusion glasses that activated to occlude vision immediately following ball release during each shot. After each shot, shooters verbally predicted shot outcome as “in” or “out”, and predicted results were compared with actual outcomes. As anticipated, for made shots, collegiate shooters more accurately predicted their own shots than recreational shooters. However, unexpectedly, for missed shots, collegiate shooters were worse than recreational shooters and were even significantly worse than chance. Further analysis found that collegiate shooters exhibited a significantly higher bias toward predicting their shots as “in”. Understanding how shooters of different skill levels perceive their own shot could inform future training strategies for improving shooter accuracy.

The Limitations of Being a Copycat: Learning Golf Putting Through Auditory and Visual Guidance

The goal of this study was to investigate whether sensory cues carrying the kinematic template of expert performance (produced by mapping movement to a sound or visual cue) displayed prior to and during movement execution can enhance motor learning of a new skill (golf putting) in a group of novices. We conducted a motor learning study on a sample of 30 participants who were divided into three groups: a control, an auditory guide and visual guide group. The learning phase comprised of two sessions per week over a period of 4 weeks, giving rise to eight sessions. In each session participants made 20 shots to three different putting distances. All participants had their measurements taken at separate sessions without any guidance: baseline, transfer (different distances) and retention 2 weeks later. Results revealed a subtle improvement in goal attainment and a decrease in kinematic variability in the sensory groups (auditory and visual) compared to the control group. The comparable changes in performance between the visual and auditory guide groups, particularly during training, supports the idea that temporal patterns relevant to motor control can be perceived similarly through either visual or auditory modalities. This opens up the use of auditory displays to inform motor learning in tasks or situations where visual attention is otherwise constrained or unsuitable. Further research into the most useful template actions to display to learners may thus still support effective auditory guidance in motor learning.

The influence of visual cues on temporal anticipation and movement synchronization with musical sequences

Music presents a complex case of movement timing, as one to several dozen musicians coordinate their actions at short time-scales. This process is often directed by a conductor who provides a visual beat and guides the ensemble through tempo changes. The current experiment tested the ways in which audio-motor coordination is influenced by visual cues from a conductor's gestures, and how this influence might manifest in two ways: movements used to produce sound related to the music, and movements of the upper-body that do not directly affect sound output. We designed a virtual conductor that was derived from morphed motion capture recordings of human conductors. Two groups of participants (29 musicians and 28 nonmusicians, to test the generalizability of visuo-motor synchronization to non-experts) were shown the virtual conductor, a simple visual metronome, or a stationary circle while completing a drumming task that required synchronization with tempo-changing musical sequences. We measured asynchronies and temporal anticipation in the drumming task, as well as participants' upper-body movement using motion capture. Drumming results suggest the conductor generally improves synchronization by facilitating anticipation of tempo changes in the music. Motion capture results showed that the conductor visual cue elicited more structured head movements than the other two visual cues for nonmusicians only. Multiple regression analysis showed that the nonmusicians with less rigid movement and high anticipation had lower asynchronies. Thus, the visual cues provided by a conductor might serve to facilitate temporal anticipation and more synchronous movement in the general population, but might also cause rigid ancillary movements in some non-experts.

Behavioral performance and visual strategies during skill acquisition using a novel tool use motor learning task

Habitual tool use is considered a hallmark of human evolution. One potential explanation for humanity's advanced tool using abilities is that humans possess a unique neurobiological system that estimates efficient ways to manipulate objects with novel tools, resulting in rapid tool use motor learning. However, since humans regularly use a multitude of tools, examining these underlying processes is challenging. As such, we developed a tool use motor learning paradigm that utilizes a challenging tool (chopsticks) in order to accomplish a difficult behavioral task that requires extensive practice to continuously improve one's proficiency. We then assessed the paradigm by recruiting participants with little experience using chopsticks and training them over the course of eight training sessions to grasp marbles with chopsticks and drop them in a cylindrical container. Throughout training, we examined behavioral performance and visual strategies to determine whether practicing the task resulted in outcomes congruent with traditional motor learning. Results show that performance increases in a logarithmic pattern and is accompanied by decreased confirmatory visual strategies. Since these findings are congruent with those seen in traditional motor learning, this paradigm is a novel method for use in future research examining the underlying mechanisms that mediate tool use motor learning.

Listening to yourself is special: Evidence from global speech rate tracking

Listeners are known to use adjacent contextual speech rate in processing temporally ambiguous speech sounds. For instance, an ambiguous vowel between short /α/ and long /a:/ in Dutch sounds relatively long (i.e., as /a:/) embedded in a fast precursor sentence, but short in a slow sentence. Besides the local speech rate, listeners also track talker-specific global speech rates. However, it is yet unclear whether other talkers’ global rates are encoded with reference to a listener’s self-produced rate. Three experiments addressed this question. In Experiment 1, one group of participants was instructed to speak fast, whereas another group had to speak slowly. The groups were compared on their perception of ambiguous /α/-/a:/ vowels embedded in neutral rate speech from another talker. In Experiment 2, the same participants listened to playback of their own speech and again evaluated target vowels in neutral rate speech. Neither of these experiments provided support for the involvement of self-produced speech in perception of another talker’s speech rate. Experiment 3 repeated Experiment 2 but with a new participant sample that was unfamiliar with the participants from Experiment 2. This experiment revealed fewer /a:/ responses in neutral speech in the group also listening to a fast rate, suggesting that neutral speech sounds slow in the presence of a fast talker and vice versa. Taken together, the findings show that self-produced speech is processed differently from speech produced by others. They carry implications for our understanding of rate-dependent speech perception in dialogue settings, suggesting that both perceptual and cognitive mechanisms are involved.

Aberrant patterns of neural activity when perceiving emotion from biological motion in schizophrenia

Social perceptual deficits in schizophrenia are well established. Recent work suggests that the ability to extract social information from bodily cues is reduced in patients. However, little is known about the neurobiological mechanisms underlying this deficit. In the current study, 20 schizophrenia patients and 16 controls completed two tasks using point-light animations during fMRI: a basic biological motion task and an emotion in biological motion task. The basic biological motion task was used to localize activity in posterior superior temporal sulcus (pSTS), a critical region for biological motion perception. During the emotion in biological motion task, participants viewed brief videos depicting happiness, fear, anger, or neutral emotions and were asked to decide which emotion was portrayed. Activity in pSTS and amygdala was interrogated during this task. Results indicated that patients showed overall reduced activation compared to controls in pSTS and at a trend level in amygdala across emotions, despite similar task performance. Further, a functional connectivity analysis revealed that controls, but not patients, showed significant positive connectivity between pSTS and left frontal regions as well as bilateral angular gyrus during the emotion in biological motion task. These findings indicate that schizophrenia patients show aberrant neural activity and functional connectivity when extracting complex social information from simple motion stimuli, which may contribute to social perception deficits in this disorder.

•

Perception of social information from bodily cues is impaired in schizophrenia.

•

We examined neural correlates of perception of emotion from biological motion.

•

Activity in amygdala and posterior superior temporal sulcus was reduced in patients.

•

pSTS functional connectivity with frontal and parietal regions was reduced in patients.

•

Aberrant neural responses may contribute to social perceptual deficits in schizophrenia.

The Study of Visual-Auditory Interactions on Lower Limb Motor Imagery

In order to improve the activation of the mirror neuron system and the ability of the visual-cued motor imagery further, the multi-stimuli-cued unilateral lower limb motor imagery is studied in this paper. The visual-auditory evoked pathway is proposed and the sensory process is studied. To analyze the visual-auditory interactions, the kinesthetic motor imagery with the visual-auditory stimulus, visual stimulus and no stimulus are involved. The motor-related rhythm suppression is applied on quantitative evaluation. To explore the statistical sensory process, the causal relationships among the functional areas and the event-related potentials are investigated. The results have demonstrated the outstanding performances of the visual-auditory evoked motor imagery on the improvement of the mirror neuron system activation and the motor imagery ability. Besides, the abundant information interactions among functional areas and the positive impacts of the auditory stimulus in the motor and the visual areas have been revealed. The possibility that the sensory processes evoked by the visual-auditory interactions differ from the one elicited by kinesthetic motor imagery, has also been indicated. This study will promisingly offer an efficient way to motor rehabilitation, thus favorable for hemiparesis and partial paralysis patients.

The dynamics of the interrelation of perception and action across the life span

Successful social interaction relies on the interaction partners' perception, anticipation and understanding of their respective actions. The perception of a particular action and the capability to produce this action share a common representational ground. So far, no study has explored the interrelation between action perception and production across the life span using the same tasks and the same measurement techniques. This study was designed to fill this gap. Participants between 3 and 80 years (N = 214) observed two multistep actions of different familiarities and then reproduced the according actions. Using eye tracking, we measured participants' action perception via their prediction of action goals during observation. To capture subtler perceptual processes, we additionally analysed the dynamics and recurrent patterns within participants' gaze behaviour. Action production was assessed via the accuracy of the participants' reproduction of the observed actions. No age-related differences were found for the perception of the familiar action, where participants of all ages could rely on previous experience. In the unfamiliar action, where participants had less experience, action goals were predicted more frequently with increasing age. The recurrence in participants' gaze behaviour was related to both, age and action production: gaze behaviour was more recurrent (i.e. less flexible) in very young and very old participants, and lower levels of recurrence (i.e. greater flexibility) were related to higher scores in action production across participants. Incorporating a life-span perspective, this study illustrates the dynamic nature of developmental differences in the associations of action production with action perception.

East is not right: Spatial compatibility differs between egocentric and cardinal retrieval

Four experiments examined perceptuo-motor associations involved in spatial knowledge encoding and retrieval. Participants learned spatial information by studying a map or by navigating through a real environment and then verified spatial descriptions based on either egocentric or cardinal directional terms. Participants moved the computer mouse to a YES or NO button to verify each statement. We tracked mouse cursor trajectories to examine perceptuo-motor associations in spatial knowledge. An encoding hypothesis predicts that perceptuo-motor associations depend on the involvement of perceptions and actions during encoding, regardless of how spatial knowledge would be used. The retrieval hypothesis predicts that perceptuo-motor associations change as a function of retrieval demands, regardless of how they are learned. The results supported the retrieval hypothesis. Participants showed action compatibility effects with egocentric retrieval, regardless of how spatial information was learned. With well-developed spatial knowledge, a reliable compatibility effect emerged during egocentric retrieval, but no or limited compatibility effects emerged with cardinal retrieval. With less-developed knowledge, the compatibility effects evident during cardinal retrieval suggest a process of egocentric recoding. Other factors of environment learning, such as location proximity and orientation changes, also impacted the compatibility effect, as revealed in the temporal dynamics of mouse movements. Taken together, the results demonstrate that retrieval demands differentially rely upon perceptuo-motor associations in long-term spatial knowledge. This effect is also modulated by environment experience, proximity of learned locations, and experienced orientations.

Prediction error induced motor contagions in human behaviors

Motor contagions refer to implicit effects on one's actions induced by observed actions. Motor contagions are believed to be induced simply by action observation and cause an observer's action to become similar to the action observed. In contrast, here we report a new motor contagion that is induced only when the observation is accompanied by prediction errors - differences between actions one observes and those he/she predicts or expects. In two experiments, one on whole-body baseball pitching and another on simple arm reaching, we show that the observation of the same action induces distinct motor contagions, depending on whether prediction errors are present or not. In the absence of prediction errors, as in previous reports, participants' actions changed to become similar to the observed action, while in the presence of prediction errors, their actions changed to diverge away from it, suggesting distinct effects of action observation and action prediction on human actions.

Watching sports sometimes causes people to unintentionally move in the same way as the athlete they are observing. This type of unconscious mimicry is called a motor contagion. Observing everyday actions can also trigger motor contagion, and plays an important role in social interactions.

So far, studies have focused on understanding how observing an action leads to motor contagion. They have not factored in the fact that in everyday life individuals consciously or unconsciously predict observed actions by others. Sometimes these predictions are wrong, leading to so called ‘prediction errors’. It was not clear whether motor contagion occurs when the viewer has made an incorrect prediction, or if prediction errors change the behavior of the viewer.

Now, Ikegami, Ganesh et al. show that prediction errors influence motor contagion. In one experiment, baseball players were asked to watch a video of an actor pitching a ball toward a target and predict where on the target the ball would hit. Some of the players were given misleading information intended to increase the likelihood they would incorrectly predict where the actor would throw. The players then pitched the ball towards a target themselves. When the players had just watched the actor’s throw, their throws became similar to it. When their predictions were wrong, their throws were very different from the actor’s throw. The players were not aware of the changes to their throw in either case.

Ikegami, Ganesh et al. also conducted a similar experiment in which other volunteers were asked to observe an actor reaching for a target and then reach for the target themselves. The results were similar: when the volunteers’ predictions were wrong, they reached in different ways to the actor.

This may be a new type of motor contagion. Learning more about this effect could help researchers to better understand the adjustments people make to their social behaviors and give new insights about the brain mechanisms that underlie normal human actions and social interactions. Sports trainers or physical therapists might also use this information to develop better strategies for maintaining athlete performances or helping people to recover movement after an injury or illness.

Joint action coordination in expert-novice pairs: Can experts predict novices' suboptimal timing?

Previous research has established that skilled joint action partners use predictive models to achieve temporal coordination, for instance, when playing a music duet. But how do joint action partners with different skill levels achieve coordination? Can experts predict the suboptimal timing of novices? What kind of information allows them to predict novices’ timing? To address these questions, we asked skilled pianists to perform duets with piano novices. We varied whether, prior to performing duets, experts were familiar with novices’ performances of their individual parts of the duets and whether experts had access to the musical scores including the novices’ part of the duet. Familiarity with the score led to better coordination when the score implied a difficult passage. Familiarity with novices’ performances led to better joint action coordination for the remaining parts of the duet. Together, the results indicate that experts are surprisingly flexible in predicting novices’ suboptimal timing.

Toward navigation ability for autonomous mobile robots with learning from demonstration paradigm

Learning from demonstration, as an important component of imitation learning, is a paradigm for robot to learn new tasks. Considering the application of learning from demonstration in the navigation issue, the robot can also acquire the navigation task via the human teacher’s demonstration. Based on research of the human brain neocortex, in this article, we present a learning from demonstration navigation paradigm from the perspective of hierarchical temporal memory theory. As a type of end-to-end learning form, the demonstrated relationship between perception data and motion commands will be learned and predicted by using hierarchical temporal memory. This framework first perceives images to obtain the corresponding categories information; then the categories incorporated with depth and motion command data are encoded as a sequence of sparse distributed representation vectors. The sequential vectors are treated as the inputs to train the navigation hierarchical temporal memory. After the training, the navigation hierarchical temporal memory stores the transitions of the perceived images, depth, and motion data so that future motion commands can be predicted. The performance of the proposed navigation strategy is evaluated via the real experiments and the public data sets.

Action compatibility in spatial knowledge developed through virtual navigation

Action-compatibility effects (ACEs) arise due to incongruity between perceptuo-motor traces stored in memory and the perceptuo-motor demands of a retrieval task. Recent research has suggested that ACEs arising during spatial memory retrieval are additionally modulated by individual differences in how experienced participants are with a college campus environment. However, the extent and nature of experience with a real-world environment is difficult to assess and control, and characteristics of the retrieval task itself might modulate ACEs during spatial memory retrieval. The present study provides a more controlled and in-depth examination of how individual differences and task-based factors interact to shape ACEs when participants retrieve spatial memories. In two experiments, participants with varied video game experience learned a virtual environment and then used the computer mouse to verify spatial relationships from different perspectives. Mouse trajectories demonstrated ACEs, differing by retrieval perspective and video game experience. Videogame experts demonstrated the ACE based on learned spatial relationships during egocentric retrieval only, whereas videogame novices showed the ACE based on semantic processing of directional terms only. Specifically, gaming experts invoke perspective-specific perceptuo-motor associations to retrieve spatial knowledge, whereas non-experts are influenced by semantically based associations specific to the retrieval task. Results are discussed in the context of action-compatibility effects, the intentional weighting hypothesis, and the flexible encoding and retrieval of spatial information.

Temporal Order of Strokes Primes letter Recognition

Does the perception of objects that are the result of human actions reflect the underlying temporal structure of the actions that gave rise to them? We tested whether the temporal order of letter strokes influences letter recognition. In three experiments, participants were asked to identify letters that temporally unfolded as an additive sequence of letter strokes, either consistent or inconsistent with common writing action. Participants were significantly faster to identify letters from consistent temporal sequences, indicating that the initial part of the sequence contained sufficient information to prime letter recognition. We suggest that letter perception reflects the temporal structure of letter production; in other words, Simon sees as Simon does.