Contextual expectations shape the motor coding of movement kinematics during the prediction of observed actions: A TMS study

Contextual information may shape motor resonance and support intention understanding during observation of incomplete, ambiguous actions. It is unclear, however, whether this effect is contingent upon kinematics ambiguity or contextual information is continuously integrated with kinematics to predict the overarching action intention. Moreover, a differentiation between the motor mapping of the intention suggested by context or kinematics has not been clearly demonstrated. In a first action execution phase, 29 participants were asked to perform reaching-to-grasp movements towards big or small food objects with the intention to eat or to move; electromyography from the First Dorsal Interosseous (FDI) and Abductor Digiti Minimi (ADM) was recorded. Depending on object size, the intentions to eat or to move were differently implemented by a whole-hand or a precision grip kinematics, thus qualifying an action-muscle dissociation. Then, in a following action prediction task, the same participants were asked to observe an actor performing the same actions and to predict his/her intention while motor resonance was assessed for the same muscles. Of note, videos were interrupted at early or late action phases, and actions were embedded in contexts pointing toward an eating or a moving intention, congruently or incongruently with kinematics. We found greater involvement of the FDI or ADM in the execution of precision or whole-hand grips, respectively. Crucially, this pattern of activation was mirrored during observation of the same actions in congruent contexts, but it was cancelled out or reversed in the incongruent ones, either when videos were interrupted at either early or long phases of action deployment. Our results extend previous evidence by showing that contextual information shapes motor resonance not only under conditions of perceptual uncertainty but also when more informative kinematics is available.

The social relevance and the temporal constraints of motor resonance in humans

In humans, motor resonance effects can be tracked by measuring the enhancement of corticospinal excitability by action observation. Uncovering factors driving motor resonance is crucial for optimizing action observation paradigms in experimental and clinical settings. In the present study, we deepen motor resonance properties for grasping movements. Thirty-five healthy subjects underwent an action observation task presenting right-hand grasping movements differing from their action goal. Single-pulse transcranial magnetic stimulation was applied over the left primary motor cortex at 100, 200, or 300 ms from the onset of the visual stimulus depicting the action. Motor-evoked potentials were recorded from four muscles of the right hand and forearm. Results show a muscle-specific motor resonance effect at 200 ms after movement but selectively for observing a socially relevant grasp towards another human being. This effect correlates with observers' emotional empathy scores, and it was followed by inhibition of motor resonance at 300 ms post-stimulus onset. No motor resonance facilitation emerged while observing intransitive hand movement or object grasping. This evidence highlights the social side of motor resonance and its dependency on temporal factors.

Functional role of the theory of mind network in integrating mentalistic prior information with action kinematics during action observation

Inferring intentions from verbal and nonverbal human behaviour is critical for everyday social life. Here, we combined Transcranial Magnetic Stimulation (TMS) with a behavioural priming paradigm to test whether key nodes of the Theory of Mind network (ToMn) contribute to understanding others' intentions by integrating prior knowledge about an agent with the observed action kinematics. We used a modified version of the Faked-Action Discrimination Task (FAD), a forced-choice paradigm in which participants watch videos of actors lifting a cube and judge whether the actors are trying to deceive them concerning the weight of the cube. Videos could be preceded or not by verbal description (prior) about the agent's truthful or deceitful intent. We applied single pulse TMS over three key nodes of the ToMn, namely dorsomedial prefrontal cortex (dmPFC), right posterior superior temporal sulcus (pSTS) and right temporo-parietal junction (rTPJ). Sham-TMS served as a control (baseline) condition. Following sham or rTPJ stimulation, we observed no consistent influence of priors on FAD performance. In contrast, following dmPFC stimulation, and to a lesser extent pSTS stimulation, truthful and deceitful actions were perceived as more deceptive only when the prior suggested a dishonest intention. These findings highlight a functional role of dmPFC and pSTS in coupling prior knowledge about deceptive intents with observed action kinematics in order to judge faked actions. Our study provides causal evidence that fronto-temporal nodes of the ToMn are functionally relevant to mental state inference during action observation.

Can static Rorschach stimuli perceived as in motion affect corticospinal excitability?

It has been proposed that seeing human movement or activity (M), while trying to say what the static Rorschach inkblot design look like, is accompanied by Mirror Neuron System (MNS)-like mirroring activity in the brain. The present study aimed to investigate whether the Rorschach cards eliciting M responses could affect the excitability of the motor cortex by recording motor evoked potentials (MEPs) elicited by single-pulse TMS over the primary motor cortex (M1). We hypothesized that Rorschach inkblot stimuli triggering the viewer's experience of human movement would increase corticospinal excitability. Twenty-one healthy volunteers (15 women) participated in the preliminary experiment, while another different sample of twenty-two healthy participants (11 women) ranging in age from 21 to 41 years was enrolled in the main experiment. Our results showed that the Rorschach cards known to be associated with a high number of M responses elicited human movement both as automatic internal sensations and as verbal production of responses involving human movement. However, contrary to our hypothesis, the reported internal feeling of human movement had no corresponding physiological counterpart, as the amplitude of MEPs did not increase. Possible and innovative explanations for the involvement of bottom-up and top-down processes were provided.

Human but not robotic gaze facilitates action prediction

Do people ascribe intentions to humanoid robots as they would to humans or non-human-like animated objects? In six experiments, we compared people’s ability to extract non-mentalistic (i.e., where an agent is looking) and mentalistic (i.e., what an agent is looking at; what an agent is going to do) information from gaze and directional cues performed by humans, human-like robots, and a non-human-like object. People were faster to infer the mental content of human agents compared to robotic agents. Furthermore, although the absence of differences in control conditions rules out the use of non-mentalizing strategies, the human-like appearance of non-human agents may engage mentalizing processes to solve the task. Overall, results suggest that human-like robotic actions may be processed differently from humans’ and objects’ behavior. These findings inform our understanding of the relevance of an object’s physical features in triggering mentalizing abilities and its relevance for human–robot interaction.

•

People differently ascribe mental content to human-like and non-human-like agents

•

A human-like shape may automatically engage mentalizing processes

•

Human actions are interpreted faster than non-human actions

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

Contextual Priors Guide Perception and Motor Responses to Observed Actions

In everyday-life scenarios, prior expectations provided by the context in which actions are embedded support action prediction. However, it is still unclear how newly learned action-context associations can drive our perception and motor responses. To fill this gap, we measured behavioral (Experiment 1) and motor responses (Experiment 2) during two tasks requiring the prediction of occluded actions or geometrical shapes. Each task consisted of an implicit probabilistic learning and a test phase. During learning, we exposed participants to videos showing specific associations between a contextual cue and a particular action or shape. During the test phase, videos were earlier occluded to reduce the amount of sensorial information and induce participants to use the implicitly learned action/shape-context associations for disambiguation. Results showed that reliable contextual cues made participants more accurate in identifying the unfolding action or shape. Importantly, motor responses were modulated by contextual probability during action, but not shape prediction. Particularly, in conditions of perceptual uncertainty the motor system coded for the most probable action based on contextual informativeness, regardless of action kinematics. These findings suggest that contextual priors can shape motor responses to action observation beyond mere kinematics mapping.

Implicit visual sensitivity towards slim versus overweight bodies modulates motor resonance in the primary motor cortex: A tDCS study

Motor resonance (MR) can be influenced by individual differences and similarity in the physical appearance between the actor and observer. Recently, we reported that action simulation is modulated by an implicit visual sensitivity towards normal-weight compared with overweight bodies. Furthermore, recent research has suggested the existence of an action observation network responsible for MR, with limited evidence whether the primary motor cortex (M1) is part of this. We expanded our previous findings with regards to the role of an implicit normal-weight-body preference in the MR mechanism. At the same time, we tested the functional relevance of M1 to MR, by using a transcranial direct current stimulation (tDCS) protocol. Seventeen normal-weight and 17 overweight participants were asked to observe normal-weight or overweight actors reaching and grasping a light or heavy cube, and then, at the end of each video-clip to indicate the correct cube weight. Before the task, all participants received 15 min of sham or cathodal tDCS over the left M1. Measures of anti-fat attitudes were also collected. During sham tDCS, all participants were better in simulating the actions performed by normal-weight compared with overweight models. Surprisingly, cathodal tDCS selectively improved the ability in the overweight group to simulate actions performed by the overweight models. This effect was not associated with scores of fat phobic attitudes or implicit anti-fat bias. Our findings are discussed in the context of relevance of M1 to MR and its social modulation by anti-fat attitudes.

Proactive gaze is present during biological and non-biological motion observation

Others' action observation activates in the observer a coordinated hand-eye motor program, covert for the hand (i.e. motor resonance), and overt for the eye (i.e. proactive gaze), similar to that of the observed agent. The biological motion hypothesis of action anticipation claims that proactive gaze occurs only in the presence of biological motion, and that kinematic information is sufficient to determine the anticipation process. The results of the present study did not support the biological motion hypothesis of action anticipation. Specifically, proactive gaze was present during observation of both a biological accelerated-decelerated motion and a non-biological constant velocity motion (Experiment 1), in the presence of a barrier able to restrict differences between the two kinematics to the motion profile of individual markers prior to contact (Experiment 2), but only if an object was present at the end point of the movement trajectory (Experiment 3). Furthermore, proactive gaze was found independently of the presence of end effects temporally congruent with the instant in which the movement stopped (Experiments 4, and 5). We propose that the involvement of the observer's motor system is not restricted to when the agent moves with natural kinematics, and it is mandatory whenever the presence of an agent or a goal is evident, regardless of physical appearance, natural kinematics, and the possibility to identify the action behind the stimulus.

Autistic Traits Differently Account for Context-Based Predictions of Physical and Social Events

Autism is associated with difficulties in making predictions based on contextual cues. Here, we investigated whether the distribution of autistic traits in the general population, as measured through the Autistic Quotient (AQ), is associated with alterations of context-based predictions of social and non-social stimuli. Seventy-eight healthy participants performed a social task, requiring the prediction of the unfolding of an action as interpersonal (e.g., to give) or individual (e.g., to eat), and a non-social task, requiring the prediction of the appearance of a moving shape as a short (e.g., square) or a long (e.g., rectangle) figure. Both tasks consisted of (i) a familiarization phase, in which the association between each stimulus type and a contextual cue was manipulated with different probabilities of co-occurrence, and (ii) a testing phase, in which visual information was impoverished by early occlusion of video display, thus forcing participants to rely on previously learned context-based associations. Findings showed that the prediction of both social and non-social stimuli was facilitated when embedded in high-probability contexts. However, only the contextual modulation of non-social predictions was reduced in individuals with lower 'Attention switching' abilities. The results provide evidence for an association between weaker context-based expectations of non-social events and higher autistic traits.

Observer-Agent Kinematic Similarity Facilitates Action Intention Decoding

It is well known that the kinematics of an action is modulated by the underlying motor intention. In turn, kinematics serves as a cue also during action observation, providing hints about the intention of the observed action. However, an open question is whether decoding others’ intentions on the basis of their kinematics depends solely on how much the kinematics varies across different actions, or rather it is also influenced by its similarity with the observer motor repertoire. The execution of reach-to-grasp and place actions, differing for target size and context, was recorded in terms of upper-limb kinematics in 21 volunteers and in an actor. Volunteers had later to observe the sole reach-to-grasp phase of the actor’s actions, and predict the underlying intention. The potential benefit of the kinematic actor-participant similarity for recognition accuracy was evaluated. In execution, both target size and context modulated specific kinematic parameters. More importantly, although participants performed above chance in intention recognition, the similarity of motor patterns positively correlated with recognition accuracy. Overall, these data indicate that kinematic similarity exerts a facilitative role in intention recognition, providing further support to the view of action intention recognition as a visuo-motor process grounded in motor resonance.

The last chance to pass the ball: investigating the role of temporal expectation and motor resonance in processing temporal errors in motor actions

Humans can acquire information on others' motor outputs (action prediction) and intentions (action understanding) according to their individual motor repertoire and to the detected gesture's features (e.g. temporal patterns). We aimed at dissociating between action prediction and action understanding abilities in soccer players and novices observing soccer action videos including correct timing pass (CTP) or delayed pass (DP). First, we used an occluding paradigm to evaluate participants' ability to predict the correct time to pass the ball. Although soccer players showed reduced reaction times, all subjects showed a similar pattern of performance: during DP observation, responses appeared delayed with respect to the other conditions but anticipated with respect to the observed DP. In a separate experiment, we investigated the ability to recognize CTP vs DP and the modulation of primary motor cortex (M1) excitability associated to video observation. Only soccer players showed selective modulation of M1 according to the plausibility of the observed action, with increased excitability during the observation of the CTP and in a phase preceding the DP. In conclusion, action prediction ability seems to be independent from the individual motor repertoire. By contrast, only subjects with previously acquired sensorimotor skills are able to infer the observed action's long-term intention.

Development of visual perception of others' actions: Children's judgment of lifted weight

Humans are excellent at perceiving different features of the actions performed by others. For instance, by viewing someone else manipulating an unknown object, one can infer its weight–an intrinsic feature otherwise not directly accessible through vision. How such perceptual skill develops during childhood remains unclear. To confront this gap, the current study had children (N:63, 6–10 years old) and adults (N:21) judge the weight of objects after observing videos of an actor lifting them. Although 6-year-olds could already discriminate different weights, judgment accuracy had not reached adult-like levels by 10 years of age. Additionally, children’s stature was a more reliable predictor of their ability to read others’ actions than was their chronological age. This paper discusses the results in light of a potential link between motor development and action perception.

Observation of Both Skilled and Erroneous Object Lifting Can Improve Predictive Force Scaling in the Observer

Recent studies have highlighted that the observation of hand-object interactions can influence perceptual weight judgments made by an observer. Moreover, observing salient motor errors during object lifting allows individuals to update their internal sensorimotor representation about object weight. Embodying observed visuomotor cues for the planning of a motor command further enables individuals to accurately scale their fingertip forces when subsequently lifting the same object. However, it is still unknown whether the observation of a skilled lift is equally able to mediate predictive motor control in the observer. Here, we tested this hypothesis by asking participants to grasp and lift a manipulandum after observing an actor's lift. The object weight changed unpredictably (light or heavy) every fourth to sixth trial performed by the actor. Participants were informed that they would always lift the same weight as the actor and that, based on the experimental condition, they would have to observe skilled or erroneously performed lifts. Our results revealed that the observation of both skilled and erroneously performed lifts allows participants to update their internal sensorimotor object representation, in turn enabling them to predict force scaling accurately. These findings suggest that the observation of salient motor errors, as well as subtle features of skilled motor performance, are embodied in the observer's motor repertoire and can drive changes in predictive motor control.

Gaze and body cues interplay during interactive requests

Although observing other's gaze and body movements provides a crucial source of information to successfully interact with other people, it remains unclear whether observers weigh differently these cues and whether the convergence of gaze and body's directions determines facilitation effects. Here we aim to shed more light on this issue by testing the reliance upon these cues from both a behavioral and a neurophysiological perspective in a social interactive context. In Experiment 1, we manipulated the convergence between the direction of an actor's upper limb movement and gaze direction while he attempts to socially interact with the participants observing the scene. We determined the direction of gaze as well as the duration of participants' ocular fixations during the observation of the scene. In Experiment 2, we measured and correlated the effect of the body/gaze manipulation on corticospinal excitability and on the readiness to interact-a disposition to engage in social situations. Eye-tracking data revealed that participants fixated chiefly the actor's head when his hand and gaze directions were divergent. Possibly a strategy to disambiguate the scene. Whereas participants mainly fixated the actor's hand when he performed an interactive request toward the participants. From a neurophysiological point of view, the more participants felt involved in the interaction, the lower was motor preparation in the muscle potentially needed to fulfill the actor's request. We contend that social contexts are more likely to elicit motor preparation compared to non-social ones, and that muscular inhibition is a necessary mechanism in order to prevent unwanted overt reactions during action observation tasks.

Low or High-Level Motor Coding? The Role of Stimulus Complexity

Transcranial magnetic stimulation (TMS) studies have shown that observing an action induces activity in the onlooker's motor system. In light of the muscle specificity and time-locked mirroring nature of the effect, this motor resonance has been traditionally viewed as an inner automatic replica of the observed movement. Notably, studies highlighting this aspect have classically considered movement in isolation (i.e., using non-realistic stimuli such as snapshots of hands detached from background). However, a few recent studies accounting for the role of contextual cues, motivational states, and social factors, have challenged this view by showing that motor resonance is not completely impervious to top-down modulations. A debate is still present. We reasoned that motor resonance reflects the inner replica of the observed movement only when its modulation is assessed during the observation of movements in isolation. Conversely, the presence of top-down modulations of motor resonance emerges when other high-level factors (i.e., contextual cues, past experience, social, and motivational states) are taken into account. Here, we attempt to lay out current TMS studies assessing this issue and discuss the results in terms of their potential to favor the inner replica or the top-down modulation hypothesis. In doing so, we seek to shed light on this actual debate and suggest specific avenues for future research, highlighting the need for a more ecological approach when studying motor resonance phenomenon.

Autistic traits predict poor integration between top-down contextual expectations and movement kinematics during action observation

Autism is associated with difficulties in predicting and understanding other people’s actions. There is evidence that autistic traits are distributed across a spectrum and that subclinical forms of autistic impairments can also be measured in the typical population. To investigate the association between autistic traits and motor responses to others’ actions, we quantified these traits and measured cortico-spinal excitability modulations in M1 during the observation of actions embedded in congruent, incongruent and ambiguous contexts. In keeping with previous studies, we found that actions observed in congruent contexts elicited an early facilitation of M1 responses, and actions observed in incongruent contexts, resulted in a later inhibition. Correlational analysis revealed no association between autistic traits and the facilitation for congruent contexts. However, we found a significant correlation between motor inhibition and autistic traits, specifically related to social skills and attention to details. Importantly, the influence of these factors was independent from each other, and from the observer’s gender. Thus, results suggest that individuals with higher social deficits and greater detail-processing style are more impaired in suppressing action simulation in M1 when a mismatch between kinematics and context occurs. This points to difficult integration between kinematics and contextual representations in the autistic-like brain.

Implicit preference towards slim bodies and weight-stigma modulate the understanding of observed familiar actions

Mounting research evidence suggests that motor resonance (MR, i.e., the mapping of others’ actions onto one’s own motor repertoire) can be influenced by diverse factors related to individual differences. However, no evidence has been reported so far on the effects of physical appearance and negative attitudes toward obesity to the mechanism of MR. Thirty-six participants (18 normal-weight and 18 overweight) performed a weight discrimination task, in which they were observing amateur actors reaching and grasping a light or heavy cube with or without deception (true vs. fake actions). At the end of each video clip, participants were instructed to indicate the correct cube size (light or heavy). Importantly, body similarity between observers and actors was manipulated by presenting videos of normal-weight or overweight actors. Fat phobic attitudes and automatic preference for normal-weight than obese people were also examined. Signal detection analysis (d′) on the acquired accuracy data has shown that both normal- and overweight participants were able to better discriminate truthful actions when performed by the normal-weight as compared to overweight actors. Furthermore, this finding was negatively correlated with increased scores of fat phobic attitudes in both groups. Hence, for the first time, we provide experimental evidence of action simulation being modulated by an implicit visual sensitivity towards slim bodies.

The heaviness of invisible objects: Predictive weight judgments from observed real and pantomimed grasps

Observation of others' actions has been proposed to provide a shared experience of the properties of objects acted upon. We report results that suggest a similar form of shared experience may be gleaned from the observation of pantomimed grasps, i.e., grasps aimed at pretended objects. In a weight judgment task, participants were asked to observe a hand reaching towards and grasping either a real or imagined glass, and to predictively judge its weight. Results indicate that participants were able to discriminate whether the to-be-grasped glass was empty, and thus light, or full, and thus heavy. Worthy of further investigation, this finding suggests that by observing others' movements we can make predictions, and form expectations about the characteristics of objects that exist only in others' minds.

How to Trick Your Opponent: A Review Article on Deceptive Actions in Interactive Sports

Performing deceptive actions is a wide-spread phenomenon in sports and it is of considerable practical relevance to know whether or not a fake or a disguised action decreases the opponents’ performance. Therefore, research on deceptive actions for various sport disciplines (e.g., cricket, rugby, martial arts, soccer, and basketball) has been conducted. This research is scattered, both across time and scientific disciplines. Here, we aim to systematically review the empirical work on deceptive actions in interactive sports and want to give an overview about several issues investigated in the last decades. Three main topics of the detected literature were discussed here: (1) the role of expertise for the recognition of deceptive actions, (2) the cognitive mechanisms underlying the processing of deceptive actions, and (3) the pros and cons of in situ research designs. None of these themes seems to be settled and therefore, they should be considered in future research agendas.