When emulation becomes reciprocity

The contribution of eye gaze and movement kinematics to the expression and identification of social intention in object-directed motor actions

The intention to include another person in an interaction (i.e., social intention) is known to influence the spatio-temporal characteristics of motor performances. However, the interplay between these kinematic variations and the social cues provided by eye gaze has not been properly assessed yet. In the present study, we tested whether limiting the access to eye gaze altered the motor-related effects of social intention on motor performances. In a dyadic interaction, the agents' task was to displace a dummy glass to a new position with the intention to fill it themselves (personal intention) or having it filled by the observers facing them (social intention). The observers performed their action only when they were able to identify a social intention in agents' action. The task was performed while having access to observers' eye gaze or not, through the manipulation of an occluder. Results showed an effect of social intention on agents' motor performances, that induced an amplification of the kinematic spatio-temporal parameters. Such amplification was smaller when the observers' eye gaze was not available. In this latter condition, the identification of the social intention in the observed actions was impaired. Altogether, the results suggest that the presence of eye gaze cues contributes significantly to the success of social interaction, by facilitating the expression and the understanding of social intentions through the kinematics of object-directed actions.

Driving Hebbian plasticity over ventral premotor-motor projections transiently enhances motor resonance

BACKGROUND

Making sense of others' actions relies on the activation of an action observation network (AON), which maps visual information about observed actions onto the observer's motor system. This motor resonance process manifests in the primary motor cortex (M1) as increased corticospinal excitability finely tuned to the muscles engaged in the observed action. Motor resonance in M1 is facilitated by projections from higher-order AON regions. However, whether manipulating the strength of AON-to-M1 connectivity affects motor resonance remains unclear.

METHODS

We used transcranial magnetic stimulation (TMS) in 48 healthy humans. Cortico-cortical paired associative stimulation (ccPAS) was administered over M1 and the ventral premotor cortex (PMv), a key AON node, to induce spike-timing-dependent plasticity (STDP) in the pathway connecting them. Single-pulse TMS assessed motor resonance during action observation.

RESULTS

Before ccPAS, action observation increased corticospinal excitability in the muscles corresponding to the observed movements, reflecting motor resonance in M1. Notably, ccPAS aimed at strengthening projections from PMv to M1 (PMv→M1) induced short-term enhancement of motor resonance. The enhancement specifically occurred with the ccPAS configuration consistent with forward PMv→M1 projections and dissipated 20 min post-stimulation; ccPAS administered in the reverse order (M1→PMv) and sham stimulation did not affect motor resonance.

CONCLUSIONS

These findings provide the first evidence that inducing STDP to strengthen PMv input to M1 neurons causally enhances muscle-specific motor resonance in M1. Our study sheds light on the plastic mechanisms that shape AON functionality and demonstrates that exogenous manipulation of AON connectivity can influence basic mirror mechanisms that underlie social perception.

Motor cognition in plants: from thought to real experiments

Motor cognition involves the process of planning and executing goal-directed movements and recognizing, anticipating, and interpreting others' actions. Motor cognitive functions are generally associated with the presence of a brain and are ascribed only to humans and other animal species. A growing body of evidence suggests that aneural organisms, like climbing plants, exhibit behaviors driven by the intention to achieve goals, challenging our understanding of cognition. Here, we propose an inclusive perspective under motor cognition to explain climbing plants' behavior. We will first review our empirical research based on kinematical analysis to understand movement in pea plants. Then, we situate this empirical research within the current theoretical debate aimed at extending the principles of cognition to aneural organisms. A novel comparative perspective that considers the perception-action cycle, involving transforming perceived environmental elements into intended movement patterns, is provided.

Attention allocation in complementary joint action: How joint goals affect spatial orienting

When acting jointly, individuals often attend and respond to the same object or spatial location in complementary ways (e.g., when passing a mug, one person grasps its handle with a precision grip; the other receives it with a whole-hand grip). At the same time, the spatial relation between individuals' actions affects attentional orienting: one is slower to attend and respond to locations another person previously acted upon than to alternate locations ("social inhibition of return", social IOR). Achieving joint goals (e.g., passing a mug), however, often requires complementary return responses to a co-actor's previous location. This raises the question of whether attentional orienting, and hence the social IOR, is affected by the (joint) goal our actions are directed at. The present study addresses this question. Participants responded to cued locations on a computer screen, taking turns with a virtual co-actor. They pursued either an individual goal or performed complementary actions with the co-actor, in pursuit of a joint goal. Four experiments showed that the social IOR was significantly modulated when participant and co-actor pursued a joint goal. This suggests that attentional orienting is affected not only by the spatial but also by the social relation between two agents' actions. Our findings thus extend research on interpersonal perception-action effects, showing that the way another agent's perceived action shapes our own depends on whether we share a joint goal with that agent.

When Corticospinal Inhibition Favors an Efficient Motor Response

Many daily activities involve responding to the actions of other people. However, the functional relationship between the motor preparation and execution phases still needs to be clarified. With the combination of different and complementary experimental techniques (i.e., motor excitability measures, reaction times, electromyography, and dyadic 3-D kinematics), we investigated the behavioral and neurophysiological signatures characterizing different stages of a motor response in contexts calling for an interactive action. Participants were requested to perform an action (i.e., stirring coffee or lifting a coffee cup) following a co-experimenter's request gesture. Another condition, in which a non-interactive gesture was used, was also included. Greater corticospinal inhibition was found when participants prepared their motor response after observing an interactive request, compared to a non-interactive gesture. This, in turn, was associated with faster and more efficient action execution in kinematic terms (i.e., a social motor priming effect). Our results provide new insights on the inhibitory and facilitatory drives guiding social motor response generation. Altogether, the integration of behavioral and neurophysiological indexes allowed us to demonstrate that a more efficient action execution followed a greater corticospinal inhibition. These indexes provide a full picture of motor activity at both planning and execution stages.

The influence of cooperative action intention on object affordance: evidence from the perspective-taking ability of individuals

In complex interactive scenarios, action understanding lies at the heart of social interactions. Nevertheless, the ability to understand action intention may differ among people. The current study distinguished two groups of participants with different social intention-understanding abilities (high and low) based on a perspective-taking task to investigate the influence of social intention on object affordance under conditions of individual and cooperative action intention. In the affordance perception experiment, participants were shown a video with the presenter reaching to grasp an object in different grips and asked to classify objects into kitchen or non-kitchen items by pressing the left- or right-hand button under the two intention conditions. The results showed that the object affordance effects were modulated by the participants' understanding of social intention in the interactive scenarios. Specifically, the object affordance effects were observed only in the high perspective-taking ability group under the condition of cooperative action intention. However, under the condition of individual action intention, object affordance effects were shown in both the high and low perspective-taking ability groups, and the difference between the two groups was not significant. This study suggests that processing of object affordance depends greatly on the contextual correspondence of perception and action and that the understanding of cooperative action intention can affect the activation of object affordance.

The combined effects of motor and social goals on the kinematics of object-directed motor action

Voluntary actions towards manipulable objects are usually performed with a particular motor goal (i.e., a task-specific object-target-effector interaction) and in a particular social context (i.e., who would benefit from these actions), but the mutual influence of these two constraints has not yet been properly studied. For this purpose, we asked participants to grasp an object and place it on either a small or large target in relation to Fitts’ law (motor goal). This first action prepared them for a second grasp-to-place action which was performed under temporal constraints, either by the participants themselves or by a confederate (social goal). Kinematic analysis of the first preparatory grasp-to-place action showed that, while deceleration time was impacted by the motor goal, peak velocity was influenced by the social goal. Movement duration and trajectory height were modulated by both goals, the effect of the social goal being attenuated by the effect of the motor goal. Overall, these results suggest that both motor and social constraints influence the characteristics of object-oriented actions, with effects that combine in a hierarchical way.

Susceptibility to the fusion illusion is modulated during both action execution and action observation

Many researchers have proposed that when an individual observes the actions of another individual, the observer simulates the action using many of the same neural areas that are involved in action production. The present study was designed to test this simulation hypothesis by comparing the perception of multisensory stimuli during both the execution and observation of an aiming action. The present work used the fusion illusion - an audio-visual illusion in which two visual stimuli presented with one auditory stimulus are erroneously perceived as being one visual stimulus. Previous research has shown that, during action execution, susceptibly to this illusion is reduced early in the execution of the movement when visual information may be more highly weighted than other sensory information. We sought to determine whether or not a non-acting observer of an action showed a similar reduction in susceptibility to the fusion illusion. Participants fixated a target and either executed or observed a manual aiming movement to that target. Audiovisual stimuli were presented at 0, 100, or 200 ms relative to movement onset and participants reported the number of perceived flashes after the movement was completed. Analysis of perceived flashes revealed that participants were less susceptible to the fusion illusion when the stimuli were presented early (100 ms) relative to later in the movement (200 ms). Critically, this pattern emerged in both execution and observation tasks. These findings support the hypothesis that observers simulate the performance of the actor and experience comparable real-time alterations in multisensory processing.

Gaze and body cues interplay during interactive requests

Although observing other's gaze and body movements provides a crucial source of information to successfully interact with other people, it remains unclear whether observers weigh differently these cues and whether the convergence of gaze and body's directions determines facilitation effects. Here we aim to shed more light on this issue by testing the reliance upon these cues from both a behavioral and a neurophysiological perspective in a social interactive context. In Experiment 1, we manipulated the convergence between the direction of an actor's upper limb movement and gaze direction while he attempts to socially interact with the participants observing the scene. We determined the direction of gaze as well as the duration of participants' ocular fixations during the observation of the scene. In Experiment 2, we measured and correlated the effect of the body/gaze manipulation on corticospinal excitability and on the readiness to interact-a disposition to engage in social situations. Eye-tracking data revealed that participants fixated chiefly the actor's head when his hand and gaze directions were divergent. Possibly a strategy to disambiguate the scene. Whereas participants mainly fixated the actor's hand when he performed an interactive request toward the participants. From a neurophysiological point of view, the more participants felt involved in the interaction, the lower was motor preparation in the muscle potentially needed to fulfill the actor's request. We contend that social contexts are more likely to elicit motor preparation compared to non-social ones, and that muscular inhibition is a necessary mechanism in order to prevent unwanted overt reactions during action observation tasks.

Low or High-Level Motor Coding? The Role of Stimulus Complexity

Transcranial magnetic stimulation (TMS) studies have shown that observing an action induces activity in the onlooker's motor system. In light of the muscle specificity and time-locked mirroring nature of the effect, this motor resonance has been traditionally viewed as an inner automatic replica of the observed movement. Notably, studies highlighting this aspect have classically considered movement in isolation (i.e., using non-realistic stimuli such as snapshots of hands detached from background). However, a few recent studies accounting for the role of contextual cues, motivational states, and social factors, have challenged this view by showing that motor resonance is not completely impervious to top-down modulations. A debate is still present. We reasoned that motor resonance reflects the inner replica of the observed movement only when its modulation is assessed during the observation of movements in isolation. Conversely, the presence of top-down modulations of motor resonance emerges when other high-level factors (i.e., contextual cues, past experience, social, and motivational states) are taken into account. Here, we attempt to lay out current TMS studies assessing this issue and discuss the results in terms of their potential to favor the inner replica or the top-down modulation hypothesis. In doing so, we seek to shed light on this actual debate and suggest specific avenues for future research, highlighting the need for a more ecological approach when studying motor resonance phenomenon.

Social Motor Priming: when offline interference facilitates motor execution

Many daily activities involve synchronizing with other people's actions. Previous literature has revealed that a slowdown of performance occurs whenever the action to be carried out is different to the one observed (i.e., visuomotor interference). However, action execution can be facilitated by observing a different action if it calls for an interactive gesture (i.e., social motor priming). The aim of this study is to investigate the costs and benefits of spontaneously processing a social response and then executing the same or a different action. Participants performed two different types of grips, which could be either congruent or not with the socially appropriate response and with the observed action. In particular, participants performed a precision grip (PG; thumb-index fingers opposition) or a whole-hand grasp (WHG; fingers-palm opposition) after observing videos showing an actor performing a PG and addressing them (interactive condition) or not (non-interactive condition). Crucially, in the interactive condition, the most appropriate response was a WHG, but in 50 percent of trials participants were asked to perform a PG. This procedure allowed us to measure both the facilitator effect of performing an action appropriate to the social context (WHG)-but different with respect to the observed one (PG)-and the cost of inhibiting it. These effects were measured by means of 3-D kinematical analysis of movement. Results show that, in terms of reaction time and movement time, the interactive request facilitated (i.e., speeded) the socially appropriate action (WHG), whereas interfered with (i.e., delayed) a different action (PG), although observed actions were always PGs. This interference also manifested with an increase of maximum grip aperture, which seemingly reflects the concurrent representation of the socially appropriate response. Overall, these findings extend previous research by revealing that physically incongruent action representations can be integrated into a single action plan even during an offline task and without any training.

Interpersonal motor coordination during joint actions in children with and without autism spectrum disorder: The role of motor information

BACKGROUND

Kinematics plays a key role in action prediction, imitation and joint action coordination. Despite people with autism spectrum disorder (ASD) show a failure to use kinematic cues during observation and imitation, there is a paucity of studies exploring the role of this dysfunction during joint actions in children with ASD.

AIM

To evaluate the interpersonal motor coordination of children with ASD and typically developing (TD) children during a joint action task.

METHOD

Twenty-two participants performed two cooperative tasks. In the first one (Clear End-Point), children were provided with a priori information on movement end-point. In the second one (Unclear End-Point), the end-point was unknown and children had to use kinematic cues to accomplish the shared goal.

RESULTS

We found no between-group differences in the first task, even if children with ASD displayed greater reaction time variability. In the second task, they showed less accurate and slower movements than TD children. Moreover, their movement features did not differ between the two tasks, whereas TD children showed reduced reaction time variability and number of errors in the second task.

CONCLUSION

Children with ASD were impaired in joint action coordination when they had to rely only on kinematic information. They were not able to pay more attention to the kinematic cues in absence of a visual goal.

Look at Me: Early Gaze Engagement Enhances Corticospinal Excitability During Action Observation

Direct gaze is a powerful social cue able to capture the onlooker’s attention. Beside gaze, head and limb movements as well can provide relevant sources of information for social interaction. This study investigated the joint role of direct gaze and hand gestures on onlookers corticospinal excitability (CE). In two experiments we manipulated the temporal and spatial aspects of observed gaze and hand behavior to assess their role in affecting motor preparation. To do this, transcranial magnetic stimulation (TMS) on the primary motor cortex (M1) coupled with electromyography (EMG) recording was used in two experiments. In the crucial manipulation, we showed to participants four video clips of an actor who initially displayed eye contact while starting a social request gesture, and then completed the action while directing his gaze toward a salient object for the interaction. This way, the observed gaze potentially expressed the intention to interact. Eye tracking data confirmed that gaze manipulation was effective in drawing observers’ attention to the actor’s hand gesture. In the attempt to reveal possible time-locked modulations, we tracked CE at the onset and offset of the request gesture. Neurophysiological results showed an early CE modulation when the actor was about to start the request gesture looking straight to the participants, compared to when his gaze was averted from the gesture. This effect was time-locked to the kinematics of the actor’s arm movement. Overall, data from the two experiments seem to indicate that the joint contribution of direct gaze and precocious kinematic information, gained while a request gesture is on the verge of beginning, increases the subjective experience of involvement and allows observers to prepare for an appropriate social interaction. On the contrary, the separation of gaze cues and body kinematics can have adverse effects on social motor preparation. CE is highly susceptible to biological cues, such as averted gaze, which is able to automatically capture and divert observer’s attention. This point to the existence of heuristics based on early action and gaze cues that would allow observers to interact appropriately.

Anticipating actions and corticospinal excitability: A preregistered motor TMS experiment

Past research on action observation and imitation suggests that observing a movement activates a corresponding motor representation in the observer. However, recent research suggests that individuals may not only reflexively simulate the observed behavior but also simulate and engage in anticipated action without another person actually engaging in it. For example, it has been demonstrated that observing a triggering event (i.e., nose wrinkling) that potentially leads to the anticipation of an action (i.e., nose scratching) increases the likelihood that the observer will perform that action. In the present research, we applied motor Transcranial Magnetic Stimulation (TMS) to investigate such anticipated social action effects at the neurophysiological level within a trial-by-trial measure. While a pilot study suggests that observing nose wrinkling elicits stronger motor evoked potentials (MEPs) in participants' biceps muscles than observing control events, this effect could not be fully replicated in a preregistered study. Although a post hoc meta-analysis across both studies supports the general hypothesis, these results need to be taken cautiously. Implications of the results reported in the manuscript are discussed.

The role of the action context in object affordance

Behavioral and neuroscience studies have shown that observation of objects automatically evokes potential actions to interact with those objects. In this study, the left and right hand key presses were facilitated when they corresponded with the task-irrelevant handle orientation of household objects, which is termed the affordance effect. The present study investigated how the affordance effect is affected by the action context when other agents are observed acting on a neutral or dangerous object. Participants were shown a series of pictures in which an actor grasped a neutral or dangerous object and moved it away from or toward the participant. The participants were required to press different keys to identify a symbol which was presented above the last picture. The results showed that affordance effect of a neutral object was modulated by the direction of object movement. When the neutral object moved away from the participant, an affordance effect was observed if the perceived action was congruent with handle orientation, whereas the affordance effect emerged if the perceived action was incongruent with handle orientation when the object was moved toward the participant. However, for the dangerous object, the affordance effect was obtained regardless of object movement direction or congruency between perceived action and handle orientation. This result suggests that the processing of objects involves a sophisticated integration of body behavior with the object.

Investigation of Perceptual-Motor Behavior Across the Expert Athlete to Disabled Patient Skill Continuum can Advance Theory and Practical Application

A framework is presented of how theoretical predictions can be tested across the expert athlete to disabled patient skill continuum. Common-coding theory is used as the exemplar to discuss sensory and motor system contributions to perceptual-motor behavior. Behavioral and neural studies investigating expert athletes and patients recovering from cerebral stroke are reviewed. They provide evidence of bi-directional contributions of visual and motor systems to perceptual-motor behavior. Majority of this research is focused on perceptual-motor performance or learning, with less on transfer. The field is ripe for research designed to test theoretical predictions across the expert athlete to disabled patient skill continuum. Our view has implications for theory and practice in sports science, physical education, and rehabilitation.

Interacting With Robots to Investigate the Bases of Social Interaction

Humans show a great natural ability at interacting with each other. Such efficiency in joint actions depends on a synergy between planned collaboration and emergent coordination, a subconscious mechanism based on a tight link between action execution and perception. This link supports phenomena as mutual adaptation, synchronization, and anticipation, which cut drastically the delays in the interaction and the need of complex verbal instructions and result in the establishment of joint intentions, the backbone of social interaction. From a neurophysiological perspective, this is possible, because the same neural system supporting action execution is responsible of the understanding and the anticipation of the observed action of others. Defining which human motion features allow for such emergent coordination with another agent would be crucial to establish more natural and efficient interaction paradigms with artificial devices, ranging from assistive and rehabilitative technology to companion robots. However, investigating the behavioral and neural mechanisms supporting natural interaction poses substantial problems. In particular, the unconscious processes at the basis of emergent coordination (e.g., unintentional movements or gazing) are very difficult-if not impossible-to restrain or control in a quantitative way for a human agent. Moreover, during an interaction, participants influence each other continuously in a complex way, resulting in behaviors that go beyond experimental control. In this paper, we propose robotics technology as a potential solution to this methodological problem. Robots indeed can establish an interaction with a human partner, contingently reacting to his actions without losing the controllability of the experiment or the naturalness of the interactive scenario. A robot could represent an "interactive probe" to assess the sensory and motor mechanisms underlying human-human interaction. We discuss this proposal with examples from our research with the humanoid robot iCub, showing how an interactive humanoid robot could be a key tool to serve the investigation of the psychological and neuroscientific bases of social interaction.

The influence of intrapersonal sensorimotor experiences on the corticospinal responses during action-observation

The coupling of perception and action has been strongly indicated by evidence that the observation of an action primes a response in the observer. It has been proposed that these primed responses may be inhibited when the observer is able to more closely distinguish between self- and other-generated actions - the greater the distinction, then the greater the inhibition of the primed response. This self-other distinction is shown to be enhanced following a period of visual feedback of self-generated action. The present study was designed to examine how sensorimotor experiences pertaining to self-generated action affect primed responses from observed actions. Single-pulse transcranial magnetic stimulation was used to investigate corticospinal activity elicited during the observation of index- and little-finger actions before and after training (self-generated action). For sensorimotor training, participants executed finger movements with or without visual feedback of their own movement. Results showed that the increases in muscle-specific corticospinal activity elicited from action-observation persisted after training without visual feedback, but did not emerge following training with visual feedback. This inhibition in corticospinal activity during action-observation following training with vision could have resulted from the refining of internal models of self-generated action, which then led to a greater distinction between "self" and "other" actions.

Overt orienting of spatial attention and corticospinal excitability during action observation are unrelated

Observing moving body parts can automatically activate topographically corresponding motor representations in the primary motor cortex (M1), the so-called direct matching. Novel neurophysiological findings from social contexts are nonetheless proving that this process is not automatic as previously thought. The motor system can flexibly shift from imitative to incongruent motor preparation, when requested by a social gesture. In the present study we aim to bring an increase in the literature by assessing whether and how diverting overt spatial attention might affect motor preparation in contexts requiring interactive responses from the onlooker. Experiment 1 shows that overt attention—although anchored to an observed biological movement—can be captured by a target object as soon as a social request for it becomes evident. Experiment 2 reveals that the appearance of a short-lasting red dot in the contralateral space can divert attention from the target, but not from the biological movement. Nevertheless, transcranial magnetic stimulation (TMS) over M1 combined with electromyography (EMG) recordings (Experiment 3) indicates that attentional interference reduces corticospinal excitability related to the observed movement, but not motor preparation for a complementary action on the target. This work provides evidence that social motor preparation is impermeable to attentional interference and that a double dissociation is present between overt orienting of spatial attention and neurophysiological markers of action observation.

Primary Motor Cortex Activation during Action Observation of Tasks at Different Video Speeds Is Dependent on Movement Task and Muscle Properties

The aim of the present study was to investigate how the video speed of observed action affects the excitability of the primary motor cortex (M1), as assessed by the size of motor-evoked potentials (MEPs) induced by transcranial magnetic stimulation (TMS). Twelve healthy subjects observed a video clip of a person catching a ball (Experiment 1: rapid movement) and another 12 healthy subjects observed a video clip of a person reaching to lift a ball (Experiment 2: slow movement task). We played each video at three different speeds (slow, normal and fast). The stimulus was given at two points of timing in each experiment. These stimulus points were locked to specific frames of the video rather than occurring at specific absolute times, for ease of comparison across different speeds. We recorded MEPs from the first dorsal interosseous muscle (FDI) and abductor digiti minimi muscle (ADM) of the right hand. MEPs were significantly different for different video speeds only in the rapid movement task. MEPs for the rapid movement task were higher when subjects observed an action played at slow speed than normal or fast speed condition. There was no significant change for the slow movement task. Video speed was effective only in the ADM. Moreover, MEPs in the ADM were significantly higher than in the FDI in a rapid movement task under the slow speed condition. Our findings suggest that the M1 becomes more excitable when subjects observe the video clip at the slow speed in a rapid movement, because they could recognize the elements of movement in others. Our results suggest the effects of manipulating the speed of the viewed task on the excitability of the M1 during passive observation differ depending on the type of movement task observed. It is likely that rehabilitation in the clinical setting will be more efficient if the video speed is changed to match the task’s characteristics.

Hitting is male, giving is female: automatic imitation and complementarity during action observation

Is somebody going to hurt us? We draw back. The present study investigates using behavioral measures the interplay between imitative and complementary actions activated while observing female/male hands performing different actions. Female and male participants were required to discriminate the gender of biologically and artificially colored hands that displayed both individual (grasping) and social (giving and punching) actions. Biological hands evoked automatic imitation, while hands of different gender activated complementary mechanisms. Furthermore, responses reflected gender stereotypes: giving actions were more associated to females, punching actions to males. Results have implications for studies on social stereotyping, and for research on action observation, showing that the mirror neuron system resonates in both an imitative and complementary fashion.

Complementary Hand Responses Occur in Both Peri- and Extrapersonal Space

Human beings have a strong tendency to imitate. Evidence from motor priming paradigms suggests that people automatically tend to imitate observed actions such as hand gestures by performing mirror-congruent movements (e.g., lifting one’s right finger upon observing a left finger movement; from a mirror perspective). Many observed actions however, do not require mirror-congruent responses but afford complementary (fitting) responses instead (e.g., handing over a cup; shaking hands). Crucially, whereas mirror-congruent responses don't require physical interaction with another person, complementary actions often do. Given that most experiments studying motor priming have used stimuli devoid of contextual information, this space or interaction-dependency of complementary responses has not yet been assessed. To address this issue, we let participants perform a task in which they had to mirror or complement a hand gesture (fist or open hand) performed by an actor depicted either within or outside of reach. In three studies, we observed faster reaction times and less response errors for complementary relative to mirrored hand movements in response to open hand gestures (i.e., ‘hand-shaking’) irrespective of the perceived interpersonal distance of the actor. This complementary effect could not be accounted for by a low-level spatial cueing effect. These results demonstrate that humans have a strong and automatic tendency to respond by performing complementary actions. In addition, our findings underline the limitations of manipulations of space in modulating effects of motor priming and the perception of affordances.

Stimulation over primary motor cortex during action observation impairs effector recognition

Recent work suggests that motor cortical processing during action observation plays a role in later recognition of the object involved in the action. Here, we investigated whether recognition of the effector making an action is also impaired when transcranial magnetic stimulation (TMS) - thought to interfere with normal cortical activity - is applied over the primary motor cortex (M1) during action observation. In two experiments, single-pulse TMS was delivered over the hand area of M1 while participants watched short clips of hand actions. Participants were then asked whether an image (experiment 1) or a video (experiment 2) of a hand presented later in the trial was the same or different to the hand in the preceding video. In Experiment 1, we found that participants' ability to recognise static images of hands was significantly impaired when TMS was delivered over M1 during action observation, compared to when no TMS was delivered, or when stimulation was applied over the vertex. Conversely, stimulation over M1 did not affect recognition of dot configurations, or recognition of hands that were previously presented as static images (rather than action movie clips) with no object. In Experiment 2, we found that effector recognition was impaired when stimulation was applied part way through (300ms) and at the end (500ms) of the action observation period, indicating that 200ms of action-viewing following stimulation was not long enough to form a new representation that could be used for later recognition. The findings of both experiments suggest that interfering with cortical motor activity during action observation impairs subsequent recognition of the effector involved in the action, which complements previous findings of motor system involvement in object memory. This work provides some of the first evidence that motor processing during action observation is involved in forming representations of the effector that are useful beyond the action observation period.

Kick with the finger: symbolic actions shape motor cortex excitability

A large body of research indicates that observing actions made by others is associated with corresponding motor facilitation of the observer's corticospinal system. However, it is still controversial whether this matching mechanism strictly reflects the kinematics of the observed action or its meaning. To test this issue, motor evoked potentials induced by single-pulse transcranial magnetic stimulation were recorded from hand and leg muscles while participants observed a symbolic action carried out with the index finger, but classically performed with the leg (i.e., a soccer penalty kick). A control condition in which participants observed a similar (but not symbolic) hand movement was also included. Results showed that motor facilitation occurs both in the observer's hand (first dorsal interosseous) and leg (quadriceps femoris) muscles. The present study provides evidence that both the kinematics and the symbolic value of an observed action are able to modulate motor cortex excitability. The human motor system is thus not only involved in mirroring observed actions but is also finely tuned to their symbolic value.

You Smell Dangerous: Communicating Fight Responses Through Human Chemosignals of Aggression

The ability to detect conspecifics that represent a potential harm for an individual represents a high survival benefit. Humans communicate socially relevant information using all sensory modalities, including the chemosensory systems. In study 1, we investigated whether the body odor of a stranger with the intention to harm serves as a chemosignal of aggression. Sixteen healthy male participants donated their body odor while engaging in a boxing session characterized by aggression-induction methods (chemosignal of aggression) and while performing an ergometer session (exercise chemosignal). Self-reports on aggression-related physical activity, motivation to harm and angry emotions selectively increased after aggression induction. In study 2, we examined whether receivers smelling such chemosignals experience emotional contagion (e.g., anger) or emotional reciprocity (e.g., anxiety). The aggression and exercise chemosignals were therefore presented to 22 healthy normosmic participants in a double-blind, randomized exposure during which affective/cognitive processing was examined (i.e., emotion recognition task, emotional stroop task). Behavioral results indicate that chemosignals of aggression induce an affective/cognitive modulation compatible with an anxiety reaction in the recipients. These findings are discussed in light of mechanisms of emotional reciprocity as a way to convey not only affective but also motivational information via chemosensory signals in humans.

Self-selected conscious strategies do not modulate motor cortical output during action observation

The human motor system is active not only when actions are performed but also when they are observed. Experimenters often manipulate aspects of the action or context to examine factors that influence this "mirror" response. However, little is known about the role of the observer's own top-down intentions and motivation. In this exploratory study, we investigated whether observers are able to exert conscious control over their mirror response, when they are explicitly instructed to either increase or decrease mirroring. Transcranial magnetic stimulation (TMS) was used to elicit motor-evoked potentials (MEPs) in a thumb abductor muscle as participants (n = 13) watched a video of a hand squeezing a rubber ball. The size of these MEPs, relative to the size of MEPs elicited during fixation cross observation, was taken as an index of mirroring. In an initial block of trials, participants were instructed to merely observe the actions presented. After the first block, the concept of mirroring was explained to the participants, and in the second and third blocks participants were instructed to either increase or decrease their mirror response. We did not instruct them about how to achieve this increase or decrease. Our results showed no difference in either facilitation or absolute motor excitability (i.e., nonnormalized MEP size) between the three blocks, indicating that individuals do not seem to be able to exert control over motor excitability during action observation, at least in the absence of a specific and maintained strategy.

Perceiving what you intend to do from what you do: evidence for embodiment in social interactions

Although action and perception are central components of our interactions with the external world, the most recent experimental investigations also support their implications in the emotional, decision-making, and goal ascription processes in social context. In this article, we review the existing literature supporting this view and highlighting a link between reach-to-grasp motor actions and social communicative processes. First, we discuss the most recent experimental findings showing how the social context subtly influences the execution of object-oriented motor actions. Then, we show that the kinematic characteristics of object-oriented motor actions are modulated by the actor's social intention. Finally, we demonstrate that naïve observers can implicitly take advantage of these kinematic effects for their own motor productions. Considered together, these data are compatible with the embodied cognition framework stating that cognition, and in our case social cognition, is grounded in knowledge associated with past sensory and motor experiences.

Congruent and Incongruent Corticospinal Activations at the Level of Multiple Effectors

Motor resonance is defined as the subliminal activation of the motor system while observing actions performed by others. However, resonating with another person's actions is not always an appropriate response: In real life, people do not just imitate but rather respond in a suitable fashion. A growing body of neurophysiologic studies has demonstrated that motor resonance can be overridden by complementary motor responses (such as preparing a precision grip on a small object when seeing an open hand in sign of request). In this study, we investigated the relationship between congruent and incongruent corticospinal activations at the level of multiple effectors. The modulation of motor evoked potentials evoked by single-pulse TMS over the motor cortex was assessed in upper and lower limb muscles of participants observing a soccer player performing a penalty kick straight in their direction. Study results revealed a double dissociation: Seeing the soccer player kicking the ball triggered a motor resonance in the observer's lower limb, whereas the upper limb response afforded by the object was overridden. On the other hand, seeing the ball approaching the observers elicited a complementary motor activation in upper limbs while motor resonance in lower limbs disappeared. Control conditions showing lateral kicks, mimicked kicks, and a ball in penalty area were also included to test the motor coding of object affordances. Results point to a modulation of motor responses in different limbs over the course of action and in function of their relevance in different contexts. We contend that ecologically valid paradigms are now needed to shed light on the motor system functioning in complex forms of interaction.

Motor interference in interactive contexts

Action observation and execution share overlapping neural substrates, so that simultaneous activation by observation and execution modulates motor performance. Previous literature on simple prehension tasks has revealed that motor influence can be two-sided: facilitation for observed and performed congruent actions and interference for incongruent actions. But little is known of the specific modulations of motor performance in complex forms of interaction. Is it possible that the very same observed movement can lead either to interference or facilitation effects on a temporally overlapping congruent executed action, depending on the context? To answer this question participants were asked to perform a reach-to-grasp movement adopting a precision grip (PG) while: (i) observing a fixation cross, (ii) observing an actor performing a PG with interactive purposes, (iii) observing an actor performing a PG without interactive purposes. In particular, in the interactive condition the actor was shown trying to pour some sugar on a large cup located out of her reach but close to the participant watching the video, thus eliciting in reaction a complementary whole-hand grasp. Notably, fine-grained kinematic analysis for this condition revealed a specific delay in the grasping and reaching components and an increased trajectory deviation despite the observed and executed movement’s congruency. Moreover, early peaks of trajectory deviation seem to indicate that socially relevant stimuli are acknowledged by the motor system very early. These data suggest that interactive contexts can determine a prompt modulation of stimulus–response compatibility effects.

Eliminating mirror responses by instructions

The observation of an action leads to the activation of the corresponding motor plan in the observer. This phenomenon of motor resonance has an important role in social interaction, promoting imitation, learning and action understanding. However, mirror responses not always have a positive impact on our behavior. An automatic tendency to imitate others can introduce interference in action execution and non-imitative or opposite responses have an advantage in some contexts. Previous studies suggest that mirror tendencies can be suppressed after extensive practice or in complementary joint action situations revealing that mirror responses are more flexible than previously thought. The aim of the present study was to gain insight into the mechanisms that allow response flexibility of motor mirroring. Here we show that the mere instruction of a counter-imitative mapping changes mirror responses as indexed by motor evoked potentials (MEPs) enhancement induced by transcranial magnetic stimulation (TMS). Importantly, mirror activation was measured while participants were passively watching finger movements, without having the opportunity to execute the task. This result suggests that the implementation of task instructions activates stimulus-response association that can overwrite the mirror representations. Our outcome reveals one of the crucial mechanisms that might allow flexible adjustments of mirror responses in different contexts. The implications of this outcome are discussed.

I don't get you. Action observation effects inverted by kinematic variation

Recent studies have reported an intricate interplay between affordance and mirror effects (the imitation of another agent) when participants attend to the concurrent presentation of an object and another agent interacting with it. In the present paper, we compare two experimental settings in which an observed action was presented as a prime for a task involving the categorization of a graspable object. In experiment 1a, the action depicted a reach and grasp gesture whereas in experiment 1b, only the reach phase was presented. This modification led to very different outcomes. Experiment 1a reflected the traditional imitation effect elicited by human motion. Conversely, experiment 1b showed the facilitation of contralateral responses. Affordance effects were found in experiment 1a only for the RVF. Our results support the view that motor simulation processes underlying imitation or joint actions are extremely sensitive to specific phase kinematics.

Complementary actions

Complementary colors are color pairs which, when combined in the right proportions, produce white or black. Complementary actions refer here to forms of social interaction wherein individuals adapt their joint actions according to a common aim. Notably, complementary actions are incongruent actions. But being incongruent is not sufficient to be complementary (i.e., to complete the action of another person). Successful complementary interactions are founded on the abilities: (i) to simulate another person's movements, (ii) to predict another person's future action/s, (iii) to produce an appropriate incongruent response which differ, while interacting, with observed ones, and (iv) to complete the social interaction by integrating the predicted effects of one's own action with those of another person. This definition clearly alludes to the functional importance of complementary actions in the perception-action cycle and prompts us to scrutinize what is taking place behind the scenes. Preliminary data on this topic have been provided by recent cutting-edge studies utilizing different research methods. This mini-review aims to provide an up-to-date overview of the processes and the specific activations underlying complementary actions.

Observing end-state comfort favorable actions does not modulate action plan recall

A large corpus of work demonstrates that observing other people’s actions activates corresponding motor representations in the observer by running an internal simulation of the observed action. Recent evidence suggests that recalled action plans reflect a plan of how the observer would execute that action (based on the specific motor representation) rather than a plan of the actually observed action (based on the visual representation). This study examined whether people would recall an action plan based on a visual representation if the observed movement is biomechanically favorable for their own subsequent action. Participants performed an object manipulation task alongside a confederate. In the intra-individual task, the participant (or confederate) transported a plunger from an outer platform of fixed height to a center target platform located at different heights (home-to-target move), and then the same person transported the plunger back to the outer platform (target-back-to-home move). In the inter-individual task, the sequence was split between the two persons such that the participant (or confederate) performed the home-to-target move and the other person performed the target-back-to-home move. Importantly, the confederate always grasped the plunger at the same height. This grasp height was designated such that if participants would copy the action (i.e., grasp the object at the same height) it would place the participant’s arm in a comfortable position at the end of the target-back-to-home move (i.e., end-state comfort). Results show that participants’ grasp height was inversely related to center target height and similar regardless of direction (home-to-target vs. target-back-to-home move) and task (intra- vs. inter-individual). In addition, during the inter-individual task, participant’s target-back-to-home grasp height was correlated with their own, but not with the confederate’s grasp height during the home-to-target moves. These findings provide evidence that observing actions that are biomechanically favorable for subsequent action execution does not influence action plan recall processes.

Prejudiced interactions: implicit racial bias reduces predictive simulation during joint action with an out-group avatar

During social interactions people automatically apply stereotypes in order to rapidly categorize others. Racial differences are among the most powerful cues that drive these categorizations and modulate our emotional and cognitive reactivity to others. We investigated whether implicit racial bias may also shape hand kinematics during the execution of realistic joint actions with virtual in- and out-group partners. Caucasian participants were required to perform synchronous imitative or complementary reach-to-grasp movements with avatars that had different skin color (white and black) but showed identical action kinematics. Results demonstrate that stronger visuo-motor interference (indexed here as hand kinematics differences between complementary and imitative actions) emerged: i) when participants were required to predict the partner's action goal in order to on-line adapt their own movements accordingly; ii) during interactions with the in-group partner, indicating the partner's racial membership modulates interactive behaviors. Importantly, the in-group/out-group effect positively correlated with the implicit racial bias of each participant. Thus visuo-motor interference during joint action, likely reflecting predictive embodied simulation of the partner's movements, is affected by cultural inter-individual differences.

Excitability of the primary motor cortex increases more strongly with slow- than with normal-speed presentation of actions

Introduction

The aim of the present study was to investigate how the speed of observed action affects the excitability of the primary motor cortex (M1), as assessed by the size of motor evoked potentials (MEPs) induced by transcranial magnetic stimulation (TMS).

Methods

Eighteen healthy subjects watched a video clip of a person catching a ball, played at three different speeds (normal-, half-, and quarter-speed). MEPs were induced by TMS when the model's hand had opened to the widest extent just before catching the ball (“open”) and when the model had just caught the ball (“catch”). These two events were locked to specific frames of the video clip (“phases”), rather than occurring at specific absolute times, so that they could easily be compared across different speeds. MEPs were recorded from the thenar (TH) and abductor digiti minimi (ADM) muscles of the right hand.

Results

The MEP amplitudes were higher when the subjects watched the video clip at low speed than when they watched the clip at normal speed. A repeated-measures ANOVA, with the factor VIDEO-SPEED, showed significant main effects. Bonferroni's post hoc test showed that the following MEP amplitude differences were significant: TH, normal vs. quarter; ADM, normal vs. half; and ADM, normal vs. quarter. Paired t-tests showed that the significant MEP amplitude differences between TMS phases under each speed condition were TH, “catch” higher than “open” at quarter speed; ADM, “catch” higher than “open” at half speed.

Conclusions

These results indicate that the excitability of M1 was higher when the observed action was played at low speed. Our findings suggest that the action observation system became more active when the subjects observed the video clip at low speed, because the subjects could then recognize the elements of action and intention in others.

The left side of motor resonance

Motor resonance is defined as the internal activation of an observer's motor system, specifically attuned to the perceived movement. In social contexts, however, different patterns of observed and executed muscular activation are frequently required. This is the case, for instance, of seeing a key offered with a precision grip and received by opening the hand. Novel evidence suggests that compatibility effects in motor resonance can be altered by social response preparation. What is not known is how handedness modulates this effect. The present study aimed at determining how a left- and a right-handed actor grasping an object and then asking for a complementary response influences corticospinal activation in left- and right-handers instructed to observe the scene. Transcranial magnetic stimulation (TMS)-induced motor evoked potentials (MEPs) were thus recorded from the dominant hands of left- and right-handers. Interestingly, requests posed by the right-handed actor induced a motor activation in the participants' respective dominant hands, suggesting that left-handers tend to mirror right-handers with their most efficient hand. Whereas requests posed by the left-handed actor activated the anatomically corresponding muscles (i.e., left hand) in all the participants, right-handers included. Motor resonance effects classically reported in the literature were confirmed when observing simple grasping actions performed by the right-handed actor. These findings indicate that handedness influences both congruent motor resonance and complementary motor preparation to observed actions.

Conscious and Unconscious Representations of Observed Actions in the Human Motor System

Action observation activates the observer's motor system. These motor resonance responses are automatic and triggered even when the action is only implied in static snapshots. However, it is largely unknown whether an action needs to be consciously perceived to trigger motor resonance. In this study, we used single-pulse TMS to study the facilitation of corticospinal excitability (a measure of motor resonance) during supraliminal and subliminal presentations of implied action images. We used a forward and backward dynamic masking procedure that successfully prevented the conscious perception of prime stimuli depicting a still hand or an implied abduction movement of the index or little finger. The prime was followed by the supraliminal presentation of a still or implied action probe hand. Our results revealed a muscle-specific increase of motor facilitation following observation of the probe hand actions that were consciously perceived as compared with observation of a still hand. Crucially, unconscious perception of prime hand actions presented before probe still hands did not increase motor facilitation as compared with observation of a still hand, suggesting that motor resonance requires perceptual awareness. However, the presentation of a masked prime depicting an action that was incongruent with the probe hand action suppressed motor resonance to the probe action such that comparable motor facilitation was recorded during observation of implied action and still hand probes. This suppression of motor resonance may reflect the processing of action conflicts in areas upstream of the motor cortex and may subserve a basic mechanism for dealing with the multiple and possibly incongruent actions of other individuals.

Kinematics fingerprints of leader and follower role-taking during cooperative joint actions

Performing online complementary motor adjustments is quintessential to joint actions since it allows interacting people to coordinate efficiently and achieve a common goal. We sought to determine whether, during dyadic interactions, signaling strategies and simulative processes are differentially implemented on the basis of the interactional role played by each partner. To this aim, we recorded the kinematics of the right hand of pairs of individuals who were asked to grasp as synchronously as possible a bottle-shaped object according to an imitative or complementary action schedule. Task requirements implied an asymmetric role assignment so that participants performed the task acting either as (1) Leader (i.e., receiving auditory information regarding the goal of the task with indications about where to grasp the object) or (2) Follower (i.e., receiving instructions to coordinate their movements with their partner's by performing imitative or complementary actions). Results showed that, when acting as Leader, participants used signaling strategies to enhance the predictability of their movements. In particular, they selectively emphasized kinematic parameters and reduced movement variability to provide the partner with implicit cues regarding the action to be jointly performed. Thus, Leaders make their movements more "communicative" even when not explicitly instructed to do so. Moreover, only when acting in the role of Follower did participants tend to imitate the Leader, even in complementary actions where imitation is detrimental to joint performance. Our results show that mimicking and signaling are implemented in joint actions according to the interactional role of the agent, which in turn is reflected in the kinematics of each partner.

Time will show: real time predictions during interpersonal action perception

Predictive processes are crucial not only for interpreting the actions of individual agents, but also to predict how, in the context of a social interaction between two agents, the actions of one agent relate to the actions of a second agent. In the present study we investigated whether, in the context of a communicative interaction between two agents, observers can use the actions of one agent to predict when the action of a second agent will take place. Participants observed point-light displays of two agents (A and B) performing separate actions. In the communicative condition, the action performed by agent B responded to a communicative gesture performed by agent A. In the individual condition, agent A's communicative action was substituted with a non-communicative action. For each condition, we manipulated the temporal coupling of the actions of the two agents, by varying the onset of agent A's action. Using a simultaneous masking detection task, we demonstrated that the timing manipulation had a critical effect on the communicative condition, with the visual discrimination of agent B increasing linearly while approaching the original interaction timing. No effect of the timing manipulation was found for the individual condition. Our finding complements and extends previous evidence for interpersonal predictive coding, suggesting that the communicative gestures of one agent can serve not only to predict what the second agent will do, but also when his/her action will take place.