And yet they act together: interpersonal perception modulates visuo-motor interference and mutual adjustments during a joint-grasping task

Pleasantness makes a good time: musical consonance shapes interpersonal synchronization in dyadic joint action

Introduction

Music making is a process by which humans across cultures come together to create patterns of sounds that are aesthetically pleasing. What remains unclear is how this aesthetic outcome affects the sensorimotor interaction between participants.

Method

Here we approach this question using an interpersonal sensorimotor synchronization paradigm to test whether the quality of a jointly created chord (consonant vs. dissonant) affects movement coordination. We recruited non-musician participants in dyads to perform a dyadic synchronization-continuation task (dSCT): on each trial, participants first synchronized their movements to a metronome (synchronization phase) and then continued tapping together at the same tempo without the metronome (continuation phase). Each tap yielded a note and participants heard both their own and that of their partner, thus creating a chord that was varied to be either consonant (Perf5 or Maj6) or dissonant (Min2 or Maj2). For each trial, participants also rated the pleasure they felt in creating the sounds together. Additionally, they completed questionnaires about social closeness to the other participant, musical reward sensitivity and musical training.

Results

Results showed that participants' taps were closer in time when they jointly created consonant (high pleasure) vs. dissonant (low pleasure) chords, and that pleasure experienced by the dyad in each trial predicted interpersonal synchronization. However, consonance did not affect individual synchronization with the metronome or individual tapping when the metronome was discontinued. The effect of consonance on synchronization was greater in dyads who reported feeling less close prior to the task.

Discussion

Together, these results highlight the role of consonance in shaping the temporal coordination of our actions with others. More broadly, this work shows that the aesthetic outcome of what we create together affects joint behaviors.

A systematic review of observational practice for adaptation of reaching movements

Observational practice is discussed as a substitute for physical practice for motor learning and adaptation. We systematically reviewed the literature on observational practice in reaching and aiming tasks. Our objectives were to identify (i) performance differences between observational and physical practice; (ii) factors that contribute to adaptation following observational practice; and (iii) the neural correlates of observational practice. We found 18 studies, all investigated adaptation of reaching in visuomotor rotations or force-field perturbations. Results of the studies showed that observational practice led to adaptation in both, visuomotor rotation and force-field paradigms (d = -2.16 as compared to no practice). However, direct effects were considerably smaller as compared to physical practice (d = 4.38) and aftereffects were absent, suggesting that observational practice informed inverse, but not forward modes. Contrarily, neurophysiological evidence in this review showed that observational and physical practice involved similar brain regions.

Attention allocation in complementary joint action: How joint goals affect spatial orienting

When acting jointly, individuals often attend and respond to the same object or spatial location in complementary ways (e.g., when passing a mug, one person grasps its handle with a precision grip; the other receives it with a whole-hand grip). At the same time, the spatial relation between individuals' actions affects attentional orienting: one is slower to attend and respond to locations another person previously acted upon than to alternate locations ("social inhibition of return", social IOR). Achieving joint goals (e.g., passing a mug), however, often requires complementary return responses to a co-actor's previous location. This raises the question of whether attentional orienting, and hence the social IOR, is affected by the (joint) goal our actions are directed at. The present study addresses this question. Participants responded to cued locations on a computer screen, taking turns with a virtual co-actor. They pursued either an individual goal or performed complementary actions with the co-actor, in pursuit of a joint goal. Four experiments showed that the social IOR was significantly modulated when participant and co-actor pursued a joint goal. This suggests that attentional orienting is affected not only by the spatial but also by the social relation between two agents' actions. Our findings thus extend research on interpersonal perception-action effects, showing that the way another agent's perceived action shapes our own depends on whether we share a joint goal with that agent.

The role of dorsal premotor cortex in joint action inhibition

Behavioral interpersonal coordination requires smooth negotiation of actions in time and space (joint action-JA). Inhibitory control may play a role in fine-tuning appropriate coordinative responses. To date, little research has been conducted on motor inhibition during JA and on the modulatory influence that premotor areas might exert on inhibitory control. Here, we used an interactive task in which subjects were required to reach and open a bottle using one hand. The bottle was held and stabilized by a co-actor (JA) or by a mechanical holder (vice clamp, no-JA). We recorded two TMS-based indices of inhibition (short-interval intracortical inhibition-sICI; cortical silent period-cSP) during the reaching phase of the task. These reflect fast intracortical (GABAa-mediated) and slow corticospinal (GABAb-mediated) inhibition. Offline continuous theta burst stimulation (cTBS) was used to interfere with dorsal premotor cortex (PMd), ventral premotor cortex (PMv), and control site (vertex) before the execution of the task. Our results confirm a dissociation between fast and slow inhibition during JA coordination and provide evidence that premotor areas drive only slow inhibitory mechanisms, which in turn may reflect behavioral co-adaptation between trials. Exploratory analyses further suggest that PMd, more than PMv, is the key source of modulatory drive sculpting movements, according to the socio-interactive context.

What makes us act together? On the cognitive models supporting humans’ decisions for joint action

We face tasks every day that we can solve alone but decide to solve together with others. When do we choose to act together vs. alone? How long do we persist in working together when doing so is difficult? Do we prefer to act together when times are uncertain? An open question in joint action research is under what conditions humans prefer to act together or alone to achieve a certain goal, and whether their preference is based on a utility calculus that takes into account the costs and benefits associated with individual and joint action alternatives. Research on cooperation reveals that frequent engagement in joint activities provides high survival benefits, as it allows individuals to achieve goals together that are otherwise unavailable. Yet, survival advantage does not wholly explain the reasons for human cooperative behavior. In fact, humans are motivated to cooperate even when it is not necessary to achieve an outcome. Research in cognitive science suggests that navigating the potential costs of joint actions is a challenge for humans, and that joint actions might provide individuals with rewards that go beyond the achievement of instrumental goals. We here address the influence of key factors on the decision to engage in joint action, such as the coordination costs arising when acting together compared to alone and the social and instrumental rewards expected when acting together compared to alone. Addressing these questions will provide critical insight for the design of cognitive models of human decisions for cooperation.

Midfrontal Theta tACS Facilitates Motor Coordination in Dyadic Human-Avatar Interactions

Synchronous interpersonal motor interactions require moment-to-moment prediction and proactive monitoring of the partner's actions. Neurophysiologically, this is highlighted by an enhancement of midfrontal theta (4-7 Hz) oscillations. In this study, we explored the causal role of midfrontal theta for interpersonal motor interactions using transcranial alternating current stimulation (tACS). We implemented a realistic human-avatar interaction task in immersive virtual reality where participants controlled a virtual arm and hand to press a button synchronously with a virtual partner. Participants completed the task while receiving EEG-informed theta (Experiment 1) or beta (control frequency, Experiment 2) tACS over the frontal midline, as well as sham stimulation as a control. Results showed that midfrontal theta tACS significantly improved behavioral performance (i.e., reduced interpersonal asynchrony) and participants' motor strategies (i.e., increased movement times and reduced RTs), whereas beta tACS had no effect on these measures. These results suggest that theta tACS over frontal areas facilitates action monitoring and motor abilities supporting interpersonal interactions.

Inhibitory Theta Burst Stimulation Highlights the Role of Left aIPS and Right TPJ during Complementary and Imitative Human-Avatar Interactions in Cooperative and Competitive Scenarios

Competitive and cooperative interactions are based on anticipation or synchronization with the partner's actions. Both forms of interaction may either require performing imitative or complementary movements with respect to those performed by our partner. We explored how parietal regions involved in the control of imitative behavior (temporo-parietal junction, TPJ), goal coding and visuo-motor integration (anterior intraparietal sulcus, aIPS) contribute to the execution of imitative and complementary movements during cooperative and competitive interactions. To this aim, we delivered off-line non-invasive inhibitory brain stimulation to healthy individuals' left aIPS and right TPJ before they were asked to reach and grasp an object together with a virtual partner by either performing imitative or complementary interactions. In different blocks, participants were asked to compete or cooperate with the virtual partner that varied its behavior according to cooperative or competitive contexts. Left aIPS and right TPJ inhibition impaired individuals' performance (i.e., synchrony in cooperative task and anticipation in competition) during complementary and imitative interactions, respectively, in both cooperative and competitive contexts, indicating that aIPS and TPJ inhibition affects own-other action integration and action imitation (that are different in complementary vs imitative interactions) more than action synchronization or anticipation (that are different in cooperative vs competitive contexts).

Competence-based social status and implicit preference modulate the ability to coordinate during a joint grasping task

Studies indicate that social status influences people's social perceptions. Less information is available about whether induced social status influences dyadic coordination during motor interactions. To explore this issue, we designed a study in which two confederates obtained high or low competence-based status by playing a game together with the participant, while the participant always occupied the middle position of the hierarchy. Following this status-inducing phase, participants were engaged in a joint grasping task with the high- and low-status confederates in different sessions while behavioural (i.e., interpersonal asynchrony and movement start time) indexes were measured. Participants' performance in the task (i.e., level of interpersonal asynchrony) when interacting with the low-status partner was modulated by their preference for him. The lower participants' preference for a low- relative to a high-status confederate, the worse participants' performance when interacting with the low-status confederate. Our results show that participants' performance during motor interactions changes according to the social status of the interaction partner.

Interpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space

This perspective review focuses on the proposal that predictive multisensory integration occurring in one's peripersonal space (PPS) supports individuals' ability to efficiently interact with others, and that integrating sensorimotor signals from the interacting partners leads to the emergence of a shared representation of the PPS. To support this proposal, we first introduce the features of body and PPS representations that are relevant for interpersonal motor interactions. Then, we highlight the role of action planning and execution on the dynamic expansion of the PPS. We continue by presenting evidence of PPS modulations after tool use and review studies suggesting that PPS expansions may be accounted for by Bayesian sensory filtering through predictive coding. In the central section, we describe how this conceptual framework can be used to explain the mechanisms through which the PPS may be modulated by the actions of our interaction partner, in order to facilitate interpersonal coordination. Last, we discuss how this proposal may support recent evidence concerning PPS rigidity in Autism Spectrum Disorder (ASD) and its possible relationship with ASD individuals' difficulties during interpersonal coordination. Future studies will need to clarify the mechanisms and neural underpinning of these dynamic, interpersonal modulations of the PPS.

Mechanisms for mutual support in motor interactions

What is the key to successful interaction? Is it sufficient to represent a common goal, or does the way our partner achieves that goal count as well? How do we react when our partner misbehaves? We used a turn-taking music-like task requiring participants to play sequences of notes together with a partner, and we investigated how people adapt to a partner's error that violates their expectations. Errors consisted of either playing a wrong note of a sequence that the agents were playing together (thus preventing the achievement of the joint goal) or playing the expected note with an unexpected action. In both cases, we found post-error slowing and inaccuracy suggesting the participants' implicit tendency to correct the partner's error and produce the action that the partner should have done. We argue that these "joint" monitoring processes depend on the motor predictions made within a (dyadic) motor plan and may represent a basic mechanism for mutual support in motor interactions.

Dynamic emotional expressions do not modulate responses to gestures

The tendency to imitate the actions of others appears to be a fundamental aspect of human social interaction. Emotional expressions are a particularly salient form of social stimuli (Vuilleumier & Schwartz, 2001) but their relationship to imitative behaviour is currently unclear. In this paper we report the results of five studies which investigated the effect of a target's dynamic emotional stimuli on participants' tendency to respond compatibly to the target's actions. Experiment one examined the effect of dynamic emotional expressions on the automatic imitation of opening and closing hand movements. Experiment two used the same basic paradigm but added gaze direction as an additional factor. Experiment three investigated the effect of dynamic emotional expressions on compatibility responses to handshakes. Experiment four investigated whether dynamic emotional expressions modulated response to valenced social gestures. Finally, experiment five compared the effects of dynamic and static emotional expressions on participants' automatic imitation of finger lifting. Across all five studies we reliably elicited a compatibility effect however, none of the studies found a significant modulating effect of emotional expression. This null effect was also supported by a random effects meta-analysis and a series of Bayesian t-tests. Nevertheless, these results must be caveated by the fact that our studies had limited power to detect effect sizes below d = 0.4. We conclude by situating our findings within the literature, suggesting that the effect of emotional expressions on automatic imitation is, at best, minimal.

Midline frontal and occipito-temporal activity during error monitoring in dyadic motor interactions

Discrepancies between sensory predictions and action outcome are at the base of error coding. However, these phenomena have mainly been studied focussing on individual performance. Here, we explored EEG responses to motor prediction errors during a human-avatar interaction and show that Theta/Alpha activity of the frontal error-monitoring system works in phase with activity of the occipito-temporal node of the action observation network. Our motor interaction paradigm required healthy individuals to synchronize their reach-to-grasp movements with those of a virtual partner in conditions that did (Interactive) or did not require (Cued) movement prediction and adaptation to the partner's actions. Crucially, in 30% of the trials the virtual partner suddenly and unpredictably changed its movement trajectory thereby violating the human participant's expectation. These changes elicited error-related neuromarkers (ERN/Pe - Theta/Alpha modulations) over fronto-central electrodes during the Interactive condition. Source localization and connectivity analyses showed that the frontal Theta/Alpha activity induced by violations of the expected interactive movements was in phase with occipito-temporal Theta/Alpha activity. These results expand current knowledge about the neural correlates of on-line interpersonal motor interactions linking the frontal error-monitoring system to visual, body motion-related, responses.

Pain perception during social interactions is modulated by self-related and moral contextual cues

Despite the growing interest on the effect of the social context on pain, whether and how different facets of interpersonal interactions modulate pain are still unclear. We tested whether personal (i.e., convenient for the self), moral (i.e., equitability of the transaction) or social (i.e., positive vs. negative feedback from others) valence of an interpersonal interaction differentially affects pain and the perceived fairness. Thirty-two healthy participants played the role of Receivers in a Dictator Game, where a player, the Dictator, determined how to divide a payoff between her/himself and the other player, the Receiver. We manipulated the payoff (pain vs. money), the personal valence (favorable vs. unfavorable offer to participants), the moral valence of the offer (from very iniquitous to equitable), and social valence of the Dictator (social acceptance vs. rejection). Moral and personal valence differentially modulated pain. Lower pain was elicited by iniquity, but also by favorable offers. Moreover, unfavorable offers in the economic game were rated as more unfair, whereas only very iniquitous offers elicited such ratings in the pain game, suggesting that participants valued when Dictators endured extra pain for their benefit. Together, we show that the valence of a social interaction at different levels can independently modulate pain and fairness perception.

Interactor's body shape does not affect visuo-motor interference effects during motor coordination

The biological-tuning of the Action Observation Network is highly debated. A current open question relates to whether the morphological appearance (body shape) and/or the biological motion of the observed agent triggers action simulation processes. Motor simulation of the partner's action is critical for motor interactions, where two partners coordinate their actions in space and time. It supports interpersonal alignment and facilitates online coordination. However, motor simulation also leads to visuo-motor interference effects when people are required to coordinate with complementary actions, i.e. incongruent movements as compared to the observed ones. Movement kinematics of interactive partners allows us to capture their automatic tendency to simulate and imitate the partner's complementary movements. In an online reach-to-grasp task, we investigated whether visuo-motor interference effects, visible in the kinematics of complementary movements, are modulated by the visual presence of the interactor's body shape. We asked participants to interact with 1) a humanoid agent with a human-like body shape and with real human, biological, movement kinematics, or 2) a non-humanoid agent, which did not resemble the human body-shape but moved with the same real kinematics. Through the combination of inferential and Bayesian statistics, the results show no effect of interactor's body shape on visuo-motor interference in reaching and grasping kinematics during online motor coordination. We discuss the results and propose that the kinematics of the observed movements, during motor interactions, might be the key factor for visuo-motor interference to take place independently from the morphological appearance of the partner. This is particularly relevant in a technological society that constantly asks humans to interact with artificial agents.

Analysis of genome-wide in cell free DNA methylation: progress and prospect

In this work, we focus on the detection methods of cfDNA methylation based on NGS and the latest progress.

Inhibition of left anterior intraparietal sulcus shows that mutual adjustment marks dyadic joint-actions in humans

Creating real-life dynamic contexts to study interactive behaviors is a fundamental challenge for the social neuroscience of interpersonal relations. Real synchronic interpersonal motor interactions involve online, inter-individual mutual adaptation (the ability to adapt one’s movements to those of another in order to achieve a shared goal). In order to study the contribution of the left anterior Intra Parietal Sulcus (aIPS) (i.e. a region supporting motor functions) to mutual adaptation, here, we combined a behavioral grasping task where pairs of participants synchronized their actions when performing mutually adaptive imitative and complementary movements, with the inhibition of activity of aIPS via non-invasive brain stimulation. This approach allowed us to investigate whether aIPS supports online complementary and imitative interactions. Behavioral results showed that inhibition of aIPS selectively impairs pair performance during complementary compared to imitative interactions. Notably, this effect depended on pairs’ mutual adaptation skills and was higher for pairs composed of participants who were less capable of adapting to each other. Thus, we provide the first causative evidence for a role of the left aIPS in supporting mutually adaptive interactions and show that the inhibition of the neural resources of one individual of a pair is compensated at the dyadic level.

Visuo-motor interference with a virtual partner is equally present in cooperative and competitive interactions

Automatic imitation of observed actions is thought to be a powerful mechanism, one that may mediate the reward value of interpersonal interactions, but that could also generate visuo-motor interference when interactions involve complementary movements. Since interpersonal coordination seems to be crucial both when cooperating and competing with others, the questions arises as to whether imitation-and thus visuo-motor interference-occurs in both scenarios. To address this issue, we asked human participants to engage in high- or low-interactive (Interactive or Cued condition, respectively), cooperative or competitive, joint reach-to-grasps with a virtual partner. More specifically, interactions occurred in: (i) a Cued condition, where participants simply adapted their movement timing to synchronize with (during cooperation) or anticipate (during competition) the virtual partner's grasp; (ii) an Interactive condition requiring the same adaptation, as well as a real-time selection of their action according to the virtual character's movement. To simulate a realistic human-human interaction, the virtual character would change its movement speed in consecutive trials according to participants' behaviour. Results demonstrate that visuo-motor interference-as indexed by movement kinematics (higher maximum wrist height during complementary compared to imitative power grips)-emerge in both cooperative and competitive motor interactions only when predictions about the partner's movements are needed to perform one's own action (interactive condition). These results support the idea that simulative imitation is heavily present when individuals need to match their behaviours closely.

Co-actors represent the order of each other's actions

Previous research has shown that people represent each other’s tasks and actions when acting together. However, less is known about how co-actors represent each other’s action sequences. Here, we asked whether co-actors represent the order of each other’s actions within an action sequence, or whether they merely represent the intended end state of a joint action together with their own contribution. In the present study, two co-actors concurrently performed action sequences composed of two actions. We predicted that if co-actors represent the order of each other’s actions, they should experience interference when the order of their actions differs. Supporting this prediction, the results of six experiments consistently showed that co-actors moved more slowly when performing the same actions in a different order compared to performing the same actions in the same order. In line with findings from bimanual movement tasks, our results indicate that interference can arise due to differences in movement parameters and due to differences in the perceptual characteristics of movement goals. The present findings extend previous research on co-representation, providing evidence that people represent not only the elements of another’s task, but also their temporal structure.

Come together: human-avatar on-line interactions boost joint-action performance in apraxic patients

Limb apraxia (LA) is a high-order motor disorder linked to left-hemisphere damage. It is characterized by defective execution of purposeful actions upon delayed imitation, or verbal command when the actions are performed in isolated, non-naturalistic, conditions. Whether interpersonal interactions provide social affordances that activate neural resources different from those requested by individual action execution, which may improve LA performance, is unknown. To fill this gap, we measured interaction performance, behavioral and kinematic indexes of left-brain damaged patients with/without LA in a social reach-to-grasp task involving two different degrees of spatio-temporal interactivity with an avatar. We found that LA patients' impairment in coordinating with the virtual partner was abolished in highly interactive conditions (where patients selected their actions on-line based on the behavior of the virtual partner) with respect to low interactive conditions (where actions were selected beforehand based on abstract instructions). Voxel-based-Lesion-Symptom-Mapping indicated that impairments in low-interactive conditions were underpinned by lesions of premotor, motor and insular areas, and of the basal ganglia. Our approach expands current understanding of the behavioral and neural correlates of interactive motor performance by highlighting the important role of social affordances, and provides novel, potentially important, views on rehabilitation of higher-order motor cognition disorders.

From automata to animate beings: the scope and limits of attributing socialness to artificial agents

Understanding the mechanisms and consequences of attributing socialness to artificial agents has important implications for how we can use technology to lead more productive and fulfilling lives. Here, we integrate recent findings on the factors that shape behavioral and brain mechanisms that support social interactions between humans and artificial agents. We review how visual features of an agent, as well as knowledge factors within the human observer, shape attributions across dimensions of socialness. We explore how anthropomorphism and dehumanization further influence how we perceive and interact with artificial agents. Based on these findings, we argue that the cognitive reconstruction within the human observer is likely to be far more crucial in shaping our interactions with artificial agents than previously thought, while the artificial agent's visual features are possibly of lesser importance. We combine these findings to provide an integrative theoretical account based on the "like me" hypothesis, and discuss the key role played by the Theory-of-Mind network, especially the temporal parietal junction, in the shift from mechanistic to social attributions. We conclude by highlighting outstanding questions on the impact of long-term interactions with artificial agents on the behavioral and brain mechanisms of attributing socialness to these agents.

Transitory Inhibition of the Left Anterior Intraparietal Sulcus Impairs Joint Actions: A Continuous Theta-Burst Stimulation Study

Although temporal coordination is a hallmark of motor interactions, joint action (JA) partners do not simply synchronize; rather, they dynamically adapt to each other to achieve a joint goal. We created a novel paradigm to tease apart the processes underlying synchronization and JA and tested the causal contribution of the left anterior intraparietal sulcus (aIPS) in these behaviors. Participants had to synchronize their congruent or incongruent movements with a virtual partner in two conditions: (i) being instructed on what specific action to perform, independently from what action the partner performed (synchronization), and (ii) being instructed to adapt online to the partner's action (JA). Offline noninvasive inhibitory brain stimulation (continuous theta-burst stimulation) over the left aIPS selectively modulated interpersonal synchrony in JA by boosting synchrony during congruent interactions and impairing it during incongruent ones, while leaving performance in the synchronization condition unaffected. These results suggest that the left aIPS plays a causal role in supporting online adaptation to a partner's action goal, whereas it is not necessarily engaged in social situations where the goal of the partner is irrelevant. This indicates that, during JAs, the integration of one's own and the partner's action goal is supported by aIPS.

Vitality Forms Expressed by Others Modulate Our Own Motor Response: A Kinematic Study

During social interaction, actions, and words may be expressed in different ways, for example, gently or rudely. A handshake can be gentle or vigorous and, similarly, tone of voice can be pleasant or rude. These aspects of social communication have been named vitality forms by Daniel Stern. Vitality forms represent how an action is performed and characterize all human interactions. In spite of their importance in social life, to date it is not clear whether the vitality forms expressed by the agent can influence the execution of a subsequent action performed by the receiver. To shed light on this matter, in the present study we carried out a kinematic study aiming to assess whether and how visual and auditory properties of vitality forms expressed by others influenced the motor response of participants. In particular, participants were presented with video-clips showing a male and a female actor performing a "giving request" (give me) or a "taking request" (take it) in visual, auditory, and mixed modalities (visual and auditory). Most importantly, requests were expressed with rude or gentle vitality forms. After the actor's request, participants performed a subsequent action. Results showed that vitality forms expressed by the actors influenced the kinematic parameters of the participants' actions regardless to the modality by which they are conveyed.

On the Role of Physical Interaction on Performance of Object Manipulation by Dyads

Human physical interactions can be intrapersonal, e.g., manipulating an object bimanually, or interpersonal, e.g., transporting an object with another person. In both cases, one or two agents are required to coordinate their limbs to attain the task goal. We investigated the physical coordination of two hands during an object-balancing task performed either bimanually by one agent or jointly by two agents. The task consisted of a series of static (holding) and dynamic (moving) phases, initiated by auditory cues. We found that task performance of dyads was not affected by different pairings of dominant and non-dominant hands. However, the spatial configuration of the two agents (side-by-side vs. face-to-face) appears to play an important role, such that dyads performed better side-by-side than face-to-face. Furthermore, we demonstrated that only individuals with worse solo performance can benefit from interpersonal coordination through physical couplings, whereas the better individuals do not. The present work extends ongoing investigations on human-human physical interactions by providing new insights about factors that influence dyadic performance. Our findings could potentially impact several areas, including robotic-assisted therapies, sensorimotor learning and human performance augmentation.

How Working With a Helpful Versus Less Helpful Confederate Influences Joint-Action in a Pegboard Task

Actors change their movement strategies to complement a coactor's movements when performing cooperative tasks. To further investigate this topic, the authors designed a pegboard task whereby a participant-confederate pair worked together to move a peg from one side of the board to the other. The authors examined how the experience of working with a helpful confederate versus less helpful confederate influenced the participant's movement behavior. Results provide evidence that participants change their movement behaviors in response to the actions of the confederate. Here the human capacity to act in such a manner exemplifies an individual's ability to utilize his or her own action system to understand others and interact to complete joint action tasks. Individuals appear to adapt their behavior to their experiences, and thus may be helpful in some contexts and less helpful in others.

Autistic traits affect interpersonal motor coordination by modulating strategic use of role-based behavior

Background

Despite the fact that deficits in social communication and interaction are at the core of Autism Spectrum Conditions (ASC), no study has yet tested individuals on a continuum from neurotypical development to autism in an on-line, cooperative, joint action task. In our study, we aimed to assess whether the degree of autistic traits affects participants' ability to modulate their motor behavior while interacting in a Joint Grasping task and according to their given role.

Methods

Sixteen pairs of adult participants played a cooperative social interactive game in which they had to synchronize their reach-to-grasp movements. Pairs were comprised of one ASC and one neurotypical with no cognitive disability. In alternate experimental blocks, one participant knew what action to perform (instructed role) while the other had to infer it from his/her partner’s action (adaptive role). When in the adaptive condition, participants were told to respond with an action that was either opposite or similar to their partner. Participants also played a non-social control game in which they had to synchronize with a non-biological stimulus.

Results

In the social interactive task, higher degree of autistic traits predicted less ability to modulate joint action according to one’s interactive role. In the non-social task, autistic traits did not predict differences in movement preparation and planning, thus ruling out the possibility that social interactive task results were due to basic motor or executive function difficulties. Furthermore, when participants played the non-social game, the higher their autistic traits, the more they were interfered by the non-biological stimulus.

Conclusions

Our study shows for the first time that high autistic traits predict a stereotypical interaction style when individuals are required to modulate their movements in order to coordinate with their partner according to their role in a joint action task. Specifically, the infrequent emergence of role-based motor behavior modulation during on-line motor cooperation in participants with high autistic traits sheds light on the numerous difficulties ASC have in nonverbal social interactions.

Electronic supplementary material

The online version of this article (doi:10.1186/s13229-017-0141-0) contains supplementary material, which is available to authorized users.

Interactional leader-follower sensorimotor communication strategies during repetitive joint actions

Non-verbal communication is the basis of animal interactions. In dyadic leader-follower interactions, leaders master the ability to carve their motor behaviour in order to 'signal' their future actions and internal plans while these signals influence the behaviour of follower partners, who automatically tend to imitate the leader even in complementary interactions. Despite their usefulness, signalling and imitation have a biomechanical cost, and it is unclear how this cost-benefits trade-off is managed during repetitive dyadic interactions that present learnable regularities. We studied signalling and imitation dynamics (indexed by movement kinematics) in pairs of leaders and followers during a repetitive, rule-based, joint action. Trial-by-trial Bayesian model comparison was used to evaluate the relation between signalling, imitation and pair performance. The different models incorporate different hypotheses concerning the factors (past interactions versus online movements) influencing the leader's signalling (or follower's imitation) kinematics. This approach showed that (i) leaders' signalling strategy improves future couple performance, (ii) leaders used the history of past interactions to shape their signalling, (iii) followers' imitative behaviour is more strongly affected by the online movement of the leader. This study elucidates the ways online sensorimotor communication help individuals align their task representations and ultimately improves joint action performance.

Kick with the finger: symbolic actions shape motor cortex excitability

A large body of research indicates that observing actions made by others is associated with corresponding motor facilitation of the observer's corticospinal system. However, it is still controversial whether this matching mechanism strictly reflects the kinematics of the observed action or its meaning. To test this issue, motor evoked potentials induced by single-pulse transcranial magnetic stimulation were recorded from hand and leg muscles while participants observed a symbolic action carried out with the index finger, but classically performed with the leg (i.e., a soccer penalty kick). A control condition in which participants observed a similar (but not symbolic) hand movement was also included. Results showed that motor facilitation occurs both in the observer's hand (first dorsal interosseous) and leg (quadriceps femoris) muscles. The present study provides evidence that both the kinematics and the symbolic value of an observed action are able to modulate motor cortex excitability. The human motor system is thus not only involved in mirroring observed actions but is also finely tuned to their symbolic value.

Social cues to joint actions: the role of shared goals

In daily life, we do not just move independently from how others move. Rather, the way we move conveys information about our cognitive and affective attitudes toward our conspecifics. However, the implicit social substrate of our movements is not easy to capture and isolate given the complexity of human interactive behaviors. In this perspective article we discuss the crucial conditions for exploring the impact of "interpersonal" cognitive/emotional dimensions on the motor behavior of individuals interacting in realistic contexts. We argue that testing interactions requires one to build up naturalistic and yet controlled scenarios where participants reciprocally adapt their movements in order to achieve an overarching "shared goal." We suggest that a shared goal is what singles out real interactions from situations where two or more individuals contingently but independently act next to each other, and that "interpersonal" socio-emotional dimensions might fail to affect co-agents' behaviors if real interactions are not at place. We report the results of a novel joint-grasping task suitable for exploring how individual sub-goals (i.e., correctly grasping an object) relate to, and depend from, the representation of "shared goals."

Causative role of left aIPS in coding shared goals during human-avatar complementary joint actions

Successful motor interactions require agents to anticipate what a partner is doing in order to predictively adjust their own movements. Although the neural underpinnings of the ability to predict others' action goals have been well explored during passive action observation, no study has yet clarified any critical neural substrate supporting interpersonal coordination during active, non-imitative (complementary) interactions. Here, we combine non-invasive inhibitory brain stimulation (continuous Theta Burst Stimulation) with a novel human–avatar interaction task to investigate a causal role for higher-order motor cortical regions in supporting the ability to predict and adapt to others' actions. We demonstrate that inhibition of left anterior intraparietal sulcus (aIPS), but not ventral premotor cortex, selectively impaired individuals' performance during complementary interactions. Thus, in addition to coding observed and executed action goals, aIPS is crucial in coding ‘shared goals', that is, integrating predictions about one's and others' complementary actions.

The neural mechanisms supporting imitative motor interactions have been well studied. However, considerably less is known about the mechanisms supporting complementary interactions. Here the authors demonstrate a causal role for left anterior intraparietal sulcus in coding complementary motor goals.

Complementary actions

Complementary colors are color pairs which, when combined in the right proportions, produce white or black. Complementary actions refer here to forms of social interaction wherein individuals adapt their joint actions according to a common aim. Notably, complementary actions are incongruent actions. But being incongruent is not sufficient to be complementary (i.e., to complete the action of another person). Successful complementary interactions are founded on the abilities: (i) to simulate another person's movements, (ii) to predict another person's future action/s, (iii) to produce an appropriate incongruent response which differ, while interacting, with observed ones, and (iv) to complete the social interaction by integrating the predicted effects of one's own action with those of another person. This definition clearly alludes to the functional importance of complementary actions in the perception-action cycle and prompts us to scrutinize what is taking place behind the scenes. Preliminary data on this topic have been provided by recent cutting-edge studies utilizing different research methods. This mini-review aims to provide an up-to-date overview of the processes and the specific activations underlying complementary actions.

Prejudiced interactions: implicit racial bias reduces predictive simulation during joint action with an out-group avatar

During social interactions people automatically apply stereotypes in order to rapidly categorize others. Racial differences are among the most powerful cues that drive these categorizations and modulate our emotional and cognitive reactivity to others. We investigated whether implicit racial bias may also shape hand kinematics during the execution of realistic joint actions with virtual in- and out-group partners. Caucasian participants were required to perform synchronous imitative or complementary reach-to-grasp movements with avatars that had different skin color (white and black) but showed identical action kinematics. Results demonstrate that stronger visuo-motor interference (indexed here as hand kinematics differences between complementary and imitative actions) emerged: i) when participants were required to predict the partner's action goal in order to on-line adapt their own movements accordingly; ii) during interactions with the in-group partner, indicating the partner's racial membership modulates interactive behaviors. Importantly, the in-group/out-group effect positively correlated with the implicit racial bias of each participant. Thus visuo-motor interference during joint action, likely reflecting predictive embodied simulation of the partner's movements, is affected by cultural inter-individual differences.

Enfacing others but only if they are nice to you

Experiencing tactile facial stimulation while seeing synchronous stimuli on the face of another individual induces “enfacement,” i.e., the subjective illusory experience of ownership of the other's face (explicit measure) and the attribution of the others' facial features to one's own face (implicit measure). Here we expanded previous knowledge by investigating if the tendency to include the other into one's own representation is influenced by positive or negative interpersonal attitudes derived either from consolidated socio-cultural stereotypes or from newly acquired, short-term individual interactions with a specific person. To this aim, we tested in Caucasian white participants the enfacement with a white and a black confederate, before and after an experimental procedure inducing a positive or negative perception of each of them. The results show that the subjective experience of enfacement with in- and out-group others before and after the manipulation is similar. The bias in attributing other's facial features to one's own face after synchronous stroking was, instead, dependent on whether the other person was positively perceived, independently of his/her ethnicity. Thus, we show that realistic positive face-to-face interactions are more effective than consolidated racial biases in influencing the strength of self-attribution of another persons' facial features in the context of multisensory illusions. Results suggest that positive interpersonal interactions might powerfully change the plasticity of self-other representations.

I give you a cup, I get a cup: a kinematic study on social intention

While affordances have been intensively studied, the mechanisms according to how their activation is modulated by context are poorly understood. We investigated how the Agent׳s reach-to-grasp movement towards a target-object (e.g. a can) is influenced by the other׳s interaction with a second object (manipulative/functional) and by his/her eye-gaze communication. To manipulate physical context we showed participants two objects that could be linked by a spatial relation (e.g. can-knife, typically found in the same context), or by different functional relations. The functional relations could imply an action to perform with another person (functional-cooperative: e.g. can-glass), or on our own (functional-individual: e.g. can-straw). When objects were not related (e.g. can-toothbrush) participants had to refrain from responding. In order to respond, in the giving condition participants had to move the target object towards the other person, in the getting condition towards their own body. When participants (Agents) performed a reach-to-grasp movement to give the target object, in presence of eye-gaze communication they reached the wrist׳s acceleration peak faster if the Other previously interacted with the second object in accordance with its conventional use. Consistently participants reached faster the MFA when the objects were related by a functional-individual than a functional-cooperative relation. The Agent׳s getting response strongly affected the grasping component of the movement: in case of eye-gaze sharing, MFA was greater when the other previously performed a manipulative than a functional grip. Results reveal that humans have developed a sophisticated capability in detecting information from hand posture and eye-gaze, which are informative as to the Agent׳s intention.

The effect of model uncertainty on cooperation in sensorimotor interactions

Decision-makers have been shown to rely on probabilistic models for perception and action. However, these models can be incorrect or partially wrong in which case the decision-maker has to cope with model uncertainty. Model uncertainty has recently also been shown to be an important determinant of sensorimotor behaviour in humans that can lead to risk-sensitive deviations from Bayes optimal behaviour towards worst-case or best-case outcomes. Here, we investigate the effect of model uncertainty on cooperation in sensorimotor interactions similar to the stag-hunt game, where players develop models about the other player and decide between a pay-off-dominant cooperative solution and a risk-dominant, non-cooperative solution. In simulations, we show that players who allow for optimistic deviations from their opponent model are much more likely to converge to cooperative outcomes. We also implemented this agent model in a virtual reality environment, and let human subjects play against a virtual player. In this game, subjects' pay-offs were experienced as forces opposing their movements. During the experiment, we manipulated the risk sensitivity of the computer player and observed human responses. We found not only that humans adaptively changed their level of cooperation depending on the risk sensitivity of the computer player but also that their initial play exhibited characteristic risk-sensitive biases. Our results suggest that model uncertainty is an important determinant of cooperation in two-player sensorimotor interactions.

Motor simulation and the coordination of self and other in real-time joint action

Joint actions require the integration of simultaneous self- and other-related behaviour. Here, we investigated whether this function is underpinned by motor simulation, that is the capacity to represent a perceived action in terms of the neural resources required to execute it. This was tested in a music performance experiment wherein on-line brain stimulation (double-pulse transcranial magnetic stimulation, dTMS) was employed to interfere with motor simulation. Pianists played the right-hand part of piano pieces in synchrony with a recording of the left-hand part, which had (Trained) or had not (Untrained) been practiced beforehand. Training was assumed to enhance motor simulation. The task required adaptation to tempo changes in the left-hand part that, in critical conditions, were preceded by dTMS delivered over the right primary motor cortex. Accuracy of tempo adaptation following dTMS or sham stimulations was compared across Trained and Untrained conditions. Results indicate that dTMS impaired tempo adaptation accuracy only during the perception of trained actions. The magnitude of this interference was greater in empathic individuals possessing a strong tendency to adopt others' perspectives. These findings suggest that motor simulation provides a functional resource for the temporal coordination of one's own behaviour with others in dynamic social contexts.

Vicarious motor activation during action perception: beyond correlational evidence

Neurophysiological and imaging studies have shown that seeing the actions of other individuals brings about the vicarious activation of motor regions involved in performing the same actions. While this suggests a simulative mechanism mediating the perception of others' actions, one cannot use such evidence to make inferences about the functional significance of vicarious activations. Indeed, a central aim in social neuroscience is to comprehend how vicarious activations allow the understanding of other people's behavior, and this requires to use stimulation or lesion methods to establish causal links from brain activity to cognitive functions. In the present work, we review studies investigating the effects of transient manipulations of brain activity or stable lesions in the motor system on individuals' ability to perceive and understand the actions of others. We conclude there is now compelling evidence that neural activity in the motor system is critical for such cognitive ability. More research using causal methods, however, is needed in order to disclose the limits and the conditions under which vicarious activations are required to perceive and understand actions of others as well as their emotions and somatic feelings.

Kinematics fingerprints of leader and follower role-taking during cooperative joint actions

Performing online complementary motor adjustments is quintessential to joint actions since it allows interacting people to coordinate efficiently and achieve a common goal. We sought to determine whether, during dyadic interactions, signaling strategies and simulative processes are differentially implemented on the basis of the interactional role played by each partner. To this aim, we recorded the kinematics of the right hand of pairs of individuals who were asked to grasp as synchronously as possible a bottle-shaped object according to an imitative or complementary action schedule. Task requirements implied an asymmetric role assignment so that participants performed the task acting either as (1) Leader (i.e., receiving auditory information regarding the goal of the task with indications about where to grasp the object) or (2) Follower (i.e., receiving instructions to coordinate their movements with their partner's by performing imitative or complementary actions). Results showed that, when acting as Leader, participants used signaling strategies to enhance the predictability of their movements. In particular, they selectively emphasized kinematic parameters and reduced movement variability to provide the partner with implicit cues regarding the action to be jointly performed. Thus, Leaders make their movements more "communicative" even when not explicitly instructed to do so. Moreover, only when acting in the role of Follower did participants tend to imitate the Leader, even in complementary actions where imitation is detrimental to joint performance. Our results show that mimicking and signaling are implemented in joint actions according to the interactional role of the agent, which in turn is reflected in the kinematics of each partner.