Acting together in and beyond the mirror neuron system

Attention allocation in complementary joint action: How joint goals affect spatial orienting

When acting jointly, individuals often attend and respond to the same object or spatial location in complementary ways (e.g., when passing a mug, one person grasps its handle with a precision grip; the other receives it with a whole-hand grip). At the same time, the spatial relation between individuals' actions affects attentional orienting: one is slower to attend and respond to locations another person previously acted upon than to alternate locations ("social inhibition of return", social IOR). Achieving joint goals (e.g., passing a mug), however, often requires complementary return responses to a co-actor's previous location. This raises the question of whether attentional orienting, and hence the social IOR, is affected by the (joint) goal our actions are directed at. The present study addresses this question. Participants responded to cued locations on a computer screen, taking turns with a virtual co-actor. They pursued either an individual goal or performed complementary actions with the co-actor, in pursuit of a joint goal. Four experiments showed that the social IOR was significantly modulated when participant and co-actor pursued a joint goal. This suggests that attentional orienting is affected not only by the spatial but also by the social relation between two agents' actions. Our findings thus extend research on interpersonal perception-action effects, showing that the way another agent's perceived action shapes our own depends on whether we share a joint goal with that agent.

Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action

Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.

Two-monkey fMRI setup for investigating multifaceted aspects of social cognition and behavior involving a real-live conspecific

While brain research over the past decades has shed light on the neural correlates of social cognition and behavior in human and non-human primates, most of this research has been performed in virtual settings requiring subjects to observe pictures or recorded videos instead of observing or interacting with another real-live individual. Here we present a two-monkey fMRI setup, allowing examining whole brain responses in macaque monkeys while they observe or interact face-to-face with another real-live conspecific. We tested this setup by comparing overall brain responses during observation of conspecific hand actions in a virtual (observation of recorded videos of actions) or live context (observation of a real-live conspecific performing actions). This dyadic monkey fMRI setup allows examining brain-wide responses in macaque monkeys during different aspects of social behavior, including observation of real-live actions and sensations, social facilitation, joint-attention and social interactions.

Effect of Social Context on Cognitive and Motor Behavior: A Systematic Review

Human cognitive and motor behavior is influenced by the social contexts. The aim of this systematic review is to investigate the impact of the social contexts on human behaviors. A systematic search of the literature was performed via Pub-Med/Medline, Web of sciences, Google scholar, Science direct, Springer-Link and EMBASE and 68 articles were selected. After applying all the inclusion and exclusion criteria, 16 articles were retained. The results show that the presence of other people and the social context influence motor behavior (i.e. movement duration, trajectory behavior, maximum speed) and cognitive behavior (reaction time). Studies have shown an improvement in performance in the presence of other people compared to the individual situation. However, other studies showed that the presence of other people led to deterioration in performance compared to the individual situation. The improvement of behavior is attributed to the social phenomenon of facilitation while the deterioration was explained by the conduct theory or the distraction conflict theory. These social phenomena of facilitation or inhibition could be related to the perception-action theory, which interferes with interaction with other. This, in turn, seems to be associated with neural circuits of mirror neurons and motor system.

Autonomic system tuning during gesture observation and reproduction

Gestural communication allows providing information about thoughts and feelings, characterizing face-to-face interactions, also during non-verbal exchanges. In the present study, the autonomic responses and peripheral synchronization mechanisms of two individuals (encoder and decoder) were recorded simultaneously, through the use of biofeedback in hyperscanning, during two different experimental phases consisting in the observation (watching videos of gestures) and reproduction of positive and negative different types of gestures (affective, social and informative) supported by linguistic contexts. Therefore, the main aim of this study was focused on the analysis of simultaneous individuals' peripheral mechanisms during the performing of complex joint action, consisting of the observation (watching videos) and the reproduction of positive and negative social, affective, and informative gestures each supported by a linguistic script. Single-subject and inter-subject correlation analyses were conducted to observe individuals' autonomic responses and physiological synchronization. Single-subject results revealed an increase in emotional arousal, indicated by an increase in electrodermal activity (skin conductance level - SCL and response - SCR), during both the observation (watching videos) and reproduction of negative social and affective gestures contextualized by a linguistic context. Moreover, an increase of emotional engagement, expressed by an increase in heart rate (HR) activity, emerged in the encoder compare to the decoder during gestures reproduction (simulation of gestures). Inter-subject correlation results showed the presence of mirroring mechanisms, indicated by an increase in SCL, SCR, and HR synchronization, during the linguistic contexts and gesture observation (watching videos). Furthermore, an increase in SCL and SCR synchronization emerged during the observation (watching videos) and reproduction of negative social and affective gestures. Therefore, the present study allowed to obtain information on the mirroring mechanisms and physiological synchronization underlying the linguistic and gesture system during non-verbal interaction.

Not so social after all: Video-based acquisition of observational stimulus-response bindings

Merely observing how another person responds to a stimulus results in incidental stimulus-response (SR) bindings in memory. These observationally acquired SR bindings can be retrieved on a later occasion. Retrieval will bias current behavioral response tendencies towards re-execution of the observed response. Previous demonstrations of this effect endorsed a dyadic interaction paradigm in which two co-actors respond in alternating fashion. The present paper investigates a video-based version of the observational SR binding task in which videotaped responses are observed on screen. Whereas findings from the dyadic paradigm indicate that retrieval of observationally acquired SR bindings is modulated by social relevance, the video-based paradigm is not influenced by social moderators. Data of four experiments show that manipulations of visual perspective, natural and artificial group membership had no modulatory effect on retrieval of observationally acquired SR bindings in the video-based paradigm. The absence of any socially modulated effect in the video-based paradigm is supported by Bayesian statistics in favor of the null hypothesis. Data from a fifth experiment suggests that observational SR binding and retrieval effects in the video-based paradigm reflect the influence of spatial attention allocated towards response keys of observed responses. Implications for the suitability of both paradigms to study observational learning and joint action phenomena are discussed.

Brain hemodynamic response in Examiner-Examinee dyads during spatial short-term memory task: an fNIRS study

The Corsi Block-Tapping test (CBT) is a measure of spatial working memory (WM) in clinical practice, requiring an examinee to reproduce sequences of cubes tapped by an examiner. CBT implies complementary behaviors in the examiners and the examinees, as they have to attend a precise turn taking. Previous studies demonstrated that the Prefrontal Cortex (PFC) is activated during CBT, but scarce evidence is available on the neural correlates of CBT in the real setting. We assessed PFC activity in dyads of examiner–examinee participants while completing the real version of CBT, during conditions of increasing and exceeding workload. This procedure allowed to investigate whether brain activity in the dyads is coordinated. Results in the examinees showed that PFC activity was higher when the workload approached or reached participants’ spatial WM span, and lower during workload conditions that were largely below or above their span. Interestingly, findings in the examiners paralleled the ones in the examinees, as examiners’ brain activity increased and decreased in a similar way as the examinees’ one. In the examiners, higher left-hemisphere activity was observed suggesting the likely activation of non-spatial WM processes. Data support a bell-shaped relationship between cognitive load and brain activity, and provide original insights on the cognitive processes activated in the examiner during CBT.

Competence-based social status and implicit preference modulate the ability to coordinate during a joint grasping task

Studies indicate that social status influences people's social perceptions. Less information is available about whether induced social status influences dyadic coordination during motor interactions. To explore this issue, we designed a study in which two confederates obtained high or low competence-based status by playing a game together with the participant, while the participant always occupied the middle position of the hierarchy. Following this status-inducing phase, participants were engaged in a joint grasping task with the high- and low-status confederates in different sessions while behavioural (i.e., interpersonal asynchrony and movement start time) indexes were measured. Participants' performance in the task (i.e., level of interpersonal asynchrony) when interacting with the low-status partner was modulated by their preference for him. The lower participants' preference for a low- relative to a high-status confederate, the worse participants' performance when interacting with the low-status confederate. Our results show that participants' performance during motor interactions changes according to the social status of the interaction partner.

Mechanisms for mutual support in motor interactions

What is the key to successful interaction? Is it sufficient to represent a common goal, or does the way our partner achieves that goal count as well? How do we react when our partner misbehaves? We used a turn-taking music-like task requiring participants to play sequences of notes together with a partner, and we investigated how people adapt to a partner's error that violates their expectations. Errors consisted of either playing a wrong note of a sequence that the agents were playing together (thus preventing the achievement of the joint goal) or playing the expected note with an unexpected action. In both cases, we found post-error slowing and inaccuracy suggesting the participants' implicit tendency to correct the partner's error and produce the action that the partner should have done. We argue that these "joint" monitoring processes depend on the motor predictions made within a (dyadic) motor plan and may represent a basic mechanism for mutual support in motor interactions.

The motor-related brain activity that supports joint action: A review

Recent years have seen a rapid increase in research investigating the motor-related brain activity that supports joint action. This research has employed a variety of joint action tasks and an array of neuroimaging techniques, including fMRI, fNIRS, EEG, and TMS. In this review, we provide an overview of this research to delineate what is known about the motor-related brain activity that contributes to joint action and to highlight key questions for future research. Taken together, the surveyed research supports three major conclusions. First, the mere presence of a joint action context is sufficient to modulate motor activity elicited by observing others' actions. Second, joint action is supported by dissociable motor activity associated with a person's own actions, their partner's actions, and the joint action, and by between-brain coupling of motor-related oscillatory activity. Third, the structure of a joint action modulates the motor activity involved: Unique motor activity is associated with performing joint actions comprised of complementary actions and with holding the roles of leader and follower within a joint action. We conclude the review by highlighting overarching themes and key questions for future research.

The influence of prior intention on joint action: an fNIRS-based hyperscanning study

Motor performances of the same action are affected by prior intentions to move unintentionally, cooperatively or competitively. Here, a back-and-forth movement task combined with a motion capture system and functional near-infrared spectroscopy (fNIRS)-based hyperscanning technology was utilized to record both the behavioral and neural data of 18 dyads of participants acting in pairs [joint conditions: no-intention, cooperative (Coop) and competitive (Comp)] or alone (single conditions: self-paced and fast-speed). The results revealed that Coop or Comp intentions in the joint conditions significantly sped up motor performance compared with similar single conditions, e.g. shorter movement times (MTs) in the Coop/Comp condition than the self-paced/fast-speed condition. Hemodynamic response analysis demonstrated that stronger activities for all joint conditions than the single conditions in the premotor and the supplementary motor cortex (Brodmann area 6) were independent of variations of MTs, indicating that they might reflect more complex aspects of action planning rather than simple execution-based processes. The comparisons of joint conditions across distinct prior intentions before acting yielded significant results for both behavioral and neural measures, with the highest activation of the temporo-parietal junction (TPJ) and the shortest MTs in the Comp condition considered to be implications for the top-down influence of prior intentions on joint performance.

Nonlinear engagement of action observation network underlying action anticipation in players with different levels of expertise

The goal of this study was to reconcile inconsistency of neural engagement underlying action anticipation between experts and nonexperts, as well as between correct and incorrect anticipations. Therefore, we asked novice, intermediate, and skilled baseball batters (N, IB, and SB) to anticipate their swing decisions in response to pitching videos of a strike or ball, using functional magnetic resonance imaging. Behavioral results confirmed the effect of expertise that is generally shown in a linear fashion. Imaging results instead revealed a nonlinear relationship between expertise level and the evoked response amplitude of nodes within the action observation network. The relationship was best captured by an inverted U‐shaped quadratic response profile across the three groups such that IB exhibited higher activation than did both SB and N. These empirical findings extend the framework of predictive coding as well as of neural efficiency in anticipating the action of others, and they might be associated with the underlying process to interpret the goal of the observed action and prepare one's own response. Furthermore, the right anterior cerebellum showed different levels of activation for correct and incorrect anticipations in all groups, adding novel evidence of its subtle involvement in anticipation processes irrespective of expertise status.

The engaging nature of interactive gestures

The social interactions that we experience from early infancy often involve actions that are not strictly instrumental but engage the recipient by eliciting a (complementary) response. Interactive gestures may have privileged access to our perceptual and motor systems either because of their intrinsically engaging nature or as a result of extensive social learning. We compared these two hypotheses in a series of behavioral experiments by presenting individuals with interactive gestures that call for motor responses to complement the interaction ('hand shaking', 'requesting', 'high-five') and with communicative gestures that are equally socially relevant and salient, but do not strictly require a response from the recipient ('Ok', 'Thumbs up', 'Peace'). By means of a spatial compatibility task, we measured the interfering power of these task-irrelevant stimuli on the behavioral responses of individuals asked to respond to a target. Across three experiments, our results showed that the interactive gestures impact on response selection and reduce spatial compatibility effects as compared to the communicative (non-interactive) gestures. Importantly, this effect was independent of the activation of specific social scripts that may interfere with response selection. Overall, our results show that interactive gestures have privileged access to our perceptual and motor systems, possibly because they entail an automatic preparation to respond that involuntary engages the motor system of the observers. We discuss the implications from a developmental and neurophysiological point of view.

Using second-person neuroscience to elucidate the mechanisms of social interaction

Although a large proportion of our lives are spent participating in social interactions, the investigation of the neural mechanisms supporting these interactions has largely been restricted to situations of social observation - that is, situations in which an individual observes a social stimulus without opportunity for interaction. In recent years, efforts have been made to develop a truly social, or 'second-person', neuroscientific approach to these investigations in which neural processes are examined within the context of a real-time reciprocal social interaction. These developments have helped to elucidate the behavioural and neural mechanisms of social interactions; however, further theoretical and methodological innovations are still needed. Findings to date suggest that the neural mechanisms supporting social interaction differ from those involved in social observation and highlight a role of the so-called 'mentalizing network' as important in this distinction. Taking social interaction seriously may also be particularly important for the advancement of the neuroscientific study of different psychiatric conditions.

How Task Interactivity Shapes Action Observation

Action observation triggers imitation, a powerful mechanism permitting interpersonal coordination. Coordination, however, also occurs when the partners’ actions are nonimitative and physically incongruent. One influential theory postulates that this is achieved via top-down modulation of imitation exerted by prefrontal regions. Here, we rather argue that coordination depends on sharing a goal with the interacting partner: this shapes action observation, overriding involuntary imitation, through the predictive activity of the left ventral premotor cortex (lvPMc). During functional magnetic resonance imaging (fMRI), participants played music in turn with a virtual partner in interactive and noninteractive conditions requiring 50% of imitative/nonimitative responses. In a full-factorial design, both perceptual features and low-level motor requirements were kept constant throughout the experiment. Behaviorally, the interactive context minimized visuomotor interference due to the involuntary imitation of physically incongruent movements. This was paralleled by modulation of neural activity in the lvPMc, which was specifically recruited during the interactive task independently of the imitative/nonimitative nature of the social exchange. This lvPMc activity reflected the predictive decoding of the partner’s actions, as revealed by multivariate pattern analysis. This demonstrates that, during interactions, we process our partners’ behavior to prospectively infer their contribution to the shared goal achievement, generating motor predictions for cooperation beyond low-level imitation.

Interactor's body shape does not affect visuo-motor interference effects during motor coordination

The biological-tuning of the Action Observation Network is highly debated. A current open question relates to whether the morphological appearance (body shape) and/or the biological motion of the observed agent triggers action simulation processes. Motor simulation of the partner's action is critical for motor interactions, where two partners coordinate their actions in space and time. It supports interpersonal alignment and facilitates online coordination. However, motor simulation also leads to visuo-motor interference effects when people are required to coordinate with complementary actions, i.e. incongruent movements as compared to the observed ones. Movement kinematics of interactive partners allows us to capture their automatic tendency to simulate and imitate the partner's complementary movements. In an online reach-to-grasp task, we investigated whether visuo-motor interference effects, visible in the kinematics of complementary movements, are modulated by the visual presence of the interactor's body shape. We asked participants to interact with 1) a humanoid agent with a human-like body shape and with real human, biological, movement kinematics, or 2) a non-humanoid agent, which did not resemble the human body-shape but moved with the same real kinematics. Through the combination of inferential and Bayesian statistics, the results show no effect of interactor's body shape on visuo-motor interference in reaching and grasping kinematics during online motor coordination. We discuss the results and propose that the kinematics of the observed movements, during motor interactions, might be the key factor for visuo-motor interference to take place independently from the morphological appearance of the partner. This is particularly relevant in a technological society that constantly asks humans to interact with artificial agents.

fNIRS Responses in Professional Violinists While Playing Duets: Evidence for Distinct Leader and Follower Roles at the Brain Level

Music played in ensembles is a naturalistic model to study joint action and leader-follower relationships. Recently, the investigation of the brain underpinnings of joint musical actions has gained attention; however, the cerebral correlates underlying the roles of leader and follower in music performance remain elusive. The present study addressed this question by simultaneously measuring the hemodynamic correlates of functional neural activity elicited during naturalistic violin duet performance using fNIRS. Findings revealed distinct patterns of functional brain activation when musicians played the Violin 2 (follower) than the Violin 1 part (leader) in duets, both compared to solo performance. More specifically, results indicated that musicians playing the Violin 2 part had greater oxy-Hb activation in temporo-parietal (p = 0.02) and somatomotor (p = 0.04) regions during the duo condition in relation to the solo. On the other hand, there were no significant differences in the activation of these areas between duo/solo conditions during the execution of the Violin 1 part (p's > 0.05). These findings suggest that ensemble cohesion during a musical performance may impose particular demands when musicians play the follower position, especially in brain areas associated with the processing of dynamic social information and motor simulation. This study is the first to use fNIRS hyperscanning technology to simultaneously measure the brain activity of two musicians during naturalistic music ensemble performance, opening new avenues for the investigation of brain correlates underlying joint musical actions with multiple subjects in a naturalistic environment.

Inhibition of left anterior intraparietal sulcus shows that mutual adjustment marks dyadic joint-actions in humans

Creating real-life dynamic contexts to study interactive behaviors is a fundamental challenge for the social neuroscience of interpersonal relations. Real synchronic interpersonal motor interactions involve online, inter-individual mutual adaptation (the ability to adapt one’s movements to those of another in order to achieve a shared goal). In order to study the contribution of the left anterior Intra Parietal Sulcus (aIPS) (i.e. a region supporting motor functions) to mutual adaptation, here, we combined a behavioral grasping task where pairs of participants synchronized their actions when performing mutually adaptive imitative and complementary movements, with the inhibition of activity of aIPS via non-invasive brain stimulation. This approach allowed us to investigate whether aIPS supports online complementary and imitative interactions. Behavioral results showed that inhibition of aIPS selectively impairs pair performance during complementary compared to imitative interactions. Notably, this effect depended on pairs’ mutual adaptation skills and was higher for pairs composed of participants who were less capable of adapting to each other. Thus, we provide the first causative evidence for a role of the left aIPS in supporting mutually adaptive interactions and show that the inhibition of the neural resources of one individual of a pair is compensated at the dyadic level.

Come together: human-avatar on-line interactions boost joint-action performance in apraxic patients

Limb apraxia (LA) is a high-order motor disorder linked to left-hemisphere damage. It is characterized by defective execution of purposeful actions upon delayed imitation, or verbal command when the actions are performed in isolated, non-naturalistic, conditions. Whether interpersonal interactions provide social affordances that activate neural resources different from those requested by individual action execution, which may improve LA performance, is unknown. To fill this gap, we measured interaction performance, behavioral and kinematic indexes of left-brain damaged patients with/without LA in a social reach-to-grasp task involving two different degrees of spatio-temporal interactivity with an avatar. We found that LA patients' impairment in coordinating with the virtual partner was abolished in highly interactive conditions (where patients selected their actions on-line based on the behavior of the virtual partner) with respect to low interactive conditions (where actions were selected beforehand based on abstract instructions). Voxel-based-Lesion-Symptom-Mapping indicated that impairments in low-interactive conditions were underpinned by lesions of premotor, motor and insular areas, and of the basal ganglia. Our approach expands current understanding of the behavioral and neural correlates of interactive motor performance by highlighting the important role of social affordances, and provides novel, potentially important, views on rehabilitation of higher-order motor cognition disorders.

Evidence for a dyadic motor plan in joint action

What mechanisms distinguish interactive from non-interactive actions? To answer this question we tested participants while they took turns playing music with a virtual partner: in the interactive joint action condition, the participants played a melody together with their partner by grasping (C note) or pressing (G note) a cube-shaped instrument, alternating in playing one note each. In the non-interactive control condition, players’ behavior was not guided by a shared melody, so that the partner’s actions and notes were irrelevant to the participant. In both conditions, the participant’s and partner’s actions were physically congruent (e.g., grasp-grasp) or incongruent (e.g., grasp-point), and the partner’s association between actions and notes was coherent with the participant’s or reversed. Performance in the non-interactive condition was only affected by physical incongruence, whereas joint action was only affected when the partner’s action-note associations were reversed. This shows that task interactivity shapes the sensorimotor coding of others’ behaviors, and that joint action is based on active prediction of the partner’s action effects rather than on passive action imitation. We suggest that such predictions are based on Dyadic Motor Plans that represent both the agent’s and the partner’s contributions to the interaction goal, like playing a melody together.

Taking two to tango: fMRI analysis of improvised joint action with physical contact

Many forms of joint action involve physical coupling between the participants, such as when moving a sofa together or dancing a tango. We report the results of a novel two-person functional MRI study in which trained couple dancers engaged in bimanual contact with an experimenter standing next to the bore of the magnet, and in which the two alternated between being the leader and the follower of joint improvised movements. Leading showed a general pattern of self-orientation, being associated with brain areas involved in motor planning, navigation, sequencing, action monitoring, and error correction. In contrast, following showed a far more sensory, externally-oriented pattern, revealing areas involved in somatosensation, proprioception, motion tracking, social cognition, and outcome monitoring. We also had participants perform a "mutual" condition in which the movement patterns were pre-learned and the roles were symmetric, thereby minimizing any tendency toward either leading or following. The mutual condition showed greater activity in brain areas involved in mentalizing and social reward than did leading or following. Finally, the analysis of improvisation revealed the dual importance of motor-planning and working-memory areas. We discuss these results in terms of theories of both joint action and improvisation.

Transitory Inhibition of the Left Anterior Intraparietal Sulcus Impairs Joint Actions: A Continuous Theta-Burst Stimulation Study

Although temporal coordination is a hallmark of motor interactions, joint action (JA) partners do not simply synchronize; rather, they dynamically adapt to each other to achieve a joint goal. We created a novel paradigm to tease apart the processes underlying synchronization and JA and tested the causal contribution of the left anterior intraparietal sulcus (aIPS) in these behaviors. Participants had to synchronize their congruent or incongruent movements with a virtual partner in two conditions: (i) being instructed on what specific action to perform, independently from what action the partner performed (synchronization), and (ii) being instructed to adapt online to the partner's action (JA). Offline noninvasive inhibitory brain stimulation (continuous theta-burst stimulation) over the left aIPS selectively modulated interpersonal synchrony in JA by boosting synchrony during congruent interactions and impairing it during incongruent ones, while leaving performance in the synchronization condition unaffected. These results suggest that the left aIPS plays a causal role in supporting online adaptation to a partner's action goal, whereas it is not necessarily engaged in social situations where the goal of the partner is irrelevant. This indicates that, during JAs, the integration of one's own and the partner's action goal is supported by aIPS.

A Social-Interactive Neuroscience Approach to Understanding the Developing Brain

From birth onward, social interaction is central to our everyday lives. Our ability to seek out social partners, flexibly navigate and learn from social interactions, and develop social relationships is critically important for our social and cognitive development and for our mental and physical health. Despite the importance of our social interactions, the neurodevelopmental bases of such interactions are underexplored, as most research examines social processing in noninteractive contexts. We begin this chapter with evidence from behavioral work and adult neuroimaging studies demonstrating how social-interactive context fundamentally alters cognitive and neural processing. We then highlight four brain networks that play key roles in social interaction and, drawing on existing developmental neuroscience literature, posit the functional roles these networks may play in social-interactive development. We conclude by discussing how a social-interactive neuroscience approach holds great promise for advancing our understanding of both typical and atypical social development.

Learning, remembering, and predicting how to use tools: Distributed neurocognitive mechanisms: Comment on Osiurak and Badets (2016)

The reasoning-based approach championed by Francois Osiurak and Arnaud Badets (Osiurak & Badets, 2016) denies the existence of sensory-motor memories of tool use except in limited circumstances, and suggests instead that most tool use is subserved solely by online technical reasoning about tool properties. In this commentary, I highlight the strengths and limitations of the reasoning-based approach and review a number of lines of evidence that manipulation knowledge is in fact used in tool action tasks. In addition, I present a "two route" neurocognitive model of tool use called the "Two Action Systems Plus (2AS+)" framework that posits a complementary role for online and stored information and specifies the neurocognitive substrates of task-relevant action selection. This framework, unlike the reasoning based approach, has the potential to integrate the existing psychological and functional neuroanatomic data in the tool use domain. (PsycINFO Database Record

Autistic traits affect interpersonal motor coordination by modulating strategic use of role-based behavior

Background

Despite the fact that deficits in social communication and interaction are at the core of Autism Spectrum Conditions (ASC), no study has yet tested individuals on a continuum from neurotypical development to autism in an on-line, cooperative, joint action task. In our study, we aimed to assess whether the degree of autistic traits affects participants' ability to modulate their motor behavior while interacting in a Joint Grasping task and according to their given role.

Methods

Sixteen pairs of adult participants played a cooperative social interactive game in which they had to synchronize their reach-to-grasp movements. Pairs were comprised of one ASC and one neurotypical with no cognitive disability. In alternate experimental blocks, one participant knew what action to perform (instructed role) while the other had to infer it from his/her partner’s action (adaptive role). When in the adaptive condition, participants were told to respond with an action that was either opposite or similar to their partner. Participants also played a non-social control game in which they had to synchronize with a non-biological stimulus.

Results

In the social interactive task, higher degree of autistic traits predicted less ability to modulate joint action according to one’s interactive role. In the non-social task, autistic traits did not predict differences in movement preparation and planning, thus ruling out the possibility that social interactive task results were due to basic motor or executive function difficulties. Furthermore, when participants played the non-social game, the higher their autistic traits, the more they were interfered by the non-biological stimulus.

Conclusions

Our study shows for the first time that high autistic traits predict a stereotypical interaction style when individuals are required to modulate their movements in order to coordinate with their partner according to their role in a joint action task. Specifically, the infrequent emergence of role-based motor behavior modulation during on-line motor cooperation in participants with high autistic traits sheds light on the numerous difficulties ASC have in nonverbal social interactions.

Electronic supplementary material

The online version of this article (doi:10.1186/s13229-017-0141-0) contains supplementary material, which is available to authorized users.

The mirror neuron system also rests

The mirror neuron system (MNS) is a brain network that has been associated with the understanding of the actions performed by others. The main areas of the brain that are considered as belonging to the MNS are the rostral part of the inferior parietal lobe (IPL) and the inferior frontal gyrus (IFG). Many studies have tried to focus on the relationship between the regions belonging to the MNS, but a little consideration has been given to the study of the MNS in resting conditions. In the present experiment, the MNS has been studied by two fMRI modalities (task-based fMRI and resting-fMRI) and three analytical procedures [task-block comparison, functional connectivity (FC), and independent component analysis (ICA)]. The task-fMRI with block design showed a mirror activity located in the rostral IPL. The coordinates of this local maximum voxel were defined as a region of interest (ROI) for an FC analysis of the resting-fMRI. This analysis revealed the existence of a functional connectivity within regions forming the core of MNS network and also with other regions with mirror properties. Finally, resting-state fMRI ICA showed the same functional network, although it was more restricted to the core MNS regions. To the best of our knowledge, this is the first study that approaches the MNS using the resting-state fMRI analysis using independent component analysis and functional connectivity at the same time.

Examining ecological validity in social interaction: problems of visual fidelity, gaze, and social potential

Social interaction is an essential part of the human experience, and much work has been done to study it. However, several common approaches to examining social interactions in psychological research may inadvertently either unnaturally constrain the observed behaviour by causing it to deviate from naturalistic performance, or introduce unwanted sources of variance. In particular, these sources are the differences between naturalistic and experimental behaviour that occur from changes in visual fidelity (quality of the observed stimuli), gaze (whether it is controlled for in the stimuli), and social potential (potential for the stimuli to provide actual interaction). We expand on these possible sources of extraneous variance and why they may be important. We review the ways in which experimenters have developed novel designs to remove these sources of extraneous variance. New experimental designs using a 'two-person' approach are argued to be one of the most effective ways to develop more ecologically valid measures of social interaction, and we suggest that future work on social interaction should use these designs wherever possible.

Interactional leader-follower sensorimotor communication strategies during repetitive joint actions

Non-verbal communication is the basis of animal interactions. In dyadic leader-follower interactions, leaders master the ability to carve their motor behaviour in order to 'signal' their future actions and internal plans while these signals influence the behaviour of follower partners, who automatically tend to imitate the leader even in complementary interactions. Despite their usefulness, signalling and imitation have a biomechanical cost, and it is unclear how this cost-benefits trade-off is managed during repetitive dyadic interactions that present learnable regularities. We studied signalling and imitation dynamics (indexed by movement kinematics) in pairs of leaders and followers during a repetitive, rule-based, joint action. Trial-by-trial Bayesian model comparison was used to evaluate the relation between signalling, imitation and pair performance. The different models incorporate different hypotheses concerning the factors (past interactions versus online movements) influencing the leader's signalling (or follower's imitation) kinematics. This approach showed that (i) leaders' signalling strategy improves future couple performance, (ii) leaders used the history of past interactions to shape their signalling, (iii) followers' imitative behaviour is more strongly affected by the online movement of the leader. This study elucidates the ways online sensorimotor communication help individuals align their task representations and ultimately improves joint action performance.

Neonatal imitation and early social experience predict gaze following abilities in infant monkeys

Individuals vary in their social skills and motivation, the causes of which remain largely unknown. Here we investigated whether an individual’s propensity to interact with others measured within days after birth, and differences in infants’ early social environment, may predict a later social skill. Specifically, we tested whether neonatal imitation—newborns’ capacity to match modelled actions—and social experience in the first months of life predict gaze following (directing attention to locations where others look), in infant macaques (Macaca mulatta; n = 119). Facial gesture imitation in the first week of life predicted gaze following at 7 months of age. Imitators were better at gaze following than non-imitators, suggesting neonatal imitation may be an early marker predicting socio-cognitive functioning. In addition, infants with rich social environments outperformed infants with less socialization, suggesting early social experiences also support the development of infants’ gaze following competence. The present study offers compelling evidence that an individual difference present from birth predicts a functional social cognitive skill in later infancy. In addition, this foundational skill—gaze following—is plastic, and can be improved through social interactions, providing infants with a strong foundation for later social interaction and learning.

Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences

An essential tension can be found between researchers interested in ecological validity and those concerned with maintaining experimental control. Research in the human neurosciences often involves the use of simple and static stimuli lacking many of the potentially important aspects of real world activities and interactions. While this research is valuable, there is a growing interest in the human neurosciences to use cues about target states in the real world via multimodal scenarios that involve visual, semantic, and prosodic information. These scenarios should include dynamic stimuli presented concurrently or serially in a manner that allows researchers to assess the integrative processes carried out by perceivers over time. Furthermore, there is growing interest in contextually embedded stimuli that can constrain participant interpretations of cues about a target’s internal states. Virtual reality environments proffer assessment paradigms that combine the experimental control of laboratory measures with emotionally engaging background narratives to enhance affective experience and social interactions. The present review highlights the potential of virtual reality environments for enhanced ecological validity in the clinical, affective, and social neurosciences.

Causative role of left aIPS in coding shared goals during human-avatar complementary joint actions

Successful motor interactions require agents to anticipate what a partner is doing in order to predictively adjust their own movements. Although the neural underpinnings of the ability to predict others' action goals have been well explored during passive action observation, no study has yet clarified any critical neural substrate supporting interpersonal coordination during active, non-imitative (complementary) interactions. Here, we combine non-invasive inhibitory brain stimulation (continuous Theta Burst Stimulation) with a novel human–avatar interaction task to investigate a causal role for higher-order motor cortical regions in supporting the ability to predict and adapt to others' actions. We demonstrate that inhibition of left anterior intraparietal sulcus (aIPS), but not ventral premotor cortex, selectively impaired individuals' performance during complementary interactions. Thus, in addition to coding observed and executed action goals, aIPS is crucial in coding ‘shared goals', that is, integrating predictions about one's and others' complementary actions.

The neural mechanisms supporting imitative motor interactions have been well studied. However, considerably less is known about the mechanisms supporting complementary interactions. Here the authors demonstrate a causal role for left anterior intraparietal sulcus in coding complementary motor goals.

Decreased activity with increased background network efficiency in amnestic MCI during a visuospatial working memory task

Recent studies have demonstrated the working memory impairment in patients with amnestic mild cognitive impairment (aMCI). However, the neurophysiological basis of the working memory deficit in aMCI is poorly understood. The aim of this study was to explore the abnormal activity during encoding and recognition procedures, as well as the reorganization of the background network maintaining the working memory state in aMCI. Using event-related fMRI during a visuospatial working memory task with three recognition difficulty levels, the task-related activations and network efficiency of the background network in 17 aMCI patients and 19 matched controls were investigated. Compared with cognitively healthy controls, patients with aMCI showed significantly decreased activity in the frontal and visual cortices during the encoding phase, while during the recognition phase, decreased activity was detected in the frontal, parietal, and visual regions. In addition, increased local efficiency was also observed in the background network of patients with aMCI. The results suggest patients with aMCI showed impaired encoding and recognition functions during the visuospatial working memory task, and may pay more effort to maintain the cognitive state. This study extends our understanding of the impaired working memory function in aMCI and provides a new perspective to investigate the compensatory mechanism in aMCI.

Eliminating mirror responses by instructions

The observation of an action leads to the activation of the corresponding motor plan in the observer. This phenomenon of motor resonance has an important role in social interaction, promoting imitation, learning and action understanding. However, mirror responses not always have a positive impact on our behavior. An automatic tendency to imitate others can introduce interference in action execution and non-imitative or opposite responses have an advantage in some contexts. Previous studies suggest that mirror tendencies can be suppressed after extensive practice or in complementary joint action situations revealing that mirror responses are more flexible than previously thought. The aim of the present study was to gain insight into the mechanisms that allow response flexibility of motor mirroring. Here we show that the mere instruction of a counter-imitative mapping changes mirror responses as indexed by motor evoked potentials (MEPs) enhancement induced by transcranial magnetic stimulation (TMS). Importantly, mirror activation was measured while participants were passively watching finger movements, without having the opportunity to execute the task. This result suggests that the implementation of task instructions activates stimulus-response association that can overwrite the mirror representations. Our outcome reveals one of the crucial mechanisms that might allow flexible adjustments of mirror responses in different contexts. The implications of this outcome are discussed.

Complementary actions

Complementary colors are color pairs which, when combined in the right proportions, produce white or black. Complementary actions refer here to forms of social interaction wherein individuals adapt their joint actions according to a common aim. Notably, complementary actions are incongruent actions. But being incongruent is not sufficient to be complementary (i.e., to complete the action of another person). Successful complementary interactions are founded on the abilities: (i) to simulate another person's movements, (ii) to predict another person's future action/s, (iii) to produce an appropriate incongruent response which differ, while interacting, with observed ones, and (iv) to complete the social interaction by integrating the predicted effects of one's own action with those of another person. This definition clearly alludes to the functional importance of complementary actions in the perception-action cycle and prompts us to scrutinize what is taking place behind the scenes. Preliminary data on this topic have been provided by recent cutting-edge studies utilizing different research methods. This mini-review aims to provide an up-to-date overview of the processes and the specific activations underlying complementary actions.

Frontal alpha oscillations distinguish leaders from followers: multivariate decoding of mutually interacting brains

Successful social interactions rely upon the abilities of two or more people to mutually exchange information in real-time, while simultaneously adapting to one another. The neural basis of social cognition has mostly been investigated in isolated individuals, and more recently using two-person paradigms to quantify the neuronal dynamics underlying social interaction. While several studies have shown the relevance of understanding complementary and mutually adaptive processes, the neural mechanisms underlying such coordinative behavioral patterns during joint action remain largely unknown. Here, we employed a synchronized finger-tapping task while measuring dual-EEG from pairs of human participants who either mutually adjusted to each other in an interactive task or followed a computer metronome. Neurophysiologically, the interactive condition was characterized by a stronger suppression of alpha and low-beta oscillations over motor and frontal areas in contrast to the non-interactive computer condition. A multivariate analysis of two-brain activity to classify interactive versus non-interactive trials revealed asymmetric patterns of the frontal alpha-suppression in each pair, during both task anticipation and execution, such that only one member showed the frontal component. Analysis of the behavioral data showed that this distinction coincided with the leader-follower relationship in 8/9 pairs, with the leaders characterized by the stronger frontal alpha-suppression. This suggests that leaders invest more resources in prospective planning and control. Hence our results show that the spontaneous emergence of leader-follower relationships in dyadic interactions can be predicted from EEG recordings of brain activity prior to and during interaction. Furthermore, this emphasizes the importance of investigating complementarity in joint action.

When mirroring is not enough: that is, when only a complementary action will do (the trick)

It is well known that perceiving another person's body movements activates corresponding motor representations in an observer's brain, a process which appears to be imitative in nature. However, it is also true that simply imitating another person's action/s in many situations is not an effective or appropriate response, as successful interaction often requires complementary rather than emulative behavior. This manuscript presents a review of the recent efforts to identify the mechanisms responsible--once observed actions have been mapped onto an observer's motor system--for the switch from the tendency to imitate actions to the inclination to carry out a nonidentical context-appropriate response. The putative human mirror neuron system seems to play a particularly important role in this process because of its prominent function in action observation and execution. Recent findings indicate, however, that acting in a complementary fashion might entail the recruitment of neural systems outside of the human mirror neuron system.

Neural correlates of non-verbal social interactions: a dual-EEG study

Successful non-verbal social interaction between human beings requires dynamic and efficient encoding of others' gestures. Our study aimed at identifying neural markers of social interaction and goal variations in a non-verbal task. For this, we recorded simultaneously the electroencephalogram from two participants (dual-EEG), an actor and an observer, and their arm/hand kinematics in a real face-to-face paradigm. The observer watched "biological actions" performed by the human actor and "non-biological actions" performed by a robot. All actions occurred within an interactive or non-interactive context depending on whether the observer had to perform a complementary action or not (e.g., the actor presents a saucer and the observer either places the corresponding cup or does nothing). We analysed the EEG signals of both participants (i.e., beta (~20 Hz) oscillations as an index of cortical motor activity and motor related potentials (MRPs)). We identified markers of social interactions by synchronising EEG to the onset of the actor's movement. Movement kinematics did not differ in the two context conditions and the MRPs of the actor were similar in the two conditions. For the observer, however, an observation-related MRP was measured in all conditions but was more negative in the interactive context over fronto-central electrodes. Moreover, this feature was specific to biological actions. Concurrently, the suppression of beta oscillations was observed in the actor's EEG and the observer's EEG rapidly after the onset of the actor's movement. Critically, this suppression was stronger in the interactive than in the non-interactive context despite the fact that movement kinematics did not differ in the two context conditions. For the observer, this modulation was observed independently of whether the actor was a human or a robot. Our results suggest that acting in a social context induced analogous modulations of motor and sensorimotor regions in observer and actor. Sharing a common goal during an interaction seems thus to evoke a common representation of the global action that includes both actor and observer movements.

Toward a second-person neuroscience

In spite of the remarkable progress made in the burgeoning field of social neuroscience, the neural mechanisms that underlie social encounters are only beginning to be studied and could – paradoxically – be seen as representing the “dark matter” of social neuroscience. Recent conceptual and empirical developments consistently indicate the need for investigations that allow the study of real-time social encounters in a truly interactive manner. This suggestion is based on the premise that social cognition is fundamentally different when we are in interaction with others rather than merely observing them. In this article, we outline the theoretical conception of a second-person approach to other minds and review evidence from neuroimaging, psychophysiological studies, and related fields to argue for the development of a second-person neuroscience, which will help neuroscience to really “go social”; this may also be relevant for our understanding of psychiatric disorders construed as disorders of social cognition.

Vicarious motor activation during action perception: beyond correlational evidence

Neurophysiological and imaging studies have shown that seeing the actions of other individuals brings about the vicarious activation of motor regions involved in performing the same actions. While this suggests a simulative mechanism mediating the perception of others' actions, one cannot use such evidence to make inferences about the functional significance of vicarious activations. Indeed, a central aim in social neuroscience is to comprehend how vicarious activations allow the understanding of other people's behavior, and this requires to use stimulation or lesion methods to establish causal links from brain activity to cognitive functions. In the present work, we review studies investigating the effects of transient manipulations of brain activity or stable lesions in the motor system on individuals' ability to perceive and understand the actions of others. We conclude there is now compelling evidence that neural activity in the motor system is critical for such cognitive ability. More research using causal methods, however, is needed in order to disclose the limits and the conditions under which vicarious activations are required to perceive and understand actions of others as well as their emotions and somatic feelings.

Kinematics fingerprints of leader and follower role-taking during cooperative joint actions

Performing online complementary motor adjustments is quintessential to joint actions since it allows interacting people to coordinate efficiently and achieve a common goal. We sought to determine whether, during dyadic interactions, signaling strategies and simulative processes are differentially implemented on the basis of the interactional role played by each partner. To this aim, we recorded the kinematics of the right hand of pairs of individuals who were asked to grasp as synchronously as possible a bottle-shaped object according to an imitative or complementary action schedule. Task requirements implied an asymmetric role assignment so that participants performed the task acting either as (1) Leader (i.e., receiving auditory information regarding the goal of the task with indications about where to grasp the object) or (2) Follower (i.e., receiving instructions to coordinate their movements with their partner's by performing imitative or complementary actions). Results showed that, when acting as Leader, participants used signaling strategies to enhance the predictability of their movements. In particular, they selectively emphasized kinematic parameters and reduced movement variability to provide the partner with implicit cues regarding the action to be jointly performed. Thus, Leaders make their movements more "communicative" even when not explicitly instructed to do so. Moreover, only when acting in the role of Follower did participants tend to imitate the Leader, even in complementary actions where imitation is detrimental to joint performance. Our results show that mimicking and signaling are implemented in joint actions according to the interactional role of the agent, which in turn is reflected in the kinematics of each partner.

Interaction vs. observation: distinctive modes of social cognition in human brain and behavior? A combined fMRI and eye-tracking study

Human cognition has usually been approached on the level of individual minds and brains, but social interaction is a challenging case. Is it best thought of as a self-contained individual cognitive process aiming at an "understanding of the other," or should it rather be approached as an collective, inter-personal process where individual cognitive components interact on a moment-to-moment basis to form coupled dynamics? In a combined fMRI and eye-tracking study we directly contrasted these models of social cognition. We found that the perception of situations affording social contingent responsiveness (e.g., someone offering or showing you an object) elicited activations in regions of the right posterior temporal sulcus and yielded greater pupil dilation corresponding to a model of coupled dynamics (joint action). In contrast, the social-cognitive perception of someone "privately" manipulating an object elicited activation in medial prefrontal cortex, the right inferior frontal gyrus and right inferior parietal lobus, regions normally associated with Theory of Mind and with the mirror neuron system. Our findings support a distinction in social cognition between social observation and social interaction, and demonstrate that simple ostensive cues may shift participants' experience, behavior, and brain activity between these modes. The identification of a distinct, interactive mode has implications for research on social cognition, both in everyday life and in clinical conditions.

And yet they act together: interpersonal perception modulates visuo-motor interference and mutual adjustments during a joint-grasping task

Prediction of “when” a partner will act and “what” he is going to do is crucial in joint-action contexts. However, studies on face-to-face interactions in which two people have to mutually adjust their movements in time and space are lacking. Moreover, while studies on passive observation have shown that somato-motor simulative processes are disrupted when the observed actor is perceived as an out-group or unfair individual, the impact of interpersonal perception on joint-actions has never been directly addressed. Here we explored this issue by comparing the ability of pairs of participants who did or did not undergo an interpersonal perception manipulation procedure to synchronise their reach-to-grasp movements during: i) a guided interaction, requiring pure temporal reciprocal coordination, and ii) a free interaction, requiring both time and space adjustments. Behavioural results demonstrate that while in neutral situations free and guided interactions are equally challenging for participants, a negative interpersonal relationship improves performance in guided interactions at the expense of the free interactive ones. This was paralleled at the kinematic level by the absence of movement corrections and by low movement variability in these participants, indicating that partners cooperating within a negative interpersonal bond executed the cooperative task on their own, without reciprocally adapting to the partner's motor behaviour. Crucially, participants' performance in the free interaction improved in the manipulated group during the second experimental session while partners became interdependent as suggested by higher movement variability and by the appearance of interference between the self-executed actions and those observed in the partner. Our study expands current knowledge about on-line motor interactions by showing that visuo-motor interference effects, mutual motor adjustments and motor-learning mechanisms are influenced by social perception.

Interactions between visual and motor areas during the recognition of plausible actions as revealed by magnetoencephalography

Several studies have shown activation of the mirror neuron system (MNS), comprising the temporal, posterior parietal, and sensorimotor areas when observing plausible actions, but far less is known on how these cortical areas interact during the recognition of a plausible action. Here, we recorded neural activity with magnetoencephalography while subjects viewed point-light displays of biologically plausible and scrambled versions of actions. We were interested in modulations of oscillatory activity and, specifically, in coupling of oscillatory activity between visual and motor areas. Both plausible and scrambled actions elicited modulations of θ (5-7 Hz), α (7-13 Hz), β (13-35 Hz), and γ (55-100 Hz) power within visual and motor areas. When comparing between the two actions, we observed sequential and spatially distinct increases of γ (∼65 Hz), β (∼25 Hz), and α (∼11 Hz) power between 0.5 and 1.3 s in parieto-occipital, sensorimotor, and left temporal areas. In addition, significant clusters of γ (∼65 Hz) and α/β (∼15 Hz) power decrease were observed in right temporal and parieto-occipital areas between 1.3 and 2.0 s. We found β-power in sensorimotor areas to be positively correlated on a trial-by-trial basis with parieto-occipital γ and left temporal α-power for the plausible but not for the scrambled condition. These results provide new insights in the neuronal oscillatory activity of the areas involved in the recognition of plausible action movements and their interaction. The power correlations between specific areas underscore the importance of interactions between visual and motor areas of the MNS during the recognition of a plausible action.