How preschoolers and adults represent their joint action partner's behavior

Atypical and variable attention patterns reveal reduced contextual priors in children with autism spectrum disorder

Accumulating evidence suggests that individuals with autism spectrum disorder (ASD) show impairments in using contextual priors to predict others' actions and make intention inference. Yet less is known about whether and how children with ASD acquire contextual priors during action observation and how contextual priors relate to their action prediction and intention inference. To form proper contextual priors, individuals need to observe the social scenes in a reliable manner and focus on socially relevant information. By employing a data-driven scan path method and areas of interest (AOI)-based analysis, the current study investigated how contextual priors would relate to action prediction and intention understanding in 4-to-9-year-old children with ASD (N = 56) and typically developing (TD) children (N = 50) during free viewing of dynamic social scenes with different intentions. Results showed that children with ASD exhibited higher intra-subject variability when scanning social scenes and reduced attention to socially relevant areas. Moreover, children with high-level action prediction and intention understanding showed lower intra-subject variability and increased attention to socially relevant areas. These findings suggest that altered fixation patterns might restrain children with ASD from acquiring proper contextual priors, which has cascading downstream effects on their action prediction and intention understanding.

Neuromodulation of the Left Inferior Frontal Cortex Affects Social Monitoring during Motor Interactions

Motor interactions require observing and monitoring a partner's performance as the interaction unfolds. Studies in monkeys suggest that this form of social monitoring might be mediated by the activity of the ventral premotor cortex (vPMc), a critical brain region in action observation and motor planning. Our previous fMRI studies in humans showed that the left vPMc is indeed recruited during social monitoring, but its causal role is unexplored. In three experiments, we applied online anodal or cathodal transcranial direct current stimulation over the left lateral frontal cortex during a music-like interactive task to test the hypothesis that neuromodulation of the left vPMc affects participants' performance when a partner violates the agent's expectations. Participants played short musical sequences together with a virtual partner by playing one note each in turn-taking. In 50% of the trials, the partner violated the participant's expectations by generating the correct note through an unexpected movement. During sham stimulation, the partner's unexpected behavior led to a slowdown in the participant's performance (observation-induced posterror slowing). A significant interaction with the stimulation type showed that cathodal and anodal transcranial direct current stimulation induced modulation of the observation-induced posterror slowing in opposite directions by reducing or enhancing it, respectively. Cathodal stimulation significantly reduced the effect compared to sham stimulation. No effect of neuromodulation was found when the partner behaved as expected or when the observed violation occurred within a context that was perceptually matched but noninteractive in nature. These results provide evidence for the critical causal role that the left vPMc might play in social monitoring during motor interactions, possibly through the interplay with other brain regions in the posterior medial frontal cortex.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Encoding interactive scripts at 10 months of age

Understanding action-reaction associations that give origin to interactive scripts (e.g., give-and-take interactions) is essential for appreciating social exchanges. However, studies on infants' action understanding have mainly investigated the case of actions performed by individual agents. Moreover, although extensive literature has explored infants' comprehension of action-effect relationships in object functioning, no study has addressed whether it also plays a role when observing social interactions, an issue we addressed here. In a first study, 10-month-old infants observed short videos of dyadic exchanges. We investigated whether they were able to link specific human gestures directed toward another person to specific vocal reactions in the receiver. We used a double-habituation paradigm in which infants were sequentially habituated to two specific action-reaction associations. In the test phase, infants watched one of the two habituated (Familiar) videos, a video with a reversed action-reaction association (Violation), and a Novel video. Results showed that the infants looked longer at both the Novel and Violation test trials than at the Familiar test trials. In a control study, we show that these results could not be accounted for by associative learning; indeed, learning of the action-reaction association did not occur when the vocalization was not produced by the receiver but only contingent on the agent's action. Thus, we show that 10-month-old infants can encode specific social action-effect relationships during the observation of dyadic interactions and that the interactivity of the social context may be critical to shaping young infants' understanding of others' behaviors.

The contextual cueing effect disappears during joint search in preschool children

During preschool years, children's interacting with others increases. One of the involved developmental skills is task co-representation, through which children aged 5 years and older represent a partner's task in a similar way to their own task. In adults, task co-representation makes participants attend to and form memories of objects relevant to both their own task and their partner's task; however, it is unclear whether children can also form such memories. In Experiment 1, we examined the memory facilitation of joint search using a contextual cueing effect paradigm. Children were presented with search displays repeatedly with the same or random layouts and searched and responded to the target either alone (the single group; n = 32; M_age = 73.6 months, range = 61-80) or with their parent (the joint group; n = 32; M_age = 74.3 months, range = 64-81). Results showed that the search with the same layouts was faster than that with the random layouts for the single group, indicating that children form associative memories of target and distractors relevant to their own task. For the joint group, this effect was not statistically different from that of the single group, with exploratory analysis suggesting that it was disrupted. In Experiment 2, children performed the search with a peer (n = 32; M_age = 72.7 months, range = 67-79) and the effect was also not found. Our findings suggest that the self's and partner's tasks are represented but might not be incorporated into associative memory in 5- and 6-year-old children.

Your action does matter to me: Examining the role of the co-actor's action-effects in resolving the self-other discrimination problem

Sharing a task with another person can introduce the need to discriminate representations that refer to our own action from that of the other person's. The current understanding is that information about the stimulus event drives the self-other discrimination process, as it promotes (via the reactivation of feature codes) the representation that encodes the corresponding action. However, this mechanistic explanation relies on experimental situations in which stimulus event information (e.g., spatial location) is always and directly available. Thus, it remains unclear whether and how we could successfully discriminate between self- and other related action representations in the absence of such information. The present study addressed this unanswered question using a novel joint Simon task-based paradigm. We report the results of three experiments in which we manipulated the availability of stimulus event information into the contralateral space. Our findings demonstrate that participants are able to compensate for the absence of stimulus event information by relying on temporal features of their co-actor's action-effects (Experiment 1). Even more surprising was that participants continued to monitor the temporal features of their co-actor's actions even when given a verbal signal by their co-actor (Experiments 2a), or full access to the common workspace (Experiment 2b). Our results are strong evidence that the representation of actions is not purely stimulus driven. They suggest that the temporal dimension of the other person's actions is able to drive the self-other discrimination process, in the same way as other perceptual dimensions and feature codes that are shared with the stimulus event.

Taking apart what brings us together: The role of action prediction, perspective-taking, and theory of mind in joint action

The ability to act together with others to achieve common goals is crucial in life, yet there is no full consensus on the underlying cognitive skills. While influential theoretical accounts suggest that interaction requires sophisticated insights into others' minds, alternative views propose that high-level social skills might not be necessary because interactions are grounded on sensorimotor predictive mechanisms. At present, empirical evidence is insufficient to decide between the two. This study addressed this issue and explored the association between performance at joint action tasks and cognitive abilities in three domains-action prediction, perspective-taking, and theory of mind-in healthy adults (N = 58). We found that, while perspective-taking played a role in reading the behaviour of others independently of the social context, action prediction abilities specifically influenced the agents' performance in an interactive task but not in a control (social but non-interactive) task. In our study, performance at a theory of mind test did not play any role, as confirmed by Bayesian analyses. The results suggest that, in adults, sensorimotor predictive mechanisms might play a significant and specific role in supporting interpersonal coordination during motor interactions. We discuss the implications of our findings for the contrasting theoretical views described earlier and propose a way they might be partly reconciled.

Mechanisms for mutual support in motor interactions

What is the key to successful interaction? Is it sufficient to represent a common goal, or does the way our partner achieves that goal count as well? How do we react when our partner misbehaves? We used a turn-taking music-like task requiring participants to play sequences of notes together with a partner, and we investigated how people adapt to a partner's error that violates their expectations. Errors consisted of either playing a wrong note of a sequence that the agents were playing together (thus preventing the achievement of the joint goal) or playing the expected note with an unexpected action. In both cases, we found post-error slowing and inaccuracy suggesting the participants' implicit tendency to correct the partner's error and produce the action that the partner should have done. We argue that these "joint" monitoring processes depend on the motor predictions made within a (dyadic) motor plan and may represent a basic mechanism for mutual support in motor interactions.

Becoming better together: The early development of interpersonal coordination

Crucial for interacting successfully with other people is the ability to coordinate one's actions with those of others. Interpersonal coordination can be planned or emergent (spontaneous). Although typically easy for adults, coordinating successfully and smoothly with others may be far from trivial for infants and toddlers. What do we know about the developmental trajectory of interpersonal coordination in the first years of life? Which processes play a role in successfully coordinating with others? And how does the development of interpersonal coordination impact other aspects of children's development? In this chapter, we review when and how infants and young children develop successful interpersonal coordination skills (planned and emergent) in early childhood. We argue that insights from the field of cognitive (neuro-) science have significantly advanced our knowledge on which social-cognitive processes underlie interpersonal coordination and its development. In particular, we discuss four important social-cognitive processes; monitoring and predicting others' actions as well as planning and controlling one's own actions. We then present findings on the impact of interpersonal coordination on young children's social understanding, their prosocial behavior and affiliation. Together, we conclude that for future research on the development of interpersonal coordination interdisciplinary exchanges between fields like cognitive (neuro-) science and developmental science offer promising avenues.

Age-group differences in beginning-state comfort reveal an increase in motor planning capabilities

Objects can be grasped in different ways to ensure a movement plan is aligned with the intended action. The current study assessed grasp posture in joint action object manipulation in children (ages 6–11, n = 68), young adults ( n = 21), and older adults ( n = 23). Participants performed two actions (pickup and pass; pickup and pass for use) within two movement contexts (using a dowel as if it were the actual object; actual object use), using two objects (glass and hammer) that differed in use-dependent experience. Beginning-state comfort (prioritizing a comfortable initial hand posture for an object recipient) was assessed. Taken together, findings support the notion that the ability to anticipate the intended action, and thus consider an action partner in one’s action plan, increases with age. With age and use-dependent experience, it can be argued that there is a shift from stimulus-driven, familiar responses, to considering affordances and task demands. Together, findings add to our understanding of changes in motor planning capabilities across the life span.

Evidence for a dyadic motor plan in joint action

What mechanisms distinguish interactive from non-interactive actions? To answer this question we tested participants while they took turns playing music with a virtual partner: in the interactive joint action condition, the participants played a melody together with their partner by grasping (C note) or pressing (G note) a cube-shaped instrument, alternating in playing one note each. In the non-interactive control condition, players’ behavior was not guided by a shared melody, so that the partner’s actions and notes were irrelevant to the participant. In both conditions, the participant’s and partner’s actions were physically congruent (e.g., grasp-grasp) or incongruent (e.g., grasp-point), and the partner’s association between actions and notes was coherent with the participant’s or reversed. Performance in the non-interactive condition was only affected by physical incongruence, whereas joint action was only affected when the partner’s action-note associations were reversed. This shows that task interactivity shapes the sensorimotor coding of others’ behaviors, and that joint action is based on active prediction of the partner’s action effects rather than on passive action imitation. We suggest that such predictions are based on Dyadic Motor Plans that represent both the agent’s and the partner’s contributions to the interaction goal, like playing a melody together.