Enhancing motor imagery practice using synchronous action observation

In this paper, we discuss a variety of ways in which practising motor actions by means of motor imagery (MI) can be enhanced via synchronous action observation (AO), that is, by AO + MI. We review the available research on the (mostly facilitatory) behavioural effects of AO + MI practice in the early stages of skill acquisition, discuss possible theoretical explanations, and consider several issues related to the choice and presentation schedules of suitable models. We then discuss considerations related to AO + MI practice at advanced skill levels, including expertise effects, practical recommendations such as focussing attention on specific aspects of the observed action, using just-ahead models, and possible effects of the perspective in which the observed action is presented. In section "Coordinative AO + MI", we consider scenarios where the observer imagines performing an action that complements or responds to the observed action, as a promising and yet under-researched application of AO + MI training. In section "The dual action simulation hypothesis of AO + MI", we review the neurocognitive hypothesis that AO + MI practice involves two parallel action simulations, and we consider opportunities for future research based on recent neuroimaging work on parallel motor representations. In section "AO + MI training in motor rehabilitation", we review applications of AO, MI, and AO + MI training in the field of neurorehabilitation. Taken together, this evidence-based, exploratory review opens a variety of avenues for future research and applications of AO + MI practice, highlighting several clear advantages over the approaches of purely AO- or MI-based practice.

Potential benefits of synchronous action observation and motor imagery: a commentary on Eaves et al. 2022

In a recent Psychological Research article, Eaves et al. (2022) review the literature on how motor imagery (MI) practice combined with action observation (AO) enhances motor performance. The authors propose that the synchronous form of AO and MI (AOMI) affords unique benefits to performance that are not possible when the two interventions are performed asynchronously. We discuss three questions raised by Eaves et al.'s review: (1) are there any clear advantages to synchronous AOMI? (2) Are there super-additive benefits to AOMI, and if so, are they unique to synchronous AOMI? (3) How might coordinative AOMI, in which people imagine complementary actions, facilitate joint actions?

Motor-related cortical oscillations distinguish one's own from a partner's contributions to a joint action

The ability to distinguish between one's own and others' actions is a requirement for successful joint action. Such a distinction might be supported by dissociable motor activity underlying each partner's individual contributions to the joint action. However, little research has directly compared motor activity associated with one's own vs. others' actions during joint action. The current study investigated whether motor-related cortical oscillations distinguish between self- and partner-produced actions when partners take turns producing taps to meet a joint timing goal. Across two experiments, the degree of beta suppression differentiated one's own from a partner's actions, with more suppression occurring during one's own actions than during a partner's actions. Self-partner differences in mu suppression were also evident, particularly when partners produced actions in succession. Increased beta suppression was also observed during partners' actions when they were followed by one's own actions, suggesting that the coordination demands imposed by the joint action could affect the pattern of beta reactivity during a turn-taking joint action. Together, these findings demonstrate that dynamic patterns of motor activity underpin successful joint action and that periods of distinct motor activity are associated with one's own contributions to a joint action.

Me or we? Action-outcome learning in synchronous joint action

Goal-directed behaviour requires mental representations that encode instrumental relationships between actions and their outcomes. The present study investigated how people acquire representations of joint actions where co-actors perform synchronized action contributions to produce joint outcomes in the environment. Adapting an experimental procedure to assess individual action-outcome learning, we tested whether co-acting individuals link jointly produced action outcomes to individual-level features of their own action contributions or to group-level features of their joint action instead. In a learning phase, pairs of participants produced musical chords by synchronizing individual key press responses. In a subsequent test phase, the previously produced chords were presented as imperative stimuli requiring forced-choice responses by both pair members. Stimulus-response mappings were systematically manipulated to be either compatible or incompatible with the individual and joint action-outcome mappings of the preceding learning phase. Only joint but not individual compatibility was found to modulate participants' performance in the test phase. Yet, opposite to predictions of associative accounts of action-outcome learning, jointly incompatible mappings between learning and test phase resulted in better performance. We discuss a possible explanation of this finding, proposing that pairs' group-level learning experience modulated how participants encoded ambiguous task instructions in the test phase. Our findings inform current debates about mechanistic explanations of action-outcome learning effects and provide novel evidence that joint action is supported by dedicated mental representations encoding own and others' actions on a group level.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.

Unveiling the invisible: receivers use object weight cues for grip force planning in handover actions

Handover actions are part of our daily lives. Whether it is the milk carton at the breakfast table or tickets at the box office, we usually perform these joint actions without much conscious attention. The individual actions involved in handovers, that have already been studied intensively at the level of individual actions, are grasping, lifting, and transporting objects. Depending on the object's properties, actors must plan their execution in order to ensure smooth and efficient object transfer. Therefore, anticipatory grip force scaling is crucial. Grip forces are planned in anticipation using weight estimates based on experience or visual cues. This study aimed to investigate whether receivers are able to correctly estimate object weight by observing the giver's kinematics. For this purpose, handover actions were performed with 20 dyads, manipulating the participant role (giver/receiver) and varying the size and weight of the object. Due to the random presentation of the object weight and the absence of visual cues, the participants were unaware of the object weight from trial to trial. Kinematics were recorded with a motion tracking system and grip forces were recorded with customized test objects. Peak grip force rates were used as a measure of anticipated object weight. Results showed that receiver kinematics are significantly affected by object weight. The peak grip force rates showed that receivers anticipate object weight, but givers not. This supports the hypothesis that receivers obtain information about the object weight by observing giver's kinematics and integrating this information into their own action execution.

Chimpanzees demonstrate a behavioural signature of human joint action

The strength of human society can largely be attributed to the tendency to work together to achieve outcomes that are not possible alone. Effective social coordination benefits from mentally representing a partner's actions. Specifically, humans optimize social coordination by forming internal action models adapted to joint rather than individual task demands. To what extent do humans share the cognitive mechanisms that support optimal human coordination and collaboration with other species? An ecologically inspired joint handover-to-retrieve task was systematically manipulated across several experiments to assess whether joint action planning in chimpanzees reflects similar patterns to humans. Chimpanzees' chosen handover locations shifted towards the location of the experimenter's free or unobstructed hand, suggesting they represent the constraints of the joint task even though their individual half of the task was unobstructed. These findings indicate that chimpanzees and humans may share common cognitive mechanisms or predispositions that support joint action.

Enhancing human-human musical interaction through kinesthetic haptic feedback using wearable exoskeletons: theoretical foundations, validation scenarios, and limitations

In this perspective paper, we explore the use of haptic feedback to enhance human-human interaction during musical tasks. We start by providing an overview of the theoretical foundation that underpins our approach, which is rooted in the embodied music cognition framework, and by briefly presenting the concepts of action-perception loop, sensorimotor coupling and entrainment. Thereafter, we focus on the role of haptic information in music playing and we discuss the use of wearable technologies, namely lightweight exoskeletons, for the exchange of haptic information between humans. We present two experimental scenarios in which the effectiveness of this technology for enhancing musical interaction and learning might be validated. Finally, we briefly discuss some of the theoretical and pedagogical implications of the use of technologies for haptic communication in musical contexts, while also addressing the potential barriers to the widespread adoption of exoskeletons in such contexts.

Social-Motor Coordination Between Peers: Joint Action Developmental Trajectories in ASD and TD

Coordinating a physical movement in time and space with social and nonsocial partners to achieve a shared goal - "joint action" (JA) - characterizes many peer-engagement situations that pose challenges for individuals with autism spectrum disorder (ASD). This cross-sectional study examined development of JA capabilities comparing ASD versus typically developing (TD) groups in early childhood, preadolescence, and adolescence while performing mirroring and complementing JA tasks with social (peer) and nonsocial (computer) partners. Results indicated better motor coordination abilities on computerized tasks than in peer dyads, with larger peer-dyad deficits shown by the ASD group. Developmental growth in JA abilities emerged, but the ASD group lagged behind same-age peers with TD. Socio-motor interventions may offer new channels to facilitate peer engagement in ASD.

Enhancing surgical performance in cardiothoracic surgery with innovations from computer vision and artificial intelligence: a narrative review

When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial. This narrative review synthesises work on technical and non-technical surgical skills, collaborative task performance, and pose estimation to illustrate new opportunities to advance cardiothoracic surgical performance with innovations from computer vision and artificial intelligence. These technological innovations are critically evaluated in terms of the benefits they could offer the cardiothoracic surgical community, and any barriers to the uptake of the technology are elaborated upon. Like some other specialities, cardiothoracic surgery has relatively few opportunities to benefit from tools with data capture technology embedded within them (as is possible with robotic-assisted laparoscopic surgery, for example). In such cases, pose estimation techniques that allow for movement tracking across a conventional operating field without using specialist equipment or markers offer considerable potential. With video data from either simulated or real surgical procedures, these tools can (1) provide insight into the development of expertise and surgical performance over a surgeon's career, (2) provide feedback to trainee surgeons regarding areas for improvement, (3) provide the opportunity to investigate what aspects of skill may be linked to patient outcomes which can (4) inform the aspects of surgical skill which should be focused on within training or mentoring programmes. Classifier or assessment algorithms that use artificial intelligence to 'learn' what expertise is from expert surgical evaluators could further assist educators in determining if trainees meet competency thresholds. With collaborative efforts between surgical teams, medical institutions, computer scientists and researchers to ensure this technology is developed with usability and ethics in mind, the developed feedback tools could improve cardiothoracic surgical practice in a data-driven way.

Putting it Together, Together

People are not as fast or as strong as many other creatures that evolved around us. What gives us an evolutionary advantage is working together to achieve common aims. Coordinating joint action begins at a tender age with such cooperative activities as alternating babbling and clapping games. Adult joint activities are far more complex and use multiple means of coordination. Joint action has attracted qualitative analyses by sociolinguists, cognitive scientists, and philosophers as well as empirical analyses and theories by cognitive scientists. Here, we analyze how joint action is spontaneously coordinated from start to finish in a novel complex real-life joint activity, assembling a piece of furniture, a task that captures the essentials of joint action, collaborators, things in the world, and communicative devices. Pairs of strangers assembled a TV cart from a stack of parts and a photo of the completed cart. Coordination prior to each assembly action was coded as explicit, using speech or gesture, or implicit, actions that both advanced the task and communicated the next step. Initial planning relied on explicit communication about structure, but not action nor division of labor, which were improvised. That served to establish a joint representation of the goal that informed actions and monitored progress. As assembly progressed, coordination was increasingly implicit, through actions alone. Joint action is a dynamic interplay of explicit and implicit signaling with respect to things in the world to coordinate ongoing progress, guided by a shared representation of the goal.

Flexible Cultural Learning Through Action Coordination

The cultural transmission of technical know-how has proven vital to the success of our species. The broad diversity of learning contexts and social configurations, as well as the various kinds of coordinated interactions they involve, speaks to our capacity to flexibly adapt to and succeed in transmitting vital knowledge in various learning contexts. Although often recognized by ethnographers, the flexibility of cultural learning has so far received little attention in terms of cognitive mechanisms. We argue that a key feature of the flexibility of cultural learning is that both the models and learners recruit cognitive mechanisms of action coordination to modulate their behavior contingently on the behavior of their partner, generating a process of mutual adaptation supporting the successful transmission of technical skills in diverse and fluctuating learning environments. We propose that the study of cultural learning would benefit from the experimental methods, results, and insights of joint-action research and, complementarily, that the field of joint-action research could expand its scope by integrating a learning and cultural dimension. Bringing these two fields of research together promises to enrich our understanding of cultural learning, its contextual flexibility, and joint action coordination.

An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action

A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.

Joint spatial-temporal association of response codes (STEARC) effect: Mental timelines embodied interpersonally

A co-action task was used to explore the effect of social interactions on temporal judgements, in comparison with an individual-task condition. In Experiment 1, the co-actors sat either individually (individual condition) or alongside a partner (joint condition) in front of a monitor and then responded to time-related words (e.g. yesterday, tomorrow). In Experiment 2, co-actors sat separately in front of two monitors and categorized the words either individually or jointly. Participants' response times to past- and future-related words in the individual conditions of both experiments had no significant difference. However, in the joint conditions, the responses were faster when the past-time words were mapped toward the participants on the left than when future-time words were mapped toward them. Our data support the existence of a specific mapping between past-time-left space and future-time-right space. This suggests that the two cooperators probably shared a similar mental timeline.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Grounded Cognition Entails Linguistic Relativity: Response to Commentators

In this paper, I respond to eight commentaries on my target article called "Grounded cognition entails linguistic relativity: A neglected implication of a major semantic theory." The commentaries span a broad range of disciplines and perspectives. I have organized my response around the following topics: (1) an introductory synopsis of my main argument; (2) grounded versus amodal theories of concepts; (3) language-specific versus language-independent concepts; (4) language, culture, and cognition; (5) language itself as a source of conceptual grounding; (6) abstract concepts, linguistic relativity, and contextual and individual variability; (7) word meanings as language-specific predictions; and (8) some final remarks about the importance of cross-linguistic diversity.

An Integrated Model of Collaborative Skill Acquisition: Anticipation, Control Tuning, and Role Adoption

We studied collaborative skill acquisition in a dynamic setting with the game Co-op Space Fortress. While gaining expertise, the majority of subjects became increasingly consistent in the role they adopted without being able to communicate. Moreover, they acted in anticipation of the future task state. We constructed a collaborative skill acquisition model in the cognitive architecture ACT-R that reproduced subject skill acquisition trajectory. It modeled role adoption through reinforcement learning and predictive processes through motion extrapolation and learned relevant control parameters using both a reinforcement learning procedure and a new to ACT-R supervised learning procedure. This is the first integrated cognitive model of collaborative skill acquisition and, as such, gives us valuable insights into the multiple cognitive processes that are involved in learning to collaborate.

Motor performance in joint action tasks: The impact of dyadic motive fit

In many daily situations, two or more individuals need to coordinate their actions to achieve a common goal and perform successfully. Past research on joint action has predominantly focused on the question of how such interactions are accomplished. Here we focus on the impact of inter-individual, trait-like differences to predict joint action performance. More specifically, we examined whether performance in a joint action task is moderated by the (in)congruence of individuals' motive dispositions. To this end, 27 dyads performed a joint action task in which they had to navigate a ball through a maze with each partner using a joystick and each being responsible for either moving the ball along the x-axis or the y-axis. As dependent measures, we analyzed dyads' performance (times and errors). As trait-like predictors, we assessed implicit and explicit motives by means of the Picture Story Exercise and the Unified Motive Scale, respectively. Linear regression modeling revealed that congruent explicit affiliation motives predict faster best times and that higher congruent implicit achievement motives are associated with reduced errors. Exploratory Response Surface Analyses yielded identical results for the affiliation motive. These findings provide initial evidence to suggest that interindividual differences and in motives as well as their fit are related to joint action performance. Future directions of this new paradigm and novel ways to analyze dyadic motive fits and their relation to joint action performance are discussed.

A systematic review of handover actions in human dyads

Introduction

Handover actions are joint actions in which an object is passed from one actor to another. In order to carry out a smooth handover action, precise coordination of both actors' movements is of critical importance. This requires the synchronization of both the kinematics of the reaching movement and the grip forces of the two actors during the interaction. Psychologists, for example, may be interested in studying handover actions in order to identify the cognitive mechanisms underlying the interaction of two partners. In addition, robotic engineers may utilize insights from sensorimotor information processing in human handover as models for the design controllers in robots in hybrid (human-robot) interaction scenarios. To date, there is little knowledge transfer between researchers in different disciplines and no common framework or language for the study of handover actions.

Methods

For this reason, we systematically reviewed the literature on human-human handover actions in which at least one of the two types of behavioral data, kinematics or grip force, was measured.

Results

Nine relevant studies were identified. The different methodologies and results of the individual studies are here described and contextualized.

Discussion

Based on these results, a common framework is suggested that, provides a distinct and straightforward language and systematics for use in future studies. We suggest to term the actors as giver and receiver, as well as to subdivide the whole action into four phases: (1) Reach and grasp, (2) object transport, (3) object transfer, and (4) end of handover to comprehensively and clearly describe the handover action. The framework aims to foster the necessary exchange between different scientific disciplines to promote research on handover actions. Overall, the results support the assumption that givers adapt their executions according to the receiver's intentions, that the start of the release of the object is processed feedforward and that the release process is feedback-controlled in the transfer phase. We identified the action planning of the receiver as a research gap.

Not just in sync: Relations between partners' actions influence the sense of joint agency during joint action

When people perform joint actions together, they often experience a sense of joint agency ("we did that together"). The current study investigated whether relations between partners' actions within joint actions that require precise interpersonal synchrony influence joint agency, above and beyond the degree of synchrony partners achieve. We employed a mixed-methods approach that combined a quantitative experiment with a qualitative analysis of post-experiment interviews. Partners produced synchronized tone sequences that comprised either constant pitch sequences (simple temporal alignment between partners' actions) or musical duets (complex metrical and harmonic relations between partners' actions). Participants reported stronger joint agency for duets than constant pitches, when comparing trials with equally good synchronization. Post-experiment interviews revealed that joint agency was also influenced by participants' knowledge of the music and their perceptions of task performance, difficulty, and enjoyability. These findings further our understanding of joint agency for joint actions that require precise interpersonal synchrony.

Face2face: advancing the science of social interaction

Face-to-face interaction is core to human sociality and its evolution, and provides the environment in which most of human communication occurs. Research into the full complexities that define face-to-face interaction requires a multi-disciplinary, multi-level approach, illuminating from different perspectives how we and other species interact. This special issue showcases a wide range of approaches, bringing together detailed studies of naturalistic social-interactional behaviour with larger scale analyses for generalization, and investigations of socially contextualized cognitive and neural processes that underpin the behaviour we observe. We suggest that this integrative approach will allow us to propel forwards the science of face-to-face interaction by leading us to new paradigms and novel, more ecologically grounded and comprehensive insights into how we interact with one another and with artificial agents, how differences in psychological profiles might affect interaction, and how the capacity to socially interact develops and has evolved in the human and other species. This theme issue makes a first step into this direction, with the aim to break down disciplinary boundaries and emphasizing the value of illuminating the many facets of face-to-face interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Predicting and understanding human action decisions during skillful joint-action using supervised machine learning and explainable-AI

This study investigated the utility of supervised machine learning (SML) and explainable artificial intelligence (AI) techniques for modeling and understanding human decision-making during multiagent task performance. Long short-term memory (LSTM) networks were trained to predict the target selection decisions of expert and novice players completing a multiagent herding task. The results revealed that the trained LSTM models could not only accurately predict the target selection decisions of expert and novice players but that these predictions could be made at timescales that preceded a player's conscious intent. Importantly, the models were also expertise specific, in that models trained to predict the target selection decisions of experts could not accurately predict the target selection decisions of novices (and vice versa). To understand what differentiated expert and novice target selection decisions, we employed the explainable-AI technique, SHapley Additive explanation (SHAP), to identify what informational features (variables) most influenced modelpredictions. The SHAP analysis revealed that experts were more reliant on information about target direction of heading and the location of coherders (i.e., other players) compared to novices. The implications and assumptions underlying the use of SML and explainable-AI techniques for investigating and understanding human decision-making are discussed.

Emergent and planned interpersonal synchronization are both sensitive to 'tempo aftereffect contagion'

Interpersonal synchronization is fundamental for motor coordination during social interactions. Discerning emergent (entrainment) from planned synchronization represents a non-trivial issue in visually bonded individuals acting together, as well as assessing whether inter-individual differences, e.g., in autistic traits, modulate both types of synchronization. In a visuomotor finger-tapping task, two participants replicated a target tempo either synchronizing ('joint' condition) or not ('non-interactive' condition, 'non-int') with each other. One participant was exposed ('induced') to tempo aftereffect (a medium tempo seems faster or slower after exposure to slower or faster inducing tempi), but not the other participant ('not induced'); thus they had different timing perceptions of the same target. We assessed to what degree emergent and/or planned synchronization affected dyads by analyzing inter-tap-intervals, synchronization indexes, and cross-correlation coefficients. Results revealed a 'tempo aftereffect contagion': inter-tap-intervals of both induced and not-induced participants showed aftereffect in both the joint and non-int conditions. Moreover, aftereffects did not correlate across conditions suggesting they might be due to (at least in part) different processes, but the propensity for tempo aftereffect contagion correlated with individuals' autistic traits only in the non-int condition. Finally, participants co-adjusted their tapping more in the joint condition than in the non-int one, as confirmed by higher synchronization indexes and the mutual adaptation pattern of cross-correlation coefficients. Altogether, these results show the subtle interplay between emergent and planned interpersonal synchronization mechanisms that act on a millisecond timescale independently from synching or not with the partner.

The contextual cueing effect disappears during joint search in preschool children

During preschool years, children's interacting with others increases. One of the involved developmental skills is task co-representation, through which children aged 5 years and older represent a partner's task in a similar way to their own task. In adults, task co-representation makes participants attend to and form memories of objects relevant to both their own task and their partner's task; however, it is unclear whether children can also form such memories. In Experiment 1, we examined the memory facilitation of joint search using a contextual cueing effect paradigm. Children were presented with search displays repeatedly with the same or random layouts and searched and responded to the target either alone (the single group; n = 32; M_age = 73.6 months, range = 61-80) or with their parent (the joint group; n = 32; M_age = 74.3 months, range = 64-81). Results showed that the search with the same layouts was faster than that with the random layouts for the single group, indicating that children form associative memories of target and distractors relevant to their own task. For the joint group, this effect was not statistically different from that of the single group, with exploratory analysis suggesting that it was disrupted. In Experiment 2, children performed the search with a peer (n = 32; M_age = 72.7 months, range = 67-79) and the effect was also not found. Our findings suggest that the self's and partner's tasks are represented but might not be incorporated into associative memory in 5- and 6-year-old children.

Understanding others' distal goals from proximal communicative actions

Many social interactions require individuals to coordinate their actions and to inform each other about their goals. Often these goals concern an immediate (i.e., proximal) action, as when people give each other a brief handshake, but they sometimes also refer to a future (i.e. distal) action, as when football players perform a passing sequence. The present study investigates whether observers can derive information about such distal goals by relying on kinematic modulations of an actor's instrumental actions. In Experiment 1 participants were presented with animations of a box being moved at different velocities towards an apparent endpoint. The distal goal, however, was for the object to be moved past this endpoint, to one of two occluded target locations. Participants then selected the location which they considered the likely distal goal of the action. As predicted, participants were able to detect differences in movement velocity and, based on these differences, systematically mapped the movements to the two distal goal locations. Adding a distal goal led to more variation in the way participants mapped the observed movements onto different target locations. The results of Experiments 2 and 3 indicated that this cannot be explained by difficulties in perceptual discrimination. Rather, the increased variability likely reflects differences in interpreting the underlying connection between proximal communicative actions and distal goals. The present findings extend previous research on sensorimotor communication by demonstrating that communicative action modulations are not restricted to predicting proximal goals but can also be used to infer more distal goals.

The role of reciprocity in dynamic interpersonal coordination of physiological rhythms

A central question in social cognition research is how people coordinate their bodily rhythms, and how important reciprocity of interaction is for interpersonal coordination. Previous research has primarily focused on interpersonal action coordination, which has been shown to be facilitated by mechanisms of prediction and mutual adaption. Recent research is beginning to show that people also coordinate their physiological rhythms (i.e., respiration, heart rhythms) when they engage in natural forms of social interaction, such as conversation, choir singing, and rituals. However, the mechanisms underlying interpersonal physiological synchronization remain obscure, and could provide insight into the dynamic mechanisms that underlie continuous and regulatory, rather than instrumental, joint actions. Using real-time biofeedback, we investigated whether people synchronize their respiration rhythms by forming a joint dynamical system through reciprocity of interaction, or by producing more predictable respiration rhythms. Our results show that people are more in-phase synchronized but less phase-locked when interacting bidirectionally versus unidirectionally (online), but there is no difference in synchronization during reciprocal interaction and when adapting unidirectionally (offline) to recordings of respiration signals that emerged during the reciprocal interaction. Moreover, the strength of synchronization is driven by the predictability of the respiration rhythms that emerge in the bidirectional interaction - specifically, the slowing of breathing rhythms and stability of breathing frequencies - rather than the online mutual adaptation itself. These results suggest that coordination is facilitated by the emergence of predictable breathing patterns, rather than reciprocity itself.

Smaller preferred interpersonal distance for joint versus parallel action

During social interaction, humans prefer to keep a certain distance between themselves and other individuals. This preferred 'interpersonal distance' (IPD) is known to be sensitive to social context, and in the present study we aimed to further investigate the extent to which IPD is affected by the specific type of social interaction. In particular, we focused on the contrast between joint actions, where two or more individuals coordinate their actions in space and time to achieve a shared goal, and parallel actions, where individuals act alongside each other but individually. We predicted that joint action would be associated with a smaller preferred IPD compared to parallel action. Additionally, given that this research took place in the midst of the COVID-19 pandemic, we aimed to assess whether IPD preferences are affected by individuals' concerns about infection in general, as well as COVID-19 in particular. We predicted that higher individual concerns would be associated with greater preferred IPD. To test these hypotheses, we asked participants to imagine different social scenarios (involving either joint or parallel actions alongside a stranger) and indicate, on a visual scale, their preferred IPD. The results of two experiments (n = 211, n = 212) showed that participants preferred a shorter distance when they imagined acting jointly compared to when they imagined acting in parallel. Moreover, participants who reported higher discomfort for potential pathogen contact and who were more aware of the COVID-19 context in which the study took place preferred a larger IPD in general. Our results provide further evidence that different types of social interaction shape IPD preference. We discuss potential reasons for this phenomenon and highlight remaining questions for future research.

Taking the mystery away from shared intentionality: The straightforward view and its empirical implications

Ordinary language in Western and non-Western cultures individuates shared mental states or experiences as unitary interpersonal events that belong to more than one individual. However, a default assumption in modern Western thought is that, in this regard, ordinary language is either illusory or merely metaphorical: a mental state or experience can belong to only one person. This assumption is called Cartesian eliminativism and is often taken to be foundational in psychology. It follows that any view that contradicts Cartesian eliminativism is a priori suspected of being "mysterious," i.e., of not meeting scientific standards. This paper suggests that the very opposite may be the case. The straightforward view explains how individuals assemble and experience a shared mental state as a unitary whole whose components are distributed among the participants. The naturalistic advantages of such a view are brought to light by focusing on developmental science. Since it explains early shared emotions, goals, and attention merely by relying on domain-general, associative processes, the straightforward view is more parsimonious than current psychological theories. Indeed, it abandons the cumbersome postulates of (i) multi-level recursive mindreading and (ii) a special, conceptually elusive phenomenal quality. I outline the distinctive developmental predictions of the view and discuss how it accounts for the functions of shared mental states. As a reductionist, non-eliminativist approach, the straightforward view promises to be viable also for cognitive scientists who have so far worked within the Cartesian framework due to a lack of a rigorous and sufficiently developed alternative.

Revisiting the human 'interaction engine': comparative approaches to social action coordination

The evolution of language was likely facilitated by a special predisposition for social interaction, involving a set of communicative and cognitive skills summarized as the 'interaction engine'. This assemblage seems to emerge early in development, to be found universally across cultures, and to enable participation in sophisticated joint action through the addition of spoken language. Yet, new evidence on social action coordination and communication in nonhuman primates warrants an update of the interaction engine hypothesis, particularly with respect to the evolutionary origins of its specific ingredients. However, one enduring problem for comparative research results from a conceptual gulf between disciplines, rendering it difficult to test concepts derived from human interaction research in nonhuman animals. The goal of this theme issue is to make such concepts accessible for comparative research, to promote a fruitful interdisciplinary debate on social action coordination as a new arena of research, and to enable mutual fertilization between human and nonhuman interaction research. In consequence, we here consider relevant theoretical and empirical research within and beyond this theme issue to revisit the interaction engine's shared, convergently derived and uniquely derived ingredients preceding (or perhaps in the last case, succeeding) human language. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

The Components of Interpersonal Synchrony in the Typical Population and in Autism: A Conceptual Analysis

Interpersonal synchrony - the tendency for social partners to temporally co-ordinate their behaviour when interacting - is a ubiquitous feature of social interactions. Synchronous interactions play a key role in development, and promote social bonding and a range of pro-social behavioural outcomes across the lifespan. The process of achieving and maintaining interpersonal synchrony is highly complex, with inputs required from across perceptual, temporal, motor, and socio-cognitive domains. In this conceptual analysis, we synthesise evidence from across these domains to establish the key components underpinning successful non-verbal interpersonal synchrony, how such processes interact, and factors that may moderate their operation. We also consider emerging evidence that interpersonal synchrony is reduced in autistic populations. We use our account of the components contributing to interpersonal synchrony in the typical population to identify potential points of divergence in interpersonal synchrony in autism. The relationship between interpersonal synchrony and broader aspects of social communication in autism are also considered, together with implications for future research.

Social Action Effects: Representing Predicted Partner Responses in Social Interactions

The sociomotor framework outlines a possible role of social action effects on human action control, suggesting that anticipated partner reactions are a major cue to represent, select, and initiate own body movements. Here, we review studies that elucidate the actual content of social action representations and that explore factors that can distinguish action control processes involving social and inanimate action effects. Specifically, we address two hypotheses on how the social context can influence effect-based action control: first, by providing unique social features such as body-related, anatomical codes, and second, by orienting attention towards any relevant feature dimensions of the action effects. The reviewed empirical work presents a surprisingly mixed picture: while there is indirect evidence for both accounts, previous studies that directly addressed the anatomical account showed no signs of the involvement of genuinely social features in sociomotor action control. Furthermore, several studies show evidence against the differentiation of social and non-social action effect processing, portraying sociomotor action representations as remarkably non-social. A focus on enhancing the social experience in future studies should, therefore, complement the current database to establish whether such settings give rise to the hypothesized influence of social context.

Individual differences in co-representation in three monkey species (Callithrix jacchus, Sapajus apella and Macaca tonkeana) in the joint Simon task: the role of social factors and inhibitory control

Behavioral coordination is involved in many forms of primate interactions. Co-representation is the simultaneous mental representation of one’s own and the partner’s task and actions. It often underlies behavioral coordination and cooperation success. In humans, the dyadic social context can modulate co-representation. Here, we first investigated whether individual differences in co-representation in the joint Simon task in capuchin monkeys and Tonkean macaques can be explained by social factors, namely dyadic grooming and sociality index, rank difference and eigenvector centrality. These factors did not predict variation in co-representation. However, in this specific task, co-representation reduces rather than facilitates joint performance. Automatic co-representation therefore needs to be inhibited or suppressed to maximize cooperation success. We therefore also investigated whether general inhibitory control (detour-reaching) would predict co-representation in the joint Simon task in Tonkean macaques, brown capuchin and marmoset monkeys. Inhibitory control did neither explain individual differences nor species differences, since marmosets were most successful in their joint performance despite scoring lowest on inhibitory control. These results suggest that the animals’ ability to resolve conflicts between self and other representation to increase cooperation success in this task is gradually learned due to frequent exposure during shared infant care, rather than determined by strong general inhibitory control. Further, we conclude that the joint Simon task, while useful to detect co-representation non-invasively, is less suitable for identifying the factors explaining individual differences and thus a more fruitful approach to identify these factors is to design tasks in which co-representation favors, rather than hinders cooperation success.

Understanding Design Features of Music and Language: The Choric/Dialogic Distinction

Music and spoken language share certain characteristics: both consist of sequences of acoustic elements that are combinatorically combined, and these elements partition the same continuous acoustic dimensions (frequency, formant space and duration). However, the resulting categories differ sharply: scale tones and note durations of small integer ratios appear in music, while speech uses phonemes, lexical tone, and non-isochronous durations. Why did music and language diverge into the two systems we have today, differing in these specific features? We propose a framework based on information theory and a reverse-engineering perspective, suggesting that design features of music and language are a response to their differential deployment along three different continuous dimensions. These include the familiar propositional-aesthetic ('goal') and repetitive-novel ('novelty') dimensions, and a dialogic-choric ('interactivity') dimension that is our focus here. Specifically, we hypothesize that music exhibits specializations enhancing coherent production by several individuals concurrently-the 'choric' context. In contrast, language is specialized for exchange in tightly coordinated turn-taking-'dialogic' contexts. We examine the evidence for our framework, both from humans and non-human animals, and conclude that many proposed design features of music and language follow naturally from their use in distinct dialogic and choric communicative contexts. Furthermore, the hybrid nature of intermediate systems like poetry, chant, or solo lament follows from their deployment in the less typical interactive context.

Seeing through the cat's eyes: evidence of a spontaneous perspective taking process using a non-human avatar

In many daily face-to-face interactions, people are able to take the perspective of others, for example, coding right and left based on point-of-view of others. In the present study, we investigated whether observers are able to take the perspective of a non-human figure such as a cat, observing the same effects obtained with human or robot avatars. In both experiments, we used a centrally presented stimulus (i.e. a cat), with its tail lateralized to the left or to the right. Participants had to respond to the side of the tail with a lateralized keypress. In Experiment 1 (spatial perspective taking task), participants were required to explicitly adopt the cat's perspective to respond, whereas in Experiment 2 (SR compatibility task), this was not explicitly required. In both experiments, faster RTs are obtained when the cat is presented back, with a greater difference between front and back views when the tail is on the right; furthermore, there is no temporal modulation of the back-front effect. These common results between the two experiments are interpreted on the basis of the spatial perspective taking processes, elicited voluntarily (Experiment 1) or spontaneously (Experiment 2).

The sense of agency in joint action: An integrative review

When people perform joint actions together, their individual actions (e.g., moving one end of a heavy couch) must be coordinated to achieve a collective goal (e.g., moving the couch across the room). Joint actions pose unique challenges for understanding people's sense of agency, because each person engaged in the joint action can have a sense of agency not only at the individual level (a sense that "I moved my end of the couch" or "My partner moved their end of the couch"), but also at the collective level (a sense that "We moved the couch together"). This review surveys research that has examined people's sense of agency in joint action, including explicit judgments of agency, implicit measures of agency, and first-hand accounts of agency in real-world settings. The review provides a comprehensive summary of the factors that influence individual- and collective-level agency in joint action; reveals the progress that has been made toward understanding different forms of collective-level agency in joint action, including the sense that agency is shared among co-actors and the sense that co-actors are acting as a single unit; and synthesizes evidence concerning the relationships between different measures of implicit agency and individual- versus collective-level agency in joint action. The review concludes by highlighting numerous outstanding questions and promising avenues for future research.

"You're wrong, I'll switch, I'm wrong, I'll stay": How task-switching strategies are modulated by a partner in a multi-task learning protocol

Individuals given control over practice variables make practice decisions based on their current performance. When individuals practice in pairs, the question as to if and how a partner's performance impacts these decisions is of theoretical and practical interest. Here, we evaluated this question in a multi-task learning protocol, where individuals and dyads practiced three, differently timed keystroke sequences. Dyad participants alternated turns with a partner so we could study the immediate consequences of the partner's performance on practice choice. Only one of the partners had choice over the sequence order, the other partner practiced the sequences in either a predetermined blocked or random order. Practice with a partner that had a random-schedule promoted more task-switching in the other partner and had some benefit for retention accuracy. Distinct "own-error" and "partner-error" switching strategies were evidenced, with partners choosing to repeat the same sequence on their next turn when they performed poorly or when their partner performed well. These data show that an individual's practice decisions are influenced by their social context, particularly the practice schedule and patterns of errors in a partner's performance.

Bounded rational response equilibria in human sensorimotor interactions

The Nash equilibrium is one of the most central solution concepts to study strategic interactions between multiple players and has recently also been shown to capture sensorimotor interactions between players that are haptically coupled. While previous studies in behavioural economics have shown that systematic deviations from Nash equilibria in economic decision-making can be explained by the more general quantal response equilibria, such deviations have not been reported for the sensorimotor domain. Here we investigate haptically coupled dyads across three different sensorimotor games corresponding to the classic symmetric and asymmetric Prisoner's Dilemma, where the quantal response equilibrium predicts characteristic shifts across the three games, although the Nash equilibrium stays the same. We find that subjects exhibit the predicted deviations from the Nash solution. Furthermore, we show that taking into account subjects' priors for the games, we arrive at a more accurate description of bounded rational response equilibria that can be regarded as a quantal response equilibrium with non-uniform prior. Our results suggest that bounded rational response equilibria provide a general tool to explain sensorimotor interactions that include the Nash equilibrium as a special case in the absence of information processing limitations.

Exploring the "Dark Matter" of Social Interaction: Systematic Review of a Decade of Research in Spontaneous Interpersonal Coordination

Interpersonal coordination is a research topic that has attracted considerable attention this last decade both due to a theoretical shift from intra-individual to inter-individual processes and due to the development of new methods for recording and analyzing movements in ecological settings. Encompassing spatiotemporal behavioral matching, interpersonal coordination is considered as "social glue" due to its capacity to foster social bonding. However, the mechanisms underlying this effect are still unclear and recent findings suggest a complex picture. Goal-oriented joint action and spontaneous coordination are often conflated, making it difficult to disentangle the role of joint commitment from unconscious mutual attunement. Consequently, the goals of the present article are twofold: (1) to illustrate the rapid expansion of interpersonal coordination as a research topic and (2) to conduct a systematic review of spontaneous interpersonal coordination, summarizing its latest developments and current challenges this last decade. By applying Rapid Automatic Keyword Extraction and Latent Dirichlet Allocation algorithms, keywords were extracted from PubMed and Scopus databases revealing the large diversity of research topics associated with spontaneous interpersonal coordination. Using the same databases and the keywords "behavioral matching," "interactional synchrony," and "interpersonal coordination," 1,213 articles were identified, extracted, and screened following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses protocol. A total of 19 articles were selected using the following inclusion criteria: (1) dynamic and spontaneous interactions between two unacquainted individuals (2) kinematic analyses, and (3) non-clinical and non-expert adult populations. The results of this systematic review stress the proliferation of various definitions and experimental paradigms that study perceptual and/or social influences on the emergence of spontaneous interpersonal coordination. As methods and indices used to quantify interpersonal coordination differ from one study to another, it becomes difficult to establish a coherent picture. This review highlights the need to reconsider interpersonal coordination not as the pinnacle of social interactions but as a complex dynamical process that requires cautious interpretation. An interdisciplinary approach is necessary for building bridges across scattered research fields through opening a dialogue between different theoretical frameworks and consequently provides a more ecological and holistic understanding of human social cognition.

Coordinating With a Robot Partner Affects Neural Processing Related to Action Monitoring

Robots start to play a role in our social landscape, and they are progressively becoming responsive, both physically and socially. It begs the question of how humans react to and interact with robots in a coordinated manner and what the neural underpinnings of such behavior are. This exploratory study aims to understand the differences in human-human and human-robot interactions at a behavioral level and from a neurophysiological perspective. For this purpose, we adapted a collaborative dynamical paradigm from the literature. We asked 12 participants to hold two corners of a tablet while collaboratively guiding a ball around a circular track either with another participant or a robot. In irregular intervals, the ball was perturbed outward creating an artificial error in the behavior, which required corrective measures to return to the circular track again. Concurrently, we recorded electroencephalography (EEG). In the behavioral data, we found an increased velocity and positional error of the ball from the track in the human-human condition vs. human-robot condition. For the EEG data, we computed event-related potentials. We found a significant difference between human and robot partners driven by significant clusters at fronto-central electrodes. The amplitudes were stronger with a robot partner, suggesting a different neural processing. All in all, our exploratory study suggests that coordinating with robots affects action monitoring related processing. In the investigated paradigm, human participants treat errors during human-robot interaction differently from those made during interactions with other humans. These results can improve communication between humans and robot with the use of neural activity in real-time.

Sensory Attenuation of the Auditory P2 Differentiates Self- from Partner-Produced Sounds during Joint Action

Successful human interaction relies on people's ability to differentiate between the sensory consequences of their own and others' actions. Research in solo action contexts has identified sensory attenuation, that is, the selective perceptual or neural dampening of the sensory consequences of self-produced actions, as a potential marker of the distinction between self- and externally produced sensory consequences. However, very little research has examined whether sensory attenuation distinguishes self- from partner-produced sensory consequences in joint action contexts. The current study examined whether sensory attenuation of the auditory N1 or P2 ERPs distinguishes self- from partner-produced tones when pairs of people coordinate their actions to produce tone sequences that match a metronome pace. We did not find evidence of auditory N1 attenuation for either self- or partner-produced tones. Instead, the auditory P2 was attenuated for self-produced tones compared to partner-produced tones within the joint action. These findings indicate that self-specific attenuation of the auditory P2 differentiates the sensory consequences of one's own from others' actions during joint action. These findings also corroborate recent evidence that N1 attenuation may be driven by general rather than action-specific processes and support a recently proposed functional dissociation between auditory N1 and P2 attenuation.

Joint control of visually guided actions involves concordant increases in behavioural and neural coupling

It is often necessary for individuals to coordinate their actions with others. In the real world, joint actions rely on the direct observation of co-actors and rhythmic cues. But how are joint actions coordinated when such cues are unavailable? To address this question, we recorded brain activity while pairs of participants guided a cursor to a target either individually (solo control) or together with a partner (joint control) from whom they were physically and visibly separated. Behavioural patterns revealed that joint action involved real-time coordination between co-actors and improved accuracy for the lower performing co-actor. Concurrent neural recordings and eye tracking revealed that joint control affected cognitive processing across multiple stages. Joint control involved increases in both behavioural and neural coupling - both quantified as interpersonal correlations - peaking at action completion. Correspondingly, a neural offset response acted as a mechanism for and marker of interpersonal neural coupling, underpinning successful joint actions.