Joint action coordination in expert-novice pairs: Can experts predict novices' suboptimal timing?

Potential benefits of synchronous action observation and motor imagery: a commentary on Eaves et al. 2022

In a recent Psychological Research article, Eaves et al. (2022) review the literature on how motor imagery (MI) practice combined with action observation (AO) enhances motor performance. The authors propose that the synchronous form of AO and MI (AOMI) affords unique benefits to performance that are not possible when the two interventions are performed asynchronously. We discuss three questions raised by Eaves et al.'s review: (1) are there any clear advantages to synchronous AOMI? (2) Are there super-additive benefits to AOMI, and if so, are they unique to synchronous AOMI? (3) How might coordinative AOMI, in which people imagine complementary actions, facilitate joint actions?

A Framework for Joint Music Making: Behavioral Findings, Neural Processes, and Computational Models

Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.

The Impact of Limited Previous Motor Experience on Action Possibility Judgments in People with Spinal Muscle Atrophy

Previous studies have shown that people with limited motor capabilities may rely on previous motor experience when making action possibility judgments for others. In the present study, we examined if having limited previous motor experience, as a consequence of spinal muscle atrophy (SMA), alters action possibility judgments. Participants with SMA and neurologically healthy (NH) sex- and age-matched controls performed a perceptual-motor judgment task using the Fitts's law paradigm. Participants observed apparent motion videos of reciprocal aiming movements with varying levels of difficulty. For each movement, participants predicted the shortest movement time (MT) at which a neurologically healthy young adult could accurately perform the task. Participants with SMA predicted significantly longer MTs compared to controls; however, the predicted MTs of both SMA and NH participants exhibited a Fitts's law relationship (i.e., the predicted MTs significantly increased as movement difficulty increased). Overall, these results provide evidence that participants with SMA who have limited, or no motor experience may make more conservative action possibility judgments for others. Critically, our finding that the pattern of action possibility judgments was not different between SMA and NH groups suggests that limited previous motor experience may not completely impair action possibility judgments.

Distinct neural couplings to shared goal and action coordination in joint action: evidence based on fNIRS hyperscanning

Joint action is central to human nature, enabling individuals to coordinate in time and space to achieve a joint outcome. Such interaction typically involves two key elements: shared goal and action coordination. Yet, the substrates entrained to these two components in joint action remained unclear. In the current study, dyads performed two tasks involving both sharing goal and action coordination, i.e. complementary joint action and imitative joint action, a task only involving shared goal and a task only involving action coordination, while their brain activities were recorded by the functional near-infrared spectroscopy hyperscanning technique. The results showed that both complementary and imitative joint action (i.e. involving shared goal and action coordination) elicited better behavioral performance than the task only involving shared goal/action coordination. We observed that the interbrain synchronization (IBS) at the right inferior frontal cortex (IFC) entrained more to shared goal, while left-IFC IBS entrained more to action coordination. We also observed that the right-IFC IBS was greater during completing a complementary action than an imitative action. Our results suggest that IFC plays an important role in joint action, with distinct lateralization for the sub-components of joint action.

Seeing through the cat's eyes: evidence of a spontaneous perspective taking process using a non-human avatar

In many daily face-to-face interactions, people are able to take the perspective of others, for example, coding right and left based on point-of-view of others. In the present study, we investigated whether observers are able to take the perspective of a non-human figure such as a cat, observing the same effects obtained with human or robot avatars. In both experiments, we used a centrally presented stimulus (i.e. a cat), with its tail lateralized to the left or to the right. Participants had to respond to the side of the tail with a lateralized keypress. In Experiment 1 (spatial perspective taking task), participants were required to explicitly adopt the cat's perspective to respond, whereas in Experiment 2 (SR compatibility task), this was not explicitly required. In both experiments, faster RTs are obtained when the cat is presented back, with a greater difference between front and back views when the tail is on the right; furthermore, there is no temporal modulation of the back-front effect. These common results between the two experiments are interpreted on the basis of the spatial perspective taking processes, elicited voluntarily (Experiment 1) or spontaneously (Experiment 2).

Joint rushing alters internal timekeeping in non-musicians and musicians

Recent studies have shown that people engaging in joint rhythmic activity unintentionally increase their tempo. The same tempo increase does not occur when the same rhythmic activity is performed alone. This phenomenon is known as joint rushing. In two experiments, we investigated whether joint rushing is caused by correction mechanisms that facilitate sensorimotor synchronization. Because such correction mechanisms require perceptual input, joint rushing should discontinue when auditory feedback in a joint rhythmic activity is interrupted. This prediction was clearly supported in two experiments, one with musicians and one with non-musicians. Surprisingly, there was no indication that the amount of joint rushing differed between musicians and non-musicians. Furthermore, neither musicians nor non-musicians were able to return to the initially instructed tempo after feedback had been interrupted. This result indicates that joint rushing has a lasting effect on an internal timekeeper. An important question for future research is whether joint rushing is only a dysfunctional side effect of the way sensorimotor synchronization works or whether it has a function in enabling precise temporal coordination between different individuals.

Mutual Skill Learning and Adaptability to Others via Haptic Interaction

When learning a new skill through an unknown environment, should we practice alone, or together with another beginner, or learn from the expert? It is normally helpful to have an expert guiding through unknown environmental dynamics. The guidance from the expert is fundamentally based on mutual interactions. From the perspective of the beginner, one needs to face dual unknown dynamics of the environment and motor coordination of the expert. In a cooperative visuo-haptic motor task, we asked novice participants to bring a virtual mass onto the specified target location under an unknown external force field. The task was completed by an individual or with an expert or another novice. In addition to evaluation of the motor performance, we evaluated the adaptability of the novice participants to a new partner while attempting to achieve a common goal together. The experiment was set in five phases; baseline for skill transfer and adaptability, learning and evaluation for adaptability and skill transfer respectively. The performance of the participants was characterized by using the time to target, effort index, and length of the trajectory. Experimental results suggested that (1) peer-to-peer interactions among paired beginners enhanced the motor learning most, (2) individuals practicing on their own (learning as a single) showed better motor learning than practicing under the expert's guidance, and (3) regarding the adaptability, peer-to-peer interactions induced higher adaptability to a new partner than the novice-to-expert interactions while attempting to achieve a common goal together. Thus, we conclude that the peer-to-peer interactions under a collaborative task can realize the best motor learning of the motor skills through the new environmental dynamics, and adaptability to others in order to achieve a goal together. We suggest that the peer-to-peer learning can induce both adaptability to others and learning of motor skills through the unknown environmental dynamics under mutual interactions. On the other hand, during the peer-to-peer interactions, the novice can learn how to coordinate motion with his/her partner (even though one is a new partner), and thus, is able to learn the motor skills through new environmental dynamics.

Coordinating With a Robot Partner Affects Neural Processing Related to Action Monitoring

Robots start to play a role in our social landscape, and they are progressively becoming responsive, both physically and socially. It begs the question of how humans react to and interact with robots in a coordinated manner and what the neural underpinnings of such behavior are. This exploratory study aims to understand the differences in human-human and human-robot interactions at a behavioral level and from a neurophysiological perspective. For this purpose, we adapted a collaborative dynamical paradigm from the literature. We asked 12 participants to hold two corners of a tablet while collaboratively guiding a ball around a circular track either with another participant or a robot. In irregular intervals, the ball was perturbed outward creating an artificial error in the behavior, which required corrective measures to return to the circular track again. Concurrently, we recorded electroencephalography (EEG). In the behavioral data, we found an increased velocity and positional error of the ball from the track in the human-human condition vs. human-robot condition. For the EEG data, we computed event-related potentials. We found a significant difference between human and robot partners driven by significant clusters at fronto-central electrodes. The amplitudes were stronger with a robot partner, suggesting a different neural processing. All in all, our exploratory study suggests that coordinating with robots affects action monitoring related processing. In the investigated paradigm, human participants treat errors during human-robot interaction differently from those made during interactions with other humans. These results can improve communication between humans and robot with the use of neural activity in real-time.

Musical novices perform with equal accuracy when learning to drum alone or with a peer

The capacity of expert musicians to coordinate with each other when playing in ensembles or rehearsing has been widely investigated. However, little is known about the ability of novices to achieve satisfactory coordinated behaviour when making music together. We tested whether performance accuracy differs when novices play a newly learned drumming pattern with another musically untrained individual (duo group) or alone (solo group). A comparison between musical outcomes of the two groups revealed no significant differences concerning performative accuracy. An additional, exploratory examination of the degree of mutual influence between members of the duos suggested that they reciprocally affected each other when playing together. These findings indicate that a responsive auditory feedback involving surprises introduced by human errors could be part of pedagogical settings that employ repetition or imitation, thereby facilitating coordination among novices in a less prescribed fashion.

Synchronous vs. non-synchronous imitation: Using dance to explore interpersonal coordination during observational learning

Observational learning can enhance the acquisition and performance quality of complex motor skills. While an extensive body of research has focused on the benefits of synchronous (i.e., concurrent physical practice) and non-synchronous (i.e., delayed physical practice) observational learning strategies, the question remains as to whether these approaches differentially influence performance outcomes. Accordingly, we investigate the differential outcomes of synchronous and non-synchronous observational training contexts using a novel dance sequence. Using multidimensional cross-recurrence quantification analysis, movement time-series were recorded for novice dancers who either synchronised with (n = 22) or observed and then imitated (n = 20) an expert dancer. Participants performed a 16-count choreographed dance sequence for 20 trials assisted by the expert, followed by one final, unassisted performance trial. Although end-state performance did not significantly differ between synchronous and non-synchronous learners, a significant decline in performance quality from imitation to independent replication was shown for synchronous learners. A non-significant positive trend in performance accuracy was shown for non-synchronous learners. For all participants, better imitative performance across training trials led to better end-state performance, but only for the accuracy (and not timing) of movement reproduction. Collectively, the results suggest that synchronous learners came to rely on a real-time mapping process between visual input from the expert and their own visual and proprioceptive intrinsic feedback, to the detriment of learning. Thus, the act of synchronising alone does not ensure an appropriate training context for advanced sequence learning.

Progress in Joint-Action Research

Humans have a striking ability to coordinate their actions with each other to achieve joint goals. The tight interpersonal coordination that characterizes joint actions is achieved through processes that help with preparing for joint action as well as processes that are active while joint actions are being performed. To prepare for joint action, partners form representations of each other’s actions and tasks and the relation between them. This enables them to predict each other’s upcoming actions, which, in turn, facilitates coordination. While performing joint actions, partners’ coordination is maintained by (a) monitoring whether individual and joint outcomes correspond to what was planned, (b) predicting partners’ action parameters on the basis of familiarity with their individual actions, (c) communicating task-relevant information unknown to partners in an action-based fashion, and (d) relying on coupling of predictions through dense perceptual-information flow between coactors. The next challenge for the field of joint action is to generate an integrated perspective that links coordination mechanisms to normative, evolutionary, and communicative frameworks.

The roles of musical expertise and sensory feedback in beat keeping and joint action

Auditory feedback of actions provides additional information about the timing of one’s own actions and those of others. However, little is known about how musicians and nonmusicians integrate auditory feedback from multiple sources to regulate their own timing or to (intentionally or unintentionally) coordinate with a partner. We examined how musical expertise modulates the role of auditory feedback in a two-person synchronization–continuation tapping task. Pairs of individuals were instructed to tap at a rate indicated by an initial metronome cue in all four auditory feedback conditions: no feedback, self-feedback (cannot hear their partner), other feedback (cannot hear themselves), or full feedback (both self and other). Participants within a pair were either both musically trained (musicians), both untrained (nonmusicians), or one musically trained and one untrained (mixed). Results demonstrated that all three pair types spontaneously synchronized with their partner when receiving other or full feedback. Moreover, all pair types were better at maintaining the metronome rate with self-feedback than with no feedback. Musician pairs better maintained the metronome rate when receiving other feedback than when receiving no feedback; in contrast, nonmusician pairs were worse when receiving other or full feedback compared to no feedback. Both members of mixed pairs maintained the metronome rate better in the other and full feedback conditions than in the no feedback condition, similar to musician pairs. Overall, nonmusicians benefited from musicians’ expertise without negatively influencing musicians’ ability to maintain the tapping rate. One implication is that nonmusicians may improve their beat-keeping abilities by performing tasks with musically skilled individuals.