Follow you, Follow me: Continuous Mutual Prediction and Adaptation in Joint Tapping

Brain-to-brain coupling forecasts future joint action outcomes

In this study, we investigated whether brain-to-brain coupling patterns could predict performance in a time-estimation task that requires two players to cooperate. The participant pairs were tasked with synchronizing button presses after converging on a shared representation of "short," "medium," and "long" time intervals while utilizing feedback to adjust responses. We employed electroencephalogram (EEG)-hyperscanning and focused on post-feedback brain activity. We found that negative feedback led to increased frontal mid-line theta activity across individuals. Moreover, a correlation in post-feedback theta power between players forecasted failed joint action, while an anti-correlation forecasted success. These findings suggest that temporally coupled feedback-related brain activity between two individuals serves as an indicator of redundancy in adjustment of a common goal representation. Additionally, the anti-correlation of this activity reflects cognitive strategic mechanisms that ensure optimal joint action outcomes. Rather than a paired overcompensation, successful cooperation requires flexible strategic agility from both partners.

Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagement

Attentional engagement is known to vary on a moment-to-moment basis. However, few self-report methods can effectively capture dynamic fluctuations in attentional engagement over time. In the current paper, we evaluated the utility of stimulated recall, a method wherein individuals are asked to remember their subjective states while using a mnemonic cue, for the measurement of temporal changes in attentional engagement. Participants were asked to watch a video lecture, during which we assessed their in-the-moment levels of attentional engagement using intermittent thought probes. Then, we used stimulated recall by cueing participants with short video clips from the lecture to retrospectively assess the levels of attentional engagement they had experienced when they first watched those clips within the lecture. Experiment 1 assessed the statistical overlap between in-the-moment and video-stimulated ratings. Experiment 2 assessed the generalizability of video-stimulated recall across different types of lectures. Experiment 3 assessed the impact of presenting video-stimulated probe clips in non-chronological order. Experiment 4 assessed the effect of video-stimulated recall on its own. Across all experiments, we found statistically robust correspondence between in-the-moment and video-stimulated ratings of attentional engagement, illustrating a strong convergence between these two methods of assessment. Taken together, our findings indicate that stimulated recall provides a new and practical methodological approach that can accurately capture dynamic fluctuations in subjective attentional states over time.

Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement

Theories of embodied cognition suggest that a shared environment and ongoing sensorimotor interaction are central for interpersonal learning and engagement. To investigate the embodied, distributed and hence dynamically unfolding nature of social cognitive capacities, we present a novel laboratory-based coordination task: the BallGame. Our paradigm requires continuous sensing and acting between two players who jointly steer a virtual ball around obstacles towards as many targets as possible. By analysing highly resolved measures of movement coordination and gaming behaviour, game-concurrent experience ratings, semi-structured interviews, and personality questionnaires, we reveal contributions from different levels of observation on social experience. In particular, successful coordination (number of targets collected) and intermittent periods of high versus low movement coordination (variability of relation) emerged as prominent predictors of social experience. Importantly, having the same (but incomplete) view on the game environment strengthened interpersonal coordination, whereas complementary views enhanced engagement and tended to generate more complex interactive behaviour. Overall, we find evidence for a critical balance between similarity and synchrony on the one hand, and variability and difference on the other, for successful engagement in social interactions. Finally, following participant reports, we highlight how interpersonal experience emerges from specific histories of coordination that are closely related to the interaction context in both space and time.

Effect of time delay on performance and timing control in dyadic rhythm coordination using finger tapping

In musical ensembles, people synchronise with each other despite the presence of time delays such as those related to sound transmission. However, the ways in which time delays in synchronisation are overcome remain unclear. This study aimed to investigate the basic characteristics and mechanism of synchronisation with time delays using a dyadic synchronisation-continuation finger-tapping task with time delays ranging from 0 to 240 ms. The results reveal that synchronisation performance improved under time delays of 40-160 ms compared with in the other conditions. This tolerance to the time delay could have been because such a delay allowed both participants in each pair to tap before receiving the stimuli from their partner, as seen in synchronisation with a constant-tempo metronome. In addition, the dependency of the timing control on the partner's previous inter-tap interval decreased at a time delay of 80 ms, relating to the fact that the acceleration and deceleration of the tapping tempo reduced under certain time delays, while the synchronisation performance improved. Uncertainty in the timing of the partner's stimulus could induce greater anticipatory responses, making it possible to tolerate longer time delays in dyadic finger-tapping tasks.

Excitatory/inhibitory motor balance reflects individual differences during joint action coordination

Joint action (JA) is a continuous process of motor co-regulation based on the integration of contextual (top-down) and kinematic (bottom-up) cues from partners. The fine equilibrium between excitation and inhibition in sensorimotor circuits is, thus, central to such a dynamic process of action selection and execution. In a bimanual task adapted to become a unimanual JA task, the participant held a bottle (JA), while a confederate had to reach and unscrew either that bottle or another stabilized by a mechanical clamp (No_JA). Prior knowledge was manipulated in each trial such that the participant knew (K) or not (No_K) the target bottle in advance. Online transcranial magnetic stimulation (TMS) was administered at action-relevant landmarks to explore corticospinal excitability (CSE) and inhibition (cortical silent period [cSP]). CSE was modulated early on before the action started if prior information was available. In contrast, cSP modulation emerged later during the reaching action, regardless of prior information. These two indexes could thus reflect the concurrent elaboration of contextual priors (top-down) and the online sampling of partner's kinematic cues (bottom-up). Furthermore, participants selected either one of two possible behavioural strategies, preferring early or late force exertion on the bottle. One translates into a reduced risk of motor coordination failure and the other into reduced metabolic expenditure. Each strategy was characterised by a specific excitatory/inhibitory profile. In conclusion, the study of excitatory/inhibitory balance paves the way for the neurophysiological determination of individual differences in the combination of top-down and bottom-up processing during JA coordination.

How and Why People Synchronize: An Integrated Perspective

Academic AbstractInterpersonal synchrony, the alignment of behavior and/or physiology during interactions, is a pervasive phenomenon observed in diverse social contexts. Here we synthesize across contexts and behaviors to classify the different forms and functions of synchrony. We provide a concise framework for classifying the manifold forms of synchrony along six dimensions: periodicity, discreteness, spatial similarity, directionality, leader-follower dynamics, and observability. We also distill the various proposed functions of interpersonal synchrony into four interconnected functions: reducing complexity and improving understanding, accomplishing joint tasks, strengthening social connection, and influencing partners' behavior. These functions derive from first principles, emerge from each other, and are accomplished by some forms of synchrony more than others. Effective synchrony flexibly adapts to social goals and more synchrony is not always better. Our synthesis offers a shared framework and language for the field, allowing for better cross-context and cross-behavior comparisons, generating new hypotheses, and highlighting future research directions.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Submovement interpersonal coupling is associated to audio-motor coordination performance

Acting in concert with others, a key aspect of our social life, requires behavioral coordination between persons on multiple timescales. When zooming in on the kinematic properties of movements, it appears that small speed fluctuations, called submovements, are embedded within otherwise smooth end-point trajectories. Submovements, by occurring at a faster timescale than that of movements, offer a novel window upon the functional relationship between distinct motor timescales. In this regard, it has previously been shown that when partners visually synchronize their movements, they also coordinate the timing of their submovement by following an alternated pattern. However, it remains unclear whether the mechanisms behind submovement coordination are domain-general or specific to the visual modality, and whether they have relevance for interpersonal coordination also at the scale of whole movements. In a series of solo and dyadic tasks, we show that submovements are also present and coordinated across partners when sensorimotor interactions are mediated by auditory feedback only. Importantly, the accuracy of task-instructed interpersonal coordination at the movement level correlates with the strength of submovement coordination. These results demonstrate that submovement coordination is a potentially fundamental mechanism that participates in interpersonal motor coordination regardless of the sensory domain mediating the interaction.

Interpersonal alignment of neural evidence accumulation to social exchange of confidence

Private, subjective beliefs about uncertainty have been found to have idiosyncratic computational and neural substrates yet, humans share such beliefs seamlessly and cooperate successfully. Bringing together decision making under uncertainty and interpersonal alignment in communication, in a discovery plus pre-registered replication design, we examined the neuro-computational basis of the relationship between privately held and socially shared uncertainty. Examining confidence-speed-accuracy trade-off in uncertainty-ridden perceptual decisions under social vs isolated context, we found that shared (i.e. reported confidence) and subjective (inferred from pupillometry) uncertainty dynamically followed social information. An attractor neural network model incorporating social information as top-down additive input captured the observed behavior and demonstrated the emergence of social alignment in virtual dyadic simulations. Electroencephalography showed that social exchange of confidence modulated the neural signature of perceptual evidence accumulation in the central parietal cortex. Our findings offer a neural population model for interpersonal alignment of shared beliefs.

You, me, and us: Maintaining self-other distinction enhances coordination, agency, and affect

Coordinating our actions with others changes how we behave and feel. Here, we provide evidence that interacting with others rests on a balance between self-other integration and segregation. Using a group walking paradigm, participants were instructed to synchronize with a metronome while listening to the sounds of 8 virtual partners. By manipulating the similarity and synchronicity of the partners' steps to the participant's own, our novel auditory task disentangles the effects of synchrony and self-other similarity and examines their contribution to both collective and individual awareness. We measured temporal coordination (step timing regularity and synchrony with the metronome), gait patterns, and subjective reports about sense of self and group cohesion. The main findings show that coordination is best when participants hear distinct but synchronous virtual others, leading to greater subjective feelings of agency, strength, dominance, and happiness.

Dynamics in interbrain synchronization while playing a piano duet

Humans interact with each other through actions that are implemented by sensory and motor processes. To investigate the role of interbrain synchronization emerging during interpersonal action coordination, electroencephalography data from 13 pairs of pianists were recorded simultaneously while they performed a duet together. The study aimed to investigate whether interbrain phase couplings can be reduced to similar bottom-up driven processes during synchronous play, or rather represent cognitive top-down control required during periods of higher coordination demands. To induce such periods, one of the musicians acted as a confederate who deliberately desynchronized the play. As intended, on the behavioral level, the perturbation caused a breakdown in the synchronization of the musicians' play and in its stability across trials. On the brain level, interbrain synchrony, as measured by the interbrain phase coherence (IPC), increased in the delta and theta frequency bands during perturbation as compared to non-perturbed trials. Interestingly, this increase in IPC in the delta band was accompanied by the shift of the phase difference angle from in-phase toward anti-phase synchrony. In conclusion, the current study demonstrates that interbrain synchronization is based on the interpersonal temporal alignment of different brain mechanisms and is not simply reducible to similar sensory or motor responses.

The physiological basis of leader-follower roles in the dyadic alternating tapping task

Introduction

Cooperative and collaborative behaviors are important concepts for co-creative communication. One of the key elements for these behaviors is the leader-follower roles in human communication. Leaders are those who maintain their own pace and rhythm, on the contrary, followers are those who follow the pace and rhythm of the other. Well-coordinated leader-follower roles would produce better cooperative and collaborative behaviors, which could promote co-creative communication.

Methods

Here, to explore the physiological basis for the leader-follower roles, we conducted the dyadic alternating tapping task with electrocardiographic and electroencephalographic recordings. The task would be stable for modeling human communication in the laboratory because it includes timing control in tens of milliseconds and turn-taking. Given that human communications are complex and constantly fluctuating, this study estimated the degree of leader-follower with the state-space model. This model allowed us to calculate two parameters independently for estimating the degree of leader-follower of each participant: αSelf (degree of one's tap(n) was explained by one's tap(n-1)) and αPair (degree of one's tap(n) was explained by one's tap (n-1) and pair's tap (n-1)).

Results

The result showed heart rate synchronization in the group in which both participants had high αPair. Also, the high-frequency component of heart rate variability was positively correlated with αPair. EEG analyses suggested the deactivation of the mirror neuron system (increasing φ1) in the participants with higher αSelf than lower ones. The activation of the mirror neuron system (increasing φ2) was shown in the participants with lower αPair than higher ones.

Discussion

These data of physiological basis for leader-follower roles could be useful for the constructivist approach to co-creative communication.

Embodied perspective-taking enhances interpersonal synchronization: A body-swap study

Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

Autonomic synchrony induced by hyperscanning interoception during interpersonal synchronization tasks

According to previous research, people influence each other's emotional states during social interactions via resonance mechanisms and coordinated autonomic rhythms. However, no previous studies tested if the manipulation of the interoceptive focus (focused attention on the breath for a given time interval) in hyperscanning during synchronized tasks may have an impact on autonomic synchrony. Thus, this study aims to assess the psychophysiological synchrony through autonomic measures recording during dyadic linguistic and motor synchronization tasks performed in two distinct interoceptive conditions: the focus and no focus on the breath condition. 26 participants coupled in 13 dyads were recruited. Individuals' autonomic measures [electrodermal: skin conductance level and response (SCL, SCR); cardiovascular indices: heart rate (HR) and HR variability (HRV)] was continuously monitored during the experiment and correlational coefficients were computed to analyze dyads physiological synchrony. Inter-subject analysis revealed higher synchrony for HR, HRV, SCL, and SCR values in the focus compared to no focus condition during the motor synchronization task and in general more for motor than linguistic task. Higher synchrony was also found for HR, SCL, and SCR values during focus than no focus condition in linguistic task. Overall, evidence suggests that the manipulation of the interoceptive focus has an impact on the autonomic synchrony during distinct synchronization tasks and for different autonomic measures. Such findings encourage the use of hyperscanning paradigms to assess the effect of breath awareness practices on autonomic synchrony in ecological and real-time conditions involving synchronization.

An Integrated Model of Collaborative Skill Acquisition: Anticipation, Control Tuning, and Role Adoption

We studied collaborative skill acquisition in a dynamic setting with the game Co-op Space Fortress. While gaining expertise, the majority of subjects became increasingly consistent in the role they adopted without being able to communicate. Moreover, they acted in anticipation of the future task state. We constructed a collaborative skill acquisition model in the cognitive architecture ACT-R that reproduced subject skill acquisition trajectory. It modeled role adoption through reinforcement learning and predictive processes through motion extrapolation and learned relevant control parameters using both a reinforcement learning procedure and a new to ACT-R supervised learning procedure. This is the first integrated cognitive model of collaborative skill acquisition and, as such, gives us valuable insights into the multiple cognitive processes that are involved in learning to collaborate.

Preceding and trailing role-taking in dyad synchronization using finger tapping

In ensembles, people synchronize the timings of their movements with those of others. Players sometimes take on preceding and trailing roles, whereby one's beat is either slightly earlier or slightly later than that of another. In this study, we aimed to clarify whether the division of preceding and trailing roles occurs in simple rhythmic coordination among non-musicians. Additionally, we investigated the temporal dependencies between these roles. We conducted a synchronous-continuous tapping task involving pairs of people, whereby pairs of participants first tapped to synchronize with a metronome. After the metronome stopped, the participants synchronized their taps to their partners' tap timings, which were presented as auditory stimuli. Except in one trial, the pairs involved participants taking on preceding and trailing roles. Compared to the participants taking on the trailing role, those taking on the preceding role demonstrated enhanced phase-correction responses, while those taking on the trailing role significantly adapted their tempos to match those of their partners. As a result, people spontaneously divided into preceding and trailing roles. The preceding participants tended to reduce asynchronies, while the trailing participants tended to match their tempo to their partners'.

The Role of Visual and Auditory Communication in the Performance of a Joint Team Task

OBJECTIVE

This study examines visual, auditory, and the combination of both (bimodal) coupling modes in the performance of a two-person perceptual-motor task, in which one person provides the perceptual inputs and the other the motor inputs.

BACKGROUND

Parking a plane or landing a helicopter on a mountain top requires one person to provide motor inputs while another person provides perceptual inputs. Perceptual inputs are communicated either visually, auditorily, or through both cues.

METHODS

One participant drove a remote-controlled car around an obstacle and through a target, while another participant provided auditory, visual, or bimodal cues for steering and acceleration. Difficulty was manipulated using target size. Performance (trial time, path variability), cue rate, and spatial ability were measured.

RESULTS

Visual coupling outperformed auditory coupling. Bimodal performance was best in the most difficult task condition but also high in the easiest condition. Cue rate predicted performance in all coupling modes. Drivers with lower spatial ability required a faster auditory cue rate, whereas drivers with higher ability performed best with a lower rate.

CONCLUSION

Visual cues result in better performance when only one coupling mode is available. As predicted by multiple resource theory, when both cues are available, performance depends more on auditory cueing. In particular, drivers must be able to transform auditory cues into spatial actions.

APPLICATION

Spotters should be trained to provide an appropriate cue rate to match the spatial ability of the driver or pilot. Auditory cues can enhance visual communication when the interpersonal task is visual with spatial outputs.

Head motion synchrony in unidirectional and bidirectional verbal communication

Interpersonal communication includes verbal and nonverbal communication. Verbal communication comprises one-way (e.g., a speech or lecture) and interactive verbal communication (e.g., daily conversations or meetings), which we frequently encounter. Nonverbal communication has considerable influence on interpersonal communication, and body motion synchrony is known to be an important factor for successful communication and social interaction. However, most research on body motion synchrony has been elucidated by either the setting of one-way verbal transmission or the verbal interaction setting, and it remains unclear whether verbal directionality and interactivity affect body motion synchrony. One-way and two-way (interactive) verbal communication is implicated in designed or undesigned leader-follower relationships, and also in the complexity and diversity of interpersonal interactions, where two-way verbal communication is more complex and diverse than in the one-way condition. In this study, we tested head motion synchrony between the one-way verbal communication condition (in which the roles of the speaker and listener are fixed) and the two-way verbal communication condition (where the speaker and listener can freely engage in a conversation). Therefore, although no statistically significant difference in synchrony activity (relative frequency) was found, a statistically significant difference was observed in synchrony direction (temporal lead-lag structure as mimicry) and intensity. Specifically, the synchrony direction in two-way verbal communication was close to zero, but this in one-way verbal communication was synchronized with the listener's movement predominantly delayed. Furthermore, synchrony intensity, in terms of the degree of variation in the phase difference distribution, was significantly higher in the one-way verbal communication than in the two-way condition, with bigger time-shifts being observed in the latter. This result suggests that verbal interaction does not affect the overall frequency of head motion synchrony but does affect the temporal lead-lag structure and coherence.

Dynamic models for musical rhythm perception and coordination

Rhythmicity permeates large parts of human experience. Humans generate various motor and brain rhythms spanning a range of frequencies. We also experience and synchronize to externally imposed rhythmicity, for example from music and song or from the 24-h light-dark cycles of the sun. In the context of music, humans have the ability to perceive, generate, and anticipate rhythmic structures, for example, "the beat." Experimental and behavioral studies offer clues about the biophysical and neural mechanisms that underlie our rhythmic abilities, and about different brain areas that are involved but many open questions remain. In this paper, we review several theoretical and computational approaches, each centered at different levels of description, that address specific aspects of musical rhythmic generation, perception, attention, perception-action coordination, and learning. We survey methods and results from applications of dynamical systems theory, neuro-mechanistic modeling, and Bayesian inference. Some frameworks rely on synchronization of intrinsic brain rhythms that span the relevant frequency range; some formulations involve real-time adaptation schemes for error-correction to align the phase and frequency of a dedicated circuit; others involve learning and dynamically adjusting expectations to make rhythm tracking predictions. Each of the approaches, while initially designed to answer specific questions, offers the possibility of being integrated into a larger framework that provides insights into our ability to perceive and generate rhythmic patterns.

Beyond speaking: neurocognitive perspectives on language production in social interaction

The human faculty to speak has evolved, so has been argued, for communicating with others and for engaging in social interactions. Hence the human cognitive system should be equipped to address the demands that social interaction places on the language production system. These demands include the need to coordinate speaking with listening, the need to integrate own (verbal) actions with the interlocutor's actions, and the need to adapt language flexibly to the interlocutor and the social context. In order to meet these demands, core processes of language production are supported by cognitive processes that enable interpersonal coordination and social cognition. To fully understand the cognitive architecture and its neural implementation enabling humans to speak in social interaction, our understanding of how humans produce language needs to be connected to our understanding of how humans gain insights into other people's mental states and coordinate in social interaction. This article reviews theories and neurocognitive experiments that make this connection and can contribute to advancing our understanding of speaking in social interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Can rhythm-mediated reward boost learning, memory, and social connection? Perspectives for future research

Studies of rhythm processing and of reward have progressed separately, with little connection between the two. However, consistent links between rhythm and reward are beginning to surface, with research suggesting that synchronization to rhythm is rewarding, and that this rewarding element may in turn also boost this synchronization. The current mini review shows that the combined study of rhythm and reward can be beneficial to better understand their independent and combined roles across two central aspects of cognition: 1) learning and memory, and 2) social connection and interpersonal synchronization; which have so far been studied largely independently. From this basis, it is discussed how connections between rhythm and reward can be applied to learning and memory and social connection across different populations, taking into account individual differences, clinical populations, human development, and animal research. Future research will need to consider the rewarding nature of rhythm, and that rhythm can in turn boost reward, potentially enhancing other cognitive and social processes.

Emergent and planned interpersonal synchronization are both sensitive to 'tempo aftereffect contagion'

Interpersonal synchronization is fundamental for motor coordination during social interactions. Discerning emergent (entrainment) from planned synchronization represents a non-trivial issue in visually bonded individuals acting together, as well as assessing whether inter-individual differences, e.g., in autistic traits, modulate both types of synchronization. In a visuomotor finger-tapping task, two participants replicated a target tempo either synchronizing ('joint' condition) or not ('non-interactive' condition, 'non-int') with each other. One participant was exposed ('induced') to tempo aftereffect (a medium tempo seems faster or slower after exposure to slower or faster inducing tempi), but not the other participant ('not induced'); thus they had different timing perceptions of the same target. We assessed to what degree emergent and/or planned synchronization affected dyads by analyzing inter-tap-intervals, synchronization indexes, and cross-correlation coefficients. Results revealed a 'tempo aftereffect contagion': inter-tap-intervals of both induced and not-induced participants showed aftereffect in both the joint and non-int conditions. Moreover, aftereffects did not correlate across conditions suggesting they might be due to (at least in part) different processes, but the propensity for tempo aftereffect contagion correlated with individuals' autistic traits only in the non-int condition. Finally, participants co-adjusted their tapping more in the joint condition than in the non-int one, as confirmed by higher synchronization indexes and the mutual adaptation pattern of cross-correlation coefficients. Altogether, these results show the subtle interplay between emergent and planned interpersonal synchronization mechanisms that act on a millisecond timescale independently from synching or not with the partner.

Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action

Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.

Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior

Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.

The role of reciprocity in dynamic interpersonal coordination of physiological rhythms

A central question in social cognition research is how people coordinate their bodily rhythms, and how important reciprocity of interaction is for interpersonal coordination. Previous research has primarily focused on interpersonal action coordination, which has been shown to be facilitated by mechanisms of prediction and mutual adaption. Recent research is beginning to show that people also coordinate their physiological rhythms (i.e., respiration, heart rhythms) when they engage in natural forms of social interaction, such as conversation, choir singing, and rituals. However, the mechanisms underlying interpersonal physiological synchronization remain obscure, and could provide insight into the dynamic mechanisms that underlie continuous and regulatory, rather than instrumental, joint actions. Using real-time biofeedback, we investigated whether people synchronize their respiration rhythms by forming a joint dynamical system through reciprocity of interaction, or by producing more predictable respiration rhythms. Our results show that people are more in-phase synchronized but less phase-locked when interacting bidirectionally versus unidirectionally (online), but there is no difference in synchronization during reciprocal interaction and when adapting unidirectionally (offline) to recordings of respiration signals that emerged during the reciprocal interaction. Moreover, the strength of synchronization is driven by the predictability of the respiration rhythms that emerge in the bidirectional interaction - specifically, the slowing of breathing rhythms and stability of breathing frequencies - rather than the online mutual adaptation itself. These results suggest that coordination is facilitated by the emergence of predictable breathing patterns, rather than reciprocity itself.

The performance monitoring system is attuned to others' actions during dyadic motor interactions

Interpersonal motor interactions require the simultaneous monitoring of one's own and one's partner's actions. To characterize how the action monitoring system tracks self and other behavior during synchronous interactions, we combined electroencephalography recordings and immersive virtual reality in two tasks where participants were asked to synchronize their actions with those of a virtual partner (VP). The two tasks differed in the features to be monitored: the Goal task required participants to predict and monitor the VP's reaching goal; the Spatial task required participants to predict and monitor the VP's reaching trajectory. In both tasks, the VP performed unexpected movement changes to which the participant needed to adapt. By extracting the neural activity locked to the detection of unexpected changes in the VP's action (other-monitoring) or to the participants' action-replanning (self-monitoring), we show that the monitoring system is more attuned to others' than to one's own actions. Additionally, distinctive neural responses to VP's unexpected goals and trajectory corrections were found: goal changes were reflected both in early fronto-central and later posterior neural responses while trajectory deviations were reflected only in later posterior responses. Altogether, our results indicate that the monitoring system adopts an inherent social mode to handle interpersonal motor interactions.

Playing the mirror game in virtual reality with an autonomous character

Perceptual-motor synchronisation in human groups is crucial in many activities, from musical ensembles to sports teams. To this aim, the mirror game, where partners are asked to imitate each other's movements or gestures, is one of the best available experimental paradigms to study how humans engage in joint tasks and how they tend to synchronise their behaviour. However, to date, virtual reality characters do not engage in motor synchronisation with human users. In this work, we explored to what extent an autonomous virtual character and a human that play the mirror game in virtual reality can synchronise their behaviour. We created a full-body version of the mirror game with an autonomous virtual character, whose movements were driven by a model based on coupled oscillators. Participants engaged in a joint imitation task with a virtual player animated with one of three options: a model that included a small coupling, a model with no coupling, or another human. Behavioural measures and subjective reports suggest that participants were unable to distinguish the condition of small coupling from the engagement with an avatar driven by another human participant.

Magnetoencephalography recordings reveal the spatiotemporal dynamics of recognition memory for complex versus simple auditory sequences

Auditory recognition is a crucial cognitive process that relies on the organization of single elements over time. However, little is known about the spatiotemporal dynamics underlying the conscious recognition of auditory sequences varying in complexity. To study this, we asked 71 participants to learn and recognize simple tonal musical sequences and matched complex atonal sequences while their brain activity was recorded using magnetoencephalography (MEG). Results reveal qualitative changes in neural activity dependent on stimulus complexity: recognition of tonal sequences engages hippocampal and cingulate areas, whereas recognition of atonal sequences mainly activates the auditory processing network. Our findings reveal the involvement of a cortico-subcortical brain network for auditory recognition and support the idea that stimulus complexity qualitatively alters the neural pathways of recognition memory.

Distinct neural couplings to shared goal and action coordination in joint action: evidence based on fNIRS hyperscanning

Joint action is central to human nature, enabling individuals to coordinate in time and space to achieve a joint outcome. Such interaction typically involves two key elements: shared goal and action coordination. Yet, the substrates entrained to these two components in joint action remained unclear. In the current study, dyads performed two tasks involving both sharing goal and action coordination, i.e. complementary joint action and imitative joint action, a task only involving shared goal and a task only involving action coordination, while their brain activities were recorded by the functional near-infrared spectroscopy hyperscanning technique. The results showed that both complementary and imitative joint action (i.e. involving shared goal and action coordination) elicited better behavioral performance than the task only involving shared goal/action coordination. We observed that the interbrain synchronization (IBS) at the right inferior frontal cortex (IFC) entrained more to shared goal, while left-IFC IBS entrained more to action coordination. We also observed that the right-IFC IBS was greater during completing a complementary action than an imitative action. Our results suggest that IFC plays an important role in joint action, with distinct lateralization for the sub-components of joint action.

Endogenous sources of interbrain synchrony in duetting pianists

When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.

The dynamics of musical participation

In this paper we argue that our comprehension of musical participation-the complex network of interactive dynamics involved in collaborative musical experience-can benefit from an analysis inspired by the existing frameworks of dynamical systems theory and coordination dynamics. These approaches can offer novel theoretical tools to help music researchers describe a number of central aspects of joint musical experience in greater detail, such as prediction, adaptivity, social cohesion, reciprocity, and reward. While most musicians involved in collective forms of musicking already have some familiarity with these terms and their associated experiences, we currently lack an analytical vocabulary to approach them in a more targeted way. To fill this gap, we adopt insights from these frameworks to suggest that musical participation may be advantageously characterized as an open, non-equilibrium, dynamical system. In particular, we suggest that research informed by dynamical systems theory might stimulate new interdisciplinary scholarship at the crossroads of musicology, psychology, philosophy, and cognitive (neuro)science, pointing toward new understandings of the core features of musical participation.

Video meeting signals: Experimental evidence for a technique to improve the experience of video conferencing

We found evidence from two experiments that a simple set of gestural techniques can improve the experience of online meetings. Video conferencing technology has practical benefits, but psychological costs. It has allowed industry, education and social interactions to continue in some form during the covid-19 lockdowns. But it has left many users feeling fatigued and socially isolated, perhaps because the limitations of video conferencing disrupt users' ability to coordinate interactions and foster social affiliation. Video Meeting Signals (VMS™) is a simple technique that uses gestures to overcome some of these limitations. First, we carried out a randomised controlled trial with over 100 students, in which half underwent a short training session in VMS. All participants rated their subjective experience of two weekly seminars, and transcripts were objectively coded for the valence of language used. Compared to controls, students with VMS training rated their personal experience, their feelings toward their seminar group, and their perceived learning outcomes as significantly higher. Also, they were more likely to use positive language and less likely to use negative language. A second, larger experiment replicated the first, and added a condition where groups were given a version of the VMS training but taught to use emoji response buttons rather than gestures to signal the same information. The emoji-trained groups did not experience the same improvement as the VMS groups. By exploiting the specific benefits of gestural communication, VMS has great potential to overcome the psychological problems of group video meetings.

Identifying Signatures of Perceived Interpersonal Synchrony

Interpersonal synchrony serves as a subtle, yet powerful bonding mechanism in social interactions. Problematically, the term ‘synchrony’ has been used to label a variety of distinct aspects of interpersonal coordination, such as postural similarities or movement activity entrainment. Accordingly, different algorithms have been suggested to quantify interpersonal synchrony. Yet, it remains unknown whether the different measures of synchrony represent correlated features of the same perceivable core phenomenon. The current study addresses this by comparing the suitability of a set of algorithms with respect to their association with observers’ judgments of dyadic synchrony and leader-followership. One-hundred fifteen observers viewed computer animations of characters portraying the movements of real dyads who performed a repetitive motor task with instruction to move in unison. Animations were based on full-body motion capture data synchronously collected for both partners during the joint exercise. Results showed most synchrony measures significantly correlated with (a) perceived synchrony and (b) the perceived level of balance of leading/following by each dyad member. Phase synchrony and Pearson correlations were associated most strongly with the observer ratings. This might be typical for intentional, structured forms synchrony such as ritualized group activities. It remains open if these findings also apply to spontaneous forms of synchrony as, for instance, occurring in free-running conversations.

Interpersonal Physiological Synchrony Predicts Group Cohesion

A key emergent property of group social dynamic is synchrony–the coordination of actions, emotions, or physiological processes between group members. Despite this fact and the inherent nested structure of groups, little research has assessed physiological synchronization between group members from a multi-level perspective, thus limiting a full understanding of the dynamics between members. To address this gap of knowledge we re-analyzed a large dataset (N = 261) comprising physiological and psychological data that were collected in two laboratory studies that involved two different social group tasks. In both studies, following the group task, members reported their experience of group cohesion via questionnaires. We utilized a non-linear analysis method-multidimensional recurrence quantification analysis that allowed us to represent physiological synchronization in cardiological interbeat intervals between group members at the individual-level and at the group-level. We found that across studies and their conditions, the change in physiological synchrony from baseline to group interaction predicted a psychological sense of group cohesion. This result was evident both at the individual and the group levels and was not modified by the context of the interaction. The individual- and group-level effects were highly correlated. These results indicate that the relationship between synchrony and cohesion is a multilayered construct. We re-affirm the role of physiological synchrony for cohesion in groups. Future studies are needed to crystallize our understanding of the differences and similarities between synchrony at the individual-level and synchrony at the group level to illuminate under which conditions one of these levels has primacy, or how they interact.

Reproducible Inter-Personal Brain Coupling Measurements in Hyperscanning Settings With functional Near Infra-Red Spectroscopy

Despite a huge advancement in neuroimaging techniques and growing importance of inter-personal brain research, few studies assess the most appropriate computational methods to measure brain-brain coupling. Here, we focus on the signal processing methods to detect brain-coupling in dyads. From a public dataset of functional Near Infra-Red Spectroscopy signals (N=24 dyads), we derived a synthetic control condition by randomization, we investigated the effectiveness of four most used signal similarity metrics: Cross Correlation, Mutual Information, Wavelet Coherence and Dynamic Time Warping. We also accounted for temporal variations between signals by allowing for misalignments up to a maximum lag. Starting from the observed effect sizes, computed in terms of Cohen's d, the power analysis indicated that a high sample size ([Formula: see text]) would be required to detect significant brain-coupling. We therefore discuss the need for specialized statistical approaches and propose bootstrap as an alternative method to avoid over-penalizing the results. In our settings, and based on bootstrap analyses, Cross Correlation and Dynamic Time Warping outperform Mutual Information and Wavelet Coherence for all considered maximum lags, with reproducible results. These results highlight the need to set specific guidelines as the high degree of customization of the signal processing procedures prevents the comparability between studies, their reproducibility and, ultimately, undermines the possibility of extracting new knowledge.

The Groove Enhancement Machine (GEM): A Multi-Person Adaptive Metronome to Manipulate Sensorimotor Synchronization and Subjective Enjoyment

Synchronization of movement enhances cooperation and trust between people. However, the degree to which individuals can synchronize with each other depends on their ability to perceive the timing of others’ actions and produce movements accordingly. Here, we introduce an assistive device—a multi-person adaptive metronome—to facilitate synchronization abilities. The adaptive metronome is implemented on Arduino Uno circuit boards, allowing for negligible temporal latency between tapper input and adaptive sonic output. Across five experiments—two single-tapper, and three group (four tapper) experiments, we analyzed the effects of metronome adaptivity (percent correction based on the immediately preceding tap-metronome asynchrony) and auditory feedback on tapping performance and subjective ratings. In all experiments, tapper synchronization with the metronome was significantly enhanced with 25–50% adaptivity, compared to no adaptation. In group experiments with auditory feedback, synchrony remained enhanced even at 70–100% adaptivity; without feedback, synchrony at these high adaptivity levels returned to near baseline. Subjective ratings of being in the groove, in synchrony with the metronome, in synchrony with others, liking the task, and difficulty all reduced to one latent factor, which we termed enjoyment. This same factor structure replicated across all experiments. In predicting enjoyment, we found an interaction between auditory feedback and metronome adaptivity, with increased enjoyment at optimal levels of adaptivity only with auditory feedback and a severe decrease in enjoyment at higher levels of adaptivity, especially without feedback. Exploratory analyses relating person-level variables to tapping performance showed that musical sophistication and trait sadness contributed to the degree to which an individual differed in tapping stability from the group. Nonetheless, individuals and groups benefitted from adaptivity, regardless of their musical sophistication. Further, individuals who tapped less variably than the group (which only occurred ∼25% of the time) were more likely to feel “in the groove.” Overall, this work replicates previous single person adaptive metronome studies and extends them to group contexts, thereby contributing to our understanding of the temporal, auditory, psychological, and personal factors underlying interpersonal synchrony and subjective enjoyment during sensorimotor interaction. Further, it provides an open-source tool for studying such factors in a controlled way.

The Components of Interpersonal Synchrony in the Typical Population and in Autism: A Conceptual Analysis

Interpersonal synchrony - the tendency for social partners to temporally co-ordinate their behaviour when interacting - is a ubiquitous feature of social interactions. Synchronous interactions play a key role in development, and promote social bonding and a range of pro-social behavioural outcomes across the lifespan. The process of achieving and maintaining interpersonal synchrony is highly complex, with inputs required from across perceptual, temporal, motor, and socio-cognitive domains. In this conceptual analysis, we synthesise evidence from across these domains to establish the key components underpinning successful non-verbal interpersonal synchrony, how such processes interact, and factors that may moderate their operation. We also consider emerging evidence that interpersonal synchrony is reduced in autistic populations. We use our account of the components contributing to interpersonal synchrony in the typical population to identify potential points of divergence in interpersonal synchrony in autism. The relationship between interpersonal synchrony and broader aspects of social communication in autism are also considered, together with implications for future research.

Mutual beta power modulation in dyadic entrainment

Across a broad spectrum of interactions, humans exhibit a prominent tendency to synchronize their movements with one another. Traditionally, this phenomenon has been explained from the perspectives of predictive coding or dynamical systems theory. While these theories diverge with respect to whether individuals hold internal models of each other, they both assume a predictive or anticipatory mechanism enabling rhythmic interactions. However, the neural bases underpinning interpersonal synchronization are still a subject under active investigation. Here we provide evidence that the brain relies on a common oscillatory mechanism to pace self-generated rhythmic movements and to track the movements produced by a partner. By performing dual-electroencephalography recordings during a joint finger-tapping task, we identified an oscillatory component in the beta range (∼ 20 Hz), which was significantly modulated by both self-generated and other-generated movement. In conditions where the partners perceived each other, we observed periodic fluctuations of beta power as a function of the reciprocal movement cycles. Crucially, this modulation occurred both in visually and in auditorily coupled conditions, and was accompanied by recurrent periods of dyadic synchronized behavior. Our results show that periodic beta power modulations may be a critical mechanism underlying interpersonal synchronization, possibly enabling mutual predictions between coupled individuals, leading to co-regulation of timing and overt mutual adaptation. Our findings thus provide a potential bridge between influential theories attempting to explain interpersonal coordination, and a concrete connection to its neurophysiological bases.

Social signalling as a framework for second-person neuroscience

Despite the recent increase in second-person neuroscience research, it is still hard to understand which neurocognitive mechanisms underlie real-time social behaviours. Here, we propose that social signalling can help us understand social interactions both at the single- and two-brain level in terms of social signal exchanges between senders and receivers. First, we show how subtle manipulations of being watched provide an important tool to dissect meaningful social signals. We then focus on how social signalling can help us build testable hypotheses for second-person neuroscience with the example of imitation and gaze behaviour. Finally, we suggest that linking neural activity to specific social signals will be key to fully understand the neurocognitive systems engaged during face-to-face interactions.

The relationship between entrainment dynamics and reading fluency assessed by sensorimotor perturbation

A consistent relationship has been found between rhythmic processing and reading skills. Impairment of the ability to entrain movements to an auditory rhythm in clinical populations with language-related deficits, such as children with developmental dyslexia, has been found in both behavioral and neural studies. In this study, we explored the relationship between rhythmic entrainment, behavioral synchronization, reading fluency, and reading comprehension in neurotypical English- and Mandarin-speaking adults. First, we examined entrainment stability by asking participants to coordinate taps with an auditory metronome in which unpredictable perturbations were introduced to disrupt entrainment. Next, we assessed behavioral synchronization by asking participants to coordinate taps with the syllables they produced while reading sentences as naturally as possible (tap to syllable task). Finally, we measured reading fluency and reading comprehension for native English and native Mandarin speakers. Stability of entrainment correlated strongly with tap to syllable task performance and with reading fluency, and both findings generalized across English and Mandarin speakers.

The relationship between stability of interpersonal coordination and inter-brain EEG synchronization during anti-phase tapping

Inter-brain synchronization is enhanced when individuals perform rhythmic interpersonal coordination tasks, such as playing instruments in music ensembles. Experimentally, synchronization has been shown to correlate with the performance of joint tapping tasks. However, it is unclear whether inter-brain synchronization is related to the stability of interpersonal coordination represented as the standard deviation of relative phase (SDRP). In this study, we simultaneously recorded electroencephalograms of two paired individuals during anti-phase tapping in three interactive tapping conditions: slow (reference inter-tap interval [ITI]: 0.5 s), fast (reference ITI: 0.25 s), and free (preferred ITI), and pseudo tapping where each participant tapped according to the metronome sounds without interaction. We calculated the inter-brain synchronization between pairs of six regions of interest (ROI): frontal, central, left/right temporal, parietal, and occipital regions. During the fast tapping, the inter-brain synchronization significantly increased in multiple ROI pairs including temporoparietal junction in comparison to pseudo tapping. Synchronization between the central and left-temporal regions was positively correlated with SDRP in the theta in the fast condition. These results demonstrate that inter-brain synchronization occurs when task requirements are high and increases with the instability of the coordination.

Music in the brain

Music is ubiquitous across human cultures - as a source of affective and pleasurable experience, moving us both physically and emotionally - and learning to play music shapes both brain structure and brain function. Music processing in the brain - namely, the perception of melody, harmony and rhythm - has traditionally been studied as an auditory phenomenon using passive listening paradigms. However, when listening to music, we actively generate predictions about what is likely to happen next. This enactive aspect has led to a more comprehensive understanding of music processing involving brain structures implicated in action, emotion and learning. Here we review the cognitive neuroscience literature of music perception. We show that music perception, action, emotion and learning all rest on the human brain's fundamental capacity for prediction - as formulated by the predictive coding of music model. This Review elucidates how this formulation of music perception and expertise in individuals can be extended to account for the dynamics and underlying brain mechanisms of collective music making. This in turn has important implications for human creativity as evinced by music improvisation. These recent advances shed new light on what makes music meaningful from a neuroscientific perspective.

Gamma‐band neural coupling during conceptual alignment

Conceptual alignment is a prerequisite for mutual understanding. However, little is known about the neurophysiological brain‐to‐brain underpinning during conceptual alignment for mutual understanding. Here, we recorded multi‐channel electroencephalogram (EEG) simultaneously from two participants in Experiment 1 and adopted the dual‐tACS techniques in Experiment 2 to investigate the underlying brain‐to‐brain EEG coupling during conceptual alignment and the possible enhancement effect. Our results showed that 1) higher phase‐locking value (PLV), a sensitive measure for quantifying neural coupling strength between EEG signals, at the gamma frequency band (28–40 Hz), was observed in the left temporoparietal site (left TP) area between successful versus unsuccessful conceptual alignment. The left TP gamma coupling strength correlated with the accuracy of conceptual alignment and differentiated whether subjects belonged to the SUCCESS or FAILURE groups in our study. 2) In‐phase gamma‐band transcranial alternating current stimulation (tACS) over the left TP area increased the accuracy of subjects in the SUCCESS group but not the FAILURE group. 3) The effect of perspective‐taking on the accuracy was mediated by the gamma coupling strength within the left TP area. Our results support the role of gamma‐band coupling between brains for interpersonal conceptual alignment. We provide dynamic interpersonal neurophysiological insights into the formation of successful communication.

Liking as a balance between synchronization, complexity and novelty

Synchronization has been identified as a key aspect in social bonding. While synchronization could be maximized by increasing the predictability of an interaction, such predictability is in tension with individuals' level of interest, which is tied to the interaction's complexity and novelty. In this study, we tested the interplay between synchronization and interest. We asked 104 female dyads to play the Mirror Game, in which they had to move their hands as coordinately as possible, and then report how much they liked each other. Utilizing information theory and video processing tools, we found that a combination of movement synchronization and complexity explained liking almost two times better than movement synchronization alone. Moreover, we found that people initiated novel and challenging interactions, even though they paid a price-being less synchronized. Examining the interactions' dynamics, we found that people who liked each other moved in a more synchronized, complex, and novel manner during most of the interaction. This suggests that in addition to synchronization, maintaining interest may be critical for positive social bonding. Thus, we propose a new framework in which balancing synchronization and interest, rather than merely maximizing synchronization, optimizes the interaction quality.

Intra-individual behavioural and neural signatures of audience effects and interactions in a mirror-game paradigm

We often perform actions while observed by others, yet the behavioural and neural signatures of audience effects remain understudied. Performing actions while being observed has been shown to result in more emphasized movements in musicians and dancers, as well as during communicative actions. Here, we investigate the behavioural and neural mechanisms of observed actions in relation to individual actions in isolation and interactive joint actions. Movement kinematics and EEG were recorded in 42 participants (21 pairs) during a mirror-game paradigm, while participants produced improvised movements alone, while observed by a partner, or by synchronizing movements with the partner. Participants produced largest movements when being observed, and observed actors and dyads in interaction produced slower and less variable movements in contrast with acting alone. On a neural level, we observed increased mu suppression during interaction, as well as to a lesser extent during observed actions, relative to individual actions. Moreover, we observed increased widespread functional brain connectivity during observed actions relative to both individual and interactive actions, suggesting increased intra-individual monitoring and action-perception integration as a result of audience effects. These results suggest that observed actors take observers into account in their action plans by increasing self-monitoring; on a behavioural level, observed actions are similar to emergent interactive actions, characterized by slower and more predictable movements.