Modality-specific attractor dynamics in dyadic entrainment

Dance of two brains: Interval subdivision in alternated condition enhances resistance to interference by others

The accomplishment of interpersonal sensorimotor synchronization is a challenging endeavor because it requires the achievement of a balance between accurate temporal control within individuals and smooth communication between them. This raises a critical question: How does the brain comprehend and process the perceptual information of others to guarantee accurate temporal control of action goals in a social context? A joint synchronization - continuation tapping task was conducted together with varying relative phases (0°/180°) and intervals of tempos (400 ms/800 ms/1600 ms) while neural data was collected using fNIRS (functional near-infrared spectroscopy). Individuals showed better behavioral performance and greater interpersonal brain synchronization(IBS) in the left dorsolateral prefrontal cortex at alternated condition (180° relative phase) compared to symmetric condition (0° relative phase), suggesting that the individual can better maintain behavioral performance and show improved IBS when the partner taps between the individual's gaps. Meanwhile, in most levels of alternated condition, IBS is inversely proportional to interference from partner, implying the counteraction of IBS against interference from others. In addition, when the interval of tempo was 1600 ms, behavioral performance showed a sharp decline, accompanied by a decrease in IBS, reflecting that IBS in SMS reflects effective information exchange between individuals rather than ineffective interference with each other. This study provides insight into the mechanisms underlying sensorimotor synchronization between individuals.

Perceptual coupling in human dyads: Kinematics does not affect interpersonal synchronization

The minimal, essential condition for individuals to interact is that they exchange information via at least one sensory channel. Once informational coupling is established, it enables basic forms of coordinated behavior to spontaneously emerge from the interaction. Our previous study revealed different coordination dynamics in dyads engaged in a joint finger-tapping task based on visual versus auditory coupling. This observation led us to propose the 'modality-dependent hypothesis', which posits that coordination dynamics are influenced by the sensory modality mediating informational coupling. However, recognizing that different modalities have inherent differences in accessing spatiotemporal features of perceived movement, we formulated the alternative 'kinematic hypothesis'. This hypothesis posits that differences in dynamics would vanish given equivalent kinematic information across modalities. The study involved forty (N = 40) participants, grouped into twenty (N = 20) dyads, who engaged in a joint finger-tapping task. This task was conducted under varying conditions of visual and auditory coupling, with manipulations in the access to kinematic information, categorized as discrete and continuous. Contrary to our initial predictions, the results strongly supported the 'modality-dependent hypothesis'. We observed that visual and auditory coupling consistently yielded distinct attractor dynamics, regardless of the access to kinematic information. Furthermore, all conditions of auditory coupling resulted in higher levels of synchronization than their visual counterparts. These findings suggest that the differences in interpersonal synchronization are predominantly influenced by the sensory modality, rather than the continuity of kinematic information. Our study highlights the significance of sensorimotor interactions in interpersonal synchronization and addresses the potential of sonification strategies in supporting motor training and rehabilitation.

The geometry of interpersonal synchrony in human dance

Collective synchronized behavior has powerful social-communicative functions observed across several animal taxa.1,2,3,4,5,6,7 Operationally, synchronized behavior can be explained by individuals responding to shared external cues (e.g., light, sound, or food) as well as by inter-individual adaptation.3,8,9,10,11 We contrasted these accounts in the context of a universal human practice-collective dance-by recording full-body kinematics from dyads of laypersons freely dancing to music in a "silent disco" setting. We orthogonally manipulated musical input (whether participants were dancing to the same, synchronous music) and visual contact (whether participants could see their dancing partner). Using a data-driven method, we decomposed full-body kinematics of 70 participants into 15 principal movement patterns, reminiscent of common dance moves, explaining over 95% of kinematic variance. We find that both music and partners drive synchrony, but through distinct dance moves. This leads to distinct kinds of synchrony that occur in parallel by virtue of a geometric organization: anteroposterior movements such as head bobs synchronize through music, while hand gestures and full-body lateral movements synchronize through visual contact. One specific dance move-vertical bounce-emerged as a supramodal pacesetter of coordination, synchronizing through both music and visual contact, and at the pace of the musical beat. These findings reveal that synchrony in human dance is independently supported by shared musical input and inter-individual adaptation. The independence between these drivers of synchrony hinges on a geometric organization, enabling dancers to synchronize to music and partners simultaneously by allocating distinct synchronies to distinct spatial axes and body parts.

Social-Motor Coordination Between Peers: Joint Action Developmental Trajectories in ASD and TD

Coordinating a physical movement in time and space with social and nonsocial partners to achieve a shared goal - "joint action" (JA) - characterizes many peer-engagement situations that pose challenges for individuals with autism spectrum disorder (ASD). This cross-sectional study examined development of JA capabilities comparing ASD versus typically developing (TD) groups in early childhood, preadolescence, and adolescence while performing mirroring and complementing JA tasks with social (peer) and nonsocial (computer) partners. Results indicated better motor coordination abilities on computerized tasks than in peer dyads, with larger peer-dyad deficits shown by the ASD group. Developmental growth in JA abilities emerged, but the ASD group lagged behind same-age peers with TD. Socio-motor interventions may offer new channels to facilitate peer engagement in ASD.

You, me, and us: Maintaining self-other distinction enhances coordination, agency, and affect

Coordinating our actions with others changes how we behave and feel. Here, we provide evidence that interacting with others rests on a balance between self-other integration and segregation. Using a group walking paradigm, participants were instructed to synchronize with a metronome while listening to the sounds of 8 virtual partners. By manipulating the similarity and synchronicity of the partners' steps to the participant's own, our novel auditory task disentangles the effects of synchrony and self-other similarity and examines their contribution to both collective and individual awareness. We measured temporal coordination (step timing regularity and synchrony with the metronome), gait patterns, and subjective reports about sense of self and group cohesion. The main findings show that coordination is best when participants hear distinct but synchronous virtual others, leading to greater subjective feelings of agency, strength, dominance, and happiness.

Embodied perspective-taking enhances interpersonal synchronization: A body-swap study

Humans exhibit a strong tendency to synchronize movements with each other, with visual perspective potentially influencing interpersonal synchronization. By manipulating the visual scenes of participants engaged in a joint finger-tapping task, we examined the effects of 1st person and 2nd person visual perspectives on their coordination dynamics. We hypothesized that perceiving the partner's movements from their 1st person perspective would enhance spontaneous interpersonal synchronization, potentially mediated by the embodiment of the partner's hand. We observed significant differences in attractor dynamics across visual perspectives. Specifically, participants in 1st person coupling were unable to maintain de-coupled trajectories as effectively as in 2nd person coupling. Our findings suggest that visual perspective influences coordination dynamics in dyadic interactions, engaging error-correction mechanisms in individual brains as they integrate the partner's hand into their body representation. Our results have the potential to inform the development of applications for motor training and rehabilitation.

Exploring the dynamics of intentional sensorimotor desynchronization using phasing performance in music

Humans tend to synchronize spontaneously to rhythmic stimuli or with other humans, but they can also desynchronize intentionally in certain situations. In this study, we investigate the dynamics of intentional sensorimotor desynchronization using phasing performance in music as an experimental paradigm. Phasing is a compositional technique in modern music that requires musicians to desynchronize from each other in a controlled manner. A previous case study found systematic nonlinear trajectories in the phasing performance between two expert musicians, which were explained by coordination dynamics arising from the interaction between the intrinsic tendency of synchronization and the intention of desynchronization. A recent exploratory study further examined the dynamics of phasing performance using a simplified task of phasing against a metronome. Here we present a further analysis and modeling of the data from the exploratory study, focusing on the various types of phasing behavior found in non-expert participants. Participants were instructed to perform one phasing lap, and individual trials were classified as successful (1 lap), unsuccessful (> 1 laps), or incomplete (0 lap) based on the number of laps made. It was found that successful phasing required a gradual increment of relative phase and that different types of failure (unsuccessful vs. incomplete) were prevalent at slow vs. fast metronome tempi. The results are explained from a dynamical systems perspective, and a dynamical model of phasing performance is proposed which captures the interaction of intrinsic dynamics and intentional control in an adaptive-frequency oscillator coupled to a periodic external stimulus. It is shown that the model can replicate the multiple types of phasing behavior as well as the effect of tempo observed in the human experiment. This study provides further evidence that phasing performance is governed by the nonlinear dynamics of rhythmic coordination. It also demonstrates that the musical technique of phasing provides a unique experimental paradigm for investigating human rhythmic behavior.

Neural entrainment underpins sensorimotor synchronization to dynamic rhythmic stimuli

Neural entrainment, defined as unidirectional synchronization of neural oscillations to an external rhythmic stimulus, is a topic of major interest in the field of neuroscience. Despite broad scientific consensus on its existence, on its pivotal role in sensory and motor processes, and on its fundamental definition, empirical research struggles in quantifying it with non-invasive electrophysiology. To this date, broadly adopted state-of-the-art methods still fail to capture the dynamic underlying the phenomenon. Here, we present event-related frequency adjustment (ERFA) as a methodological framework to induce and to measure neural entrainment in human participants, optimized for multivariate EEG datasets. By applying dynamic phase and tempo perturbations to isochronous auditory metronomes during a finger-tapping task, we analyzed adaptive changes in instantaneous frequency of entrained oscillatory components during error correction. Spatial filter design allowed us to untangle, from the multivariate EEG signal, perceptual and sensorimotor oscillatory components attuned to the stimulation frequency. Both components dynamically adjusted their frequency in response to perturbations, tracking the stimulus dynamics by slowing down and speeding up the oscillation over time. Source separation revealed that sensorimotor processing enhanced the entrained response, supporting the notion that the active engagement of the motor system plays a critical role in processing rhythmic stimuli. In the case of phase shift, motor engagement was a necessary condition to observe any response, whereas sustained tempo changes induced frequency adjustment even in the perceptual oscillatory component. Although the magnitude of the perturbations was controlled across positive and negative direction, we observed a general bias in the frequency adjustments towards positive changes, which points at the effect of intrinsic dynamics constraining neural entrainment. We conclude that our findings provide compelling evidence for neural entrainment as mechanism underlying overt sensorimotor synchronization, and highlight that our methodology offers a paradigm and a measure for quantifying its oscillatory dynamics by means of non-invasive electrophysiology, rigorously informed by the fundamental definition of entrainment.

Knee flexion of saxophone players anticipates tonal context of music

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze how knee flexion is employed by expert saxophone players. Using a computational model of the auditory periphery, we extracted emergent acoustical properties of sound to inference critical cognitive patterns of music processing and relate them to motion data. Results showed that knee flexion is causally linked to tone expectations and correlated to rhythmical density, suggesting that this gesture is associated with expressive and facilitative purposes. Furthermore, when instructed to play immobile, participants tended to microflex (>1 Hz) more frequently compared to when playing expressively, possibly indicating a natural urge to move to the music. These results underline the robustness of body movement in musical performance, providing valuable insights for the understanding of communicative processes, and development of motor learning cues.

With No Attention Specifically Directed to It, Rhythmic Sound Does Not Automatically Facilitate Visual Task Performance

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography (EEG), should be recorded. This approach can be subject to a future work.

Mutual beta power modulation in dyadic entrainment

Across a broad spectrum of interactions, humans exhibit a prominent tendency to synchronize their movements with one another. Traditionally, this phenomenon has been explained from the perspectives of predictive coding or dynamical systems theory. While these theories diverge with respect to whether individuals hold internal models of each other, they both assume a predictive or anticipatory mechanism enabling rhythmic interactions. However, the neural bases underpinning interpersonal synchronization are still a subject under active investigation. Here we provide evidence that the brain relies on a common oscillatory mechanism to pace self-generated rhythmic movements and to track the movements produced by a partner. By performing dual-electroencephalography recordings during a joint finger-tapping task, we identified an oscillatory component in the beta range (∼ 20 Hz), which was significantly modulated by both self-generated and other-generated movement. In conditions where the partners perceived each other, we observed periodic fluctuations of beta power as a function of the reciprocal movement cycles. Crucially, this modulation occurred both in visually and in auditorily coupled conditions, and was accompanied by recurrent periods of dyadic synchronized behavior. Our results show that periodic beta power modulations may be a critical mechanism underlying interpersonal synchronization, possibly enabling mutual predictions between coupled individuals, leading to co-regulation of timing and overt mutual adaptation. Our findings thus provide a potential bridge between influential theories attempting to explain interpersonal coordination, and a concrete connection to its neurophysiological bases.

Liking as a balance between synchronization, complexity and novelty

Synchronization has been identified as a key aspect in social bonding. While synchronization could be maximized by increasing the predictability of an interaction, such predictability is in tension with individuals' level of interest, which is tied to the interaction's complexity and novelty. In this study, we tested the interplay between synchronization and interest. We asked 104 female dyads to play the Mirror Game, in which they had to move their hands as coordinately as possible, and then report how much they liked each other. Utilizing information theory and video processing tools, we found that a combination of movement synchronization and complexity explained liking almost two times better than movement synchronization alone. Moreover, we found that people initiated novel and challenging interactions, even though they paid a price-being less synchronized. Examining the interactions' dynamics, we found that people who liked each other moved in a more synchronized, complex, and novel manner during most of the interaction. This suggests that in addition to synchronization, maintaining interest may be critical for positive social bonding. Thus, we propose a new framework in which balancing synchronization and interest, rather than merely maximizing synchronization, optimizes the interaction quality.