Reciprocity and alignment: quantifying coupling in dynamic interactions

Audio-visual concert performances synchronize audience's heart rates

People enjoy engaging with music. Live music concerts provide an excellent option to investigate real-world music experiences, and at the same time, use neurophysiological synchrony to assess dynamic engagement. In the current study, we assessed engagement in a live concert setting using synchrony of cardiorespiratory measures, comparing inter-subject, stimulus-response, correlation, and phase coherence. As engagement might be enhanced in a concert setting by seeing musicians perform, we presented audiences with audio-only (AO) and audio-visual (AV) piano performances. Only correlation synchrony measures were above chance level. In comparing time-averaged synchrony across conditions, AV performances evoked a higher inter-subject correlation of heart rate (ISC-HR). However, synchrony averaged across music pieces did not correspond to self-reported engagement. On the other hand, time-resolved analyses show that synchronized deceleration-acceleration heart rate (HR) patterns, typical of an "orienting response" (an index of directed attention), occurred within music pieces at salient events of section boundaries. That is, seeing musicians perform heightened audience engagement at structurally important moments in Western classical music. Overall, we could show that multisensory information shapes dynamic engagement. By comparing different synchrony measures, we further highlight the advantages of time series analysis, specifically ISC-HR, as a robust measure of holistic musical listening experiences in naturalistic concert settings.

Relational neuroscience: Insights from hyperscanning research

Humans are highly social, typically without this ability requiring noticeable efforts. Yet, such social fluency poses challenges both for the human brain to compute and for scientists to study. Over the last few decades, neuroscientific research of human sociality has witnessed a shift in focus from single-brain analysis to complex dynamics occurring across several brains, posing questions about what these dynamics mean and how they relate to multifaceted behavioural models. We propose the term 'Relational Neuroscience' to collate the interdisciplinary research field devoted to modelling the inter-brain dynamics subserving human connections, spanning from real-time joint experiences to long-term social bonds. Hyperscanning, i.e., simultaneously measuring brain activity from multiple individuals, has proven to be a highly promising technique to investigate inter-brain dynamics. Here, we discuss how hyperscanning can help investigate questions within the field of Relational Neuroscience, considering a variety of subfields, including cooperative interactions in dyads and groups, empathy, attachment and bonding, and developmental neuroscience. While presenting Relational Neuroscience in the light of hyperscanning, our discussion also takes into account behaviour, physiology and endocrinology to properly interpret inter-brain dynamics within social contexts. We consider the strengths but also the limitations and caveats of hyperscanning to answer questions about interacting people. The aim is to provide an integrative framework for future work to build better theories across a variety of contexts and research subfields to model human sociality.

A scoping review of interaction dynamics in minimally verbal autistic individuals

Interaction dynamics provide information about how social interactions unfold over time and have implications for communication development. Characterizing social interaction in autistic people who are minimally verbal (MV) has the potential to illuminate mechanisms of change in communication development and intervention. The purpose of this scoping review was to investigate the current evidence characterizing interaction dynamics in MV autistic individuals, methods used to measure interaction dynamics in this population, and opportunities for future research. Articles were included if participants were diagnosed with autism, considered MV, if interaction occurred with a human communication partner during live in-person interaction, and if variables were derived by measuring the relationship between behaviors in both partners. The seven articles included in this review demonstrate that limited research describes interaction dynamics in this population, and that behavioral coding measures can be leveraged to assess constructs such as turn-taking, social contingency, and balance in social interactions. While there is some evidence describing how MV autistic individuals and their communication partners construct reciprocal interaction, there is variability in how interaction dynamics are measured and limited evidence describing individual differences. Recommendations for future research are discussed.

Social bonding through shared experiences: the role of emotional intensity

Sharing emotions with other individuals is a widespread phenomenon. Previous research proposed that experiencing intense and similar emotions with other individuals reinforces social bonds. However, several aspects of this phenomenon remain unclear, notably whether social bonding requires the convergence and synchronization of emotions in the group, and whether these effects generalize across positively valenced and negatively valenced emotional contexts. To address these questions, we measured subjective emotional experiences, physiological activity (cardiac, respiratory, electrodermal) and social attitudes in dyads of unacquainted individuals who watched videos in the presence of each other. We manipulated the emotional content of the videos and the type of shared attention between participants, to test for the contribution of interpersonal influence. The results revealed that intense emotions indexed by physiological arousal were associated with the emergence of reciprocal prosocial attitudes within dyads, and that this effect depended on joint attention. We did not observe the convergence and synchronization of emotions within dyads, which suggests that experiencing similar emotions was not necessary for social bonding. We discuss implications of this study for research on collective effervescence and the social consequences of shared experiences.

Evidence of mutual non-verbal synchrony in learners with severe learning disability and autism, and their support workers: a motion energy analysis study

Introduction

Some research indicates that neurodivergent people are less likely than "neurotypical" people to adapt their movements to a partner's movements to facilitate interpersonal motor synchrony. Researchers therefore suggest synchrony deficits underlie the social differences associated with autism and other neurodivergences. Intensive Interaction (II) is a client-led approach, where Learning Support Workers (LSW) follow the lead of learners to create balanced and reciprocal interactions.

Methods

We aimed to examine the balance of synchrony in learners with autism and Severe Learning Disabilities and their LSWs in a special education college where learners had prior experience with II. Using Motion Energy Analysis, we assessed the degree to which each partner acted as a leader, and hence which partner acted as a follower, during moments of close synchrony.

Results

Overall, learners and LSWs showed higher than chance synchrony. There were no differences in the degree to which each partner led the moments of synchrony, or the amount pairs synchronized with zero-lag, where there was no delay between each partners' movements.

Discussion

The equal balance of leading and following in the learner and LSW pairs demonstrates that both partners consistently adapted their movements to their partner's movements to facilitate synchrony. The findings tentatively challenge the notion of a synchrony deficit in autism and suggest synchrony can be present in cross-neurotype pairs in comfortable and engaging conditions. We discuss the potential for client-led, movement-based approaches to support smooth interactions across neurotypes.

Getting closer to social interactions using electroencephalography in developmental cognitive neuroscience

The field of developmental cognitive neuroscience is advancing rapidly, with large-scale, population-wide, longitudinal studies emerging as a key means of unraveling the complexity of the developing brain and cognitive processes in children. While numerous neuroscientific techniques like functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), magnetoencephalography (MEG), and transcranial magnetic stimulation (TMS) have proved advantageous in such investigations, this perspective proposes a renewed focus on electroencephalography (EEG), leveraging underexplored possibilities of EEG. In addition to its temporal precision, low costs, and ease of application, EEG distinguishes itself with its ability to capture neural activity linked to social interactions in increasingly ecologically valid settings. Specifically, EEG can be measured during social interactions in the lab, hyperscanning can be used to study brain activity in two (or more) people simultaneously, and mobile EEG can be used to measure brain activity in real-life settings. This perspective paper summarizes research in these three areas, making a persuasive argument for the renewed inclusion of EEG into the toolkit of developmental cognitive and social neuroscientists.

Why behaviour matters: Studying inter-brain coordination during child-caregiver interaction

Modern technology allows for simultaneous neuroimaging from interacting caregiver-child dyads. Whereas most analyses that examine the coordination between brain regions within an individual brain do so by measuring changes relative to observed events, studies that examine coordination between two interacting brains generally do this by measuring average intra-brain coordination across entire blocks or experimental conditions. In other words, they do not examine changes in inter-brain coordination relative to individual behavioural events. Here, we discuss the limitations of this approach. First, we present data suggesting that fine-grained temporal interdependencies in behaviour can leave residual artifact in neuroimaging data. We show how artifact can manifest as both power and (through that) phase synchrony effects in EEG and affect wavelet transform coherence in fNIRS analyses. Second, we discuss different possible mechanistic explanations of how inter-brain coordination is established and maintained. We argue that non-event-locked approaches struggle to differentiate between them. Instead, we contend that approaches which examine how interpersonal dynamics change around behavioural events have better potential for addressing possible artifactual confounds and for teasing apart the overlapping mechanisms that drive changes in inter-brain coordination.

Effects of individual practice on joint musical synchronization

Successful music-making requires precise sensorimotor synchronization, both in individual (solo) and joint (ensemble) social settings. We investigated how individual practice synchronizing with a temporally regular melody (Solo conditions) influences subsequent synchronization between two partners (Joint conditions). Musically trained adults practiced producing a melody by tapping on a keypad; each tap generated the next tone in the melody. First, the pairs synchronized their melody productions with their partner in a baseline Joint synchronization task. Then each partner separately synchronized their melody with a computer-generated recording of the partner's melody in a Solo intervention condition that presented either Normal (temporally regular) auditory feedback or delayed feedback (by 30-70 ms) in occasional (25%) randomly placed tone positions. Then the pairs synchronized again with their partner in a Joint condition. Next, they performed the second Solo condition (normal or delayed auditory feedback) followed again by the Joint condition. Joint synchronization performance was modeled with a delay-coupled oscillator model to assess the coupling strength between partners. Absolute asynchronies in the Solo Intervention tasks were greater in the Delayed feedback condition than in the Normal feedback condition. Model estimates yielded larger coupling values between partners in Joint conditions that followed the Solo Normal feedback than the Solo Delayed feedback. Notably, the asynchronies were smaller in the Joint conditions than in the Solo conditions. These findings indicate that coupled interactions in settings of two or more performers can be improved by individual synchronization practice.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Neurophysiological markers of asymmetric emotional contagion: implications for organizational contexts

Emotions play a vital role within organizations, impacting various crucial aspects of work such as job satisfaction, performance, and employee well-being. Understanding how emotional states spread in organizational settings is therefore essential. Recent studies have highlighted that a leader's emotional state can influence their followers, with significant consequences on job performance. Leaders thus possess the ability to influence their employees' psychological state and, consequently, their well-being. However, the biological underpinnings of emotional contagion from leaders to followers remain unexplored. The field of interpersonal (neuro)physiology, which involves recording brain and peripheral activity of multiple individuals during interactions, holds great potential for investigating this phenomenon. Analyzing the time-lagged synchronization of neurophysiological activity during interactions may serve as a measure of the leader's influence on their followers in organizational contexts. In this "mini review," we examine empirical studies that have employed interpersonal (neuro)physiology to quantify the asymmetrical contagion of emotions in different contexts. Asymmetrical contagion was operationalized as the unidirectional influence exerted by one individual (i.e., the "sender") to another one (i.e., the "receiver"), whereby the receiver's state can be predicted by the sender's one. The reviewed literature reveals that delayed synchronization of physiological states is a widespread phenomenon that may underpin the transmission of emotions. These findings have significant implications for various aspects of organizational life, including leader-to-employee communication, and could drive the development of effective leadership training programs. We propose that Organizational Neuroscience may benefit from including interpersonal neurophysiology in its methodological toolkit for laboratory and field studies of leader-follower dynamics.

Mobile fNIRS for exploring inter-brain synchrony across generations and time

While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.

Interoceptive technologies for psychiatric interventions: From diagnosis to clinical applications

Interoception-the perception of internal bodily signals-has emerged as an area of interest due to its implications in emotion and the prevalence of dysfunctional interoceptive processes across psychopathological conditions. Despite the importance of interoception in cognitive neuroscience and psychiatry, its experimental manipulation remains technically challenging. This is due to the invasive nature of existing methods, the limitation of self-report and unimodal measures of interoception, and the absence of standardized approaches across disparate fields. This article integrates diverse research efforts from psychology, physiology, psychiatry, and engineering to address this oversight. Following a general introduction to the neurophysiology of interoception as hierarchical predictive processing, we review the existing paradigms for manipulating interoception (e.g., interoceptive modulation), their underlying mechanisms (e.g., interoceptive conditioning), and clinical applications (e.g., interoceptive exposure). We suggest a classification for interoceptive technologies and discuss their potential for diagnosing and treating mental health disorders. Despite promising results, considerable work is still needed to develop standardized, validated measures of interoceptive function across domains and before these technologies can translate safely and effectively to clinical settings.

Social and nonlinear dynamics unite: musical group synchrony

Synchronization, the human tendency to align behaviors in time with others, is necessary for many survival skills. The ability to synchronize actions with rhythmic (predictable) sound patterns is especially well developed in music making. Recent models of synchrony in musical ensembles rely on pairwise comparisons between group members. This pairwise approach to synchrony has hampered theory development, given current findings from social dynamics indicating shifts in members' influence within larger groups. We draw on social theory and nonlinear dynamics to argue that emergent properties and novel roles arise in musical group synchrony that differ from individual or pairwise behaviors. This transformational shift in defining synchrony sheds light on successful outcomes as well as on disruptions that cause negative behavioral outcomes.

The evolution of social timing

Sociality and timing are tightly interrelated in human interaction as seen in turn-taking or synchronised dance movements. Sociality and timing also show in communicative acts of other species that might be pleasurable, but also necessary for survival. Sociality and timing often co-occur, but their shared phylogenetic trajectory is unknown: How, when, and why did they become so tightly linked? Answering these questions is complicated by several constraints; these include the use of divergent operational definitions across fields and species, the focus on diverse mechanistic explanations (e.g., physiological, neural, or cognitive), and the frequent adoption of anthropocentric theories and methodologies in comparative research. These limitations hinder the development of an integrative framework on the evolutionary trajectory of social timing and make comparative studies not as fruitful as they could be. Here, we outline a theoretical and empirical framework to test contrasting hypotheses on the evolution of social timing with species-appropriate paradigms and consistent definitions. To facilitate future research, we introduce an initial set of representative species and empirical hypotheses. The proposed framework aims at building and contrasting evolutionary trees of social timing toward and beyond the crucial branch represented by our own lineage. Given the integration of cross-species and quantitative approaches, this research line might lead to an integrated empirical-theoretical paradigm and, as a long-term goal, explain why humans are such socially coordinated animals.

Cortico-Cerebellar neurodynamics during social interaction in Autism Spectrum Disorders

BACKGROUND

Exploring neural network dynamics during social interaction could help to identify biomarkers of Autism Spectrum Disorders (ASD). A cerebellar involvement in autism has long been suspected and recent methodological advances now enable studying cerebellar functioning in a naturalistic setting. Here, we investigated the electrophysiological activity of the cerebro-cerebellar network during real-time social interaction in ASD. We focused our analysis on theta oscillations (3-8 Hz), which have been associated with large-scale coordination of distant brain areas and might contribute to interoception, motor control, and social event anticipation, all skills known to be altered in ASD.

METHODS

We combined the Human Dynamic Clamp, a paradigm for studying realistic social interactions using a virtual avatar, with high-density electroencephalography (HD-EEG). Using source reconstruction, we investigated power in the cortex and the cerebellum, along with coherence between the cerebellum and three cerebral-cortical areas, and compared our findings in a sample of participants with ASD (n = 107) and with typical development (TD) (n = 33). We developed an open-source pipeline to analyse neural dynamics at the source level from HD-EEG data.

RESULTS

Individuals with ASD showed a significant increase in theta band power over the cerebellum and the frontal and temporal cortices during social interaction compared to resting state, along with significant coherence increases between the cerebellum and the sensorimotor, frontal and parietal cortices. However, a phase-based connectivity measure did not support a strict activity increase in the cortico-cerebellar functional network. We did not find any significant differences between the ASD and the TD group.

CONCLUSIONS

This exploratory study uncovered increases in the theta band activity of participants with ASD during social interaction, pointing at the presence of neural interactions between the cerebellum and cerebral networks associated with social cognition. It also emphasizes the need for complementary functional connectivity measures to capture network-level alterations. Future work will focus on optimizing artifact correction to include more participants with TD and increase the statistical power of group-level contrasts.

Coordination tending towards an anti-phase relationship determines greater sway reduction during entrainment with a simulated partner

The increased risk of falls in the older aged population demands the development of assistive robotic devices capable of effective balance support. For the development and increased user acceptance of such devices, which provide balance support in a human-like way, it is important to understand the simultaneous occurrence of entrainment and sway reduction in human-human interaction. However, sway reduction has not been observed yet during a human touching an external, continuously moving reference, which rather increased human body sway. Therefore, we investigated in 15 healthy young adults (27.20±3.55 years, 6 females) how different simulated sway-responsive interaction partners with different coupling modes affect sway entrainment, sway reduction and relative interpersonal coordination, as well as how these human behaviours differ depending on the individual body schema accuracy. For this, participants were lightly touching a haptic device that either played back an average pre-recorded sway trajectory ("Playback") or moved based on the sway trajectory simulated by a single-inverted pendulum model with either a positive (Attractor) or negative (Repulsor) coupling to participant's body sway. We found that body sway reduced not only during the Repulsor-interaction, but also during the Playback-interaction. These interactions also showed a relative interpersonal coordination tending more towards an anti-phase relationship, especially the Repulsor. Moreover, the Repulsor led to the strongest sway entrainment. Finally, a better body schema contributed to a reduced body sway in both the "reliable" Repulsor and the "less reliable" Attractor mode. Consequently, a relative interpersonal coordination tending more towards an anti-phase relationship and an accurate body schema are important to facilitate sway reduction.

Dynamical biomarkers in teams and other multiagent systems

Effective team behavior in high-performance environments such as in sport and the military requires individual team members to efficiently perceive the unfolding task events, predict the actions and action intents of the other team members, and plan and execute their own actions to simultaneously accomplish individual and collective goals. To enhance team performance through effective cooperation, it is crucial to measure the situation awareness and dynamics of each team member and how they collectively impact the team's functioning. Further, to be practically useful for real-life settings, such measures must be easily obtainable from existing sensors. This paper presents several methodologies that can be used on positional and movement acceleration data of team members to quantify and/or predict team performance, assess situation awareness, and to help identify task-relevant information to support individual decision-making. Given the limited reporting of these methods within military cohorts, these methodologies are described using examples from team sports and teams training in virtual environments, with discussion as to how they can be applied to real-world military teams.

A cultural-ecosocial systems view for psychiatry

While contemporary psychiatry seeks the mechanisms of mental disorders in neurobiology, mental health problems clearly depend on developmental processes of learning and adaptation through ongoing interactions with the social environment. Symptoms or disorders emerge in specific social contexts and involve predicaments that cannot be fully characterized in terms of brain function but require a larger social-ecological view. Causal processes that result in mental health problems can begin anywhere within the extended system of body-person-environment. In particular, individuals' narrative self-construal, culturally mediated interpretations of symptoms and coping strategies as well as the responses of others in the social world contribute to the mechanisms of mental disorders, illness experience, and recovery. In this paper, we outline the conceptual basis and practical implications of a hierarchical ecosocial systems view for an integrative approach to psychiatric theory and practice. The cultural-ecosocial systems view we propose understands mind, brain and person as situated in the social world and as constituted by cultural and self-reflexive processes. This view can be incorporated into a pragmatic approach to clinical assessment and case formulation that characterizes mechanisms of pathology and identifies targets for intervention.

Postural and Gestural Synchronization, Sequential Imitation, and Mirroring Predict Perceived Coupling of Dancing Dyads

Body movement is a primary nonverbal communication channel in humans. Coordinated social behaviors, such as dancing together, encourage multifarious rhythmic and interpersonally coupled movements from which observers can extract socially and contextually relevant information. The investigation of relations between visual social perception and kinematic motor coupling is important for social cognition. Perceived coupling of dyads spontaneously dancing to pop music has been shown to be highly driven by the degree of frontal orientation between dancers. The perceptual salience of other aspects, including postural congruence, movement frequencies, time-delayed relations, and horizontal mirroring remains, however, uncertain. In a motion capture study, 90 participant dyads moved freely to 16 musical excerpts from eight musical genres, while their movements were recorded using optical motion capture. A total from 128 recordings from 8 dyads maximally facing each other were selected to generate silent 8-s animations. Three kinematic features describing simultaneous and sequential full body coupling were extracted from the dyads. In an online experiment, the animations were presented to 432 observers, who were asked to rate perceived similarity and interaction between dancers. We found dyadic kinematic coupling estimates to be higher than those obtained from surrogate estimates, providing evidence for a social dimension of entrainment in dance. Further, we observed links between perceived similarity and coupling of both slower simultaneous horizontal gestures and posture bounding volumes. Perceived interaction, on the other hand, was more related to coupling of faster simultaneous gestures and to sequential coupling. Also, dyads who were perceived as more coupled tended to mirror their pair's movements.

Interpersonal attunement in social interactions: from collective psychophysiology to inter-personalized psychiatry and beyond

In this article, we analyse social interactions, drawing on diverse points of views, ranging from dialectics, second-person neuroscience and enactivism to dynamical systems, active inference and machine learning. To this end, we define interpersonal attunement as a set of multi-scale processes of building up and materializing social expectations-put simply, anticipating and interacting with others and ourselves. While cultivating and negotiating common ground, via communication and culture-building activities, are indispensable for the survival of the individual, the relevant multi-scale mechanisms have been largely considered in isolation. Here, collective psychophysiology, we argue, can lend itself to the fine-tuned analysis of social interactions, without neglecting the individual. On the other hand, an interpersonal mismatch of expectations can lead to a breakdown of communication and social isolation known to negatively affect mental health. In this regard, we review psychopathology in terms of interpersonal misattunement, conceptualizing psychiatric disorders as disorders of social interaction, to describe how individual mental health is inextricably linked to social interaction. By doing so, we foresee avenues for an inter-personalized psychiatry, which moves from a static spectrum of disorders to a dynamic relational space, focusing on how the multi-faceted processes of social interaction can help to promote mental health. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

Learning from humans to build social cognition among robots

Self-organized groups of robots have generally coordinated their behaviors using quite simple social interactions. Although simple interactions are sufficient for some group behaviors, future research needs to investigate more elaborate forms of coordination, such as social cognition, to progress towards real deployments. In this perspective, we define social cognition among robots as the combination of social inference, social learning, social influence, and knowledge transfer, and propose that these abilities can be established in robots by building underlying mechanisms based on behaviors observed in humans. We review key social processes observed in humans that could inspire valuable capabilities in robots and propose that relevant insights from human social cognition can be obtained by studying human-controlled avatars in virtual environments that have the correct balance of embodiment and constraints. Such environments need to allow participants to engage in embodied social behaviors, for instance through situatedness and bodily involvement, but, at the same time, need to artificially constrain humans to the operational conditions of robots, for instance in terms of perception and communication. We illustrate our proposed experimental method with example setups in a multi-user virtual environment.

Speaking and listening to inter-brain relationships

Studies of inter-brain relationships thrive, and yet many reservations regarding their scope and interpretation of these phenomena have been raised by the scientific community. It is thus essential to establish common ground on methodological and conceptual definitions related to this topic and to open debate about any remaining points of uncertainty. We here offer insights to improve the conceptual clarity and empirical standards offered by social neuroscience studies of inter-personal interaction using hyperscanning with a particular focus on verbal communication.

The role of reciprocity in dynamic interpersonal coordination of physiological rhythms

A central question in social cognition research is how people coordinate their bodily rhythms, and how important reciprocity of interaction is for interpersonal coordination. Previous research has primarily focused on interpersonal action coordination, which has been shown to be facilitated by mechanisms of prediction and mutual adaption. Recent research is beginning to show that people also coordinate their physiological rhythms (i.e., respiration, heart rhythms) when they engage in natural forms of social interaction, such as conversation, choir singing, and rituals. However, the mechanisms underlying interpersonal physiological synchronization remain obscure, and could provide insight into the dynamic mechanisms that underlie continuous and regulatory, rather than instrumental, joint actions. Using real-time biofeedback, we investigated whether people synchronize their respiration rhythms by forming a joint dynamical system through reciprocity of interaction, or by producing more predictable respiration rhythms. Our results show that people are more in-phase synchronized but less phase-locked when interacting bidirectionally versus unidirectionally (online), but there is no difference in synchronization during reciprocal interaction and when adapting unidirectionally (offline) to recordings of respiration signals that emerged during the reciprocal interaction. Moreover, the strength of synchronization is driven by the predictability of the respiration rhythms that emerge in the bidirectional interaction - specifically, the slowing of breathing rhythms and stability of breathing frequencies - rather than the online mutual adaptation itself. These results suggest that coordination is facilitated by the emergence of predictable breathing patterns, rather than reciprocity itself.

Longitudinal changes in infants' rhythmic arm movements during rattle-shaking play with mothers

From early on, infants produce a variety of rhythmic behaviors-an ability that likely supports later social communication. However, it is unclear, how this rhythmic motor production changes with age. Here, we investigated the coupling between infants' arm movements across the first year of life in a social context of a rattle-shaking play with their mothers. Through longitudinal measurements at 4, 6, 9, and 12 months of age using wearable motion trackers placed on infants' arms, we show that infants (N = 40) are similarly motivated to attempt rattle-shaking across the first year of life. However, with age, they make more rattling movements with an increased frequency. Their left and right arm movements become more coupled during rattle-shaking, as shown by an increase in wavelet coherence. Infants produced more rattling movements when they were rattling alone than when their mothers were rattling or singing simultaneously. There were no differences between infants' individual and social rattling in between-arms coherence. Our results may help to understand rhythmic arm movements as precursors of motor social coordination.

Artificial Partners to Understand Joint Action: Representing Others to Develop Effective Coordination

In the last years, artificial partners have been proposed as tools to study joint action, as they would allow to address joint behaviors in more controlled experimental conditions. Here we present an artificial partner architecture which is capable of integrating all the available information about its human counterpart and to develop efficient and natural forms of coordination. The model uses an extended state observer which combines prior information, motor commands and sensory observations to infer the partner's ongoing actions (partner model). Over trials, these estimates are gradually incorporated into action selection. Using a joint planar task in which the partners are required to perform reaching movements while mechanically coupled, we demonstrate that the artificial partner develops an internal representation of its human counterpart, whose accuracy depends on the degree of mechanical coupling and on the reliability of the sensory information. We also show that human-artificial dyads develop coordination strategies which closely resemble those observed in human-human dyads and can be interpreted as Nash equilibria. The proposed approach may provide insights for the understanding of the mechanisms underlying human-human interaction. Further, it may inform the development of novel neuro-rehabilitative solutions and more efficient human-machine interfaces.

Interbrain synchrony: on wavy ground

In recent years the study of dynamic, between-brain coupling mechanisms has taken social neuroscience by storm. In particular, interbrain synchrony (IBS) is a putative neural mechanism said to promote social interactions by enabling the functional integration of multiple brains. In this article, I argue that this research is beset with three pervasive and interrelated problems. First, the field lacks a widely accepted definition of IBS. Second, IBS wants for theories that can guide the design and interpretation of experiments. Third, a potpourri of tasks and empirical methods permits undue flexibility when testing the hypothesis. These factors synergistically undermine IBS as a theoretical construct. I finish by recommending measures that can address these issues.

Resonance as a Design Strategy for AI and Social Robots

Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human-robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of "sympathetic resonance" as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human-robot interactions.

Collective Rhythm as an Emergent Property During Human Social Coordination

The literature on social interactions has shown that participants coordinate not only at the behavioral but also at the physiological and neural levels, and that this coordination gives a temporal structure to the individual and social dynamics. However, it has not been fully explored whether such temporal patterns emerge during interpersonal coordination beyond dyads, whether this phenomenon arises from complex cognitive mechanisms or from relatively simple rules of behavior, or which are the sociocultural processes that underlie this phenomenon. We review the evidence for the existence of group-level rhythmic patterns that result from social interactions and argue that the complexity of group dynamics can lead to temporal regularities that cannot be predicted from the individual periodicities: an emergent collective rhythm. Moreover, we use this interpretation of the literature to discuss how taking into account the sociocultural niche in which individuals develop can help explain the seemingly divergent results that have been reported on the social influences and consequences of interpersonal coordination. We make recommendations on further research to test these arguments and their relationship to the feeling of belonging and assimilation experienced during group dynamics.

Task dynamics define the contextual emergence of human corralling behaviors

Social animals have the remarkable ability to organize into collectives to achieve goals unobtainable to individual members. Equally striking is the observation that despite differences in perceptual-motor capabilities, different animals often exhibit qualitatively similar collective states of organization and coordination. Such qualitative similarities can be seen in corralling behaviors involving the encirclement of prey that are observed, for example, during collaborative hunting amongst several apex predator species living in disparate environments. Similar encirclement behaviors are also displayed by human participants in a collaborative problem-solving task involving the herding and containment of evasive artificial agents. Inspired by the functional similarities in this behavior across humans and non-human systems, this paper investigated whether the containment strategies displayed by humans emerge as a function of the task's underlying dynamics, which shape patterns of goal-directed corralling more generally. This hypothesis was tested by comparing the strategies naïve human dyads adopt during the containment of a set of evasive artificial agents across two disparate task contexts. Despite the different movement types (manual manipulation or locomotion) required in the different task contexts, the behaviors that humans display can be predicted as emergent properties of the same underlying task-dynamic model.

Exploring the "Dark Matter" of Social Interaction: Systematic Review of a Decade of Research in Spontaneous Interpersonal Coordination

Interpersonal coordination is a research topic that has attracted considerable attention this last decade both due to a theoretical shift from intra-individual to inter-individual processes and due to the development of new methods for recording and analyzing movements in ecological settings. Encompassing spatiotemporal behavioral matching, interpersonal coordination is considered as "social glue" due to its capacity to foster social bonding. However, the mechanisms underlying this effect are still unclear and recent findings suggest a complex picture. Goal-oriented joint action and spontaneous coordination are often conflated, making it difficult to disentangle the role of joint commitment from unconscious mutual attunement. Consequently, the goals of the present article are twofold: (1) to illustrate the rapid expansion of interpersonal coordination as a research topic and (2) to conduct a systematic review of spontaneous interpersonal coordination, summarizing its latest developments and current challenges this last decade. By applying Rapid Automatic Keyword Extraction and Latent Dirichlet Allocation algorithms, keywords were extracted from PubMed and Scopus databases revealing the large diversity of research topics associated with spontaneous interpersonal coordination. Using the same databases and the keywords "behavioral matching," "interactional synchrony," and "interpersonal coordination," 1,213 articles were identified, extracted, and screened following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses protocol. A total of 19 articles were selected using the following inclusion criteria: (1) dynamic and spontaneous interactions between two unacquainted individuals (2) kinematic analyses, and (3) non-clinical and non-expert adult populations. The results of this systematic review stress the proliferation of various definitions and experimental paradigms that study perceptual and/or social influences on the emergence of spontaneous interpersonal coordination. As methods and indices used to quantify interpersonal coordination differ from one study to another, it becomes difficult to establish a coherent picture. This review highlights the need to reconsider interpersonal coordination not as the pinnacle of social interactions but as a complex dynamical process that requires cautious interpretation. An interdisciplinary approach is necessary for building bridges across scattered research fields through opening a dialogue between different theoretical frameworks and consequently provides a more ecological and holistic understanding of human social cognition.

Hybrid Harmony: A Multi-Person Neurofeedback Application for Interpersonal Synchrony

Recent years have seen a dramatic increase in studies measuring brain activity, physiological responses, and/or movement data from multiple individuals during social interaction. For example, so-called "hyperscanning" research has demonstrated that brain activity may become synchronized across people as a function of a range of factors. Such findings not only underscore the potential of hyperscanning techniques to capture meaningful aspects of naturalistic interactions, but also raise the possibility that hyperscanning can be leveraged as a tool to help improve such naturalistic interactions. Building on our previous work showing that exposing dyads to real-time inter-brain synchrony neurofeedback may help boost their interpersonal connectedness, we describe the biofeedback application Hybrid Harmony, a Brain-Computer Interface (BCI) that supports the simultaneous recording of multiple neurophysiological datastreams and the real-time visualization and sonification of inter-subject synchrony. We report results from 236 dyads experiencing synchrony neurofeedback during naturalistic face-to-face interactions, and show that pairs' social closeness and affective personality traits can be reliably captured with the inter-brain synchrony neurofeedback protocol, which incorporates several different online inter-subject connectivity analyses that can be applied interchangeably. Hybrid Harmony can be used by researchers who wish to study the effects of synchrony biofeedback, and by biofeedback artists and serious game developers who wish to incorporate multiplayer situations into their practice.

Easier Said Than Done? Task Difficulty's Influence on Temporal Alignment, Semantic Similarity, and Complexity Matching Between Gestures and Speech

Gestures and speech are clearly synchronized in many ways. However, previous studies have shown that the semantic similarity between gestures and speech breaks down as people approach transitions in understanding. Explanations for these gesture–speech mismatches, which focus on gestures and speech expressing different cognitive strategies, have been criticized for disregarding gestures’ and speech's integration and synchronization. In the current study, we applied three different perspectives to investigate gesture–speech synchronization in an easy and a difficult task: temporal alignment, semantic similarity, and complexity matching. Participants engaged in a simple cognitive task and were assigned to either an easy or a difficult condition. We automatically measured pointing gestures, and we coded participant's speech, to determine the temporal alignment and semantic similarity between gestures and speech. Multifractal detrended fluctuation analysis was used to determine the extent of complexity matching between gestures and speech. We found that task difficulty indeed influenced gesture–speech synchronization in all three domains. We thereby extended the phenomenon of gesture–speech mismatches to difficult tasks in general. Furthermore, we investigated how temporal alignment, semantic similarity, and complexity matching were related in each condition, and how they predicted participants’ task performance. Our study illustrates how combining multiple perspectives, originating from different research areas (i.e., coordination dynamics, complexity science, cognitive psychology), provides novel understanding about cognitive concepts in general and about gesture–speech synchronization and task difficulty in particular.