Hyperbrain network properties of guitarists playing in quartet

Synergy of the mirror neuron system and the mentalizing system in a single brain and between brains during joint actions

Cooperative action involves the simulation of actions and their co-representation by two or more people. This requires the involvement of two complex brain systems: the mirror neuron system (MNS) and the mentalizing system (MENT), both of critical importance for successful social interaction. However, their internal organization and the potential synergy of both systems during joint actions (JA) are yet to be determined. The aim of this study was to examine the role and interaction of these two fundamental systems-MENT and MNS-during continuous interaction. To this hand, we conducted a multiple-brain connectivity analysis in the source domain during a motor cooperation task using high-density EEG dual-recordings providing relevant insights into the roles of MNS and MENT at the intra- and interbrain levels. In particular, the intra-brain analysis demonstrated the essential function of both systems during JA, as well as the crucial role played by single brain regions of both neural mechanisms during cooperative activities. Specifically, our intra-brain analysis revealed that both neural mechanisms are essential during Joint Action (JA), showing a solid connection between MNS and MENT and a central role of the single brain regions of both mechanisms during cooperative actions. Additionally, our inter-brain study revealed increased inter-subject connections involving the motor system, MENT and MNS. Thus, our findings show a mutual influence between two interacting agents, based on synchronization of MNS and MENT systems. Our results actually encourage more research into the still-largely unknown realm of inter-brain dynamics and contribute to expand the body of knowledge in social neuroscience.

Brain to brain musical interaction: A systematic review of neural synchrony in musical activities

The use of hyperscanning technology has revealed the neural mechanisms underlying multi-person interaction in musical activities. However, there is currently a lack of integration among various research findings. This systematic review aims to provide a comprehensive understanding of the social dynamics and brain synchronization in music activities through the analysis of 32 studies. The findings illustrate a strong correlation between inter-brain synchronization (IBS) and various musical activities, with the frontal, central, parietal, and temporal lobes as the primary regions involved. The application of hyperscanning not only advances theoretical research but also holds practical significance in enhancing the effectiveness of music-based interventions in therapy and education. The review also utilizes Predictive Coding Models (PCM) to provide a new perspective for interpreting neural synchronization in music activities. To address the limitations of current research, future studies could integrate multimodal data, adopt novel technologies, use non-invasive techniques, and explore additional research directions.

Hyperscanning to explore social interaction among autistic minds

Hyperscanning - the monitoring of brain activity of two or more people simultaneously - has emerged to be a popular tool for assessing neural features of social interaction. This perspective article focuses on hyperscanning studies that use functional near-infrared spectroscopy (fNIRS), a technique that is very conducive to studies requiring naturalistic paradigms. In particular, we are interested in neural features that are related to social interaction deficits among individuals with autism spectrum disorders (ASD). This population has received relatively little attention in research using neuroimaging hyperscanning techniques, compared to neurotypical individuals. The study is outlined as follows. First, we summarize the findings about brain-behavior connections related to autism from previously published fNIRS hyperscanning studies. Then, we propose a preliminary theoretical framework of inter-brain coherence (IBC) with testable hypotheses concerning this population. Finally, we provide two examples of areas of inquiry in which studies could be particularly relevant for social-emotional/behavioral development for autistic children, focusing on intergenerational relationships in family units and learning in classroom settings in mainstream schools.

A framework for joint music making: Behavioral findings, neural processes, and computational models

Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.

Hyper-brain hyper-frequency network topology dynamics when playing guitar in quartet

Ensemble music performance is a highly coordinated form of social behavior requiring not only precise motor actions but also synchronization of different neural processes both within and between the brains of ensemble players. In previous analyses, which were restricted to within-frequency coupling (WFC), we showed that different frequencies participate in intra- and inter-brain coordination, exhibiting distinct network topology dynamics that underlie coordinated actions and interactions. However, many of the couplings both within and between brains are likely to operate across frequencies. Hence, to obtain a more complete picture of hyper-brain interaction when musicians play the guitar in a quartet, cross-frequency coupling (CFC) has to be considered as well. Furthermore, WFC and CFC can be used to construct hyper-brain hyper-frequency networks (HB-HFNs) integrating all the information flows between different oscillation frequencies, providing important details about ensemble interaction in terms of network topology dynamics (NTD). Here, we reanalyzed EEG (electroencephalogram) data obtained from four guitarists playing together in quartet to explore changes in HB-HFN topology dynamics and their relation to acoustic signals of the music. Our findings demonstrate that low-frequency oscillations (e.g., delta, theta, and alpha) play an integrative or pacemaker role in such complex networks and that HFN topology dynamics are specifically related to the guitar quartet playing dynamics assessed by sound properties. Simulations by link removal showed that the HB-HFN is relatively robust against loss of connections, especially when the strongest connections are preserved and when the loss of connections only affects the brain of one guitarist. We conclude that HB-HFNs capture neural mechanisms that support interpersonally coordinated action and behavioral synchrony.

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.

Interpersonal neural synchrony and mental disorders: unlocking potential pathways for clinical interventions

Introduction

Interpersonal synchronization involves the alignment of behavioral, affective, physiological, and brain states during social interactions. It facilitates empathy, emotion regulation, and prosocial commitment. Mental disorders characterized by social interaction dysfunction, such as Autism Spectrum Disorder (ASD), Reactive Attachment Disorder (RAD), and Social Anxiety Disorder (SAD), often exhibit atypical synchronization with others across multiple levels. With the introduction of the "second-person" neuroscience perspective, our understanding of interpersonal neural synchronization (INS) has improved, however, so far, it has hardly impacted the development of novel therapeutic interventions.

Methods

To evaluate the potential of INS-based treatments for mental disorders, we performed two systematic literature searches identifying studies that directly target INS through neurofeedback (12 publications; 9 independent studies) or brain stimulation techniques (7 studies), following PRISMA guidelines. In addition, we narratively review indirect INS manipulations through behavioral, biofeedback, or hormonal interventions. We discuss the potential of such treatments for ASD, RAD, and SAD and using a systematic database search assess the acceptability of neurofeedback (4 studies) and neurostimulation (4 studies) in patients with social dysfunction.

Results

Although behavioral approaches, such as engaging in eye contact or cooperative actions, have been shown to be associated with increased INS, little is known about potential long-term consequences of such interventions. Few proof-of-concept studies have utilized brain stimulation techniques, like transcranial direct current stimulation or INS-based neurofeedback, showing feasibility and preliminary evidence that such interventions can boost behavioral synchrony and social connectedness. Yet, optimal brain stimulation protocols and neurofeedback parameters are still undefined. For ASD, RAD, or SAD, so far no randomized controlled trial has proven the efficacy of direct INS-based intervention techniques, although in general brain stimulation and neurofeedback methods seem to be well accepted in these patient groups.

Discussion

Significant work remains to translate INS-based manipulations into effective treatments for social interaction disorders. Future research should focus on mechanistic insights into INS, technological advancements, and rigorous design standards. Furthermore, it will be key to compare interventions directly targeting INS to those targeting other modalities of synchrony as well as to define optimal target dyads and target synchrony states in clinical interventions.

Dynamics in interbrain synchronization while playing a piano duet

Humans interact with each other through actions that are implemented by sensory and motor processes. To investigate the role of interbrain synchronization emerging during interpersonal action coordination, electroencephalography data from 13 pairs of pianists were recorded simultaneously while they performed a duet together. The study aimed to investigate whether interbrain phase couplings can be reduced to similar bottom-up driven processes during synchronous play, or rather represent cognitive top-down control required during periods of higher coordination demands. To induce such periods, one of the musicians acted as a confederate who deliberately desynchronized the play. As intended, on the behavioral level, the perturbation caused a breakdown in the synchronization of the musicians' play and in its stability across trials. On the brain level, interbrain synchrony, as measured by the interbrain phase coherence (IPC), increased in the delta and theta frequency bands during perturbation as compared to non-perturbed trials. Interestingly, this increase in IPC in the delta band was accompanied by the shift of the phase difference angle from in-phase toward anti-phase synchrony. In conclusion, the current study demonstrates that interbrain synchronization is based on the interpersonal temporal alignment of different brain mechanisms and is not simply reducible to similar sensory or motor responses.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

A scalable and robust system for audience EEG recordings

The neural mechanisms that unfold when humans form a large group defined by an overarching context, such as audiences in theater or sports, are largely unknown and unexplored. This is mainly due to the lack of availability of a scalable system that can record the brain activity from a significantly large portion of such an audience simultaneously. Although the technology for such a system has been readily available for a long time, the high cost as well as the large overhead in human resources and logistic planning have prohibited the development of such a system. However, during the recent years reduction in technology costs and size have led to the emergence of low-cost, consumer-oriented EEG systems, developed primarily for recreational use. Here by combining such a low-cost EEG system with other off-the-shelve hardware and tailor-made software, we develop in the lab and test in a cinema such a scalable EEG hyper-scanning system. The system has a robust and stable performance and achieves accurate unambiguous alignment of the recorded data of the different EEG headsets. These characteristics combined with small preparation time and low-cost make it an ideal candidate for recording large portions of audiences.

Intra- and inter-brain coupling and activity dynamics during improvisational music therapy with a person with dementia: an explorative EEG-hyperscanning single case study

Objective

Real-life research into the underlying neural dynamics of improvisational music therapy, used with various clinical populations, is largely lacking. This single case study explored within-session differences in musical features and in within- and between-brain coupling between a Person with Dementia (PwD) and a music therapist during a music therapy session.

Methods

Dual-EEG from a music therapist and a PwD (male, 31 years) was recorded. Note density, pulse clarity and synchronicity were extracted from audio-visual data. Three music therapists identified moments of interest and no interest (MOI/MONI) in two drum improvisations. The Integrative Coupling Index, reflecting time-lagged neural synchronization, and musical features were compared between the MOI and MONI.

Results

Between-brain coupling of 2 Hz activity was increased during the MOI, showing anteriority of the therapist's neural activity. Within-brain coupling for the PwD was stronger from frontal and central areas during the MOI, but within-brain coupling for the therapist was stronger during MONI. Differences in musical features indicated that both acted musically more similar to one another during the MOI.

Conclusion

Within-session differences in neural synchronization and musical features highlight the dynamic nature of music therapy.

Significance

The findings contribute to a better understanding of social and affective processes in the brain and (interactive) musical behaviors during specific moments in a real-life music therapy session. This may provide insights into the role of such moments for relational-therapeutic processes.

In touch: Cardiac and respiratory patterns synchronize during ensemble singing with physical contact

Musical ensemble performances provide an ideal environment to gain knowledge about complex human interactions. Network structures of synchronization can reflect specific roles of individual performers on the one hand and a higher level of organization of all performers as a superordinate system on the other. This study builds on research on joint singing, using hyperscanning of respiration and heart rate variability (HRV) from eight professional singers. Singers performed polyphonic music, distributing their breathing within the same voice and singing without and with physical contact: that is touching each other's shoulder or waist. The idea of singing with touch was motivated by historical depictions of ensemble performances that showed singers touching each other. It raises the question of the potential benefit of touch for group performances. From a psycho-physiological point of view, physical contact should increase the synchronization of singing coordination. The results confirm previous findings on synchronization of respiration and HRV during choir singing and extend those findings to a non-homophonic musical repertoire while also revealing an increase in synchronization in respiration during physical contact. These effects were significant across different frequency ranges. The effect of physical contact was stronger when all singers were singing in comparison to the partial ensemble. Importantly, the synchronization could not be fully explained by the singing action (i.e., singing the same voice, or singing vs. listening) or by the standing position or touch. This finding suggests a higher level of organization of all singers, forming a superordinate system.

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

The study of brain-to-brain synchrony has a burgeoning application in the brain-computer interface (BCI) research, offering valuable insights into the neural underpinnings of interacting human brains using numerous neural recording technologies. The area allows exploring the commonality of brain dynamics by evaluating the neural synchronization among a group of people performing a specified task. The growing number of publications on brain-to-brain synchrony inspired the authors to conduct a systematic review using the PRISMA protocol so that future researchers can get a comprehensive understanding of the paradigms, methodologies, translational algorithms, and challenges in the area of brain-to-brain synchrony research. This review has gone through a systematic search with a specified search string and selected some articles based on pre-specified eligibility criteria. The findings from the review revealed that most of the articles have followed the social psychology paradigm, while 36% of the selected studies have an application in cognitive neuroscience. The most applied approach to determine neural connectivity is a coherence measure utilizing phase-locking value (PLV) in the EEG studies, followed by wavelet transform coherence (WTC) in all of the fNIRS studies. While most of the experiments have control experiments as a part of their setup, a small number implemented algorithmic control, and only one study had interventional or a stimulus-induced control experiment to limit spurious synchronization. Hence, to the best of the authors' knowledge, this systematic review solely contributes to critically evaluating the scopes and technological advances of brain-to-brain synchrony to allow this discipline to produce more effective research outcomes in the remote future.

Social synchronization of brain activity increases during eye-contact

Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization.

Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

Interbrain emotional connection during music performances is driven by physical proximity and individual traits

How musical emotions and the pleasure derived from music, regardless of the musical valence, can be shared between individuals is a fascinating question, and investigating it can shed light on the function of musical reward. We carried out our investigations in a natural setting during an international competition for orchestra conductors. Participants (n = 15) used a dedicated smartphone app to report their subjective emotional experiences in real time while we recorded their cerebral activity using electroencephalography and their electrodermal activity. The overall behavioral real-time behavioral ratings suggest a possible social influence on the reported and felt pleasure. The physically closer the participants, the more similar their reported pleasure. By calculating the interindividual cerebral coherence (n = 21 pairs), we showed that when people simultaneously reported either high or low pleasure, their cerebral activities were closer than for simultaneous neutral pleasure reports. Participants' skin conductance levels were also more coupled when reporting higher emotional degrees simultaneously. More importantly, the participants who were physically closer had higher cerebral coherence, but only when they simultaneously reported a high level of pleasure. We propose that emotional contagion and/or emotional resonance mechanisms could explain why a form of "emotional connecting force" arises between people during shared appraisal situations.

Toward collective animal neuroscience

[Figure: see text].

Probing associations between interbrain synchronization and interpersonal action coordination during guitar playing

Playing music in an ensemble is a highly coordinated human action involving musicians' brain-body interactions at different levels of physical and cortical organization in time and space. It has been suggested that interbrain phase synchronization plays an essential role in musical interaction. In this study, we aimed to explore associations between interbrain synchronization and interpersonal action coordination, using electroencephalographic recordings of the brain activity of guitarists playing in a duet as well as the acoustic recordings of their music. By applying phase synchronization algorithms to the musicians' brain activities and the sounds produced during guitar playing, we show that synchronous brain activity is strongly related to instrument sounds and behavioral play-onset synchrony, as indicated by phase alignment in relation to the time differences in play onsets and an angular-linear correlation between phase and time differences across trials and guitarist pairs. Interestingly, this correlation was especially strong in the first part of the music piece, when the guitarists seem to adjust their coordinated play onsets and brain rhythms actively. This suggests that the methods capturing intra- and interbrain synchronization and its relations to coordinated playing provide crucial information about the underlying mechanisms of interpersonal action coordination.

Interactive brains, social minds: Neural and physiological mechanisms of interpersonal action coordination

It is now widely accepted that inter-brain synchronization is an important and inevitable mechanism of interpersonal action coordination and social interaction behavior. This review of the current literature focuses first on the forward model for interpersonal action coordination and functional system theory for biological systems, two broadly similar concepts for adaptive system behavior. Further, we review interacting-brain and/or hyper-brain dynamics studies, to show the interplay between intra- and inter-brain connectivity resulting in hyper-brain network structure and network topology dynamics, and consider the functioning of interacting brains as a superordinate system. The concept of a superordinate system, or superorganism, is then evaluated with respect to neuronal and physiological systems group dynamics, which show further accompanying mechanisms of interpersonal interaction. We note that fundamental problems need to be resolved to better understand the neural mechanisms of interpersonal action coordination.

EEG hyperscanning in motor rehabilitation: a position paper

Studying the human brain during interpersonal interaction allows us to answer many questions related to motor control and cognition. For instance, what happens in the brain when two people walking side by side begin to change their gait and match cadences? Adapted from the neuroimaging techniques used in single-brain measurements, hyperscanning (HS) is a technique used to measure brain activity from two or more individuals simultaneously. Thus far, HS has primarily focused on healthy participants during social interactions in order to characterize inter-brain dynamics. Here, we advocate for expanding the use of this electroencephalography hyperscanning (EEG-HS) technique to rehabilitation paradigms in individuals with neurological diagnoses, namely stroke, spinal cord injury (SCI), Parkinson's disease (PD), and traumatic brain injury (TBI). We claim that EEG-HS in patient populations with impaired motor function is particularly relevant and could provide additional insight on neural dynamics, optimizing rehabilitation strategies for each individual patient. In addition, we discuss future technologies related to EEG-HS that could be developed for use in the clinic as well as technical limitations to be considered in these proposed settings.

Interacting brains coming in sync through their minds: an interbrain neurofeedback study

Neurophysiological evidence shows that interpersonal action coordination is accompanied by interbrain synchronization (IBS). However, the functional significance of this association remains unclear. Using two experimental designs, we explored whether IBS is amenable to neurofeedback (NFB). Feedback was provided either as two balls approaching each other (so-called ball design), or as two pendula, each reflecting the oscillatory activity of one of the two participants (so-called pendulum design). The NFB was provided at delta (i.e., 2.5 Hz) and theta (i.e., 5 Hz) electroencephalography frequencies, and manipulated by enhanced and inverse feedback. We showed that the participants were able to increase IBS by using NFB, especially when it was fed back at the theta frequency. Apart from intra- and interbrain coupling, other oscillatory activities (e.g., power spectral density, peak amplitude, and peak frequency) also changed during the task compared with the rest. Moreover, all the measures showed specific correlations with the subjective postsurvey item scores, reflecting subjective feeling and appraisal. We conclude that the use of IBS for NFB might help in specifying the contribution of IBS to interpersonal action coordination and in providing important information about the neural mechanisms of social interaction and the causal dimension of IBS.

Inter-brain synchronization during a cooperative task reflects the sense of joint agency

People feel the sense of 'joint agency', which is the sense that 'we' did it, during a mutually cooperative action. Previous studies have reported that the inter-brain synchronization occurs during a mutually cooperative action, nevertheless the neural correlates of the sense of joint agency remains unclear. Here, we investigated whether the sense of joint agency reflects the inter-brain synchronization during a joint action. The pairs of participants engaged in constant rhythm tapping tasks with alternative (turn-taking) or sequential (non-turn-taking) coordination. Electroencephalograms (EEGs) of the participant pair during the tasks were simultaneously measured (hyperscanned), and the participants were subsequently asked to rate the sense of joint agency. The results showed that the participants felt strong sense of joint agency in the turn-taking cooperative actions, but not in the non-turn-taking actions. Moreover, EEG theta (4-7 Hz) oscillations were more synchronized between the frontal region in the leader, who tapped the first, and the right temporo-parietal region in the follower, who tapped following the leader, during the turn-taking cooperative actions than during the non-turn-taking cooperative actions. Furthermore, the degree of inter-brain synchronization was significantly correlated with the sense of joint agency, as well as the temporal accuracy of the tapping actions of the pair. These results indicate that the sense of joint agency strongly reflects the inter-brain synchronization, which depends on the quality of mutual cooperation during a joint action.

Inter-brain synchrony in teams predicts collective performance

Despite decades of research in economics and psychology attempting to identify ingredients that make up successful teams, neuroscientists have only just begun to study how multiple brains interact. Recent research has shown that people's brain activity becomes synchronized with others' (inter-brain synchrony) during social engagement. However, little is known as to whether inter-brain synchrony relates to collective behavior within teams. Here, we merge the nascent field of group neuroscience with the extant literature of team dynamics and collective performance. We recruited 174 participants in groups of 4 and randomly assigned them to complete a series of problem-solving tasks either independently or as a team, while simultaneously recording each person's brain activity using an electroencephalography hyperscanning setup. This design allowed us to examine the relationship between group identification and inter-brain synchrony in explaining collective performance. As expected, teammates identified more strongly with one another, cooperated more on an economic game, and outperformed the average individual on most problem-solving tasks. Crucially, inter-brain synchrony, but not self-reported group identification, predicted collective performance among teams. These results suggest that inter-brain synchrony can be informative in understanding collective performance among teams where self-report measures may fail to capture behavior.

Are the new mobile wireless EEG headsets reliable for the evaluation of musical pleasure?

Since the beginning of the 20th century, electroencephalography (EEG) has been used in a wide variety of applications, both for medical needs and for the study of various cerebral processes. With the rapid development of the technique, more and more precise and advanced tools have emerged for research purposes. However, the main constraints of these devices have often been the high price and, for some devices the low transportability and the long set-up time. Nevertheless, a broad range of wireless EEG devices have emerged on the market without these constraints, but with a lower signal quality. The development of EEG recording on multiple participants simultaneously, and new technological solutions provides further possibilities to understand the cerebral emotional dynamics of a group. A great number of studies have compared and tested many mobile devices, but have provided contradictory results. It is therefore important to test the reliability of specific wireless devices in a specific research context before developing a large-scale study. The aim of this study was to assess the reliability of two wireless devices (g.tech Nautilus SAHARA electrodes and Emotiv™ Epoc +) for the detection of musical emotions, in comparison with a gold standard EEG device. Sixteen participants reported feeling emotional pleasure (from low pleasure up to musical chills) when listening to their favorite chill-inducing musical excerpts. In terms of emotion detection, our results show statistically significant concordance between Epoc + and the gold standard device in the left prefrontal and left temporal areas in the alpha frequency band. We validated the use of the Emotiv™ Epoc + for research into musical emotion. We did not find any significant concordance between g.tech and the gold standard. This suggests that Emotiv Epoc is more appropriate for musical emotion investigations in natural settings.

Cortical Patterns of Pleasurable Musical Chills Revealed by High-Density EEG

Music has the capacity to elicit strong positive feelings in humans by activating the brain's reward system. Because group emotional dynamics is a central concern of social neurosciences, the study of emotion in natural/ecological conditions is gaining interest. This study aimed to show that high-density EEG (HD-EEG) is able to reveal patterns of cerebral activities previously identified by fMRI or PET scans when the subject experiences pleasurable musical chills. We used HD-EEG to record participants (11 female, 7 male) while listening to their favorite pleasurable chill-inducing musical excerpts; they reported their subjective emotional state from low pleasure up to chills. HD-EEG results showed an increase of theta activity in the prefrontal cortex when arousal and emotional ratings increased, which are associated with orbitofrontal cortex activation localized using source localization algorithms. In addition, we identified two specific patterns of chills: a decreased theta activity in the right central region, which could reflect supplementary motor area activation during chills and may be related to rhythmic anticipation processing, and a decreased theta activity in the right temporal region, which may be related to musical appreciation and could reflect the right superior temporal gyrus activity. The alpha frontal/prefrontal asymmetry did not reflect the felt emotional pleasure, but the increased frontal beta to alpha ratio (measure of arousal) corresponded to increased emotional ratings. These results suggest that EEG may be a reliable method and a promising tool for the investigation of group musical pleasure through musical reward processing.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.

A Multi-Brain Framework for Social Interaction

Social interaction can be seen as a dynamic feedback loop that couples action, reaction, and internal cognitive processes across individual agents. A fuller understanding of the social brain requires a description of how the neural dynamics across coupled brains are linked and how they coevolve over time. We elaborate a multi-brain framework that considers social interaction as an integrated network of neural systems that dynamically shape behavior, shared cognitive states, and social relationships. We describe key findings from multi-brain experiments in humans and animal models that shed new light on the function of social circuits in health and disease. Finally, we discuss recent progress in elucidating the cellular-level mechanisms underlying inter-brain neural dynamics and outline key areas for future research.

Raising the bar: Can dual scanning improve our understanding of joint action?

Two-person neuroscience (2 ​PN) is a recently introduced conceptual and methodological framework used to investigate the neural basis of human social interaction from simultaneous neuroimaging of two or more subjects (hyperscanning). In this study, we adopted a 2 ​PN approach and a multiple-brain connectivity model to investigate the neural basis of a form of cooperation called joint action. We hypothesized different intra-brain and inter-brain connectivity patterns when comparing the interpersonal properties of joint action with non-interpersonal conditions, with a focus on co-representation, a core ability at the basis of cooperation. 32 subjects were enrolled in dual-EEG recordings during a computerized joint action task including three conditions: one in which the dyad jointly acted to pursue a common goal (joint), one in which each subject interacted with the PC (PC), and one in which each subject performed the task individually (Solo). A combination of multiple-brain connectivity estimation and specific indices derived from graph theory allowed to compare interpersonal with non-interpersonal conditions in four different frequency bands. Our results indicate that all the indices were modulated by the interaction, and returned a significantly stronger integration of multiple-subject networks in the joint vs. PC and Solo conditions. A subsequent classification analysis showed that features based on multiple-brain indices led to a better discrimination between social and non-social conditions with respect to single-subject indices. Taken together, our results suggest that multiple-brain connectivity can provide a deeper insight into the understanding of the neural basis of cooperation in humans.

The Relevance of a Conductor Competition for the Study of Emotional Synchronization Within and Between Groups in a Natural Musical Setting

Group emotional dynamics are a central concern in the study of human interaction and communication. To study group emotions, the social context of a musical event in natural conditions may overcome several limits of laboratory experiments and could provide a suitable framework. This study aimed to evaluate if cultural events such as a conductor competition could welcome scientific research for the study of group emotional sharing. We led an observational study, which suggests that in this particular context, public, musicians and jury would agree to participate and to wear neurophysiological and physiological devices to monitor their emotional state during the competition. Self-administrated scales showed that, in the context of a musical competition, members of the public felt strong musical emotions such as music chills. Our results suggest that such a specific competition design is a suitable experimental model to lead an experiment under ecological conditions to effectively investigate collective emotional synchronization. In the future, with the implementation of an acquisition system recording synchronous neurophysiological data for a large group of participants, we may be able to highlight mechanisms involved in emotional synchronization in a natural musical setting.

Dynamic Orchestration of Brains and Instruments During Free Guitar Improvisation

Playing music in ensemble requires enhanced sensorimotor coordination and the non-verbal communication of musicians that need to coordinate their actions precisely with those of others. As shown in our previous studies on guitar duets, and also on a guitar quartet, intra- and inter-brain synchronization plays an essential role during such interaction. At the same time, sensorimotor coordination as an essential part of this interaction requires being in sync with the auditory signals coming from the played instruments. In this study, using acoustic recordings of guitar playing and electroencephalographic (EEG) recordings of brain activity from guitarists playing in duet, we aimed to explore whether the musicians' brain activity synchronized with instrument sounds produced during guitar playing. To do so, we established an analytical method based on phase synchronization between time-frequency transformed guitar signals and raw EEG signals. Given phase synchronization, or coupling between guitar and brain signals, we constructed so-called extended hyper-brain networks comprising all possible interactions between two guitars and two brains. Applying a graph-theoretical approach to these networks assessed across time, we present dynamic changes of coupling strengths or dynamic orchestration of brains and instruments during free guitar improvisation for the first time. We also show that these dynamic network topology changes are oscillatory in nature and are characterized by specific spectral peaks, indicating the temporal structure in the synchronization patterns between guitars and brains. Moreover, extended hyper-brain networks exhibit specific modular organization varying in time, and binding each time, different parts of the network into the modules, which were mostly heterogeneous (i.e., comprising signals from different instruments and brains or parts of them). This suggests that the method capturing synchronization between instruments and brains when playing music provides crucial information about the underlying mechanisms. We conclude that this method may be an indispensable tool in the investigation of social interaction, music therapy, and rehabilitation dynamics.

Adjustment of Synchronization Stability of Dynamic Brain-Networks Based on Feature Fusion

When the brain is active, the neural activities of different regions are integrated on various spatial and temporal scales; this is termed the synchronization phenomenon in neurobiological theory. This synchronicity is also the main underlying mechanism for information integration and processing in the brain. Clinical medicine has found that some of the neurological diseases that are difficult to cure have deficiencies or abnormalities in the whole or local integration processes of the brain. By studying the synchronization capabilities of the brain-network, we can intensively describe and characterize both the state of the interactions between brain regions and their differences between people with a mental illness and a set of controls by measuring the rapid changes in brain activity in patients with psychiatric disorders and the strength and integrity of their entire brain network. This is significant for the study of mental illness. Because static brain network connection methods are unable to assess the dynamic interactions within the brain, we introduced the concepts of dynamics and variability in a constructed EEG brain functional network based on dynamic connections, and used it to analyze the variability in the time characteristics of the EEG functional network. We used the spectral features of the brain network to extract its synchronization features and used the synchronization features to describe the process of change and the differences in the brain network's synchronization ability between a group of patients and healthy controls during a working memory task. We propose a method based on the fusion of traditional features and spectral features to achieve an adjustment of the patient's brain network synchronization ability, so that its synchronization ability becomes consistent with that of healthy controls, theoretically achieving the purpose of the treatment of the diseases. Studying the stability of brain network synchronization can provide new insights into the pathogenic mechanism and cure of mental diseases and has a wide range of potential applications.

Hyper-Frequency Network Topology Changes During Choral Singing

Choral singing requires the coordination of physiological subsystems within and across individuals. Previously, we suggested that the choir functions as a superordinate system that imposes boundary conditions on the dynamic features of the individual singers and found reliable differences in the network topography by analyzing within- and cross-frequency couplings (WFC and CFC, respectively). Here, we further refine our analyses to investigate hyper-frequency network (HFN) topology structures (i.e., the layout or arrangement of connections) using a graph-theoretical approach. In a sample of eleven singers and one conductor engaged in choral singing (aged between 23 and 56 years, and including five men and seven women), we calculated phase coupling (WFC and CFC) between respiratory, cardiac, and vocalizing subsystems across ten frequencies of interest. All these couplings were used for construction of HFN with nodes being a combination of frequency components and subsystems across choir participants. With regard to the network topology measures, we found that clustering coefficients (CCs) as well as local and global efficiency were highest and characteristic path lengths, correspondingly, were shortest when the choir sang a canon in parts as compared to singing it in unison. Furthermore, these metrics revealed a significant relationship to individual heart rate, as an indicator of arousal, and to an index of heart rate variability indicated by the LF/HF ratio (low and high frequency, respectively), and reflecting the balance between sympathetic and parasympathetic activity. In addition, we found that the CC and local efficiency for groups singing the same canon part were higher than for groups of singers constructed randomly post hoc, indicating stronger neighbor–neighbor connections in the former. We conclude that network topology dynamics are a crucial determinant of group behavior and may represent a potent biomarker for social interaction.

Brain and Cognitive Mechanisms of Top–Down Attentional Control in a Multisensory World: Benefits of Electrical Neuroimaging

In real-world environments, information is typically multisensory, and objects are a primary unit of information processing. Object recognition and action necessitate attentional selection of task-relevant from among task-irrelevant objects. However, the brain and cognitive mechanisms governing these processes remain not well understood. Here, we demonstrate that attentional selection of visual objects is controlled by integrated top–down audiovisual object representations (“attentional templates”) while revealing a new brain mechanism through which they can operate. In multistimulus (visual) arrays, attentional selection of objects in humans and animal models is traditionally quantified via “the N2pc component”: spatially selective enhancements of neural processing of objects within ventral visual cortices at approximately 150–300 msec poststimulus. In our adaptation of Folk et al.'s [Folk, C. L., Remington, R. W., & Johnston, J. C. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030–1044, 1992] spatial cueing paradigm, visual cues elicited weaker behavioral attention capture and an attenuated N2pc during audiovisual versus visual search. To provide direct evidence for the brain, and so, cognitive, mechanisms underlying top–down control in multisensory search, we analyzed global features of the electrical field at the scalp across our N2pcs. In the N2pc time window (170–270 msec), color cues elicited brain responses differing in strength and their topography. This latter finding is indicative of changes in active brain sources. Thus, in multisensory environments, attentional selection is controlled via integrated top–down object representations, and so not only by separate sensory-specific top–down feature templates (as suggested by traditional N2pc analyses). We discuss how the electrical neuroimaging approach can aid research on top–down attentional control in naturalistic, multisensory settings and on other neurocognitive functions in the growing area of real-world neuroscience.