Cooperation and Competition with Hyperscanning Methods: Review and Future Application to Emotion Domain

Hyperscanning literature after two decades of neuroscientific research: A scientometric review

Hyperscanning, a neuroimaging approach introduced in 2002 for simultaneously recording the brain activity of multiple participants, has significantly contributed to our understanding of social interactions. Nevertheless, the existing literature requires systematic organization to advance our knowledge. This study, after two decades of hyperscanning research, aims to identify the primary thematic domains and the most influential documents in the field. We conducted a scientometric analysis to examine co-citation patterns quantitatively, using a sample of 548 documents retrieved from Scopus and their 32,022 cited references. Our analysis revealed ten major thematic domains in hyperscanning research, with the most impactful document authored by Czeszumski and colleagues in 2020. Notably, while hyperscanning was initially developed for functional magnetic resonance imaging (fMRI), our findings indicate a substantial influence of research conducted using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The introduction of fNIRS and advancements in EEG methods have enabled the implementation of more ecologically valid experiments for investigating social interactions. The study also highlights the need for more research that combines multi-brain neural stimulation with neuroimaging techniques to understand the causal role played by interpersonal neural synchrony in social interactions.

Formulation of Common Spatial Patterns for Multi-Task Hyperscanning BCI

This work proposes a new formulation for common spatial patterns (CSP), often used as a powerful feature extraction technique in brain-computer interfacing (BCI) and other neurological studies. In this approach, applied to multiple subjects' data and named as hyperCSP, the individual covariance and mutual correlation matrices between multiple simultaneously recorded subjects' electroencephalograms are exploited in the CSP formulation. This method aims at effectively isolating the common motor task between multiple heads and alleviate the effects of other spurious or undesired tasks inherently or intentionally performed by the subjects. This technique can provide a satisfactory classification performance while using small data size and low computational complexity. By using the proposed hyperCSP followed by support vector machines classifier, we obtained a classification accuracy of 81.82% over 8 trials in the presence of strong undesired tasks. We hope that this method could reduce the training error in multi-task BCI scenarios. The recorded valuable motor-related hyperscanning dataset is available for public use to promote the research in this area.

How Socially Avoidant Emerging Adults Process Social Feedback during Human-to-Human Interaction after Social Rejection: An Event-Related Potential Study

Social avoidance refers to active non-participation in social activities, which is detrimental to healthy interpersonal interaction for emerging adults. Social rejection is a kind of negative social evaluation from others making people feel social pain. However, how socially avoidant emerging adults process social feedback information after experiencing social rejection has received less attention. The current study aimed to explore the differences in social interaction feedback processing after social rejection between a socially avoidant group (n = 16) and a comparison group (n = 16) in a human-to-human interaction context. Computer game tasks with two types of interaction (cooperation and competition) were used to record the event-related potentials when receiving social interaction feedback in two conditions (social rejection and control condition). The results showed that (1) the socially avoidant group had lower reward positivity amplitudes than the comparison group when receiving social feedback; (2) the socially avoidant group presented larger P300 amplitudes in the social rejection condition than in the control condition, but the comparison group did not; and (3) social rejection evoked more negative N1 amplitudes in the socially avoidant and comparison groups. The findings suggest that socially avoidant emerging adults may have flaws in reward sensitivity during interpersonal interaction, and they might also exert more attentional and emotional resources to social feedback after social rejection.

Brain activity supporting alternating speech for semantic words: simultaneous magnetoencephalographic recording

Communication, especially conversation, is essential for human social life. Many previous studies have examined the neuroscientific underpinnings of conversation, i.e. language comprehension and speech production. However, conversation inherently involves two or more people, and unless two people actually interact with one another, the nature of the conversation cannot be truly revealed. Therefore, in this study, we used two magnetoencephalographs that were connected together, and simultaneously recorded brain activity while two people took turns speaking in a word association/alphabet completion task. We compared the amplitude modulation of the alpha- and beta-band rhythms within each of the 62 brain regions under semantic (word association; less predictable) and non-semantic (alphabet completion; more predictable) conditions. We found that the amplitudes of the rhythms were significantly different between conditions in a wide range of brain regions. Additionally, significant differences were observed in nearly the same group of brain regions after versus before each utterance, indicating that a wide range of brain areas is involved in predicting a conversation partner's next utterance. This result supports the idea that mentalizing, e.g. predicting another person's speech, plays an important role in conversation, and suggests that the neural network implicated in mentalizing extends over a wide range of brain regions.

Exploring the role of mutual prediction in inter-brain synchronization during competitive interactions: an fNIRS hyperscanning investigation

Mutual prediction is crucial for understanding the mediation of bodily actions in social interactions. Despite this importance, limited studies have investigated neurobehavioral patterns under the mutual prediction hypothesis in natural competitive scenarios. To address this gap, our study employed functional near-infrared spectroscopy hyperscanning to examine the dynamics of real-time rock-paper-scissors games using a computerized paradigm with 54 participants. Firstly, our results revealed activations in the right inferior frontal gyrus, bilateral dorsolateral prefrontal cortex, and bilateral frontopolar cortex, each displaying distinct temporal profiles indicative of diverse cognitive processes during the task. Subsequently, a task-related increase in inter-brain synchrony was explicitly identified in the right dorsolateral prefrontal cortex, which supported the mutual prediction hypothesis across the two brains. Moreover, our investigation uncovered a close association between the coherence value in the right dorsolateral prefrontal cortex and the dynamic predictive performances of dyads using inter-subject representational similarity analysis. Finally, heightened inter-brain synchrony values were observed in the right dorsolateral prefrontal cortex before a draw compared to a no-draw scenario in the second block, suggesting that cross-brain signal patterns could be reflected in behavioral responses during competition. In summary, these findings provided initial support for expanding the understanding of cognitive processes underpinning natural competitive engagements.

An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action

A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.

Brain-to-brain communication during musical improvisation: a performance case study

Understanding and predicting others' actions in ecological settings is an important research goal in social neuroscience. Here, we deployed a mobile brain-body imaging (MoBI) methodology to analyze inter-brain communication between professional musicians during a live jazz performance. Specifically, bispectral analysis was conducted to assess the synchronization of scalp electroencephalographic (EEG) signals from three expert musicians during a three-part 45 minute jazz performance, during which a new musician joined every five minutes. The bispectrum was estimated for all musician dyads, electrode combinations, and five frequency bands. The results showed higher bispectrum in the beta and gamma frequency bands (13-50 Hz) when more musicians performed together, and when they played a musical phrase synchronously. Positive bispectrum amplitude changes were found approximately three seconds prior to the identified synchronized performance events suggesting preparatory cortical activity predictive of concerted behavioral action. Moreover, a higher amount of synchronized EEG activity, across electrode regions, was observed as more musicians performed, with inter-brain synchronization between the temporal, parietal, and occipital regions the most frequent. Increased synchrony between the musicians' brain activity reflects shared multi-sensory processing and movement intention in a musical improvisation task.

Autonomic synchrony induced by hyperscanning interoception during interpersonal synchronization tasks

According to previous research, people influence each other's emotional states during social interactions via resonance mechanisms and coordinated autonomic rhythms. However, no previous studies tested if the manipulation of the interoceptive focus (focused attention on the breath for a given time interval) in hyperscanning during synchronized tasks may have an impact on autonomic synchrony. Thus, this study aims to assess the psychophysiological synchrony through autonomic measures recording during dyadic linguistic and motor synchronization tasks performed in two distinct interoceptive conditions: the focus and no focus on the breath condition. 26 participants coupled in 13 dyads were recruited. Individuals' autonomic measures [electrodermal: skin conductance level and response (SCL, SCR); cardiovascular indices: heart rate (HR) and HR variability (HRV)] was continuously monitored during the experiment and correlational coefficients were computed to analyze dyads physiological synchrony. Inter-subject analysis revealed higher synchrony for HR, HRV, SCL, and SCR values in the focus compared to no focus condition during the motor synchronization task and in general more for motor than linguistic task. Higher synchrony was also found for HR, SCL, and SCR values during focus than no focus condition in linguistic task. Overall, evidence suggests that the manipulation of the interoceptive focus has an impact on the autonomic synchrony during distinct synchronization tasks and for different autonomic measures. Such findings encourage the use of hyperscanning paradigms to assess the effect of breath awareness practices on autonomic synchrony in ecological and real-time conditions involving synchronization.

Inter-Brain Synchrony Pattern Investigation on Triadic Board Game Play-Based Social Interaction: An fNIRS Study

Recent advances in functional neuroimaging techniques, including methodologies such as fNIRS, have enabled the evaluation of inter-brain synchrony (IBS) induced by interpersonal interactions. However, the social interactions assumed in existing dyadic hyperscanning studies do not sufficiently emulate polyadic social interactions in the real world. Therefore, we devised an experimental paradigm that incorporates the Korean folk board game "Yut-nori" to reproduce social interactions that emulate social activities in the real world. We recruited 72 participants aged 25.2 ± 3.9 years (mean ± standard deviation) and divided them into 24 triads to play Yut-nori, following the standard or modified rules. The participants either competed against an opponent (standard rule) or cooperated with an opponent (modified rule) to achieve a goal efficiently. Three different fNIRS devices were employed to record cortical hemodynamic activations in the prefrontal cortex both individually and simultaneously. Wavelet transform coherence (WTC) analyses were performed to assess prefrontal IBS within a frequency range of 0.05-0.2 Hz. Consequently, we observed that cooperative interactions increased prefrontal IBS across overall frequency bands of interest. In addition, we also found that different purposes for cooperation generated different spectral characteristics of IBS depending on the frequency bands. Moreover, IBS in the frontopolar cortex (FPC) reflected the influence of verbal interactions. The findings of our study suggest that future hyperscanning studies should consider polyadic social interactions to reveal the properties of IBS in real-world interactions.

'The Mind' promotes brain synchronization: an ecological evaluation of brain synchronization in co-operative tasks

This paper presents an ecologically valid approach for using EEG hyperscanning methods to assess levels of interbrain synchrony (IBS) in teams during co-operative tasks. We employ a card-based task in an out-of-the-lab setting to evaluate levels of neural synchrony between team members completing a co-operative task. We also examine the interplay between the recorded synchronization levels and the collective performance of the team.Clinical Relevance- This study provides a simplistic and ecologically valid setup with potential to bring a better understanding of brain synchronization in clinical settings where co-operation would improve outcomes, such as home care facilities and memory clinics.

Dyadic inter-brain EEG coherence induced by interoceptive hyperscanning

Previous single-brain studies suggested interoception plays a role in interpersonal synchronization. The aim of the present study was to assess the electrophysiological intersubject coherence through electrophysiological (EEG) hyperscanning recording during simple dyadic synchronization tasks when the participants focused on their breath. To this aim, the neural activity of 15 dyads of participants was collected during the execution of a cognitive and motor synchronization task in two distinct IA conditions: focus and no focus on the breath condition. Individuals' EEG frequency bands were recorded through EEG hyperscanning and coherence analysis was performed. Results showed greater EEG coherence was observed for the alpha band in frontopolar brain regions (Fp1, Fp2) and also in central brain regions (C3, C4) within the dyads, during the focus on the breath condition for the motor compared to the cognitive synchronization task; during the same experimental condition, delta and theta band showed augmented inter-individual coherence in the frontal region (Fz) and central areas (C3, C4). To conclude, the current hyperscanning study highlights how the manipulation of the interoceptive focus (obtained through the focus on the breath) strengthens the manifestation of the EEG markers of interpersonal tuning during a motor synchronization task in specific brain areas.

Delta-Alpha EEG pattern reflects the interoceptive focus effect on interpersonal motor synchronization

Little is known about how the modulation of the interoceptive focus impacts the neural correlates of high-level social processes, such as synchronization mechanisms. Therefore, the current study aims to explore the intraindividual electrophysiological (EEG) patterns induced by the interoceptive focus on breath when performing cognitive and motor tasks requiring interpersonal synchronization. A sample of 28 healthy caucasian adults was recruited and asked to perform two tasks requiring interpersonal synchronization during two distinct conditions: while focusing on the breath or without the focus on the breath. EEG frequency bands (delta, theta, alpha, and beta band) were recorded from the frontal, temporo-central, and parieto-occipital regions of interest. Significant results were observed for the delta and alpha bands. Notably, higher mean delta values and alpha desynchronization were observed in the temporo-central area during the focus on the breath condition when performing the motor compared to the cognitive synchronization task. Taken together these results could be interpreted considering the functional meaning of delta and alpha band in relation to motor synchronization. Indeed, motor delta oscillations shape the dynamics of motor behaviors and motor neural processes, while alpha band attenuation was previously observed during generation, observation, and imagery of movement and is considered to reflect cortical motor activity and action-perception coupling. Overall, the research shows that an EEG delta-alpha pattern emerges in the temporo-central areas at the intra-individual level, indicating the attention to visceral signals, particularly during interpersonal motor synchrony.

EEG brain oscillations are modulated by interoception in response to a synchronized motor vs. cognitive task

So far, little is known about how conscious attention to internal body signals, that is, interoception, affects the synchronization with another person, a necessary or required social process that promotes affiliations and cooperation during daily joint social interactions. The effect of explicit interoceptive attentiveness (IA) modulation, conceived as the focus on the breath for a given time interval, on electrophysiological (EEG) correlates during an interpersonal motor task compared with a cognitive synchronization task was investigated in this study. A total of 28 healthy participants performed a motor and a cognitive synchronization task during the focus and no-focus breath conditions. During the tasks, frequency bands (delta, theta, alpha, and beta bands) from the frontal, temporo-central, and parieto-occipital regions of interest (ROIs) were acquired. According to the results, significantly higher delta and theta power were found in the focus condition in the frontal ROI during the execution of the motor than the cognitive synchronization task. Moreover, in the same experimental condition, delta and beta band power increased in the temporo-central ROI. The current study suggested two main patterns of frequency band modulation during the execution of a motor compared with the cognitive synchronization task while a person is focusing the attention on one's breath. This study can be considered as the first attempt to classify the different effects of interoceptive manipulation on motor and cognitive synchronization tasks using neurophysiological measures.

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

The study of brain-to-brain synchrony has a burgeoning application in the brain-computer interface (BCI) research, offering valuable insights into the neural underpinnings of interacting human brains using numerous neural recording technologies. The area allows exploring the commonality of brain dynamics by evaluating the neural synchronization among a group of people performing a specified task. The growing number of publications on brain-to-brain synchrony inspired the authors to conduct a systematic review using the PRISMA protocol so that future researchers can get a comprehensive understanding of the paradigms, methodologies, translational algorithms, and challenges in the area of brain-to-brain synchrony research. This review has gone through a systematic search with a specified search string and selected some articles based on pre-specified eligibility criteria. The findings from the review revealed that most of the articles have followed the social psychology paradigm, while 36% of the selected studies have an application in cognitive neuroscience. The most applied approach to determine neural connectivity is a coherence measure utilizing phase-locking value (PLV) in the EEG studies, followed by wavelet transform coherence (WTC) in all of the fNIRS studies. While most of the experiments have control experiments as a part of their setup, a small number implemented algorithmic control, and only one study had interventional or a stimulus-induced control experiment to limit spurious synchronization. Hence, to the best of the authors' knowledge, this systematic review solely contributes to critically evaluating the scopes and technological advances of brain-to-brain synchrony to allow this discipline to produce more effective research outcomes in the remote future.

Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects

Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.

It Takes Two: Interpersonal Neural Synchrony Is Increased after Musical Interaction

Music’s deeply interpersonal nature suggests that music-derived neuroplasticity relates to interpersonal temporal dynamics, or synchrony. Interpersonal neural synchrony (INS) has been found to correlate with increased behavioral synchrony during social interactions and may represent mechanisms that support them. As social interactions often do not have clearly delineated boundaries, and many start and stop intermittently, we hypothesize that a neural signature of INS may be detectable following an interaction. The present study aimed to investigate this hypothesis using a pre-post paradigm, measuring interbrain phase coherence before and after a cooperative dyadic musical interaction. Ten dyads underwent synchronous electroencephalographic (EEG) recording during silent, non-interactive periods before and after a musical interaction in the form of a cooperative tapping game. Significant post-interaction increases in delta band INS were found in the post-condition and were positively correlated with the duration of the preceding interaction. These findings suggest a mechanism by which social interaction may be efficiently continued after interruption and hold the potential for measuring neuroplastic adaption in longitudinal studies. These findings also support the idea that INS during social interaction represents active mechanisms for maintaining synchrony rather than mere parallel processing of stimuli and motor activity.

Interoceptive Attentiveness Induces Significantly More PFC Activation during a Synchronized Linguistic Task Compared to a Motor Task as Revealed by Functional Near-Infrared Spectroscopy

Currently, there is little understanding of how interoceptive attentiveness (IA) affects brain responses during synchronized cognitive or motor tasks. This pilot study explored the effect of explicit IA manipulation on hemodynamic correlates of simple cognitive tasks implying linguistic or motor synchronization. Eighteen healthy participants completed two linguistic and motor synchronization tasks during explicit IA and control conditions while oxygenated (O2Hb) and deoxygenated (HHb) hemoglobin variations were recorded by functional Near-Infrared Spectroscopy (fNIRS). The findings suggested that the brain regions associated with sustained attention, such as the right prefrontal cortex (PFC), were more involved when an explicit focus on the breath was induced during the cognitive linguistic task requiring synchronization with a partner, as indicated by increased O2Hb. Interestingly, this effect was not significant for the motor task. In conclusion, for the first time, this pilot research found increased activity in neuroanatomical regions that promote sustained attention, attention reorientation, and synchronization when a joint task is carried out and the person is focusing on their physiological body reactions. Moreover, the results suggested that the benefits of conscious concentration on physiological interoceptive correlates while executing a task demanding synchronization, particularly verbal alignment, may be related to the right PFC.

Face-to-face vs. remote digital settings in job assessment interviews: A multilevel hyperscanning protocol for the investigation of interpersonal attunement

The digitalization process for organizations, which was inevitably accelerated by the COVID-19 pandemic, raises relevant challenges for Human Resource Management (HRM) because every technological implementation has a certain impact on human beings. Between many organizational HRM practices, recruitment and assessment interviews represent a significant moment where a social interaction provides the context for evaluating candidates’ skills. It is therefore relevant to investigate how different interaction frames and relational conditions affect such task, with a specific focus on the differences between face-to-face (FTF) and remote computer-mediated (RCM) interaction settings. In particular, the possibility of qualifying and quantifying the mechanisms shaping the efficiency of interaction in the recruiter-candidate dyad—i.e. interpersonal attunement—is potentially insightful. We here present a neuroscientific protocol aimed at elucidating the impact of FTF vs. RCM modalities on social dynamics within assessment interviews. Specifically, the hyperscanning approach, understood as the concurrent recording and integrated analysis of behavioural-physiological responses of interacting agents, will be used to evaluate recruiter-candidate dyads while they are involved in either FTF or RCM conditions. Specifically, the protocol has been designed to collect self-report, oculometric, autonomic (electrodermal activity, heart rate, heart rate variability), and neurophysiological (electroencephalography) metrics from both inter-agents to explore the perceived quality of the interaction, automatic visual-attentional patterns of inter-agents, as well as their cognitive workload and emotional engagement. The proposed protocol will provide a theoretical evidence-based framework to assess possible differences between FTF vs. RMC settings in complex social interactions, with a specific focus on job interviews.

Multimodal hyperscanning reveals that synchrony of body and mind are distinct in mother-child dyads

Hyperscanning studies have begun to unravel the brain mechanisms underlying social interaction, indicating a functional role for interpersonal neural synchronization (INS), yet the mechanisms that drive INS are poorly understood. The current study, thus, addresses whether INS is functionally-distinct from synchrony in other systems - specifically the autonomic nervous system and motor behavior. To test this, we used concurrent functional near-infrared spectroscopy - electrocardiography recordings, while N = 34 mother-child and stranger-child dyads engaged in cooperative and competitive tasks. Only in the neural domain was a higher synchrony for mother-child compared to stranger-child dyads observed. Further, autonomic nervous system and neural synchrony were positively related during competition but not during cooperation. These results suggest that synchrony in different behavioral and biological systems may reflect distinct processes. Furthermore, they show that increased mother-child INS is unlikely to be explained solely by shared arousal and behavioral similarities, supporting recent theories that postulate that INS is higher in close relationships.

Greater Social Competence Is Associated With Higher Interpersonal Neural Synchrony in Adolescents With Autism

Difficulty engaging in reciprocal social interactions is a core characteristic of autism spectrum disorder. The mechanisms supporting effective dynamic real-time social exchanges are not yet well understood. This proof-of-concept hyperscanning electroencephalography study examined neural synchrony as the mechanism supporting interpersonal social interaction in 34 adolescents with autism spectrum disorder (50% female), age 10-16 years, paired with neurotypical confederates of similar age. The degree of brain-to-brain neural synchrony was quantified at temporo-parietal scalp locations as the circular correlation of oscillatory amplitudes in theta, alpha, and beta frequency bands while the participants engaged in a friendly conversation. In line with the hypotheses, interpersonal neural synchrony was significantly greater during the social interaction compared to the baseline. Lower levels of synchrony were associated with increased behavioral symptoms of social difficulties. With regard to sex differences, we found evidence for stronger interpersonal neural synchrony during conversation than baseline in females with autism, but not in male participants, for whom such condition differences did not reach statistical significance. This study established the feasibility of hyperscanning during real-time social interactions as an informative approach to examine social competence in autism, demonstrated that neural coordination of activity between the interacting brains may contribute to social behavior, and offered new insights into sex-related variability in social functioning in individuals with autism spectrum disorders.

Is there collaboration specific neurophysiological activation during collaborative task activity? An analysis of brain responses using electroencephalography and hyperscanning

Collaboration between two individuals is thought to be associated with the synchrony of two different brain activities. Indeed, prefrontal cortical activation and alpha frequency band modulation has been widely reported, but little is known about interbrain synchrony (IBS) changes occurring during social interaction such as collaboration or competition. In this study, we assess the dynamic of IBS variation in order to provide novel insights into the frequency band modulation underlying collaboration. To address this question, we used electroencephalography (EEG) to simultaneously record the brain activity of two individuals playing a computer-based game facing four different conditions: collaboration, competition, single participation, and passive observation. The computer-based game consisted of a fast button response task. Using data recorded in sensor space, we calculated an IBS value for each frequency band using both wavelet coherence transform and phase-locking value and performed single-subject analysis to compare each condition. We found significant IBS in frontal electrodes only present during collaboration associated with alpha frequency band modulation. In addition, we observed significant IBS in the theta frequency band for both collaboration and competition conditions, along with a significant single-subject cortical activity. Competition is distinguishable through single-subject activity in several regions and frequency bands of the brain. Performance is correlated with single-subject frontal activation during collaboration in the alpha and beta frequency band.

Beyond physical entrainment: competitive and cooperative mental stances during identical joint-action tasks differently affect inter-subjective neural synchrony and judgments of agency

Little work has examined how mental stance alone, apart from physical entrainment, affects between-participant neural synchrony during joint social interaction. We report the first findings on how cooperative and competitive mental stances, even during identical visuomotor joint-action tasks, result in distinct neural oscillatory signatures in low beta and theta band between-participant phase synchrony. Two participants jointly controlled a cursor and were instructed to either compete or cooperate to move it to one of three targets. The visuomotor output was identical for both the compete and cooperate conditions because participants were privately given the same target for experimental trials. Cooperation enhanced theta band between-participant phase-locking value (PLV) midtrial at 1-2 seconds, reflecting activation of systems for social coordination to move the cursor in a shared direction. Competition enhanced low beta between-participant PLV, shifting from temporal to frontal regions, indicating that participants focused only on their target and later evaluated self-agency as winner or loser. This interpretation of the neural signature was corroborated by participants' greater post-trial ratings of the degree of control over the cursor during competition. Top-down cooperative and competitive mental stances shape perceptions of social context and affect interpersonal neural synchrony important for representation of self and others' actions.

Bridging the gap between emotion and joint action

Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.

EEG hyperscanning in motor rehabilitation: a position paper

Studying the human brain during interpersonal interaction allows us to answer many questions related to motor control and cognition. For instance, what happens in the brain when two people walking side by side begin to change their gait and match cadences? Adapted from the neuroimaging techniques used in single-brain measurements, hyperscanning (HS) is a technique used to measure brain activity from two or more individuals simultaneously. Thus far, HS has primarily focused on healthy participants during social interactions in order to characterize inter-brain dynamics. Here, we advocate for expanding the use of this electroencephalography hyperscanning (EEG-HS) technique to rehabilitation paradigms in individuals with neurological diagnoses, namely stroke, spinal cord injury (SCI), Parkinson's disease (PD), and traumatic brain injury (TBI). We claim that EEG-HS in patient populations with impaired motor function is particularly relevant and could provide additional insight on neural dynamics, optimizing rehabilitation strategies for each individual patient. In addition, we discuss future technologies related to EEG-HS that could be developed for use in the clinic as well as technical limitations to be considered in these proposed settings.

Interacting brains coming in sync through their minds: an interbrain neurofeedback study

Neurophysiological evidence shows that interpersonal action coordination is accompanied by interbrain synchronization (IBS). However, the functional significance of this association remains unclear. Using two experimental designs, we explored whether IBS is amenable to neurofeedback (NFB). Feedback was provided either as two balls approaching each other (so-called ball design), or as two pendula, each reflecting the oscillatory activity of one of the two participants (so-called pendulum design). The NFB was provided at delta (i.e., 2.5 Hz) and theta (i.e., 5 Hz) electroencephalography frequencies, and manipulated by enhanced and inverse feedback. We showed that the participants were able to increase IBS by using NFB, especially when it was fed back at the theta frequency. Apart from intra- and interbrain coupling, other oscillatory activities (e.g., power spectral density, peak amplitude, and peak frequency) also changed during the task compared with the rest. Moreover, all the measures showed specific correlations with the subjective postsurvey item scores, reflecting subjective feeling and appraisal. We conclude that the use of IBS for NFB might help in specifying the contribution of IBS to interpersonal action coordination and in providing important information about the neural mechanisms of social interaction and the causal dimension of IBS.

Gratitude Affects Inter-Subjective Synchronicity for Cognitive Performance and Autonomic Responsiveness

Recently, social neurosciences have been interested in the investigation of neurophysiological responses related to the experience of positive emotions, such as gratitude, during social interactions. Specifically, the aim of the present research was to investigate whether gratitude related to gift exchange could favor cooperative behavior and bond construction, by improving behavioral and autonomic responsivity. At this regard, the autonomic synchronization and behavioral performance of 16 friends coupled in dyads were recorded during a joint attentional task. Gift exchange could be occurred either at the beginning or in the middle of the task. For the recording of simultaneous autonomic activity [heart rate (HR) and skin conductance level (SCL)], a hyperscanning biofeedback paradigm was used. Intra-subjective analysis showed an increase in behavioral [accuracy (ACC)] and autonomic responses (HR and SCL) when the gift exchange took place at the beginning of the task rather than in the middle. Moreover, inter-subjective analysis revealed an increase in behavioral performance and greater autonomic synchronization of HR index. The present research, therefore, shows how gratitude and trust experienced following gift exchange can modify participants’ reactions by creating a shared cognition and the adoption of joint strategies.

Special Report on the Impact of the COVID-19 Pandemic on Clinical EEG and Research and Consensus Recommendations for the Safe Use of EEG

INTRODUCTION

The global COVID-19 pandemic has affected the economy, daily life, and mental/physical health. The latter includes the use of electroencephalography (EEG) in clinical practice and research. We report a survey of the impact of COVID-19 on the use of clinical EEG in practice and research in several countries, and the recommendations of an international panel of experts for the safe application of EEG during and after this pandemic.

METHODS

Fifteen clinicians from 8 different countries and 25 researchers from 13 different countries reported the impact of COVID-19 on their EEG activities, the procedures implemented in response to the COVID-19 pandemic, and precautions planned or already implemented during the reopening of EEG activities.

RESULTS

Of the 15 clinical centers responding, 11 reported a total stoppage of all EEG activities, while 4 reduced the number of tests per day. In research settings, all 25 laboratories reported a complete stoppage of activity, with 7 laboratories reopening to some extent since initial closure. In both settings, recommended precautions for restarting or continuing EEG recording included strict hygienic rules, social distance, and assessment for infection symptoms among staff and patients/participants.

CONCLUSIONS

The COVID-19 pandemic interfered with the use of EEG recordings in clinical practice and even more in clinical research. We suggest updated best practices to allow safe EEG recordings in both research and clinical settings. The continued use of EEG is important in those with psychiatric diseases, particularly in times of social alarm such as the COVID-19 pandemic.

What has social neuroscience learned from hyperscanning studies of spoken communication? A systematic review

A growing body of literature examining the neurocognitive processes of interpersonal linguistic interaction indicates the emergence of neural alignment as participants engage in oral communication. However, questions have arisen whether the study results can be interpreted beyond observations of cortical functionality and extended to the mutual understanding between communicators. This review presents evidence from electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) hyperscanning studies of interbrain synchrony (IBS) in which participants communicated via spoken language. The studies are classified into: knowledge sharing; turn-taking speech co-ordination; cooperation, problem-solving and creativity; and naturalistic discussion paradigms according to the type of interaction specified in each study. Alignment predominantly occurred in the frontal and temporo-parietal areas, which may reflect activation of the mirror and mentalizing systems. We argue that the literature presents a significant contribution to advancing our understanding of IBS and mutual understanding between communicators. We end with suggestions for future research, including analytical approaches and experimental conditions and hypothesize that brain-inspired neural networks are promising techniques for better understanding of IBS through hyperscanning.

Gender Differences and Unfairness Processing during Economic and Moral Decision-Making: A fNIRS Study

Decisional conflicts have been investigated with social decision-making tasks, which represent good models to elicit social and emotional dynamics, including fairness perception. To explore these issues, we created two modified versions of the UG framed within an economic vs. a moral context that included two kinds of unfair offers: advantageous (upside, U) or disadvantageous (downside, D) from the responder's perspective, and vice-versa for the proponent. The hemodynamic activity of 36 participants, 20 females and 16 males, was continuously recorded with fNIRS to investigate the presence of general or specific circuits between the different experimental conditions. Results showed that disadvantageous offers (D) are associated with an increased widespread cortical activation. Furthermore, we found that advantageous moral choices at the expense of others (U) were related to the activation of the right prefrontal cortex. Finally, we found gender-related differences in brain activations in the different frameworks. In particular, the DLPFC was recruited by females during the economic task, and by males during the moral frame. In conclusion, the present study confirmed and expanded previous data about the role of the prefrontal cortices in decision-making, suggesting the need for further studies to understand better the different prefrontal networks serving moral and economic decisions also considering gender-related differences.

A Multi-Brain Framework for Social Interaction

Social interaction can be seen as a dynamic feedback loop that couples action, reaction, and internal cognitive processes across individual agents. A fuller understanding of the social brain requires a description of how the neural dynamics across coupled brains are linked and how they coevolve over time. We elaborate a multi-brain framework that considers social interaction as an integrated network of neural systems that dynamically shape behavior, shared cognitive states, and social relationships. We describe key findings from multi-brain experiments in humans and animal models that shed new light on the function of social circuits in health and disease. Finally, we discuss recent progress in elucidating the cellular-level mechanisms underlying inter-brain neural dynamics and outline key areas for future research.

Coordination Dynamics: A Foundation for Understanding Social Behavior

Humans' interactions with each other or with socially competent machines exhibit lawful coordination patterns at multiple levels of description. According to Coordination Dynamics, such laws specify the flow of coordination states produced by functional synergies of elements (e.g., cells, body parts, brain areas, people…) that are temporarily organized as single, coherent units. These coordinative structures or synergies may be mathematically characterized as informationally coupled self-organizing dynamical systems (Coordination Dynamics). In this paper, we start from a simple foundation, an elemental model system for social interactions, whose behavior has been captured in the Haken-Kelso-Bunz (HKB) model. We follow a tried and tested scientific method that tightly interweaves experimental neurobehavioral studies and mathematical models. We use this method to further develop a body of empirical research that advances the theory toward more generalized forms. In concordance with this interdisciplinary spirit, the present paper is written both as an overview of relevant advances and as an introduction to its mathematical underpinnings. We demonstrate HKB's evolution in the context of social coordination along several directions, with its applicability growing to increasingly complex scenarios. In particular, we show that accommodating for symmetry breaking in intrinsic dynamics and coupling, multiscale generalization and adaptation are principal evolutions. We conclude that a general framework for social coordination dynamics is on the horizon, in which models support experiments with hypothesis generation and mechanistic insights.

Brain-to-Brain Coupling in the Gamma-Band as a Marker of Shared Intentionality

Cooperation and competition are two ways of social interaction keys to life in society. Recent EEG-based hyperscanning studies reveal that cooperative and competitive interactions induce an increase in interbrain coupling. However, whether this interbrain coupling effect is just a reflection of inter-subject motor coordination or can also signal the type of social interaction is unknown. Here, we show that behavioral coordination and social interaction type can be distinguished according to the frequency of oscillation in which the brains are coupled. We use EEG to simultaneously measure the brain activity of pairs of subjects, while they were performing a visual cue-target task in a cooperative and competitive manner. Behavioral responses were quasi-simultaneous between subject pairs for both competitive and cooperative conditions, with faster average response times for the competitive condition. Concerning brain activity, we found increased interbrain coupling in theta band (3–7 Hz) during cooperation and competition, with stronger coupling during competitive interactions. This increase of interbrain theta coupling correlated with a decrease in reaction times of the dyads. Interestingly, we also found an increase in brain-to-brain coupling in gamma band (38–42 Hz) only during cooperative interactions. Unlike the theta coupling effect, the gamma interbrain coupling did not correlate with dyads’ reaction times. Taken together, these results suggest that theta interbrain coupling could be linked to motor coordination processes common to cooperative and competitive interactions, while gamma brain-to-brain coupling emerges as an electrophysiological marker of shared intentionality during cooperative interactions.

What binds us? Inter-brain neural synchronization and its implications for theories of human consciousness

The association between neural oscillations and functional integration is widely recognized in the study of human cognition. Large-scale synchronization of neural activity has also been proposed as the neural basis of consciousness. Intriguingly, a growing number of studies in social cognitive neuroscience reveal that phase synchronization similarly appears across brains during meaningful social interaction. Moreover, this inter-brain synchronization has been associated with subjective reports of social connectedness, engagement, and cooperativeness, as well as experiences of social cohesion and ‘self-other merging’. These findings challenge the standard view of human consciousness as essentially first-person singular and private. We therefore revisit the recent controversy over the possibility of extended consciousness and argue that evidence of inter-brain synchronization in the fastest frequency bands overcomes the hitherto most convincing sceptical position. If this proposal is on the right track, our understanding of human consciousness would be profoundly transformed, and we propose a method to test this proposal experimentally.

When gratitude and cooperation between friends affect inter-brain connectivity for EEG

Background

Recently several studies in the psychological and social field have investigated the social function of gift exchange as a useful way for the consolidation of interpersonal and social relationships and the implementation of prosocial behaviors. Specifically, the present research wanted to explore if gift exchange, increased emotional sharing, gratitude and interpersonal cooperation, leading to an improvement in cognitive and behavioral performance. In this regard, neural connectivity and cognitive performance of 14 pairs of friends were recorded during the development of a joint attention task that involved a gift exchange at the beginning or halfway through the task. The moment of gift exchange was randomized within the pairs: for seven couples, it happened at task beginning, for the remaining seven later. Individuals’ simultaneous brain activity was recorded through the use of two electroencephalograms (EEG) systems that were used in hyperscanning.

Results

The results showed that after gift exchange there was an improvement in behavioral performance in terms of accuracy. For what concerns EEG, instead, an increase of delta and theta activation was observed in the dorsolateral prefrontal cortex (DLPFC) when gift exchange occurred at the beginning of the task. Furthermore, an increase in neural connectivity for delta and theta bands was observed.

Conclusion

The present research provides a significant contribution to the exploration of the factors contributing to the strengthening of social bonds, increasing cooperation, gratitude and prosocial behavior.

The "gift effect" on functional brain connectivity. Inter-brain synchronization when prosocial behavior is in action

The gift exchange represents a moment that characterizes interpersonal interactions. In particular, research in psychological and neuroscientific fields aimed to observe the social function of gift exchange. Specifically, the present study aimed to investigate the effects of prosocial behavior, experienced during gift exchange, on individuals’ cognitive performance and brain activity. To this aim, behavioral performance and neural activity of 15 dyads of participants, with a consolidated friendship, were collected during the execution of an attentional cooperative task before or after a gift exchange. Individuals’ brain activity was recorded through the use of Functional Near Infrared Spectroscopy (fNIRS) in hyperscanning. Results showed an increase of perceived cooperation and cognitive performance, in terms of accuracy (ACC), after gift exchange. The increase of interpersonal tuning and cooperation was also shown by neural activity with an increase of oxygenated hemoglobin (O2Hb) intra-brain and inter-brain connectivity in the dorsolateral prefrontal cortex (DLPFC) following the gift exchange. Moreover, from ConIndex analysis emerged an increase of inter-brain connectivity compared to intra-brain in DLPFC area. The present study, therefore, highlights how prosocial behavior can have positive effects on cognitive performance improvement and interpersonal relationships and neural coordination strengthen, increasing intra and inter-brain connectivity mechanisms.

Hyperscanning: A Valid Method to Study Neural Inter-brain Underpinnings of Social Interaction

Social interactions are a crucial part of human life. Understanding the neural underpinnings of social interactions is a challenging task that the hyperscanning method has been trying to tackle over the last two decades. Here, we review the existing literature and evaluate the current state of the hyperscanning method. We review the type of methods (fMRI, M/EEG, and fNIRS) that are used to measure brain activity from more than one participant simultaneously and weigh their pros and cons for hyperscanning. Further, we discuss different types of analyses that are used to estimate brain networks and synchronization. Lastly, we present results of hyperscanning studies in the context of different cognitive functions and their relations to social interactions. All in all, we aim to comprehensively present methods, analyses, and results from the last 20 years of hyperscanning research.

The Relevance of a Conductor Competition for the Study of Emotional Synchronization Within and Between Groups in a Natural Musical Setting

Group emotional dynamics are a central concern in the study of human interaction and communication. To study group emotions, the social context of a musical event in natural conditions may overcome several limits of laboratory experiments and could provide a suitable framework. This study aimed to evaluate if cultural events such as a conductor competition could welcome scientific research for the study of group emotional sharing. We led an observational study, which suggests that in this particular context, public, musicians and jury would agree to participate and to wear neurophysiological and physiological devices to monitor their emotional state during the competition. Self-administrated scales showed that, in the context of a musical competition, members of the public felt strong musical emotions such as music chills. Our results suggest that such a specific competition design is a suitable experimental model to lead an experiment under ecological conditions to effectively investigate collective emotional synchronization. In the future, with the implementation of an acquisition system recording synchronous neurophysiological data for a large group of participants, we may be able to highlight mechanisms involved in emotional synchronization in a natural musical setting.

Functional EEG connectivity during competition

Background

Social behavior and interactions pervasively shape and influence our lives and relationships. Competition, in particular, has become a core topic in social neuroscience since it stresses the relevance and salience of social comparison processes between the inter-agents that are involved in a common task. The majority of studies, however, investigated such kind of social interaction via one-person individual paradigms, thus not taking into account relevant information concerning interdependent participants’ behavioral and neural responses. In the present study, dyads of volunteers participated in a hyperscanning paradigm and competed in a computerized attention task while their electrophysiological (EEG) activity and performance were monitored and recorded. Behavioral data and inter-brain coupling measures based on EEG frequency data were then computed and compared across different experimental conditions: a control condition (individual task, t0), a first competitive condition (pre-feedback condition, t1), and a second competitive condition following a positive reinforcing feedback (post-feedback condition, t2).

Results

Results showed that during competitive tasks participants’ performance was improved with respect to control condition (reduced response times and error rates), with a further specific improvement after receiving a reinforcing feedback. Concurrently, we observed a reduction of inter-brain functional connectivity (primarily involving bilateral prefrontal areas) for slower EEG frequency bands (delta and theta). Finally, correlation analyses highlighted a significant association between cognitive performance and inter-brain connectivity measures.

Conclusions

The present results may help identifying specific patterns of behavioral and inter-brain coupling measures associated to competition and processing of social reinforcements.