Social neuroscience and hyperscanning techniques: past, present and future

Hyperscanning to explore social interaction among autistic minds

Hyperscanning - the monitoring of brain activity of two or more people simultaneously - has emerged to be a popular tool for assessing neural features of social interaction. This perspective article focuses on hyperscanning studies that use functional near-infrared spectroscopy (fNIRS), a technique that is very conducive to studies requiring naturalistic paradigms. In particular, we are interested in neural features that are related to social interaction deficits among individuals with autism spectrum disorders (ASD). This population has received relatively little attention in research using neuroimaging hyperscanning techniques, compared to neurotypical individuals. The study is outlined as follows. First, we summarize the findings about brain-behavior connections related to autism from previously published fNIRS hyperscanning studies. Then, we propose a preliminary theoretical framework of inter-brain coherence (IBC) with testable hypotheses concerning this population. Finally, we provide two examples of areas of inquiry in which studies could be particularly relevant for social-emotional/behavioral development for autistic children, focusing on intergenerational relationships in family units and learning in classroom settings in mainstream schools.

Are older adults less generous? Age differences in emotion-related social decision-making

In social interaction, age-related differences in emotional processing may lead to varied social decision making between young and older adults. However, previous studies of social decision making have paid less attention to the interactants' emotions, leaving age differences and underlying neural mechanisms unexplored. To address this gap, the present study combined functional and structural magnetic resonance imaging, employing a modified dictator game task with recipients displaying either neutral or sad facial expressions. Behavioral results indicated that although older adults' overall allocations did not differ significantly from those of young adults, older adults' allocations showing a decrease in emotion-related generosity compared to young adults. Using representational similarity analysis, we found that older adults showed reduced neural representations of recipients' emotions and gray matter volume in the right anterior cingulate gyrus (ACC), right insula, and left dorsomedial prefrontal cortex (DMPFC) compared to young adults. More importantly, mediation analyses indicated that age influenced allocations not only through serial mediation of neural representations of the right insula and left DMPFC, but also through serial mediation of the mean gray matter volume of the right ACC and left DMPFC. This study identifies the potential neural pathways through which age affects emotion-related social decision making, advancing our understanding of older adults' social interaction behavior that they may not be less generous unless confronted with individuals with specific emotions.

Teach a Man to Fish: Hyper-brain Evidence on Scaffolding Strategy Enhancing Creativity Acquisition and Transfer

Creativity is an indispensable competency in today's innovation-driven society. Yet, the influences of instructional strategy, a key determinant of educational outcomes, on the creativity-fostering process remains an unresolved mystery. We proposed that instructional strategy affects creativity cultivation and further investigated the intricate neural mechanisms underlying this relationship. In a naturalistic laboratory setting, 66 instructor-learner dyads were randomized into three groups (scaffolding, explanation, and control), with divergent thinking instructions separately. Functional near-infrared spectroscopy (fNIRS) hyperscanning simultaneously collected brain signals in the prefrontal cortex and temporal-parietal junction regions. Results indicated that learners instructed with a scaffolding strategy demonstrated superior creative performance both in acquisition (direct learning) and transfer (use in a novel context) of creativity skills, compared to pretest levels. In contrast, the control and explanation groups did not exhibit such effects. Notably, we also observed remarkable interbrain neural synchronization (INS) between instructors and learners in the left superior frontal cortex in the scaffolding group, but not in the explanation or control groups. Furthermore, INS positively predicted enhancements in creativity performance (acquisition and transfer), indicating that it is a crucial neural mechanism in the creativity-fostering process. These findings reveal that scaffolding facilitates the acquisition and transfer of creativity and deepen our understanding of the neural mechanisms underlying the process of creativity-fostering. The current study provides valuable insights for implementing teaching strategies to fostering creativity.

Hyperscanning literature after two decades of neuroscientific research: A scientometric review

Hyperscanning, a neuroimaging approach introduced in 2002 for simultaneously recording the brain activity of multiple participants, has significantly contributed to our understanding of social interactions. Nevertheless, the existing literature requires systematic organization to advance our knowledge. This study, after two decades of hyperscanning research, aims to identify the primary thematic domains and the most influential documents in the field. We conducted a scientometric analysis to examine co-citation patterns quantitatively, using a sample of 548 documents retrieved from Scopus and their 32,022 cited references. Our analysis revealed ten major thematic domains in hyperscanning research, with the most impactful document authored by Czeszumski and colleagues in 2020. Notably, while hyperscanning was initially developed for functional magnetic resonance imaging (fMRI), our findings indicate a substantial influence of research conducted using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The introduction of fNIRS and advancements in EEG methods have enabled the implementation of more ecologically valid experiments for investigating social interactions. The study also highlights the need for more research that combines multi-brain neural stimulation with neuroimaging techniques to understand the causal role played by interpersonal neural synchrony in social interactions.

From physical to digital: A theoretical-methodological primer on designing hyperscanning investigations to explore remote exchanges

As individuals increasingly engage in social interactions through digital mediums, understanding the neuroscientific underpinnings of such exchanges becomes a critical challenge and a valuable opportunity. In line with a second-person neuroscience approach, understanding the forms of interpersonal syntonisation that occur during digital interactions is pivotal for grasping the mechanisms underlying successful collaboration in virtual spaces. The hyperscanning paradigm, involving the simultaneous monitoring of the brains and bodies of multiple interacting individuals, seems to be a powerful tool for unravelling the neural correlates of interpersonal syntonisation in social exchanges. We posit that such approach can now open new windows on interacting brains' responses even to digitally-conveyed social cues, offering insights into how social information is processed in the absence of traditional face-to-face settings. Yet, such paradigm shift raises challenging methodological questions, which should be answered properly to conduct significant and informative hyperscanning investigations. Here, we provide an introduction to core methodological issues dedicated to novices approaching the design of hyperscanning investigations of remote exchanges in natural settings, focusing on the selection of neuroscientific devices, synchronization of data streams, and data analysis approaches. Finally, a methodological checklist for devising robust hyperscanning studies on digital interactions is presented.

Higher emotional synchronization is modulated by relationship quality in romantic relationships and not in close friendships

Emotions are fundamental to social interaction and deeply intertwined with interpersonal dynamics, especially in romantic relationships. Although the neural basis of interaction processes in romance has been widely explored, the underlying emotions and the connection between relationship quality and neural synchronization remain less understood. Our study employed EEG hyperscanning during a non-interactive video-watching paradigm to compare the emotional coordination between romantic couples and close friends. Couples showed significantly greater behavioral and prefrontal alpha synchronization than friends. Notably, couples with low relationship quality required heightened neural synchronization to maintain robust behavioral synchronization. Further support vector machine analysis underscores the crucial role of prefrontal activity in differentiating couples from friends. In summary, our research addresses gaps concerning how intrinsic emotions linked to relationship quality influence neural and behavioral synchronization by investigating a natural non-interactive context, thereby advancing our understanding of the neural mechanisms underlying emotional coordination in romantic relationships.

Distinct social behavior and inter-brain connectivity in Dyads with autistic individuals

Autism Spectrum Disorder (ASD) is defined by distinctive socio-cognitive behaviors that deviate from typical patterns. Notably, social imitation skills appear to be particularly impacted, manifesting early on in development. This paper compared the behavior and inter-brain dynamics of dyads made up of two typically developing (TD) participants with mixed dyads made up of ASD and TD participants during social imitation tasks. By combining kinematics and EEG-hyperscanning, we show that individuals with ASD exhibited a preference for the follower rather than the lead role in imitating scenarios. Moreover, the study revealed inter-brain synchrony differences, with low-alpha inter-brain synchrony differentiating control and mixed dyads. The study's findings suggest the importance of studying interpersonal phenomena in dynamic and ecological settings and using hyperscanning methods to capture inter-brain dynamics during actual social interactions.

When "more for others, less for self" leads to co-benefits: A tri-MRI dyad-hyperscanning study

Unselfishness is admired, especially when collaborations between groups of various scales are urgently needed. However, its neural mechanisms remain elusive. In a tri-MRI dyad-hyperscanning experiment involving 26 groups, each containing 4 participants as two rotating pairs in a coordination game, we sought to achieve reciprocity, or "winning in turn by the two interacting players," as the precursor to unselfishness. Due to its critical role in social processing, the right temporal-parietal junction (rTPJ) was the seed for both time domain (connectivity) and frequency domain (i.e., coherence) analyses. For the former, negative connectivity between the rTPJ and the mentalizing network areas (e.g., the right inferior parietal lobule, rIPL) was identified, and such connectivity was further negatively correlated with the individual's final gain, supporting our task design that "rewarded" the reciprocal participants. For the latter, cerebral coherences of the rTPJs emerged between the interacting pairs (i.e., within-group interacting pairs), and the coupling between the rTPJ and the right superior temporal gyrus (rSTG) between the players who were not interacting with each other (i.e., within-group noninteracting pairs). These coherences reinforce the hypotheses that the rTPJ-rTPJ coupling tracks the collaboration processes and the rTPJ-rSTG coupling for the emergence of decontextualized shared meaning. Our results underpin two social roles (inferring others' behavior and interpreting social outcomes) subserved by the rTPJ-related network and highlight its interaction with other-self/other-concerning brain areas in reaching co-benefits among unselfish players.

Lights on music cognition: A systematic and critical review of fNIRS applications and future perspectives

Research investigating the neural processes related to music perception and production constitutes a well-established field within the cognitive neurosciences. While most neuroimaging tools have limitations in studying the complexity of musical experiences, functional Near-Infrared Spectroscopy (fNIRS) represents a promising, relatively new tool for studying music processes in both laboratory and ecological settings, which is also suitable for both typical and pathological populations across development. Here we systematically review fNIRS studies on music cognition, highlighting prospects and potentialities. We also include an overview of fNIRS basic theory, together with a brief comparison to characteristics of other neuroimaging tools. Fifty-nine studies meeting inclusion criteria (i.e., using fNIRS with music as the primary stimulus) are presented across five thematic sections. Critical discussion of methodology leads us to propose guidelines of good practices aiming for robust signal analyses and reproducibility. A continuously updated world map is proposed, including basic information from studies meeting the inclusion criteria. It provides an organized, accessible, and updatable reference database, which could serve as a catalyst for future collaborations within the community. In conclusion, fNIRS shows potential for investigating cognitive processes in music, particularly in ecological contexts and with special populations, aligning with current research priorities in music cognition.

How Socially Avoidant Emerging Adults Process Social Feedback during Human-to-Human Interaction after Social Rejection: An Event-Related Potential Study

Social avoidance refers to active non-participation in social activities, which is detrimental to healthy interpersonal interaction for emerging adults. Social rejection is a kind of negative social evaluation from others making people feel social pain. However, how socially avoidant emerging adults process social feedback information after experiencing social rejection has received less attention. The current study aimed to explore the differences in social interaction feedback processing after social rejection between a socially avoidant group (n = 16) and a comparison group (n = 16) in a human-to-human interaction context. Computer game tasks with two types of interaction (cooperation and competition) were used to record the event-related potentials when receiving social interaction feedback in two conditions (social rejection and control condition). The results showed that (1) the socially avoidant group had lower reward positivity amplitudes than the comparison group when receiving social feedback; (2) the socially avoidant group presented larger P300 amplitudes in the social rejection condition than in the control condition, but the comparison group did not; and (3) social rejection evoked more negative N1 amplitudes in the socially avoidant and comparison groups. The findings suggest that socially avoidant emerging adults may have flaws in reward sensitivity during interpersonal interaction, and they might also exert more attentional and emotional resources to social feedback after social rejection.

Bringing together multimodal and multilevel approaches to study the emergence of social bonds between children and improve social AI

This protocol paper outlines an innovative multimodal and multilevel approach to studying the emergence and evolution of how children build social bonds with their peers, and its potential application to improving social artificial intelligence (AI). We detail a unique hyperscanning experimental framework utilizing functional near-infrared spectroscopy (fNIRS) to observe inter-brain synchrony in child dyads during collaborative tasks and social interactions. Our proposed longitudinal study spans middle childhood, aiming to capture the dynamic development of social connections and cognitive engagement in naturalistic settings. To do so we bring together four kinds of data: the multimodal conversational behaviors that dyads of children engage in, evidence of their state of interpersonal rapport, collaborative performance on educational tasks, and inter-brain synchrony. Preliminary pilot data provide foundational support for our approach, indicating promising directions for identifying neural patterns associated with productive social interactions. The planned research will explore the neural correlates of social bond formation, informing the creation of a virtual peer learning partner in the field of Social Neuroergonomics. This protocol promises significant contributions to understanding the neural basis of social connectivity in children, while also offering a blueprint for designing empathetic and effective social AI tools, particularly for educational contexts.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Directed causal effect with PCMCI in hyperscanning EEG time series

Social activities are likely to cause effects or reactivity in the brains of the people involved in collaborative social situations. This study assesses a new method, Tigramite, for time domain analysis of directed causality between the prefrontal cortex (PFC) of persons in such situations. An experimental situation using hyperscanning EEG was applied while individuals led and followed each other in finger-tapping rhythms. This structured task has a long duration and a high likelihood of inter-brain causal reactions in the prefrontal cortices. Tigramite is a graph-based causal discovery method to identify directed causal relationships in observational time series. Tigramite was used to analyze directed causal connections within and between the PFC. Significantly directed causality within and between brains could be detected during the social interactions. This is the first empirical evidence the Tigramite can reveal inter- and intra-brain-directed causal effects in hyperscanning EEG time series. The findings are promising for further studies of causality in neural networks during social activities using Tigramite on EEG in the time domain.

Favoritism or bias? Cooperation and competition under different intergroup relationships: evidence from EEG hyperscanning

Cooperation and competition are the most common forms of social interaction in various social relationships. Intergroup relationships have been posited to influence individuals' interpersonal interactions significantly. Using electroencephalography hyperscanning, this study aimed to establish whether intergroup relationships influence interpersonal cooperation and competition and the underlying neural mechanisms. According to the results, the in-group Coop-index is better than the out-group, whereas the out-group Comp-index is stronger than the in-group. The in-group functional connectivity between the frontal-central region and the right temporoparietal junction in the β band was stronger in competition than cooperation. The out-group functional connectivity between the frontal-central region and the left temporoparietal junction in the α band was stronger in cooperation than competition. In both cooperation and competition, the in-group exhibited higher interbrain synchronization between the prefrontal cortex and parietal region in the θ band, as well as between the frontal-central region and frontal-central region in the α band, compared to the out-group. The intrabrain phase-locking value in both the α and β bands can effectively predict performance in competition tasks. Interbrain phase-locking value in both the α and θ bands can be effectively predicted in a performance cooperation task. This study offers neuroscientific evidence for in-group favoritism and out-group bias at an interpersonal level.

Visualizing the invisible tie: Linking parent-child neural synchrony to parents' and children's attachment representations

It is a central tenet of attachment theory that individual differences in attachment representations organize behavior during social interactions. Secure attachment representations also facilitate behavioral synchrony, a key component of adaptive parent-child interactions. Yet, the dynamic neural processes underlying these interactions and the potential role of attachment representations remain largely unknown. A growing body of research indicates that interpersonal neural synchrony (INS) could be a potential neurobiological correlate of high interaction and relationship quality. In this study, we examined whether interpersonal neural and behavioral synchrony during parent-child interaction is associated with parent and child attachment representations. In total, 140 parents (74 mothers and 66 fathers) and their children (age 5-6 years; 60 girls and 80 boys) engaged in cooperative versus individual problem-solving. INS in frontal and temporal regions was assessed with functional near-infrared spectroscopy hyperscanning. Attachment representations were ascertained by means of the Adult Attachment Interview in parents and a story-completion task in children, alongside video-coded behavioral synchrony. Findings revealed increased INS during cooperative versus individual problem solving across all dyads (𝛸2(2) = 9.37, p = 0.009). Remarkably, individual differences in attachment representations were associated with INS but not behavioral synchrony (p > 0.159) during cooperation. More specifically, insecure maternal attachment representations were related to higher mother-child INS in frontal regions (𝛸2(3) = 9.18, p = 0.027). Conversely, secure daughter attachment representations were related to higher daughter-parent INS within temporal regions (𝛸2(3) = 12.58, p = 0.006). Our data thus provide further indication for INS as a promising correlate to probe the neurobiological underpinnings of attachment representations in the context of early parent-child interactions. RESEARCH HIGHLIGHTS: We assessed attachment representations using narrative measures and interpersonal neural synchrony (INS) during parent-child problem-solving. Dyads including mothers with insecure attachment representations showed higher INS in left prefrontal regions. Dyads including daughters with secure attachment representations showed higher INS in right temporo-parietal regions. INS is a promising correlate to probe the neurobiological underpinnings of attachment representations in the context of parent-child interactions, especially within the mutual prediction framework.

Interpersonal neural synchronization during social interactions in close relationships: A systematic review and meta-analysis of fNIRS hyperscanning studies

In recent years, researchers have used hyperscanning techniques to explore how brains interact during various human activities. These studies have revealed a phenomenon called interpersonal neural synchronization (INS), but little research has focused on the overall effect of INS in close relationships. To address this gap, this study aims to synthesize and analyze the existing literature on INS during social interactions in close relationships. We conducted a meta-analysis of 17 functional near-infrared spectroscopy (fNIRS) hyperscanning studies involving 1149 dyads participants, including romantic couples and parent-child dyads. The results revealed robust and consistent INS in the frontal, temporal, and parietal regions of the brain and found similar INS patterns in couples and parent-child studies, providing solid empirical evidence for the attachment theory. Moreover, the age of children and brain areas were significant predictors of the effect size in parent-child research. The developmental stage of children and the mismatched development of brain structures might be the crucial factors for the difference in neural performance in social and cognitive behaviors in parent-child dyads.

Behavioural Synchronisation between Dogs and Humans: Unveiling Interspecific Motor Resonance?

Dogs' behavioural synchronisation with humans is of growing scientific interest. However, studies lack a comprehensive exploration of the neurocognitive foundations of this social cognitive ability. Drawing parallels from the mechanisms underlying behavioural synchronisation in humans, specifically motor resonance and the recruitment of mirror neurons, we hypothesise that dogs' behavioural synchronisation with humans is underpinned by a similar mechanism, namely interspecific motor resonance. Based on a literature review, we argue that dogs possess the prerequisites for motor resonance, and we suggest that interspecific behavioural synchronisation relies on the activation of both human and canine mirror neurons. Furthermore, interspecific behavioural studies highlight certain characteristics of motor resonance, including motor contagion and its social modulators. While these findings strongly suggest the potential existence of interspecific motor resonance, direct proof remains to be established. Our analysis thus paves the way for future research to confirm the existence of interspecific motor resonance as the neurocognitive foundation for interspecific behavioural synchronisation. Unravelling the neurocognitive mechanisms underlying this behavioural adjustment holds profound implications for understanding the evolutionary dynamics of dogs alongside humans and improving the day-to-day management of dog-human interactions.

An evaluation of inter-brain EEG coupling methods in hyperscanning studies

EEG-based hyperscanning technology has been increasingly applied to analyze interpersonal interactions in social neuroscience in recent years. However, different methods are employed in various of studies without a complete investigation of the suitability of these methods. Our study aimed to systematically compare typical inter-brain EEG coupling methods, with simulated EEG data generated by real EEG data. In particular, two critical metrics of noise level and time delay were manipulated, and three different coupling models were tested. The results revealed that: (1) under certain conditions, various methods were leveraged by noise level and time delay, leading to different performances; (2) most algorithms achieved better experimental results and performance under high coupling degree; (3) with our simulation process, temporal and spectral models showed relatively good results, while data simulated with phase coupling model performed worse. This is the first systematic comparison of typical inter-brain EEG coupling methods, with simulated EEG data generated by real EEG data from different subjects. Existing methods mainly focused on intra-brain coupling. To our knowledge, there was only one previous study that compared five inter-brain EEG coupling methods (Burgess in Front Human Neurosci 7:881, 2013). However, the simulated data used in this study were generated time series with varied degrees of phase coupling without considering any EEG characteristics. For future research, appropriate methods need to be selected based on possible underlying mechanisms (temporal, spectral and phase coupling model hypothesis) of a specific study, as well as the expected coupling degree and conditions.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09911-1.

Generation WhatsApp: inter-brain synchrony during face-to-face and texting communication

Texting has become one of the most prevalent ways to interact socially, particularly among youth; however, the effects of text messaging on social brain functioning are unknown. Guided by the biobehavioral synchrony frame, this pre-registered study utilized hyperscanning EEG to evaluate interbrain synchrony during face-to-face versus texting interactions. Participants included 65 mother-adolescent dyads observed during face-to-face conversation compared to texting from different rooms. Results indicate that both face-to-face and texting communication elicit significant neural synchrony compared to surrogate data, demonstrating for the first time brain-to-brain synchrony during texting. Direct comparison between the two interactions highlighted 8 fronto-temporal interbrain links that were significantly stronger in the face-to-face interaction compared to texting. Our findings suggest that partners co-create a fronto-temporal network of inter-brain connections during live social exchanges. The degree of improvement in the partners' right-frontal-right-frontal connectivity from texting to the live social interaction correlated with greater behavioral synchrony, suggesting that this well-researched neural connection may be specific to face-to-face communication. Our findings suggest that while technology-based communication allows humans to synchronize from afar, face-to-face interactions remain the superior mode of communication for interpersonal connection. We conclude by discussing the potential benefits and drawbacks of the pervasive use of texting, particularly among youth.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Shared Minds, Shared Feedback: tracing the influence of parental feedback on shared neural patterns

Parental feedback affects children in multiple ways. However, little is known about how children, family, and feedback types affect parental feedback neural mechanisms. The current study used functional near-infrared spectroscopy-based hyperscanning to observe 47 mother-daughter pairs's (mean age of mothers: 35.95 ± 3.99 yr old; mean age of daughters: 6.97 ± 0.75 yr old) brain synchronization in a jigsaw game under various conditions. Between parental negative feedback and praise conditions, mother-daughter brain in supramarginal gyrus, left dorsolateral prefrontal cortex, right inferior frontal gyrus, and right primary somatic (S1) differed. When criticized, conformity family-communication-patterned families had much worse brain synchronization in S1, left dorsolateral prefrontal cortex, and right Wernicke's region than conversational families. Resilient children had better mother-child supramarginal gyrus synchronicity under negative feedback. This study supports the importance of studying children's neurological development in nurturing environments to assess their psychological development.

The Effects of Distancing Design Collaboration Necessitated by COVID-19 on Brain Synchrony in Teams Compared to Co-Located Design Collaboration: A Preliminary Study

Due to the widespread involvement of distributed collaboration triggered by COVID-19, it has become a new trend that has continued into the post-pandemic era. This study investigated collective performance within two collaborative environments (co-located and distancing settings) by assessing inter-brain synchrony patterns (IBS) among design collaborators using functional near-infrared spectroscopy. The preliminary study was conducted with three dyads who possessed 2-3 years of professional product design experience. Each dyad completed two designated design tasks in distinct settings. In the distributed condition, participants interacted through video conferencing in which they were allowed to communicate by verbalization and sketching using a shared digital whiteboard. To prevent the influences of different sketching tools on design outputs, we employed digital sketching for both environments. The interactions between collaborators were identified in three behaviors: verbal only, sketch only, and mixed communication (verbal and sketch). The consequences revealed a higher level of IBS when mixed communication took place in distributed conditions than in co-located conditions. Comparably, the occurrence of IBS increased when participants solely utilized sketching as the interaction approach within the co-located setting. A mixed communication method combining verbalization and sketching might lead to more coordinated cognitive processes when in physical isolation. Design collaborators are inclined to adjust their interaction behaviors in order to adapt to different design environments, strengthen the exchange of ideas, and construct design consensus. Overall, the present paper discussed the performance of virtual collaborative design based on a neurocognitive perspective, contributing valuable insights for the future intervention design that promotes effective virtual teamwork.

Influence of interpersonal distance on collaborative performance in the joint Simon task-An fNIRS-based hyperscanning study

Collaboration is a critical skill in everyday life. It has been suggested that collaborative performance may be influenced by social factors such as interpersonal distance, which is defined as the perceived psychological distance between individuals. Previous literature has reported that close interpersonal distance may promote the level of self-other integration between interacting members, and in turn, enhance collaborative performance. These studies mainly focused on interdependent collaboration, which requires high levels of shared representations and self-other integration. However, little is known about the effect of interpersonal distance on independent collaboration (e.g., the joint Simon task), in which individuals perform the task independently while the final outcome is determined by the parties. To address this issue, we simultaneously measured the frontal activations of ninety-four pairs of participants using a functional near-infrared spectroscopy (fNIRS)-based hyperscanning technique while they performed a joint Simon task. Behavioral results showed that the Joint Simon Effect (JSE), defined as the RT difference between incongruent and congruent conditions indicating the level of self-other integration between collaborators, was larger in the friend group than in the stranger group. Consistently, the inter-brain neural synchronization (INS) across the dorsolateral and medial parts of the prefrontal cortex was also stronger in the friend group. In addition, INS in the left dorsolateral prefrontal cortex negatively predicted JSE only in the friend group. These results suggest that close interpersonal distance may enhance the shared mental representation among collaborators, which in turn influences their collaborative performance.

Low-Cost EEG Multi-Subject Recording Platform for the Assessment of Students' Attention and the Estimation of Academic Performance in Secondary School

The level of student attention in class greatly affects their academic performance. Teachers typically rely on visual inspection to react to students' attention in time, but this subjective method leads to inconsistencies across classes. Online education exacerbates the issue as students can turn off cameras and microphones to keep their own privacy. To address this, we present a novel, low-cost EEG-based platform for assessing students' attention and estimating their academic performance. In a study involving 34 secondary school students (aged 14 to 16), participants watched an academic video and answered evaluation questions while their EEG activity was recorded using a commercial headset. The results demonstrate a significant correlation (0.53, p-value = 0.003) between the power spectral density (PSD) of the EEG beta band (12-30 Hz) and students' academic performance. Additionally, there was a notable difference in PSD-beta between high and low academic performers. These findings encourage the use of PSD-beta for the immediate and objective assessment of both the student attention and the subsequent academic performance. The platform offers valuable and objective feedback to teachers, enhancing the effectiveness of both face-to-face and online teaching and learning environments.

Brain-to-brain communication during musical improvisation: a performance case study

Understanding and predicting others' actions in ecological settings is an important research goal in social neuroscience. Here, we deployed a mobile brain-body imaging (MoBI) methodology to analyze inter-brain communication between professional musicians during a live jazz performance. Specifically, bispectral analysis was conducted to assess the synchronization of scalp electroencephalographic (EEG) signals from three expert musicians during a three-part 45 minute jazz performance, during which a new musician joined every five minutes. The bispectrum was estimated for all musician dyads, electrode combinations, and five frequency bands. The results showed higher bispectrum in the beta and gamma frequency bands (13-50 Hz) when more musicians performed together, and when they played a musical phrase synchronously. Positive bispectrum amplitude changes were found approximately three seconds prior to the identified synchronized performance events suggesting preparatory cortical activity predictive of concerted behavioral action. Moreover, a higher amount of synchronized EEG activity, across electrode regions, was observed as more musicians performed, with inter-brain synchronization between the temporal, parietal, and occipital regions the most frequent. Increased synchrony between the musicians' brain activity reflects shared multi-sensory processing and movement intention in a musical improvisation task.

Gender differences in cognitive and affective interpersonal emotion regulation in couples: an fNIRS hyperscanning

Emotion regulation is vital in maintaining romantic relationships in couples. Although gender differences exist in cognitive and affective strategies during 'intrapersonal' emotion regulation, it is unclear how gender differences through affective bonds work in 'interpersonal' emotion regulation (IER) in couples. Thirty couple dyads and 30 stranger dyads underwent functional near-infrared spectroscopy hyperscanning recordings when targets complied with their partner's cognitive engagement (CE) and affective engagement (AE) strategies after viewing sad and neutral videos. Behaviorally, for males, CE was less effective than AE in both groups, but little difference occurred for females between AE and CE. For couples, Granger causality analysis showed that male targets had less neural activity than female targets in CH06, CH13 and CH17 during CE. For inflow and outflow activities on CH06 and CH13 (frontopolar cortex), respectively, male targets had less activity in the CE condition than in the AE condition, while for outflow activities on CH 17 (dorsolateral prefrontal cortex), female targets had more activity in the CE condition than in the AE condition. However, these differences were not observed in strangers. These results suggest gender differences in CE but not in AE and dissociable flow patterns in male and female targets in couples during sadness regulation.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Movement Artifact Suppression in Wearable Low-Density and Dry EEG Recordings Using Active Electrodes and Artifact Subspace Reconstruction

Wearable low-density dry electroencephalogram (EEG) headsets facilitate multidisciplinary applications of brain-activity decoding and brain-triggered interaction for healthy people in real-world scenarios. However, movement artifacts pose a great challenge to their validity in users with naturalistic behaviors (i.e., without highly controlled settings in a laboratory). High-precision, high-density EEG instruments commonly embed an active electrode infrastructure and/or incorporate an auxiliary artifact subspace reconstruction (ASR) pipeline to handle movement artifact interferences. Existing endeavors motivate this study to explore the efficacy of both hardware and software solutions in low-density and dry EEG recordings against non-tethered settings, which are rarely found in the literature. Therefore, this study employed a LEGO-like electrode-holder assembly grid to coordinate three 3-channel system designs (with passive/active dry vs. passive wet electrodes). It also conducted a simultaneous EEG recording while performing an oddball task during treadmill walking, with speeds of 1 and 2 KPH. The quantitative metrics of pre-stimulus noise, signal-to-noise ratio, and inter-subject correlation from the collected event-related potentials of 18 subjects were assessed. Results indicate that while treating a passive-wet system as benchmark, only the active-electrode design more or less rectified movement artifacts for dry electrodes, whereas the ASR pipeline was substantially compromised by limited electrodes. These findings suggest that a lightweight, minimally obtrusive dry EEG headset should at least equip an active-electrode infrastructure to withstand realistic movement artifacts for potentially sustaining its validity and applicability in real-world scenarios.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

Epigenetic modification of the oxytocin receptor gene is associated with child-parent neural synchrony during competition

Interpersonal neural synchrony (INS) occurs when neural electrical activity temporally aligns between individuals during social interactions. It has been used as a metric for interpersonal closeness, often during naturalistic child-parent interactions. This study evaluated whether other biological correlates of social processing predicted the prevalence of INS during child-parent interactions, and whether their observed cooperativity modulated this association. Child-parent dyads (n = 27) performed a visuospatial tower-building task in cooperative and competitive conditions. Neural activity was recorded using mobile electroencephalogram (EEG) headsets, and experimenters coded video-recordings post-hoc for behavioral attunement. DNA methylation of the oxytocin receptor gene (OXTRm) was measured, an epigenetic modification associated with reduced oxytocin activity and socioemotional functioning. Greater INS during competition was associated with lower child OXTRm, while greater behavioral attunement during competition and cooperation was associated with higher parent OXTRm. These differential relationships suggest that interpersonal dynamics as measured by INS may be similarly reflected by other biological markers of social functioning, irrespective of observed behavior. Children's self-perceived communication skill also showed opposite associations with parent and child OXTRm, suggesting complex relationships between children's and their parents' social functioning. Our findings have implications for ongoing developmental research, supporting the utility of biological metrics in characterizing interpersonal relationships.

Intra- and inter-brain coupling and activity dynamics during improvisational music therapy with a person with dementia: an explorative EEG-hyperscanning single case study

Objective

Real-life research into the underlying neural dynamics of improvisational music therapy, used with various clinical populations, is largely lacking. This single case study explored within-session differences in musical features and in within- and between-brain coupling between a Person with Dementia (PwD) and a music therapist during a music therapy session.

Methods

Dual-EEG from a music therapist and a PwD (male, 31 years) was recorded. Note density, pulse clarity and synchronicity were extracted from audio-visual data. Three music therapists identified moments of interest and no interest (MOI/MONI) in two drum improvisations. The Integrative Coupling Index, reflecting time-lagged neural synchronization, and musical features were compared between the MOI and MONI.

Results

Between-brain coupling of 2 Hz activity was increased during the MOI, showing anteriority of the therapist's neural activity. Within-brain coupling for the PwD was stronger from frontal and central areas during the MOI, but within-brain coupling for the therapist was stronger during MONI. Differences in musical features indicated that both acted musically more similar to one another during the MOI.

Conclusion

Within-session differences in neural synchronization and musical features highlight the dynamic nature of music therapy.

Significance

The findings contribute to a better understanding of social and affective processes in the brain and (interactive) musical behaviors during specific moments in a real-life music therapy session. This may provide insights into the role of such moments for relational-therapeutic processes.

The Synergy Zone: Connecting the Mind, Brain, and Heart for the Ideal Classroom Learning Environment

This paper proposes a new perspective on implementing neuroeducation in the classroom. The pandemic exacerbated the mental health issues of faculty and students, creating a mental health crisis that impairs learning. It is important to get our students back in "the zone", both cognitively and emotionally, by creating an ideal learning environment for capturing our students and keeping them-the Synergy Zone. Research that examines the classroom environment often focuses on the foreground-instructors' organizational and instructional aspects and content. However, the emotional climate of the classroom affects student well-being. This emotional climate would ideally exhibit the brain states of engagement, attention, connection, and enjoyment by addressing the mind, brain, and heart. This ideal learning environment would be achieved by combining proposed practices derived from three areas of research: flow theory, brain synchronization, and positive emotion with heart engagement. Each of these enhances the desired brain states in a way that the whole is greater than the sum of the individual parts. I call this the Synergy Zone. A limitation of this proposed model is that implementation of some aspects may be challenging, and professional development resources might be needed. This essay presenting this perspective provides the relevant scientific research and the educational implications of implementation.

A calculus of probability or belief? Neural underpinnings of social decision-making in a card game

For decades, the prefrontal cortex (PFC) has been the focus of social neuroscience research, specifically regarding its role in competitive social decision-making. However, the distinct contributions of PFC subregions when making strategic decisions involving multiple types of information (social, non-social, and mixed information) remain unclear. This study investigates decision-making strategies (pure probability calculation vs. mentalizing) and their neural representations using functional near-infrared spectroscopy (fNIRS) data collected during a two-person card game. We observed individual differences in information processing strategy, indicating that some participants relied more on probability than others. Overall, the use of pure probability decreased over time in favor of other types of information (e.g., mixed information), with this effect being more pronounced within-round trials than across rounds. In the brain, (1) the lateral PFC activates when decisions are driven by probability calculations; (2) the right lateral PFC responds to trial difficulty; and (3) the anterior medial PFC is engaged when decision-making involves mentalizing. Furthermore, neural synchrony, which reflects the real-time interplay between individuals' cognitive processes, did not consistently contribute to correct decisions and fluctuated throughout the experiment, suggesting a hierarchical mentalizing mechanism at work.

The evolution of social timing

Sociality and timing are tightly interrelated in human interaction as seen in turn-taking or synchronised dance movements. Sociality and timing also show in communicative acts of other species that might be pleasurable, but also necessary for survival. Sociality and timing often co-occur, but their shared phylogenetic trajectory is unknown: How, when, and why did they become so tightly linked? Answering these questions is complicated by several constraints; these include the use of divergent operational definitions across fields and species, the focus on diverse mechanistic explanations (e.g., physiological, neural, or cognitive), and the frequent adoption of anthropocentric theories and methodologies in comparative research. These limitations hinder the development of an integrative framework on the evolutionary trajectory of social timing and make comparative studies not as fruitful as they could be. Here, we outline a theoretical and empirical framework to test contrasting hypotheses on the evolution of social timing with species-appropriate paradigms and consistent definitions. To facilitate future research, we introduce an initial set of representative species and empirical hypotheses. The proposed framework aims at building and contrasting evolutionary trees of social timing toward and beyond the crucial branch represented by our own lineage. Given the integration of cross-species and quantitative approaches, this research line might lead to an integrated empirical-theoretical paradigm and, as a long-term goal, explain why humans are such socially coordinated animals.

Enhancing precision in human neuroscience

Human neuroscience has always been pushing the boundary of what is measurable. During the last decade, concerns about statistical power and replicability - in science in general, but also specifically in human neuroscience - have fueled an extensive debate. One important insight from this discourse is the need for larger samples, which naturally increases statistical power. An alternative is to increase the precision of measurements, which is the focus of this review. This option is often overlooked, even though statistical power benefits from increasing precision as much as from increasing sample size. Nonetheless, precision has always been at the heart of good scientific practice in human neuroscience, with researchers relying on lab traditions or rules of thumb to ensure sufficient precision for their studies. In this review, we encourage a more systematic approach to precision. We start by introducing measurement precision and its importance for well-powered studies in human neuroscience. Then, determinants for precision in a range of neuroscientific methods (MRI, M/EEG, EDA, Eye-Tracking, and Endocrinology) are elaborated. We end by discussing how a more systematic evaluation of precision and the application of respective insights can lead to an increase in reproducibility in human neuroscience.

A new paradigm for investigating real-world social behavior and its neural underpinnings

Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.

Coregulation: A Multilevel Approach via Biology and Behavior

In this article, we explore the concept of coregulation, which encompasses the mutual adaptation between partners in response to one another's biology and behavior. Coregulation operates at both biological (hormonal and nervous system) and behavioral (affective and cognitive) levels and plays a crucial role in the development of self-regulation. Coregulation extends beyond the actions of individuals in a dyad and involves interactive contributions of both partners. We use as an example parent-child coregulation, which is pervasive and expected, as it emerges from shared genetic relatedness, cohabitation, continuous interaction, and the influence of common factors like culture, which facilitate interpersonal coregulation. We also highlight the emerging field of neural attunement, which investigates the coordination of brain-based neural activities between individuals, particularly in social interactions. Understanding the mechanisms and significance of neural attunement adds a new dimension to our understanding of coregulation and its implications for parent-child relationships and child development.

Hyperscanning fNIRS data analysis using multiregression dynamic models: an illustration in a violin duo

Introduction

Interpersonal neural synchronization (INS) demands a greater understanding of a brain's influence on others. Therefore, brain synchronization is an even more complex system than intrasubject brain connectivity and must be investigated. There is a need to develop novel methods for statistical inference in this context.

Methods

In this study, motivated by the analysis of fNIRS hyperscanning data, which measure the activity of multiple brains simultaneously, we propose a two-step network estimation: Tabu search local method and global maximization in the selected subgroup [partial conditional directed acyclic graph (DAG) + multiregression dynamic model]. We illustrate this approach in a dataset of two individuals who are playing the violin together.

Results

This study contributes new tools to the social neuroscience field, which may provide new perspectives about intersubject interactions. Our proposed approach estimates the best probabilistic network representation, in addition to providing access to the time-varying parameters, which may be helpful in understanding the brain-to-brain association of these two players.

Discussion

The illustration of the violin duo highlights the time-evolving changes in the brain activation of an individual influencing the other one through a data-driven analysis. We confirmed that one player was leading the other given the ROI causal relation toward the other player.

Autonomic synchrony induced by hyperscanning interoception during interpersonal synchronization tasks

According to previous research, people influence each other's emotional states during social interactions via resonance mechanisms and coordinated autonomic rhythms. However, no previous studies tested if the manipulation of the interoceptive focus (focused attention on the breath for a given time interval) in hyperscanning during synchronized tasks may have an impact on autonomic synchrony. Thus, this study aims to assess the psychophysiological synchrony through autonomic measures recording during dyadic linguistic and motor synchronization tasks performed in two distinct interoceptive conditions: the focus and no focus on the breath condition. 26 participants coupled in 13 dyads were recruited. Individuals' autonomic measures [electrodermal: skin conductance level and response (SCL, SCR); cardiovascular indices: heart rate (HR) and HR variability (HRV)] was continuously monitored during the experiment and correlational coefficients were computed to analyze dyads physiological synchrony. Inter-subject analysis revealed higher synchrony for HR, HRV, SCL, and SCR values in the focus compared to no focus condition during the motor synchronization task and in general more for motor than linguistic task. Higher synchrony was also found for HR, SCL, and SCR values during focus than no focus condition in linguistic task. Overall, evidence suggests that the manipulation of the interoceptive focus has an impact on the autonomic synchrony during distinct synchronization tasks and for different autonomic measures. Such findings encourage the use of hyperscanning paradigms to assess the effect of breath awareness practices on autonomic synchrony in ecological and real-time conditions involving synchronization.

A wearable group-synchronized EEG system for multi-subject brain-computer interfaces

Objective

The multi-subject brain-computer interface (mBCI) is becoming a key tool for the analysis of group behaviors. It is necessary to adopt a neural recording system for collaborative brain signal acquisition, which is usually in the form of a fixed wire.

Approach

In this study, we designed a wireless group-synchronized neural recording system that supports real-time mBCI and event-related potential (ERP) analysis. This system uses a wireless synchronizer to broadcast events to multiple wearable EEG amplifiers. The simultaneously received broadcast signals are marked in data packets to achieve real-time event correlation analysis of multiple targets in a group.

Main results

To evaluate the performance of the proposed real-time group-synchronized neural recording system, we conducted collaborative signal sampling on 10 wireless mBCI devices. The average signal correlation reached 99.8%, the amplitude of average noise was 0.87 μV, and the average common mode rejection ratio (CMRR) reached 109.02 dB. The minimum synchronization error is 237 μs. We also tested the system in real-time processing of the steady-state visual-evoked potential (SSVEP) ranging from 8 to 15.8 Hz. Under 40 target stimulators, with 2 s data length, the average information transfer rate (ITR) reached 150 ± 20 bits/min, and the highest reached 260 bits/min, which was comparable to the marketing leading EEG system (the average: 150 ± 15 bits/min; the highest: 280 bits/min). The accuracy of target recognition in 2 s was 98%, similar to that of the Synamps2 (99%), but a higher signal-to-noise ratio (SNR) of 5.08 dB was achieved. We designed a group EEG cognitive experiment; to verify, this system can be used in noisy settings.

Significance

The evaluation results revealed that the proposed real-time group-synchronized neural recording system is a high-performance tool for real-time mBCI research. It is an enabler for a wide range of future applications in collaborative intelligence, cognitive neurology, and rehabilitation.

Inter-Brain Synchrony Pattern Investigation on Triadic Board Game Play-Based Social Interaction: An fNIRS Study

Recent advances in functional neuroimaging techniques, including methodologies such as fNIRS, have enabled the evaluation of inter-brain synchrony (IBS) induced by interpersonal interactions. However, the social interactions assumed in existing dyadic hyperscanning studies do not sufficiently emulate polyadic social interactions in the real world. Therefore, we devised an experimental paradigm that incorporates the Korean folk board game "Yut-nori" to reproduce social interactions that emulate social activities in the real world. We recruited 72 participants aged 25.2 ± 3.9 years (mean ± standard deviation) and divided them into 24 triads to play Yut-nori, following the standard or modified rules. The participants either competed against an opponent (standard rule) or cooperated with an opponent (modified rule) to achieve a goal efficiently. Three different fNIRS devices were employed to record cortical hemodynamic activations in the prefrontal cortex both individually and simultaneously. Wavelet transform coherence (WTC) analyses were performed to assess prefrontal IBS within a frequency range of 0.05-0.2 Hz. Consequently, we observed that cooperative interactions increased prefrontal IBS across overall frequency bands of interest. In addition, we also found that different purposes for cooperation generated different spectral characteristics of IBS depending on the frequency bands. Moreover, IBS in the frontopolar cortex (FPC) reflected the influence of verbal interactions. The findings of our study suggest that future hyperscanning studies should consider polyadic social interactions to reveal the properties of IBS in real-world interactions.

Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony

Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.

Why people engage in corrupt collaboration: an observation at the multi-brain level

Recent studies suggest that corrupt collaboration (i.e. acquiring private benefits with joint immoral acts) represents a dilemma between the honesty and reciprocity norms. In this study, we asked pairs of participants (labeled as A and B) to individually toss a coin and report their outcomes; their collective benefit could be maximized by dishonestly reporting (a corrupt behavior). As expected, the likelihood of corrupt behavior was high; this probability was negatively correlated with player A's moral judgment ability but positively correlated with player B's empathic concern (EC). Functional near-infrared spectroscopy data revealed that the brain-to-brain synchronization in the right dorsolateral prefrontal cortex was associated with fewer corrupt behaviors, and that it mediated the relationship between player A's moral judgment ability and corrupt collaboration. Meanwhile, the right temporal-parietal junction synchronization was associated with more corrupt behaviors, and that it mediated the relationship between player B's EC and corrupt collaboration. The roles of these 2 regions are interpreted according to the influence of the honesty and reciprocity norms on corrupt collaboration. In our opinion, these findings provide insight into the underlying mechanisms and modulating factors of corrupt collaboration.

Affective or cognitive interpersonal emotion regulation in couples: an fNIRS hyperscanning study

Sadness regulation is crucial for maintaining the romantic relationships of couples. Interpersonal emotion regulation, including affective engagement (AE) and cognitive engagement (CE), activates social brain networks. However, it is unclear how AE and CE regulate sadness in couples through affective bonds. We recruited 30 heterosexual couple dyads and 30 heterosexual stranger dyads and collected functional near-infrared spectroscopy hyperscanning data while each dyad watched sad or neutral videos and while the regulator regulated the target's sadness. Then, we characterized interbrain synchronization (IBS) and Granger causality (GC). The results indicated that AE and CE were more effective for couples than for strangers and that sadness evaluation of female targets was lower than that of male targets. CE-induced IBS at CH13 (BA10, right middle frontal gyrus) was lower for female targets than for male targets, while no gender difference in AE was detected. GC change at CH13 during CE was lower in the sad condition for male targets than for female targets, while no gender difference in AE was discovered. These observations suggest that AE and CE activate affective bonds but that CE was more effective for regulating sadness in female targets, revealing different neural patterns of cognitive and affective sadness regulation in couples.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.

The Temporal Dynamics of Brain-to-Brain Synchrony Between Students and Teachers Predict Learning Outcomes

Much of human learning happens through interaction with other people, but little is known about how this process is reflected in the brains of students and teachers. Here, we concurrently recorded electroencephalography (EEG) data from nine groups, each of which contained four students and a teacher. All participants were young adults from the northeast United States. Alpha-band (8-12 Hz) brain-to-brain synchrony between students predicted both immediate and delayed posttest performance. Further, brain-to-brain synchrony was higher in specific lecture segments associated with questions that students answered correctly. Brain-to-brain synchrony between students and teachers predicted learning outcomes at an approximately 300-ms lag in the students' brain activity relative to the teacher's brain activity, which is consistent with the time course of spoken-language comprehension. These findings provide key new evidence for the importance of collecting brain data simultaneously from groups of learners in ecologically valid settings.

Virtual (Zoom) Interactions Alter Conversational Behavior and Interbrain Coherence

A growing number of social interactions are taking place virtually on videoconferencing platforms. Here, we explore potential effects of virtual interactions on observed behavior, subjective experience, and neural "single-brain" and "interbrain" activity via functional near-infrared spectroscopy neuroimaging. We scanned a total of 36 human dyads (72 participants, 36 males, 36 females) who engaged in three naturalistic tasks (i.e., problem-solving, creative-innovation, socio-emotional task) in either an in-person or virtual (Zoom) condition. We also coded cooperative behavior from audio recordings. We observed reduced conversational turn-taking behavior during the virtual condition. Given that conversational turn-taking was associated with other metrics of positive social interaction (e.g., subjective cooperation and task performance), this measure may be an indicator of prosocial interaction. In addition, we observed altered patterns of averaged and dynamic interbrain coherence in virtual interactions. Interbrain coherence patterns that were characteristic of the virtual condition were associated with reduced conversational turn-taking. These insights can inform the design and engineering of the next generation of videoconferencing technology.SIGNIFICANCE STATEMENT Videoconferencing has become an integral part of our lives. Whether this technology impacts behavior and neurobiology is not well understood. We explored potential effects of virtual interaction on social behavior, brain activity, and interbrain coupling. We found that virtual interactions were characterized by patterns of interbrain coupling that were negatively implicated in cooperation. Our findings are consistent with the perspective that videoconferencing technology adversely affects individuals and dyads during social interaction. As virtual interactions become even more necessary, improving the design of videoconferencing technology will be crucial for supporting effective communication.

Revealing the neurobiology underlying interpersonal neural synchronization with multimodal data fusion

Humans synchronize with one another to foster successful interactions. Here, we use a multimodal data fusion approach with the aim of elucidating the neurobiological mechanisms by which interpersonal neural synchronization (INS) occurs. Our meta-analysis of 22 functional magnetic resonance imaging and 69 near-infrared spectroscopy hyperscanning experiments (740 and 3721 subjects) revealed robust brain regional correlates of INS in the right temporoparietal junction and left ventral prefrontal cortex. Integrating this meta-analytic information with public databases, biobehavioral and brain-functional association analyses suggested that INS involves sensory-integrative hubs with functional connections to mentalizing and attention networks. On the molecular and genetic levels, we found INS to be associated with GABAergic neurotransmission and layer IV/V neuronal circuits, protracted developmental gene expression patterns, and disorders of neurodevelopment. Although limited by the indirect nature of phenotypic-molecular association analyses, our findings generate new testable hypotheses on the neurobiological basis of INS.