Interbrain Synchrony in the Expectation of Cooperation Behavior: A Hyperscanning Study Using Functional Near-Infrared Spectroscopy

Bringing together multimodal and multilevel approaches to study the emergence of social bonds between children and improve social AI

This protocol paper outlines an innovative multimodal and multilevel approach to studying the emergence and evolution of how children build social bonds with their peers, and its potential application to improving social artificial intelligence (AI). We detail a unique hyperscanning experimental framework utilizing functional near-infrared spectroscopy (fNIRS) to observe inter-brain synchrony in child dyads during collaborative tasks and social interactions. Our proposed longitudinal study spans middle childhood, aiming to capture the dynamic development of social connections and cognitive engagement in naturalistic settings. To do so we bring together four kinds of data: the multimodal conversational behaviors that dyads of children engage in, evidence of their state of interpersonal rapport, collaborative performance on educational tasks, and inter-brain synchrony. Preliminary pilot data provide foundational support for our approach, indicating promising directions for identifying neural patterns associated with productive social interactions. The planned research will explore the neural correlates of social bond formation, informing the creation of a virtual peer learning partner in the field of Social Neuroergonomics. This protocol promises significant contributions to understanding the neural basis of social connectivity in children, while also offering a blueprint for designing empathetic and effective social AI tools, particularly for educational contexts.

Neural mechanisms distinguishing two types of cooperative problem-solving approaches: An fNIRS hyperscanning study

Collaborative cooperation (CC) and division of labor cooperation (DLC) are two prevalent forms of cooperative problem-solving approaches in daily life. Despite extensive research on the neural mechanisms underlying cooperative problem-solving approaches, a notable gap exists between the neural processes that support CC and DLC. The present study utilized a functional near-infrared spectroscopy (fNIRS) hyperscanning technique along with a classic cooperative tangram puzzle task to investigate the neural mechanisms engaged by both friends and stranger dyads during CC versus DLC. The key findings of this study were as follows: (1) Dyads exhibited superior behavioral performance in the DLC task than in the CC task. The CC task bolstered intra-brain functional connectivity and inter-brain synchrony (IBS) in regions linked to the mirror neuron system (MNS), spatial perception (SP) and cognitive control. (2) Friend dyads showed stronger IBS in brain regions associated with the MNS than stranger dyads. (3) Perspective-taking predicted not only dyads' behavioral performance in the CC task but also their IBS in brain regions associated with SP during the DLC task. Taken together, these findings elucidate the divergent behavioral performance and neural connection patterns between the two cooperative problem-solving approaches. This study provides novel insights into the various neurocognitive processes underlying flexible coordination strategies in real-world cooperative contexts.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Interpersonal brain synchronization during face-to-face economic exchange between acquainted dyads

Interpersonal brain synchronization (IBS) has been observed during social interactions and involves various factors, such as familiarity with the partner and type of social activity. A previous study has shown that face-to-face (FF) interactions in pairs of strangers increase IBS. However, it is unclear whether this can be observed when the nature of the interacting partners is different. Herein, we aimed to extend these findings to pairs of acquaintances. Neural activity in the frontal and temporal regions was recorded using functional near-infrared spectroscopy hyperscanning. Participants played an ultimatum game that required virtual economic exchange in two experimental settings: face-to-face and face-blocked conditions. Random pair analysis confirmed whether IBS was induced by social interaction. Contrary to the aforementioned study, our results did not show any cooperative behavior or task-induced IBS increase. Conversely, the random pair analysis results revealed that the pair-specific IBS was significant only in the task condition at the left and right superior frontal, middle frontal, orbital superior frontal, right superior temporal, precentral and postcentral gyri. Our results tentatively suggested that FF interaction in acquainted pairs did not increase IBS and supported the idea that IBS is affected by 'with whom we interact and how'.

Distinct inter-brain synchronization patterns underlying group decision-making under uncertainty with partners in different interpersonal relationships

Humans may behave in different manners when making decisions with friends and strangers. Whether the interpersonal relationship and the characteristics of the individuals in the group affected the group decision-making under uncertainty in the real-time interaction remains unknown. Using the turn-based Balloon Analogue Risk Task (BART), the present study examined the group decision-making propensity under uncertainty with partners in different interpersonal relationships and interpersonal orientations. Corresponding inter-brain synchronization (IBS) patterns at the prefrontal cortex (PFC) were also uncovered with the fNIRS-based hyperscanning approach. Behavioral results identified that dyads in the friend group exhibited the uncertainty-averse propensity when comparing with the stranger group. The fNIRS results reported that feedback-related IBS at the left inferior frontal gyrus (l-IFG) and medial frontopolar cortex (mFPC) during different feedbacks was modulated by interpersonal relationships. The IBS at all channels in the PFC during the positive and negative feedbacks, respectively, predicted the decision-making propensity under uncertainty in the stranger and friend groups based on the support vector machine (SVM) algorithm. The moderating role of the social value orientation (SVO) was also verified in the mediation effect of the dyad closeness on the decision-making propensity under uncertainty via the IBS at the right lateral frontopolar cortex (r-FPC). These findings demonstrated disparate behavioral responses and inter-brain synchronization patterns underlying group decision-making under uncertainty with partners in different interpersonal relationships.

A New Statistical Approach for fNIRS Hyperscanning to Predict Brain Activity of Preschoolers' Using Teacher's

Hyperscanning studies using functional Near-Infrared Spectroscopy (fNIRS) have been performed to understand the neural mechanisms underlying human-human interactions. In this study, we propose a novel methodological approach that is developed for fNIRS multi-brain analysis. Our method uses support vector regression (SVR) to predict one brain activity time series using another as the predictor. We applied the proposed methodology to explore the teacher-student interaction, which plays a critical role in the formal learning process. In an illustrative application, we collected fNIRS data of the teacher and preschoolers’ dyads performing an interaction task. The teacher explained to the child how to add two numbers in the context of a game. The Prefrontal cortex and temporal-parietal junction of both teacher and student were recorded. A multivariate regression model was built for each channel in each dyad, with the student’s signal as the response variable and the teacher’s ones as the predictors. We compared the predictions of SVR with the conventional ordinary least square (OLS) predictor. The results predicted by the SVR model were statistically significantly correlated with the actual test data at least one channel-pair for all dyads. Overall, 29/90 channel-pairs across the five dyads (18 channels 5 dyads = 90 channel-pairs) presented significant signal predictions withthe SVR approach. The conventional OLS resulted in only 4 out of 90 valid predictions. These results demonstrated that the SVR could be used to perform channel-wise predictions across individuals, and the teachers’ cortical activity can be used to predict the student brain hemodynamic response.