Holistic cognitive and neural processes: a fNIRS-hyperscanning study on interpersonal sensorimotor synchronization

Investigating mother-child inter-brain synchrony in a naturalistic paradigm: A functional near infrared spectroscopy (fNIRS) hyperscanning study

Successful social interactions between mothers and children are hypothesised to play a significant role in a child's social, cognitive and language development. Earlier research has confirmed, through structured experimental paradigms, that these interactions could be underpinned by coordinated neural activity. Nevertheless, the extent of neural synchrony during real-life, ecologically valid interactions between mothers and their children remains largely unexplored. In this study, we investigated mother-child inter-brain synchrony using a naturalistic free-play paradigm. We also examined the relationship between neural synchrony, verbal communication patterns and personality traits to further understand the underpinnings of brain synchrony. Twelve children aged between 3 and 5 years old and their mothers participated in this study. Neural synchrony in mother-child dyads were measured bilaterally over frontal and temporal areas using functional Near Infra-red Spectroscopy (fNIRS) whilst the dyads were asked to play with child-friendly toys together (interactive condition) and separately (independent condition). Communication patterns were captured via video recordings and conversational turns were coded. Compared to the independent condition, mother-child dyads showed increased neural synchrony in the interactive condition across the prefrontal cortex and temporo-parietal junction. There was no significant relationship found between neural synchrony and turn-taking and between neural synchrony and the personality traits of each member of the dyad. Overall, we demonstrate the feasibility of measuring inter-brain synchrony between mothers and children in a naturalistic environment. These findings can inform future study designs to assess inter-brain synchrony between parents and pre-lingual children and/or children with communication needs.

Shared Minds, Shared Feedback: tracing the influence of parental feedback on shared neural patterns

Parental feedback affects children in multiple ways. However, little is known about how children, family, and feedback types affect parental feedback neural mechanisms. The current study used functional near-infrared spectroscopy-based hyperscanning to observe 47 mother-daughter pairs's (mean age of mothers: 35.95 ± 3.99 yr old; mean age of daughters: 6.97 ± 0.75 yr old) brain synchronization in a jigsaw game under various conditions. Between parental negative feedback and praise conditions, mother-daughter brain in supramarginal gyrus, left dorsolateral prefrontal cortex, right inferior frontal gyrus, and right primary somatic (S1) differed. When criticized, conformity family-communication-patterned families had much worse brain synchronization in S1, left dorsolateral prefrontal cortex, and right Wernicke's region than conversational families. Resilient children had better mother-child supramarginal gyrus synchronicity under negative feedback. This study supports the importance of studying children's neurological development in nurturing environments to assess their psychological development.

Effective connectivity analysis of verbal working memory advantage across materials for pathological smartphone users by fNIRS

Previous studies have found working memory (WM) advantages of the pathological smartphone use (PSU) group, but most of which were emphasized in the network-related domain. Whether the advantages can transfer to other domains has yet to be confirmed. In particular, exploring from a brain mechanism perspective is necessary. Using the classical N-back paradigm, this study selected network-related words and neutral words as materials combined with fNIRS to probe the verbal WM characteristics of the PSU group. The results showed that β in channel 3, channel 4, and channel 5 were significantly lower in the PSU group than those in the control group The analysis of the region of interest revealed that the PSU group showed significantly lower β in the l-DLPFC and frontopolar. Granger Causality results showed that functional connectivity between frontopolar and R-DLPFC for the PSU group was significantly higher than for the control group in the network word condition. These results demonstrate that the PSU group has an advantage in WM, transferring from the network-related stimulus to the neutral stimulus. The advantages of network stimulus were related to bidirectional connectivity between frontopolar and R-DLPFC. Also, the l-DLPFC and frontopolar are associated with the cross-material consistency of WM.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Why people engage in corrupt collaboration: an observation at the multi-brain level

Recent studies suggest that corrupt collaboration (i.e. acquiring private benefits with joint immoral acts) represents a dilemma between the honesty and reciprocity norms. In this study, we asked pairs of participants (labeled as A and B) to individually toss a coin and report their outcomes; their collective benefit could be maximized by dishonestly reporting (a corrupt behavior). As expected, the likelihood of corrupt behavior was high; this probability was negatively correlated with player A's moral judgment ability but positively correlated with player B's empathic concern (EC). Functional near-infrared spectroscopy data revealed that the brain-to-brain synchronization in the right dorsolateral prefrontal cortex was associated with fewer corrupt behaviors, and that it mediated the relationship between player A's moral judgment ability and corrupt collaboration. Meanwhile, the right temporal-parietal junction synchronization was associated with more corrupt behaviors, and that it mediated the relationship between player B's EC and corrupt collaboration. The roles of these 2 regions are interpreted according to the influence of the honesty and reciprocity norms on corrupt collaboration. In our opinion, these findings provide insight into the underlying mechanisms and modulating factors of corrupt collaboration.

Virtual (Zoom) Interactions Alter Conversational Behavior and Interbrain Coherence

A growing number of social interactions are taking place virtually on videoconferencing platforms. Here, we explore potential effects of virtual interactions on observed behavior, subjective experience, and neural "single-brain" and "interbrain" activity via functional near-infrared spectroscopy neuroimaging. We scanned a total of 36 human dyads (72 participants, 36 males, 36 females) who engaged in three naturalistic tasks (i.e., problem-solving, creative-innovation, socio-emotional task) in either an in-person or virtual (Zoom) condition. We also coded cooperative behavior from audio recordings. We observed reduced conversational turn-taking behavior during the virtual condition. Given that conversational turn-taking was associated with other metrics of positive social interaction (e.g., subjective cooperation and task performance), this measure may be an indicator of prosocial interaction. In addition, we observed altered patterns of averaged and dynamic interbrain coherence in virtual interactions. Interbrain coherence patterns that were characteristic of the virtual condition were associated with reduced conversational turn-taking. These insights can inform the design and engineering of the next generation of videoconferencing technology.SIGNIFICANCE STATEMENT Videoconferencing has become an integral part of our lives. Whether this technology impacts behavior and neurobiology is not well understood. We explored potential effects of virtual interaction on social behavior, brain activity, and interbrain coupling. We found that virtual interactions were characterized by patterns of interbrain coupling that were negatively implicated in cooperation. Our findings are consistent with the perspective that videoconferencing technology adversely affects individuals and dyads during social interaction. As virtual interactions become even more necessary, improving the design of videoconferencing technology will be crucial for supporting effective communication.

The Increasing Effect of Interoception on Brain Frontal Responsiveness During a Socially Framed Motor Synchronization Task

This research explored the effect of explicit Interoceptive Attentiveness (IA) manipulation on hemodynamic brain correlates during a task involving interpersonal motor coordination framed with a social goal. Participants performed a task requiring interpersonal movement synchrony with and without a social framing in both explicit IA and control conditions. Functional Near-Infrared Spectroscopy (fNIRS) was used to record oxygenated (O2Hb) and deoxygenated hemoglobin (HHb) changes during the tasks. According to the results, the prefrontal cortex (PFC), which is involved in high-order social cognition and interpersonal relations processing, was more responsive when inducing the explicit focus (IA) on the breath during the socially framed motor task requiring synchronization, as indicated by increased O2Hb. In the absence of a broader social frame, this effect was not significant for the motor task. Overall, the present study suggests that when a joint task is performed and the individual focuses on his/her physiological body reactions, the brain hemodynamic correlates are “boosted” in neuroanatomical regions that support sustained attention, reorientation of attention, social responsiveness, and synchronization. Furthermore, the PFC responds significantly more as the person consciously focuses on physiological interoceptive correlates and performs a motor task requiring synchronization, particularly when the task is socially framed.

The relationship between stability of interpersonal coordination and inter-brain EEG synchronization during anti-phase tapping

Inter-brain synchronization is enhanced when individuals perform rhythmic interpersonal coordination tasks, such as playing instruments in music ensembles. Experimentally, synchronization has been shown to correlate with the performance of joint tapping tasks. However, it is unclear whether inter-brain synchronization is related to the stability of interpersonal coordination represented as the standard deviation of relative phase (SDRP). In this study, we simultaneously recorded electroencephalograms of two paired individuals during anti-phase tapping in three interactive tapping conditions: slow (reference inter-tap interval [ITI]: 0.5 s), fast (reference ITI: 0.25 s), and free (preferred ITI), and pseudo tapping where each participant tapped according to the metronome sounds without interaction. We calculated the inter-brain synchronization between pairs of six regions of interest (ROI): frontal, central, left/right temporal, parietal, and occipital regions. During the fast tapping, the inter-brain synchronization significantly increased in multiple ROI pairs including temporoparietal junction in comparison to pseudo tapping. Synchronization between the central and left-temporal regions was positively correlated with SDRP in the theta in the fast condition. These results demonstrate that inter-brain synchronization occurs when task requirements are high and increases with the instability of the coordination.

Cooperative Behavior Evokes Interbrain Synchrony in the Prefrontal and Temporoparietal Cortex: A Systematic Review and Meta-Analysis of fNIRS Hyperscanning Studies

Single-brain neuroimaging studies have shown that human cooperation is associated with neural activity in frontal and temporoparietal regions. However, it remains unclear whether single-brain studies are informative about cooperation in real life, where people interact dynamically. Such dynamic interactions have become the focus of interbrain studies. An advantageous technique in this regard is functional near-infrared spectroscopy (fNIRS) because it is less susceptible to movement artifacts than more conventional techniques like electroencephalography (EEG) or functional magnetic resonance imaging (fMRI). We conducted a systematic review and the first quantitative meta-analysis of fNIRS hyperscanning of cooperation, based on thirteen studies with 890 human participants. Overall, the meta-analysis revealed evidence of statistically significant interbrain synchrony while people were cooperating, with large overall effect sizes in both frontal and temporoparietal areas. All thirteen studies observed significant interbrain synchrony in the prefrontal cortex (PFC), suggesting that this region is particularly relevant for cooperative behavior. The consistency in these findings is unlikely to be because of task-related activations, given that the relevant studies used diverse cooperation tasks. Together, the present findings support the importance of interbrain synchronization of frontal and temporoparietal regions in interpersonal cooperation. Moreover, the present article highlights the usefulness of meta-analyses as a tool for discerning patterns in interbrain dynamics.

Integration of social status and trust through interpersonal brain synchronization

Trust can be a dynamic social process, during which the social identity of the interacting agents (e.g., an investor and a trustee) can bias trust outcomes. Here, we investigated how social status modulates trust and the neural mechanisms underlying this process. An investor and a trustee performed a 10-round repeated trust game while their brain activity was being simultaneously recorded using functional near-infrared spectroscopy. The social status (either high or low) of both investors and trustees was manipulated via a math competition task. The behavioral results showed that in the initial round, individuals invested more in low-status partners. However, the investment ratio increased faster as the number of rounds increased during trust interaction when individuals were paired with a high-status partner. This increasing trend was particularly prominent in the low (investor)-high (trustee) status group. Moreover, the low-high group showed increased investor-trustee brain synchronization in the right temporoparietal junction as the number of rounds increased, while brain activation in the right dorsolateral prefrontal cortex of the investor decreased as the number of rounds increased. Both interpersonal brain synchronization and brain activation predicted investment performance at the early stage; furthermore, two-brain data provided earlier predictions than did single-brain data. These effects were detectable in the investment phase in the low-high group only; no comparable effects were observed in the repayment phase or other groups. Overall, this study demonstrated a multi-brain mechanism for the integration of social status and trust.

The default mode network: where the idiosyncratic self meets the shared social world

The default mode network (DMN) is classically considered an 'intrinsic' system, specializing in internally oriented cognitive processes such as daydreaming, reminiscing and future planning. In this Perspective, we suggest that the DMN is an active and dynamic 'sense-making' network that integrates incoming extrinsic information with prior intrinsic information to form rich, context-dependent models of situations as they unfold over time. We review studies that relied on naturalistic stimuli, such as stories and movies, to demonstrate how an individual's DMN neural responses are influenced both by external information accumulated as events unfold over time and by the individual's idiosyncratic past memories and knowledge. The integration of extrinsic and intrinsic information over long timescales provides a space for negotiating a shared neural code, which is necessary for establishing shared meaning, shared communication tools, shared narratives and, above all, shared communities and social networks.

The integration of social and neural synchrony: a case for ecologically valid research using MEG neuroimaging

The recent decade has seen a shift from artificial and environmentally deprived experiments in neuroscience to real-life studies on multiple brains in interaction, coordination and synchrony. In these new interpersonal synchrony experiments, there has been a growing trend to employ naturalistic social interactions to evaluate mechanisms underlying synchronous neuronal communication. Here, we emphasize the importance of integrating the assessment of neural synchrony with measurement of nonverbal behavioral synchrony as expressed in various social contexts: relaxed social interactions, planning a joint pleasurable activity, conflict discussion, invocation of trauma, or support giving and assess the integration of neural and behavioral synchrony across developmental stages and psychopathological conditions. We also showcase the advantages of magnetoencephalography neuroimaging as a promising tool for studying interactive neural synchrony and consider the challenge of ecological validity at the expense of experimental rigor. We review recent evidence of rhythmic information flow between brains in interaction and conclude with addressing state-of-the-art developments that may contribute to advance research on brain-to-brain coordination to the next level.

Interpersonal brain synchronization under bluffing in strategic games

People commonly use bluffing as a strategy to manipulate other people's beliefs about them for gain. Although bluffing is an important part of successful strategic thinking, the inter-brain mechanisms underlying bluffing remain unclear. Here, we employed a functional near-infrared spectroscopy hyperscanning technique to simultaneously record the brain activity in the right temporal-parietal junction in 32 pairs of participants when they played a bluffing game against each other or with computer opponents separately. We also manipulated the penalty for bluffing (high vs low). Under the condition of high relative to low penalty, results showed a higher bluffing rate and a higher calling rate in human-to-human as compared to human-to-computer pairing. At the neural level, high relative to low penalty condition increased the interpersonal brain synchronization (IBS) in the right angular gyrus (rAG) during human-to-human as compared to human-to-computer interaction. Importantly, bluffing relative to non-bluffing, under the high penalty and human-to-human condition, resulted in an increase in response time and enhanced IBS in the rAG. Participants who bluffed more frequently also elicited stronger IBS. Our findings support the view that regions associated with mentalizing become synchronized during bluffing games, especially under the high penalty and human-to-human condition.

Capturing Human Interaction in the Virtual Age: A Perspective on the Future of fNIRS Hyperscanning

Advances in video conferencing capabilities combined with dramatic socio-dynamic shifts brought about by COVID-19, have redefined the ways in which humans interact in modern society. From business meetings to medical exams, or from classroom instruction to yoga class, virtual interfacing has permeated nearly every aspect of our daily lives. A seemingly endless stream of technological advances combined with our newfound reliance on virtual interfacing makes it likely that humans will continue to use this modern form of social interaction into the future. However, emergent evidence suggests that virtual interfacing may not be equivalent to face-to-face interactions. Ultimately, too little is currently understood about the mechanisms that underlie human interactions over the virtual divide, including how these mechanisms differ from traditional face-to-face interaction. Here, we propose functional near-infrared spectroscopy (fNIRS) hyperscanning-simultaneous measurement of two or more brains-as an optimal approach to quantify potential neurocognitive differences between virtual and in-person interactions. We argue that increased focus on this understudied domain will help elucidate the reasons why virtual conferencing doesn't always stack up to in-person meetings and will also serve to spur new technologies designed to improve the virtual interaction experience. On the basis of existing fNIRS hyperscanning literature, we highlight the current gaps in research regarding virtual interactions. Furthermore, we provide insight into current hurdles regarding fNIRS hyperscanning hardware and methodology that should be addressed in order to shed light on this newly critical element of everyday life.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.