The effect of interbrain synchronization in gesture observation: A fNIRS study

Neural mechanisms distinguishing two types of cooperative problem-solving approaches: An fNIRS hyperscanning study

Collaborative cooperation (CC) and division of labor cooperation (DLC) are two prevalent forms of cooperative problem-solving approaches in daily life. Despite extensive research on the neural mechanisms underlying cooperative problem-solving approaches, a notable gap exists between the neural processes that support CC and DLC. The present study utilized a functional near-infrared spectroscopy (fNIRS) hyperscanning technique along with a classic cooperative tangram puzzle task to investigate the neural mechanisms engaged by both friends and stranger dyads during CC versus DLC. The key findings of this study were as follows: (1) Dyads exhibited superior behavioral performance in the DLC task than in the CC task. The CC task bolstered intra-brain functional connectivity and inter-brain synchrony (IBS) in regions linked to the mirror neuron system (MNS), spatial perception (SP) and cognitive control. (2) Friend dyads showed stronger IBS in brain regions associated with the MNS than stranger dyads. (3) Perspective-taking predicted not only dyads' behavioral performance in the CC task but also their IBS in brain regions associated with SP during the DLC task. Taken together, these findings elucidate the divergent behavioral performance and neural connection patterns between the two cooperative problem-solving approaches. This study provides novel insights into the various neurocognitive processes underlying flexible coordination strategies in real-world cooperative contexts.

Inter-brain neural mechanism and influencing factors underlying different cooperative behaviors: a hyperscanning study

Cooperative behavior is a vital social interaction which plays a vital role in improving human survival and reproduction. However, few empirical studies have examined the differences between cooperative behaviors and the underlying neural substrates. In the present study, the brain activity of familiar dyads of the same sex was measured using functional near-infrared spectroscopy during three cooperative tasks (cooperative button-press, tangram, and Jenga tasks). We also measured the dyads' empathic abilities and personality traits to investigate the relationships between individual characteristics and neural markers. The results showed that first, there were significant differences in intra-brain activation and inter-brain synchronization among different cooperative tasks in three dimensions: social cognition, behavioral response, and cognitive processing. Second, male participants require stronger intra-brain activation to achieve the same inter-brain synchronization level as women in cooperative tasks. Third, when performing cooperative tasks involving high cognitive demands, Big Five Neuroticism may be an important predictor of neural activation in female participants. Inter-brain synchronization plays an important role in the frontal and temporoparietal junctions during interpersonal cooperation. Furthermore, this study demonstrates that mutual prediction theory is crucial for understanding the neural mechanisms of cooperative behavior.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

Bidirectional understanding and cooperation: interbrain neural synchronization during social navigation

The complexity of the environment requires humans to solve problems collaboratively. The aim of this study was to investigate the neural mechanism of social navigation in group problem-solving situations. A novel cooperative task was designed in which dyadic participants assumed the role of an operator or a navigator with different skills and knowledge and worked together to complete the task. Using functional near-infrared spectroscopy-based hyperscanning, we found stronger interbrain neural synchronization of the right temporoparietal junction (rTPJ) between dyads when the operator received instructions from the navigator rather than from a computer. The functional connections between the rTPJ and the other brain areas indicated the involvement of the mirror neural system during the task. Further directional analysis using Granger causality analysis revealed a flow of information from the temporal to the parietal and then to the pre-motor cortex in the operator's brain. These findings provide empirical evidence for the neural mechanism of social navigation and highlight the importance of the rTPJ for communication and joint attention in uncertain group problem-solving situations.

Exploring the Emotional Functions of Co-Speech Hand Gesture in Language and Communication

Research over the past four decades has built a convincing case that co-speech hand gestures play a powerful role in human cognition . However, this recent focus on the cognitive function of gesture has, to a large extent, overlooked its emotional role-a role that was once central to research on bodily expression. In the present review, we first give a brief summary of the wealth of research demonstrating the cognitive function of co-speech gestures in language acquisition, learning, and thinking. Building on this foundation, we revisit the emotional function of gesture across a wide range of communicative contexts, from clinical to artistic to educational, and spanning diverse fields, from cognitive neuroscience to linguistics to affective science. Bridging the cognitive and emotional functions of gesture highlights promising avenues of research that have varied practical and theoretical implications for human-machine interactions, therapeutic interventions, language evolution, embodied cognition, and more.

Interpersonal coordination enhances brain-to-brain synchronization and influences responsibility attribution and reward allocation in social cooperation

Fair distribution of resources matters to both individual interests and group harmony during social cooperation. Different allocation rules, including equity- and equality-based rules, have been widely discussed in reward allocation research; however, it remains unclear whether and how individuals' cooperative manner, such as interpersonal coordination, influence their subsequent responsibility attribution and reward allocation. Here, 46 dyads conducted a time estimation task-either synergistically (the coordination group) or solely (the control group)-while their brain activities were measured using a functional near-infrared spectroscopy hyperscanning approach. Dyads in the coordination group showed higher behavioral synchrony and higher interpersonal brain synchronization (IBS) in the dorsal lateral prefrontal cortex (DLPFC) during the time estimation task than those in the control group. They also showed a more egalitarian tendency of responsibility attribution for the task outcome. More importantly, dyads in the coordination group who had higher IBS in the dorsal medial prefrontal cortex (DMPFC) were more inclined to make egalitarian reward allocations, and this effect was mediated by responsibility attribution. Our findings elucidate the influence of interpersonal coordination on reward allocation and the critical role of the prefrontal cortex in these processes.

Intra-Brain Connectivity vs. Inter-Brain Connectivity in Gestures Reproduction: What Relationship?

Recently, the neurosciences have become interested in the investigation of neural responses associated with the use of gestures. This study focuses on the relationship between the intra-brain and inter-brain connectivity mechanisms underlying the execution of different categories of gestures (positive and negative affective, social, and informative) characterizing non-verbal interactions between thirteen couples of subjects, each composed of an encoder and a decoder. The study results underline a similar modulation of intra- and inter-brain connectivity for alpha, delta, and theta frequency bands in specific areas (frontal or posterior regions) depending on the type of gesture. Moreover, taking into account the gestures' valence (positive or negative), a similar modulation of intra- and inter-brain connectivity in the left and right sides was observed. This study showed congruence in the intra-brain and inter-brain connectivity trend during the execution of different gestures, underlining how non-verbal exchanges might be characterized by intra-brain phase alignment and implicit mechanisms of mirroring and synchronization between the two individuals involved in the social exchange.

The effect of interbrain synchronization in gesture observation: A fNIRS study

INTRODUCTION

Gestures characterize individuals' nonverbal communicative exchanges, taking on different functions. Several types of research in the neuroscientific field have been interested in the investigation of the neural correlates underlying the observation and implementation of different gestures categories. In particular, different studies have focused on the neural correlates underlying gestures observation, emphasizing the presence of mirroring mechanisms in specific brain areas, which appear to be involved in gesture observation and planning mechanisms.

MATERIALS AND METHODS

Specifically, the present study aimed to investigate the neural mechanisms, through the use of functional Near-Infrared Spectroscopy (fNIRS), underlying the observation of affective, social, and informative gestures with positive and negative valence in individuals' dyads composed by encoder and decoder. The variations of oxygenated (O2Hb) and deoxygenated (HHb) hemoglobin concentrations of both individuals were collected simultaneously through the use of hyperscanning paradigm, allowing the recording of brain responsiveness and interbrain connectivity.

RESULTS

The results showed a different brain activation and an increase of interbrain connectivity according to the type of gestures observed, with a significant increase of O2Hb brain responsiveness and interbrain connectivity and a decrease of HHb brain responsiveness for affective gestures in the dorsolateral prefrontal cortex (DLPFC) and for social gestures in the superior frontal gyrus (SFG). Furthermore, concerning the valence of the observed gestures, an increase of O2Hb brain activity and interbrain connectivity was observed in the left DLPFC for positive affective gestures compared to negative ones.

CONCLUSION

In conclusion, the present study showed different brain responses underlying the observation of different types of positive and negative gestures. Moreover, interbrain connectivity calculation allowed us to underline the presence of mirroring mechanisms involved in gesture-specific frontal regions during gestures observation and action planning.