Donate or receive? Social hyperscanning application with fNIRS

Inter-brain entrainment (IBE) during interoception. A multimodal EEG-fNIRS coherence-based hyperscanning approach

This work examined the impact of interoceptive manipulation and the presence of a shared goal on inter-brain entrainment (IBE) during a motor synchronization task. A multimodal functional Near Infrared Spectroscopy - Electroencephalogram (fNIRS-EEG) system-based hyperscanning approach was applied to 13 dyads performing the motor synchrony task during an interoceptive (focus on the breath) and control condition. Additionally, two version of the motor task-one with and one without a clearly defined common goal-were presented to participants to emphasize the task's collaborative purpose. The multimodal approach was exploited to record the electrophysiological (EEG) cortical oscillation and hemodynamic (oxy-Hb and deoxy-Hb) levels. Results revealed significant correlations between EEG delta, theta, and alpha band and hemodynamic oxy-Hb in the left compared to right hemisphere for the interoceptive confronted with the control condition. This significant EEG/fNIRS IBE correlation was also found for delta and theta band whereas the task was presented with an explicit shared goal confronted with the no-social version. In addition to separate functional connectivity EEG and fNIRS analysis, this study proposed a novel analysis pipeline including statistical tests for examining the coherence between functional connectivity EEG-fNIRS signals within couples. Besides proposing methodological advancements on EEG-fNIRS signals hyperscanning analysis, this research demonstrated that, in dyads undertaking a motor synchronization task, both the interoceptive attention to respiration and an explicit joint intention activate left anterior regions.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Virtual (Zoom) Interactions Alter Conversational Behavior and Interbrain Coherence

A growing number of social interactions are taking place virtually on videoconferencing platforms. Here, we explore potential effects of virtual interactions on observed behavior, subjective experience, and neural "single-brain" and "interbrain" activity via functional near-infrared spectroscopy neuroimaging. We scanned a total of 36 human dyads (72 participants, 36 males, 36 females) who engaged in three naturalistic tasks (i.e., problem-solving, creative-innovation, socio-emotional task) in either an in-person or virtual (Zoom) condition. We also coded cooperative behavior from audio recordings. We observed reduced conversational turn-taking behavior during the virtual condition. Given that conversational turn-taking was associated with other metrics of positive social interaction (e.g., subjective cooperation and task performance), this measure may be an indicator of prosocial interaction. In addition, we observed altered patterns of averaged and dynamic interbrain coherence in virtual interactions. Interbrain coherence patterns that were characteristic of the virtual condition were associated with reduced conversational turn-taking. These insights can inform the design and engineering of the next generation of videoconferencing technology.SIGNIFICANCE STATEMENT Videoconferencing has become an integral part of our lives. Whether this technology impacts behavior and neurobiology is not well understood. We explored potential effects of virtual interaction on social behavior, brain activity, and interbrain coupling. We found that virtual interactions were characterized by patterns of interbrain coupling that were negatively implicated in cooperation. Our findings are consistent with the perspective that videoconferencing technology adversely affects individuals and dyads during social interaction. As virtual interactions become even more necessary, improving the design of videoconferencing technology will be crucial for supporting effective communication.

A New Statistical Approach for fNIRS Hyperscanning to Predict Brain Activity of Preschoolers' Using Teacher's

Hyperscanning studies using functional Near-Infrared Spectroscopy (fNIRS) have been performed to understand the neural mechanisms underlying human-human interactions. In this study, we propose a novel methodological approach that is developed for fNIRS multi-brain analysis. Our method uses support vector regression (SVR) to predict one brain activity time series using another as the predictor. We applied the proposed methodology to explore the teacher-student interaction, which plays a critical role in the formal learning process. In an illustrative application, we collected fNIRS data of the teacher and preschoolers’ dyads performing an interaction task. The teacher explained to the child how to add two numbers in the context of a game. The Prefrontal cortex and temporal-parietal junction of both teacher and student were recorded. A multivariate regression model was built for each channel in each dyad, with the student’s signal as the response variable and the teacher’s ones as the predictors. We compared the predictions of SVR with the conventional ordinary least square (OLS) predictor. The results predicted by the SVR model were statistically significantly correlated with the actual test data at least one channel-pair for all dyads. Overall, 29/90 channel-pairs across the five dyads (18 channels 5 dyads = 90 channel-pairs) presented significant signal predictions withthe SVR approach. The conventional OLS resulted in only 4 out of 90 valid predictions. These results demonstrated that the SVR could be used to perform channel-wise predictions across individuals, and the teachers’ cortical activity can be used to predict the student brain hemodynamic response.

Gratitude Affects Inter-Subjective Synchronicity for Cognitive Performance and Autonomic Responsiveness

Recently, social neurosciences have been interested in the investigation of neurophysiological responses related to the experience of positive emotions, such as gratitude, during social interactions. Specifically, the aim of the present research was to investigate whether gratitude related to gift exchange could favor cooperative behavior and bond construction, by improving behavioral and autonomic responsivity. At this regard, the autonomic synchronization and behavioral performance of 16 friends coupled in dyads were recorded during a joint attentional task. Gift exchange could be occurred either at the beginning or in the middle of the task. For the recording of simultaneous autonomic activity [heart rate (HR) and skin conductance level (SCL)], a hyperscanning biofeedback paradigm was used. Intra-subjective analysis showed an increase in behavioral [accuracy (ACC)] and autonomic responses (HR and SCL) when the gift exchange took place at the beginning of the task rather than in the middle. Moreover, inter-subjective analysis revealed an increase in behavioral performance and greater autonomic synchronization of HR index. The present research, therefore, shows how gratitude and trust experienced following gift exchange can modify participants’ reactions by creating a shared cognition and the adoption of joint strategies.

Capturing Human Interaction in the Virtual Age: A Perspective on the Future of fNIRS Hyperscanning

Advances in video conferencing capabilities combined with dramatic socio-dynamic shifts brought about by COVID-19, have redefined the ways in which humans interact in modern society. From business meetings to medical exams, or from classroom instruction to yoga class, virtual interfacing has permeated nearly every aspect of our daily lives. A seemingly endless stream of technological advances combined with our newfound reliance on virtual interfacing makes it likely that humans will continue to use this modern form of social interaction into the future. However, emergent evidence suggests that virtual interfacing may not be equivalent to face-to-face interactions. Ultimately, too little is currently understood about the mechanisms that underlie human interactions over the virtual divide, including how these mechanisms differ from traditional face-to-face interaction. Here, we propose functional near-infrared spectroscopy (fNIRS) hyperscanning—simultaneous measurement of two or more brains—as an optimal approach to quantify potential neurocognitive differences between virtual and in-person interactions. We argue that increased focus on this understudied domain will help elucidate the reasons why virtual conferencing doesn't always stack up to in-person meetings and will also serve to spur new technologies designed to improve the virtual interaction experience. On the basis of existing fNIRS hyperscanning literature, we highlight the current gaps in research regarding virtual interactions. Furthermore, we provide insight into current hurdles regarding fNIRS hyperscanning hardware and methodology that should be addressed in order to shed light on this newly critical element of everyday life.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.

The effect of interbrain synchronization in gesture observation: A fNIRS study

INTRODUCTION

Gestures characterize individuals' nonverbal communicative exchanges, taking on different functions. Several types of research in the neuroscientific field have been interested in the investigation of the neural correlates underlying the observation and implementation of different gestures categories. In particular, different studies have focused on the neural correlates underlying gestures observation, emphasizing the presence of mirroring mechanisms in specific brain areas, which appear to be involved in gesture observation and planning mechanisms.

MATERIALS AND METHODS

Specifically, the present study aimed to investigate the neural mechanisms, through the use of functional Near-Infrared Spectroscopy (fNIRS), underlying the observation of affective, social, and informative gestures with positive and negative valence in individuals' dyads composed by encoder and decoder. The variations of oxygenated (O2Hb) and deoxygenated (HHb) hemoglobin concentrations of both individuals were collected simultaneously through the use of hyperscanning paradigm, allowing the recording of brain responsiveness and interbrain connectivity.

RESULTS

The results showed a different brain activation and an increase of interbrain connectivity according to the type of gestures observed, with a significant increase of O2Hb brain responsiveness and interbrain connectivity and a decrease of HHb brain responsiveness for affective gestures in the dorsolateral prefrontal cortex (DLPFC) and for social gestures in the superior frontal gyrus (SFG). Furthermore, concerning the valence of the observed gestures, an increase of O2Hb brain activity and interbrain connectivity was observed in the left DLPFC for positive affective gestures compared to negative ones.

CONCLUSION

In conclusion, the present study showed different brain responses underlying the observation of different types of positive and negative gestures. Moreover, interbrain connectivity calculation allowed us to underline the presence of mirroring mechanisms involved in gesture-specific frontal regions during gestures observation and action planning.

The "gift effect" on functional brain connectivity. Inter-brain synchronization when prosocial behavior is in action

The gift exchange represents a moment that characterizes interpersonal interactions. In particular, research in psychological and neuroscientific fields aimed to observe the social function of gift exchange. Specifically, the present study aimed to investigate the effects of prosocial behavior, experienced during gift exchange, on individuals’ cognitive performance and brain activity. To this aim, behavioral performance and neural activity of 15 dyads of participants, with a consolidated friendship, were collected during the execution of an attentional cooperative task before or after a gift exchange. Individuals’ brain activity was recorded through the use of Functional Near Infrared Spectroscopy (fNIRS) in hyperscanning. Results showed an increase of perceived cooperation and cognitive performance, in terms of accuracy (ACC), after gift exchange. The increase of interpersonal tuning and cooperation was also shown by neural activity with an increase of oxygenated hemoglobin (O2Hb) intra-brain and inter-brain connectivity in the dorsolateral prefrontal cortex (DLPFC) following the gift exchange. Moreover, from ConIndex analysis emerged an increase of inter-brain connectivity compared to intra-brain in DLPFC area. The present study, therefore, highlights how prosocial behavior can have positive effects on cognitive performance improvement and interpersonal relationships and neural coordination strengthen, increasing intra and inter-brain connectivity mechanisms.

The Use of Hyperscanning to Investigate the Role of Social, Affective, and Informative Gestures in Non-Verbal Communication. Electrophysiological (EEG) and Inter-Brain Connectivity Evidence

Communication can be considered as a joint action that involves two or more individuals transmitting different information. In particular, non-verbal communication involves body movements used to communicate different information, characterized by the use of specific gestures. The present study aims to investigate the electrophysiological (EEG) correlates underlying the use of affective, social, and informative gestures during a non-verbal interaction between an encoder and decoder. From the results of the single brain and inter-brain analyses, an increase of frontal alpha, delta, and theta brain responsiveness and inter-brain connectivity emerged for affective and social gestures; while, for informative gestures, an increase of parietal alpha brain responsiveness and alpha, delta, and theta inter-brain connectivity was observed. Regarding the inter-agents' role, an increase of frontal alpha activity was observed in the encoder compared to the decoder for social and affective gestures. Finally, regarding gesture valence, an increase of theta brain responsiveness and theta and beta inter-brain connectivity was observed for positive gestures on the left side compared to the right one. This study, therefore, revealed the function of the gesture type and valence in influencing individuals' brain responsiveness and inter-brain connectivity, showing the presence of resonance mechanisms underlying gesture execution and observation.