Distributed Neural Activity Patterns during Human-to-Human Competition

The neural mechanism of communication between graduate students and advisers in different adviser-advisee relationships

Communication is crucial in constructing the relationship between students and advisers, ultimately bridging interpersonal interactions. Only a few studies however explore the communication between postgraduate students and advisers. To fill the gaps in the empirical researches, this study uses functional near-infrared spectroscopy (FNIRS) techniques to explore the neurophysiology differences in brain activation of postgraduates with different adviser-advise relationships during simulated communication with their advisers. Results showed significant differences in the activation of the prefrontal cortex between high-quality and the low-quality students during simulating and when communicating with advisers, specifically in the Broca's areas, the frontal pole, and the orbitofrontal and dorsolateral prefrontal cortices. This further elucidated the complex cognitive process of communication between graduate students and advisers.

Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation

PURPOSE

We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS).

METHOD

Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad.

RESULTS

For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker.

CONCLUSIONS

We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.25452142.

Favoritism or bias? Cooperation and competition under different intergroup relationships: evidence from EEG hyperscanning

Cooperation and competition are the most common forms of social interaction in various social relationships. Intergroup relationships have been posited to influence individuals' interpersonal interactions significantly. Using electroencephalography hyperscanning, this study aimed to establish whether intergroup relationships influence interpersonal cooperation and competition and the underlying neural mechanisms. According to the results, the in-group Coop-index is better than the out-group, whereas the out-group Comp-index is stronger than the in-group. The in-group functional connectivity between the frontal-central region and the right temporoparietal junction in the β band was stronger in competition than cooperation. The out-group functional connectivity between the frontal-central region and the left temporoparietal junction in the α band was stronger in cooperation than competition. In both cooperation and competition, the in-group exhibited higher interbrain synchronization between the prefrontal cortex and parietal region in the θ band, as well as between the frontal-central region and frontal-central region in the α band, compared to the out-group. The intrabrain phase-locking value in both the α and β bands can effectively predict performance in competition tasks. Interbrain phase-locking value in both the α and θ bands can be effectively predicted in a performance cooperation task. This study offers neuroscientific evidence for in-group favoritism and out-group bias at an interpersonal level.

Generation WhatsApp: inter-brain synchrony during face-to-face and texting communication

Texting has become one of the most prevalent ways to interact socially, particularly among youth; however, the effects of text messaging on social brain functioning are unknown. Guided by the biobehavioral synchrony frame, this pre-registered study utilized hyperscanning EEG to evaluate interbrain synchrony during face-to-face versus texting interactions. Participants included 65 mother-adolescent dyads observed during face-to-face conversation compared to texting from different rooms. Results indicate that both face-to-face and texting communication elicit significant neural synchrony compared to surrogate data, demonstrating for the first time brain-to-brain synchrony during texting. Direct comparison between the two interactions highlighted 8 fronto-temporal interbrain links that were significantly stronger in the face-to-face interaction compared to texting. Our findings suggest that partners co-create a fronto-temporal network of inter-brain connections during live social exchanges. The degree of improvement in the partners' right-frontal-right-frontal connectivity from texting to the live social interaction correlated with greater behavioral synchrony, suggesting that this well-researched neural connection may be specific to face-to-face communication. Our findings suggest that while technology-based communication allows humans to synchronize from afar, face-to-face interactions remain the superior mode of communication for interpersonal connection. We conclude by discussing the potential benefits and drawbacks of the pervasive use of texting, particularly among youth.

The Neuroscience of Human and Artificial Intelligence Presence

Two decades of social neuroscience and neuroeconomics research illustrate the brain mechanisms that are engaged when people consider human beings, often in comparison to considering artificial intelligence (AI) as a nonhuman control. AI as an experimental control preserves agency and facilitates social interactions but lacks a human presence, providing insight into brain mechanisms that are engaged by human presence and the presence of AI. Here, I review this literature to determine how the brain instantiates human and AI presence across social perception and decision-making paradigms commonly used to realize a social context. People behave toward humans differently than they do toward AI. Moreover, brain regions more engaged by humans compared to AI extend beyond the social cognition brain network to all parts of the brain, and the brain sometimes is engaged more by AI than by humans. Finally, I discuss gaps in the literature, limitations in current neuroscience approaches, and how an understanding of the brain correlates of human and AI presence can inform social science in the wild.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions

Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Interpersonal Competition in Elderly Couples: A Functional Near-Infrared Spectroscopy Hyperscanning Study

Elderly people tend not to compete with others, and if they do, the mechanism behind the competition is not clear. In this study, groups of elderly couples and matched cross-sex controls were recruited to perform a competitive button-pressing task, while their brain signals were simultaneously collected using functional near-infrared spectroscopy (fNIRS) hyperscanning. Several fundamental observations were made. First, controls showed attenuated interpersonal competition across task processes, but couples held the competition with each other. Second, couples demonstrated increased inter-brain synchronization (IBS) between the middle temporal cortex and the temporoparietal junction across task processes. Third, Granger causality analysis in couples revealed significant differences between the directions (i.e., from men to women, and from women to men) in the first half of the competitive task, whereas there was no significant difference in the second half. Finally, the groups of couples and controls could be successfully discriminated against based on IBS by using a machine-learning approach. In sum, these findings indicate that elderly couples can maintain interpersonal competition, and such maintenance might be associated with changes in the IBS of the mentalizing system. It suggests the possible positive impact of long-term spouse relationships on interpersonal interactions, both behaviorally and neurally, in terms of competition.

Neural and visual processing of social gaze cueing in typical and ASD adults

Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces.

Lay Summary

Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

Technologically-assisted communication attenuates inter-brain synchrony

The transition to technologically-assisted communication has permeated all facets of human social life; yet, its impact on the social brain is still unknown and the effects may be particularly intense during periods of developmental transitions. Applying a two-brain perspective, the current preregistered study utilized hyperscanning EEG to measure brain-to-brain synchrony in 62 mother-child pairs at the transition to adolescence (child age; M = 12.26, range 10-14) during live face-to-face interaction versus technologically-assisted remote communication. The live interaction elicited 9 significant cross-brain links between densely inter-connected frontal and temporal areas in the beta range [14-30 Hz]. Mother's right frontal region connected with the child's right and left frontal, temporal, and central regions, suggesting its regulatory role in organizing the two-brain dynamics. In contrast, the remote interaction elicited only 1 significant cross-brain-cross-hemisphere link, attenuating the robust right-to-right-brain connectivity during live social moments that communicates socio-affective signals. Furthermore, while the level of social behavior was comparable between the two interactions, brain-behavior associations emerged only during the live exchange. Mother-child right temporal-temporal synchrony linked with moments of shared gaze and the degree of child engagement and empathic behavior correlated with right frontal-frontal synchrony. Our findings indicate that human co-presence is underpinned by specific neurobiological processes that should be studied in depth. Much further research is needed to tease apart whether the "Zoom fatigue" experienced during technological communication may stem, in part, from overload on more limited inter-brain connections and to address the potential cost of social technology for brain maturation, particularly among youth.

Neural correlates of eye contact and social function in autism spectrum disorder

Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.

Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions

BACKGROUND

Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur.

METHODS

In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30).

RESULTS

Cross-brain neural coupling between people was significantly greater during clinical interactions compared with everyday life verbal communication, particularly between the prefrontal cortex (e.g., inferior frontal gyrus) and inferior parietal lobule (e.g., supramarginal gyrus). The clinical tasks revealed extensive increases in activity across the prefrontal cortex, especially in the rostral prefrontal cortex (area 10), during periods in which participants were required to silently reason about the dysfunctional cognitions of the other person.

CONCLUSIONS

This work demonstrates a novel experimental approach to investigating the neural underpinnings of interpersonal interactions that typically occur in clinical settings, and its findings support the idea that particular prefrontal systems might be critical to cultivating mental health.

Future Applications of Real-World Neuroimaging to Clinical Psychology

Clinical neuroimaging has largely been limited to examining the neurophysiological outcomes of treatments for psychiatric conditions rather than the neurocognitive mechanisms by which these outcomes are brought about as a function of clinical strategies, and the cognitive neuroscientific research aiming to investigate these mechanisms in nonclinical and clinical populations has been ecologically challenged by the extent to which tasks represent and generalize to intervention strategies. However, recent technological and methodological advancements to neuroimaging techniques such as functional near-infrared spectroscopy and functional near-infrared spectroscopy-based hyperscanning provide novel opportunities to investigate the mechanisms of change in more naturalistic and interactive settings, representing a unique prospect for improving our understanding of the intra- and interbrain systems supporting the recogitation of dysfunctional cognitive operations.

Levels of naturalism in social neuroscience research

In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.

The role of anterior prefrontal cortex (area 10) in face-to-face deception measured with fNIRS

Anterior prefrontal cortex (PFC, Brodmann area 10) activations are often, but not always, found in neuroimaging studies investigating deception, and the precise role of this area remains unclear. To explore the role of the PFC in face-to-face deception, we invited pairs of participants to play a card game involving lying and lie detection while we used functional near infrared spectroscopy (fNIRS) to record brain activity in the PFC. Participants could win points for successfully lying about the value of their cards or for detecting lies. We contrasted patterns of brain activation when the participants either told the truth or lied, when they were either forced into this or did so voluntarily and when they either succeeded or failed to detect a lie. Activation in the anterior PFC was found in both lie production and detection, unrelated to reward. Analysis of cross-brain activation patterns between participants identified areas of the PFC where the lead player’s brain activity synchronized their partner’s later brain activity. These results suggest that during situations that involve close interpersonal interaction, the anterior PFC supports processing widely involved in deception, possibly relating to the demands of monitoring one’s own and other people’s behaviour.

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.

Brain and motor synchrony in children and adolescents with ASD-a fNIRS hyperscanning study

Brain-to-brain synchrony has been proposed as an important mechanism underlying social interaction. While first findings indicate that it may be modulated in children with autism spectrum disorder (ASD), no study to date has investigated the influence of different interaction partners and task characteristics. Using functional near-infrared spectroscopy hyperscanning, we assessed brain-to-brain synchrony in 41 male typically developing (TD) children (8-18 years; control sample), as well as 18 children with ASD and age-matched TD children (matched sample), while performing cooperative and competitive tasks with their parents and an adult stranger. Dyads were instructed either to respond jointly in response to a target (cooperation) or to respond faster than the other player (competition). Wavelet coherence was calculated for oxy- and deoxyhemoglobin brain signals. In the control sample, a widespread enhanced coherence was observed for parent-child competition, and a more localized coherence for parent-child cooperation in the frontopolar cortex. While behaviorally, children with ASD showed a lower motor synchrony than children in the TD group, no significant group differences were observed on the neural level. In order to identify biomarkers for typical and atypical social interactions in the long run, more research is needed to investigate the neurobiological underpinnings of reduced synchrony in ASD.

Interpersonal Agreement and Disagreement During Face-to-Face Dialogue: An fNIRS Investigation

Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rather than the canonical language areas, was also differentiated by the two conditions. Specifically, the frontoparietal system including bilateral dorsolateral prefrontal cortex, left supramarginal gyrus, angular gyrus, and superior temporal gyrus showed increased activity while talking during disagreement. In contrast, talking during agreement was characterized by increased activity in a social and attention network including right supramarginal gyrus, bilateral frontal eye-fields, and left frontopolar regions. Further, these social and visual attention networks were more synchronous across brains during agreement than disagreement. Rather than localized modulation of the canonical language system, these findings are most consistent with a model of distributed and adaptive language-related processes including cross-brain neural coupling that serves dynamic verbal exchanges.

Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals

Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.

Interpersonal brain synchronization under bluffing in strategic games

People commonly use bluffing as a strategy to manipulate other people's beliefs about them for gain. Although bluffing is an important part of successful strategic thinking, the inter-brain mechanisms underlying bluffing remain unclear. Here, we employed a functional near-infrared spectroscopy hyperscanning technique to simultaneously record the brain activity in the right temporal-parietal junction in 32 pairs of participants when they played a bluffing game against each other or with computer opponents separately. We also manipulated the penalty for bluffing (high vs low). Under the condition of high relative to low penalty, results showed a higher bluffing rate and a higher calling rate in human-to-human as compared to human-to-computer pairing. At the neural level, high relative to low penalty condition increased the interpersonal brain synchronization (IBS) in the right angular gyrus (rAG) during human-to-human as compared to human-to-computer interaction. Importantly, bluffing relative to non-bluffing, under the high penalty and human-to-human condition, resulted in an increase in response time and enhanced IBS in the rAG. Participants who bluffed more frequently also elicited stronger IBS. Our findings support the view that regions associated with mentalizing become synchronized during bluffing games, especially under the high penalty and human-to-human condition.

Capturing Human Interaction in the Virtual Age: A Perspective on the Future of fNIRS Hyperscanning

Advances in video conferencing capabilities combined with dramatic socio-dynamic shifts brought about by COVID-19, have redefined the ways in which humans interact in modern society. From business meetings to medical exams, or from classroom instruction to yoga class, virtual interfacing has permeated nearly every aspect of our daily lives. A seemingly endless stream of technological advances combined with our newfound reliance on virtual interfacing makes it likely that humans will continue to use this modern form of social interaction into the future. However, emergent evidence suggests that virtual interfacing may not be equivalent to face-to-face interactions. Ultimately, too little is currently understood about the mechanisms that underlie human interactions over the virtual divide, including how these mechanisms differ from traditional face-to-face interaction. Here, we propose functional near-infrared spectroscopy (fNIRS) hyperscanning-simultaneous measurement of two or more brains-as an optimal approach to quantify potential neurocognitive differences between virtual and in-person interactions. We argue that increased focus on this understudied domain will help elucidate the reasons why virtual conferencing doesn't always stack up to in-person meetings and will also serve to spur new technologies designed to improve the virtual interaction experience. On the basis of existing fNIRS hyperscanning literature, we highlight the current gaps in research regarding virtual interactions. Furthermore, we provide insight into current hurdles regarding fNIRS hyperscanning hardware and methodology that should be addressed in order to shed light on this newly critical element of everyday life.

The Role of Reward System in Dishonest Behavior: A Functional Near-Infrared Spectroscopy Study

Previous studies showed that the cortical reward system plays an important role in deceptive behavior. However, how the reward system activates during the whole course of dishonest behavior and how it affects dishonest decisions remain unclear. The current study investigated these questions. One hundred and two participants were included in the final analysis. They completed two tasks: monetary incentive delay (MID) task and an honesty task. The MID task served as the localizer task and the honesty task was used to measure participants' deceptive behaviors. Participants' spontaneous responses in the honesty task were categorized into three conditions: Correct-Truth condition (tell the truth after guessing correctly), Incorrect-Truth condition (tell the truth after guessing incorrectly), and Incorrect-Lie condition (tell lies after guessing incorrectly). To reduce contamination from neighboring functional regions as well as to increase sensitivity to small effects (Powell et al., Devel Sci 21:e12595, 2018), we adopted the individual functional channel of interest (fCOI) approach to analyze the data. Specially, we identified the channels of interest in the MID task in individual participants and then applied them to the honesty task. The result suggested that the reward system showed different activation patterns during different phases: In the pre-decision phase, the reward system was activated with the winning of the reward. During the decision and feedback phase, the reward system was activated when people made the decisions to be dishonest and when they evaluated the outcome of their decisions. Furthermore, the result showed that neural activity of the reward system toward the outcome of their decision was related to subsequent dishonest behaviors. Thus, the present study confirmed the important role of the reward system in deception. These results can also shed light on how one could use neuroimaging techniques to perform lie-detection.

Neural processes for live pro-social dialogue between dyads with socioeconomic disparity

An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds. The socioeconomic status of each participant was based on education and income levels. Both groups of dyads engaged in pro-social dialectic discourse during acquisition of hemodynamic signals. Post-scan questionnaires confirmed increased anxiety and effort for high-disparity dyads. Consistent with the frontal lobe hypothesis, left dorsolateral pre-frontal cortex (DLPFC), frontopolar area and pars triangularis were more active during speech dialogue in high than in low-disparity groups. Further, frontal lobe signals were more synchronous across brains for high- than low-disparity dyads. Convergence of these behavioral, neuroimaging and neural coupling findings associate left frontal lobe processes with natural pro-social dialogue under 'out-group' conditions and advance both theoretical and technical approaches for further investigation.

Distinct Effects of Social Stress on Working Memory in Obsessive-Compulsive Disorder

Stress might exaggerate the compulsion and impair the working memory of patients with obsessive-compulsive disorder (OCD). This study evaluated the effect of stress on the cognitive neural processing of working memory in OCD and its clinical significance using a "number calculation working memory" task. Thirty-eight patients and 55 gender- and education-matched healthy controls were examined. Stress impaired the performance of the manipulation task in patients. Healthy controls showed less engagement of the medial prefrontal cortex and striatum during the task under stress versus less stress, which was absent in the patients with OCD. The diagnosis × stress interaction effect was significant in the right fusiform, supplementary motor area, precentral cortex and caudate. The failure of suppression of the medial prefrontal cortex and striatum and stress-related hyperactivation in the right fusiform, supplementary motor area, precentral cortex, and caudate might be an OCD-related psychopathological and neural response to stress.

Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact

Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated. Here, we investigate this question using a novel two-person joint attention task. Participants were not instructed regarding the use of eye contacts; thus all mutual eye contact events between interacting partners that occurred during the joint attention task were spontaneous and varied with respect to frequency. We predicted that joint attention systems would be modulated by differences in the social behavior across participant pairs, which could be measured by the frequency of eye contact behavior. We used functional near-infrared spectroscopy (fNIRS) hyperscanning and eye-tracking to measure the neural signals associated with joint attention in interacting dyads and to record the number of eye contact events between them. Participants engaged in a social joint attention task in which real partners used eye gaze to direct each other's attention to specific targets. Findings were compared to a non-social joint attention task in which an LED cue directed both partners' attention to the same target. The social joint attention condition showed greater activity in right temporoparietal junction than the non-social condition, replicating prior joint attention results. Eye-contact frequency modulated the joint attention activity, revealing bilateral activity in social and high level visual areas associated with partners who made more eye contact. Additionally, when the number of mutual eye contact events was used to classify each pair as either "high eye contact" or "low eye contact" dyads, cross-brain coherence analysis revealed greater coherence between high eye contact dyads than low eye contact dyads in these same areas. Together, findings suggest that variation in social behavior as measured by eye contact modulates activity in a subunit of the network associated with joint attention.

Within-group synchronization in the prefrontal cortex associates with intergroup conflict

Individuals immersed in groups sometimes lose their individuality, take risks they would normally avoid and approach outsiders with unprovoked hostility. In this study, we identified within-group neural synchronization in the right dorsolateral prefrontal cortex (rDLPFC) and the right temporoparietal junction (rTPJ) as a candidate mechanism underlying intergroup hostility. We organized 546 individuals into 91 three-versus-three-person intergroup competitions, induced in-group bonding or no-bonding control manipulation and measured neural activity and within-group synchronization using functional near-infrared spectroscopy. After in-group bonding (versus control), individuals gave more money to in-group members than to out-group members and contributed more money to outcompete their rivals. In-group bonding decreased rDLPFC activity and increased functional connectivity between the rDLPFC and the rTPJ. Especially during the out-group attack, in-group bonding also increased within-group synchronization in both the rDLPFC and the rTPJ, and within-group rDLPFC synchronization positively correlated with intergroup hostility. Within-group synchronized reduction in prefrontal activity might explain how in-group bonding leads to impulsive and collective hostility toward outsiders.

The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience

The past few decades have seen a rapid increase in the use of functional near-infrared spectroscopy (fNIRS) in cognitive neuroscience. This fast growth is due to the several advances that fNIRS offers over the other neuroimaging modalities such as functional magnetic resonance imaging and electroencephalography/magnetoencephalography. In particular, fNIRS is harmless, tolerant to bodily movements, and highly portable, being suitable for all possible participant populations, from newborns to the elderly and experimental settings, both inside and outside the laboratory. In this review we aim to provide a comprehensive and state-of-the-art review of fNIRS basics, technical developments, and applications. In particular, we discuss some of the open challenges and the potential of fNIRS for cognitive neuroscience research, with a particular focus on neuroimaging in naturalistic environments and social cognitive neuroscience.

Real-Time Eye-to-Eye Contact Is Associated With Cross-Brain Neural Coupling in Angular Gyrus

Direct eye contact between two individuals is a salient social behavior known to initiate and promote interpersonal interaction. However, the neural processes that underlie these live interactive behaviors and eye-to-eye contact are not well understood. The Dynamic Neural Coupling Hypothesis presents a general theoretical framework proposing that shared interactive behaviors are represented by cross-brain signal coherence. Using functional near-infrared spectroscopy (fNIRS) adapted for hyper scanning, we tested this hypothesis specifically for neural mechanisms associated with eye-to-eye gaze between human participants compared to similar direct eye-gaze at a dynamic video of a face and predicted that the coherence of neural signals between the two participants during reciprocal eye-to-eye contact would be greater than coherence observed during direct eye-gaze at a dynamic video for those signals originating in social and face processing systems. Consistent with this prediction cross-brain coherence was increased for signals within the angular gyrus (AG) during eye-to-eye contact relative to direct eye-gaze at a dynamic face video (p < 0.01). Further, activity in the right temporal-parietal junction (TPJ) was increased in the real eye-to-eye condition (p < 0.05, FDR corrected). Together, these findings advance a functional and mechanistic understanding of the AG and cross-brain neural coupling associated with real-time eye-to-eye contact.

Optimization of wavelet coherence analysis as a measure of neural synchrony during hyperscanning using functional near-infrared spectroscopy

Significance: The expanding field of human social interaction is enabled by functional near-infrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Aim: Wavelet coherence analysis has been applied to cross-brain neural coupling. However, fNIRS-specific computations have not been explored. This investigation determines the effects of global mean removal, wavelet equation, and choice of oxyhemoglobin versus deoxyhemoglobin signals. Approach: We compare signals with a known coherence with acquired signals to determine optimal computational approaches. The known coherence was calculated using three visual stimulation sequences of a contrast-reversing checkerboard convolved with the canonical hemodynamic response function. This standard was compared with acquired human fNIRS responses within visual cortex using the same sequences. Results: Observed coherence was consistent with known coherence with highest correlations within the wavelength range between 10 and 20 s. Removal of the global mean improved the correlation irrespective of the specific equation for wavelet coherence, and the oxyhemoglobin signal was associated with a marginal correlation advantage. Conclusions: These findings provide both methodological and computational guidance that enhances the validity and interpretability of wavelet coherence analysis for fNIRS signals acquired during live social interactions.

Communication of emotion via drumming: dual-brain imaging with functional near-infrared spectroscopy

Nonverbal communication of emotion is essential to human interaction and relevant to many clinical applications, yet it is an understudied topic in social neuroscience. Drumming is an ancient nonverbal communication modality for expression of emotion that has not been previously investigated in this context. We investigate the neural response to live, natural communication of emotion via drumming using a novel dual-brain neuroimaging paradigm. Hemodynamic signals were acquired using whole-head functional near-infrared spectroscopy (fNIRS). Dyads of 36 subjects participated in two conditions, drumming and talking, alternating between 'sending' (drumming or talking to partner) and 'receiving' (listening to partner) in response to emotionally salient images from the International Affective Picture System. Increased frequency and amplitude of drum strikes was behaviorally correlated with higher arousal and lower valence measures and neurally correlated with temporoparietal junction (TPJ) activation in the listener. Contrast comparisons of drumming greater than talking also revealed neural activity in right TPJ. Together, findings suggest that emotional content communicated by drumming engages right TPJ mechanisms in an emotionally and behaviorally sensitive fashion. Drumming may provide novel, effective clinical approaches for treating social-emotional psychopathology.

Interpersonal brain synchronization associated with working alliance during psychological counseling

The mechanisms underlying behavioral synchrony during psychological counseling are not clear. Recent research has provided evidence that pervasive synchrony is associated with interpersonal brain synchronization (IBS) and possibly contributes to the positive working alliance-the degree to which the counseling dyads engage in collaborative and purposive work. Our study explored the IBS between the clients and the counselors using functional near-infrared spectroscopy (fNIRS)-based hyperscanning. Thirty-four participants (as clients) were randomly assigned either to the psychological counseling group or to the chatting group; three female professional counselors provided them with 40 minutes of psychological counseling or chatting. We found better working alliances and increased IBS in the right temporo-parietal junction (rTPJ) between clients and counselors during psychological counseling (versus chatting). Such IBS also correlated with the bond of working alliance. To our knowledge, our work represents the first demonstration of fNIRS-hyperscanning measurements for synchronous brain activity between the clients and counselors. This study refines the neural explanation of behavioral synchrony during psychological counseling.

A cross-brain neural mechanism for human-to-human verbal communication

Neural mechanisms that mediate dynamic social interactions remain understudied despite their evolutionary significance. The interactive brain hypothesis proposes that interactive social cues are processed by dedicated brain substrates and provides a general theoretical framework for investigating the underlying neural mechanisms of social interaction. We test the specific case of this hypothesis proposing that canonical language areas are upregulated and dynamically coupled across brains during social interactions based on talking and listening. Functional near-infrared spectroscopy (fNIRS) was employed to acquire simultaneous deoxyhemoglobin (deOxyHb) signals of the brain on partners who alternated between speaking and listening while doing an Object Naming & Description task with and without interaction in a natural setting. Comparison of interactive and non-interactive conditions confirmed an increase in neural activity associated with Wernicke's area including the superior temporal gyrus (STG) during interaction (P = 0.04). However, the hypothesis was not supported for Broca's area. Cross-brain coherence determined by wavelet analyses of signals originating from the STG and the subcentral area was greater during interaction than non-interaction (P < 0.01). In support of the interactive brain hypothesis these findings suggest a dynamically coupled cross-brain neural mechanism dedicated to pathways that share interpersonal information.

Dynamic causal modelling on infant fNIRS data: A validation study on a simultaneously recorded fNIRS-fMRI dataset

Tracking the connectivity of the developing brain from infancy through childhood is an area of increasing research interest, and fNIRS provides an ideal method for studying the infant brain as it is compact, safe and robust to motion. However, data analysis methods for fNIRS are still underdeveloped compared to those available for fMRI. Dynamic causal modelling (DCM) is an advanced connectivity technique developed for fMRI data, that aims to estimate the coupling between brain regions and how this might be modulated by changes in experimental conditions. DCM has recently been applied to adult fNIRS, but not to infants. The present paper provides a proof-of-principle for the application of this method to infant fNIRS data and a demonstration of the robustness of this method using a simultaneously recorded fMRI-fNIRS single case study, thereby allowing the use of this technique in future infant studies.

fMRI and fNIRS were simultaneously recorded from a 6-month-old sleeping infant, who was presented with auditory stimuli in a block design. Both fMRI and fNIRS data were preprocessed using SPM, and analysed using a general linear model approach. The main challenges that adapting DCM for fNIRS infant data posed included: (i) the import of the structural image of the participant for spatial pre-processing, (ii) the spatial registration of the optodes on the structural image of the infant, (iii) calculation of an accurate 3-layer segmentation of the structural image, (iv) creation of a high-density mesh as well as (v) the estimation of the NIRS optical sensitivity functions. To assess our results, we compared the values obtained for variational Free Energy (F), Bayesian Model Selection (BMS) and Bayesian Model Average (BMA) with the same set of possible models applied to both the fMRI and fNIRS datasets. We found high correspondence in F, BMS, and BMA between fMRI and fNIRS data, therefore showing for the first time high reliability of DCM applied to infant fNIRS data. This work opens new avenues for future research on effective connectivity in infancy by contributing a data analysis pipeline and guidance for applying DCM to infant fNIRS data.

•

Connectivity studies give important insights into infant brain development.

•

fNIRS is a valuable method for infancy studies, but can we analyse connectivity?

•

On fMRI-fNIRS acquired simultaneously, we estimate effective connectivity with DCM.

•

We showed high correspondence of DCM values between fMRI and fNIRS data.

•

We validated DCM on fNIRS infant data, providing guidance for future projects.

Feasibility of Functional Near-Infrared Spectroscopy (fNIRS) to Investigate the Mirror Neuron System: An Experimental Study in a Real-Life Situation

The mirror neuron system (MNS), mainly including the premotor cortex (PMC), inferior frontal gyrus (IFG), superior parietal lobule (SPL), and rostral inferior parietal lobule (IPL), has attracted extensive attention as a possible neural mechanism of social interaction. Owing to high ecological validity, functional near-infrared spectroscopy (fNIRS) has become an ideal approach for exploring the MNS. Unfortunately, for the feasibility of fNIRS to detect the MNS, none of the four dominant regions were found in previous studies, implying a very limited capacity of fNIRS to investigate the MNS. Here, we adopted an experimental paradigm in a real-life situation to evaluate whether the MNS activity, including four dominant regions, can be detected by using fNIRS. Specifically, 30 right-handed subjects were asked to complete a table-setting task that included action execution and action observation. A double density probe configuration covered the four regions of the MNS in the left hemisphere. We used a traditional channel-based group analysis and also a ROI-based group analysis to find which regions are activated during both action execution and action observation. The results showed that the IFG, adjacent PMC, SPL, and IPL were involved in both conditions, indicating the feasibility of fNIRS to detect the MNS. Our findings provide a foundation for future research to explore the functional role of the MNS in social interaction and various disorders using fNIRS.